[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:05:03.266482 12594 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.76.190:46863
I20260709 13:05:03.267944 12594 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:05:03.268931 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:03.286383 12601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:03.286381 12600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:03.286374 12603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:03.287051 12594 server_base.cc:1061] running on GCE node
I20260709 13:05:04.515640 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:04.515892 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:04.516053 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602304516037 us; error 0 us; skew 500 ppm
I20260709 13:05:04.516827 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:04.522189 12594 webserver.cc:533] Webserver started at http://127.12.76.190:45457/ using document root <none> and password file <none>
I20260709 13:05:04.523010 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:04.523192 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:04.523654 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:04.529254 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602303087285-12594-0/minicluster-data/master-0-root/instance:
uuid: "365c0a939a374e4cb76669b507376ee3"
format_stamp: "Formatted at 2026-07-09 13:05:04 on dist-test-slave-th5x"
I20260709 13:05:04.536880 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:05:04.542235 12609 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:04.543579 12594 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:05:04.543946 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602303087285-12594-0/minicluster-data/master-0-root
uuid: "365c0a939a374e4cb76669b507376ee3"
format_stamp: "Formatted at 2026-07-09 13:05:04 on dist-test-slave-th5x"
I20260709 13:05:04.544261 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602303087285-12594-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602303087285-12594-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602303087285-12594-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:04.597376 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:04.599018 12594 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:05:04.599588 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:04.671141 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.190:46863
I20260709 13:05:04.671248 12660 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.190:46863 every 8 connection(s)
I20260709 13:05:04.679108 12661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:04.701539 12661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3: Bootstrap starting.
I20260709 13:05:04.708218 12661 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:04.710172 12661 log.cc:826] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3: Log is configured to *not* fsync() on all Append() calls
I20260709 13:05:04.714931 12661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3: No bootstrap required, opened a new log
I20260709 13:05:04.735769 12661 raft_consensus.cc:359] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "365c0a939a374e4cb76669b507376ee3" member_type: VOTER }
I20260709 13:05:04.736315 12661 raft_consensus.cc:385] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:04.736528 12661 raft_consensus.cc:740] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 365c0a939a374e4cb76669b507376ee3, State: Initialized, Role: FOLLOWER
I20260709 13:05:04.737435 12661 consensus_queue.cc:260] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "365c0a939a374e4cb76669b507376ee3" member_type: VOTER }
I20260709 13:05:04.737884 12661 raft_consensus.cc:399] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:04.738121 12661 raft_consensus.cc:493] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:04.738406 12661 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:04.742583 12661 raft_consensus.cc:515] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "365c0a939a374e4cb76669b507376ee3" member_type: VOTER }
I20260709 13:05:04.743263 12661 leader_election.cc:304] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 365c0a939a374e4cb76669b507376ee3; no voters: 
I20260709 13:05:04.745023 12661 leader_election.cc:290] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:04.745361 12664 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:04.747627 12664 raft_consensus.cc:697] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3 [term 1 LEADER]: Becoming Leader. State: Replica: 365c0a939a374e4cb76669b507376ee3, State: Running, Role: LEADER
I20260709 13:05:04.748579 12664 consensus_queue.cc:237] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "365c0a939a374e4cb76669b507376ee3" member_type: VOTER }
I20260709 13:05:04.749653 12661 sys_catalog.cc:565] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:04.761261 12666 sys_catalog.cc:455] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 365c0a939a374e4cb76669b507376ee3. Latest consensus state: current_term: 1 leader_uuid: "365c0a939a374e4cb76669b507376ee3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "365c0a939a374e4cb76669b507376ee3" member_type: VOTER } }
I20260709 13:05:04.762185 12666 sys_catalog.cc:458] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:04.763880 12665 sys_catalog.cc:455] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "365c0a939a374e4cb76669b507376ee3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "365c0a939a374e4cb76669b507376ee3" member_type: VOTER } }
I20260709 13:05:04.764484 12665 sys_catalog.cc:458] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:04.767107 12674 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:04.777755 12674 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:04.780045 12594 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:04.793054 12674 catalog_manager.cc:1383] Generated new cluster ID: 2b2ce36e1a894f25bd799422cfa1ba5c
I20260709 13:05:04.793365 12674 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:04.825419 12674 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:04.826960 12674 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:04.847718 12674 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3: Generated new TSK 0
I20260709 13:05:04.848924 12674 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:04.911087 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:04.919965 12683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:04.921931 12684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:04.924834 12686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:04.925067 12594 server_base.cc:1061] running on GCE node
I20260709 13:05:04.925896 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:04.926079 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:04.926290 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602304926257 us; error 0 us; skew 500 ppm
I20260709 13:05:04.926906 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:04.931330 12594 webserver.cc:533] Webserver started at http://127.12.76.129:42999/ using document root <none> and password file <none>
I20260709 13:05:04.931942 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:04.932142 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:04.932435 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:04.933528 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602303087285-12594-0/minicluster-data/ts-0-root/instance:
uuid: "79ed44dc9d5c41eea3c6823463824f7b"
format_stamp: "Formatted at 2026-07-09 13:05:04 on dist-test-slave-th5x"
I20260709 13:05:04.939291 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 13:05:04.943989 12691 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:04.945142 12594 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:05:04.945582 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602303087285-12594-0/minicluster-data/ts-0-root
uuid: "79ed44dc9d5c41eea3c6823463824f7b"
format_stamp: "Formatted at 2026-07-09 13:05:04 on dist-test-slave-th5x"
I20260709 13:05:04.946022 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602303087285-12594-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602303087285-12594-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602303087285-12594-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:04.974704 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:04.976253 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:04.979311 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:04.984517 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:04.984817 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:04.985127 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:04.985342 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:05.095161 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.129:35503
I20260709 13:05:05.095238 12753 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.129:35503 every 8 connection(s)
I20260709 13:05:05.103029 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:05.116178 12758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:05.120129 12759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:05.131026 12594 server_base.cc:1061] running on GCE node
W20260709 13:05:05.131721 12761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:05.132807 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:05.133083 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:05.133286 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602305133270 us; error 0 us; skew 500 ppm
I20260709 13:05:05.134073 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:05.137490 12594 webserver.cc:533] Webserver started at http://127.12.76.130:36117/ using document root <none> and password file <none>
I20260709 13:05:05.138157 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:05.138413 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:05.138751 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:05.139369 12754 heartbeater.cc:344] Connected to a master server at 127.12.76.190:46863
I20260709 13:05:05.139839 12754 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:05.140188 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602303087285-12594-0/minicluster-data/ts-1-root/instance:
uuid: "0326743a82cc473d8ed3fe0a55739371"
format_stamp: "Formatted at 2026-07-09 13:05:05 on dist-test-slave-th5x"
I20260709 13:05:05.140818 12754 heartbeater.cc:507] Master 127.12.76.190:46863 requested a full tablet report, sending...
I20260709 13:05:05.143635 12626 ts_manager.cc:194] Registered new tserver with Master: 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503)
I20260709 13:05:05.146179 12626 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40618
I20260709 13:05:05.147215 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:05:05.152431 12766 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:05.153749 12594 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 13:05:05.154091 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602303087285-12594-0/minicluster-data/ts-1-root
uuid: "0326743a82cc473d8ed3fe0a55739371"
format_stamp: "Formatted at 2026-07-09 13:05:05 on dist-test-slave-th5x"
I20260709 13:05:05.154435 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602303087285-12594-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602303087285-12594-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602303087285-12594-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:05.185304 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:05.186640 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:05.189251 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:05.193228 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:05.193415 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:05.193730 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:05.193923 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:05.295192 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.130:39657
I20260709 13:05:05.295362 12828 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.130:39657 every 8 connection(s)
I20260709 13:05:05.302006 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:05.311090 12832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:05.313580 12833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:05.316023 12829 heartbeater.cc:344] Connected to a master server at 127.12.76.190:46863
I20260709 13:05:05.316401 12829 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:05.317342 12829 heartbeater.cc:507] Master 127.12.76.190:46863 requested a full tablet report, sending...
I20260709 13:05:05.319802 12626 ts_manager.cc:194] Registered new tserver with Master: 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657)
I20260709 13:05:05.322263 12626 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40632
W20260709 13:05:05.323087 12835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:05.324522 12594 server_base.cc:1061] running on GCE node
I20260709 13:05:05.325609 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:05.325788 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:05.326011 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602305325971 us; error 0 us; skew 500 ppm
I20260709 13:05:05.326560 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:05.329495 12594 webserver.cc:533] Webserver started at http://127.12.76.131:34885/ using document root <none> and password file <none>
I20260709 13:05:05.330000 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:05.330199 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:05.330483 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:05.331576 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602303087285-12594-0/minicluster-data/ts-2-root/instance:
uuid: "63cb25bafe234674bb565bce1f4f1165"
format_stamp: "Formatted at 2026-07-09 13:05:05 on dist-test-slave-th5x"
I20260709 13:05:05.336229 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:05.339721 12840 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:05.340580 12594 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:05:05.340888 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602303087285-12594-0/minicluster-data/ts-2-root
uuid: "63cb25bafe234674bb565bce1f4f1165"
format_stamp: "Formatted at 2026-07-09 13:05:05 on dist-test-slave-th5x"
I20260709 13:05:05.341243 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602303087285-12594-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602303087285-12594-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602303087285-12594-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:05.359244 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:05.360575 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:05.362150 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:05.364678 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:05.364904 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:05.365180 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:05.365363 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:05.469141 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.131:37191
I20260709 13:05:05.469691 12902 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.131:37191 every 8 connection(s)
I20260709 13:05:05.487949 12903 heartbeater.cc:344] Connected to a master server at 127.12.76.190:46863
I20260709 13:05:05.488399 12903 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:05.489389 12903 heartbeater.cc:507] Master 127.12.76.190:46863 requested a full tablet report, sending...
I20260709 13:05:05.491882 12626 ts_manager.cc:194] Registered new tserver with Master: 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191)
I20260709 13:05:05.492895 12594 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018501747s
I20260709 13:05:05.493451 12626 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40644
I20260709 13:05:05.543869 12626 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40658:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:05.547497 12626 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:05.665189 12868 tablet_service.cc:1511] Processing CreateTablet for tablet 9427963bcadf4b2395fd95d57b3a33b7 (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:05.667450 12868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9427963bcadf4b2395fd95d57b3a33b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.672423 12867 tablet_service.cc:1511] Processing CreateTablet for tablet 890890786d914eb1b5b9320f4b44ef72 (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:05.674656 12867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 890890786d914eb1b5b9320f4b44ef72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.690905 12866 tablet_service.cc:1511] Processing CreateTablet for tablet 8dca1bea92694b299ce398c63da689e2 (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:05.692493 12866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dca1bea92694b299ce398c63da689e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.696146 12865 tablet_service.cc:1511] Processing CreateTablet for tablet 7ffbf58766f147a7810738b9963ab238 (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:05.697638 12865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ffbf58766f147a7810738b9963ab238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.702435 12864 tablet_service.cc:1511] Processing CreateTablet for tablet 60751a71baea43abac2fca83e8a6dd4f (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:05.703984 12864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60751a71baea43abac2fca83e8a6dd4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.708261 12863 tablet_service.cc:1511] Processing CreateTablet for tablet 10a29ce65f52462ca9512d6224788249 (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:05.709628 12863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a29ce65f52462ca9512d6224788249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.713155 12921 tablet_bootstrap.cc:492] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165: Bootstrap starting.
I20260709 13:05:05.716786 12867 tablet_service.cc:1511] Processing CreateTablet for tablet 280a1b9b1db447cf8fc2d88b199b7a82 (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:05.718214 12867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 280a1b9b1db447cf8fc2d88b199b7a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.719487 12868 tablet_service.cc:1511] Processing CreateTablet for tablet afb03269b69b4e18b194b0483dc85796 (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:05.720224 12921 tablet_bootstrap.cc:654] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.725121 12862 tablet_service.cc:1511] Processing CreateTablet for tablet 3ffe8e9b6ec2482b8e6698ab57bac604 (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:05.731967 12862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ffe8e9b6ec2482b8e6698ab57bac604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.732673 12868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afb03269b69b4e18b194b0483dc85796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.735141 12921 tablet_bootstrap.cc:492] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165: No bootstrap required, opened a new log
I20260709 13:05:05.735661 12921 ts_tablet_manager.cc:1403] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.010s
I20260709 13:05:05.738685 12921 raft_consensus.cc:359] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } }
I20260709 13:05:05.739509 12921 raft_consensus.cc:385] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:05.739807 12921 raft_consensus.cc:740] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63cb25bafe234674bb565bce1f4f1165, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.740533 12921 consensus_queue.cc:260] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } }
I20260709 13:05:05.743615 12794 tablet_service.cc:1511] Processing CreateTablet for tablet 9427963bcadf4b2395fd95d57b3a33b7 (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:05.744815 12794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9427963bcadf4b2395fd95d57b3a33b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.748834 12793 tablet_service.cc:1511] Processing CreateTablet for tablet 890890786d914eb1b5b9320f4b44ef72 (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:05.750316 12793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 890890786d914eb1b5b9320f4b44ef72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.756582 12791 tablet_service.cc:1511] Processing CreateTablet for tablet 7ffbf58766f147a7810738b9963ab238 (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:05.752580 12792 tablet_service.cc:1511] Processing CreateTablet for tablet 8dca1bea92694b299ce398c63da689e2 (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:05.759366 12791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ffbf58766f147a7810738b9963ab238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.763126 12792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dca1bea92694b299ce398c63da689e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.772773 12790 tablet_service.cc:1511] Processing CreateTablet for tablet 60751a71baea43abac2fca83e8a6dd4f (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:05.776788 12790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60751a71baea43abac2fca83e8a6dd4f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:05.781119 12673 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:05.807274 12788 tablet_service.cc:1511] Processing CreateTablet for tablet 280a1b9b1db447cf8fc2d88b199b7a82 (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:05.809800 12788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 280a1b9b1db447cf8fc2d88b199b7a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.800836 12789 tablet_service.cc:1511] Processing CreateTablet for tablet 10a29ce65f52462ca9512d6224788249 (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:05.819480 12787 tablet_service.cc:1511] Processing CreateTablet for tablet afb03269b69b4e18b194b0483dc85796 (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:05.824168 12789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a29ce65f52462ca9512d6224788249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.825469 12786 tablet_service.cc:1511] Processing CreateTablet for tablet 3ffe8e9b6ec2482b8e6698ab57bac604 (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:05.827247 12787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afb03269b69b4e18b194b0483dc85796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.830035 12786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ffe8e9b6ec2482b8e6698ab57bac604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.834825 12903 heartbeater.cc:499] Master 127.12.76.190:46863 was elected leader, sending a full tablet report...
I20260709 13:05:05.842373 12921 ts_tablet_manager.cc:1434] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165: Time spent starting tablet: real 0.106s	user 0.017s	sys 0.021s
I20260709 13:05:05.844012 12921 tablet_bootstrap.cc:492] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165: Bootstrap starting.
I20260709 13:05:05.857757 12719 tablet_service.cc:1511] Processing CreateTablet for tablet 9427963bcadf4b2395fd95d57b3a33b7 (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:05.867547 12718 tablet_service.cc:1511] Processing CreateTablet for tablet 890890786d914eb1b5b9320f4b44ef72 (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:05.868813 12716 tablet_service.cc:1511] Processing CreateTablet for tablet 7ffbf58766f147a7810738b9963ab238 (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:05.872634 12714 tablet_service.cc:1511] Processing CreateTablet for tablet 10a29ce65f52462ca9512d6224788249 (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:05.874450 12713 tablet_service.cc:1511] Processing CreateTablet for tablet 280a1b9b1db447cf8fc2d88b199b7a82 (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:05.884047 12712 tablet_service.cc:1511] Processing CreateTablet for tablet afb03269b69b4e18b194b0483dc85796 (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:05.884809 12717 tablet_service.cc:1511] Processing CreateTablet for tablet 8dca1bea92694b299ce398c63da689e2 (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:05.886879 12715 tablet_service.cc:1511] Processing CreateTablet for tablet 60751a71baea43abac2fca83e8a6dd4f (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:05.893576 12719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9427963bcadf4b2395fd95d57b3a33b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.892668 12711 tablet_service.cc:1511] Processing CreateTablet for tablet 3ffe8e9b6ec2482b8e6698ab57bac604 (DEFAULT_TABLE table=test-workload [id=9d7fe06fa32e43bb8855a490b79ebc59]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:05.904213 12712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afb03269b69b4e18b194b0483dc85796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.906152 12715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60751a71baea43abac2fca83e8a6dd4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.910960 12711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ffe8e9b6ec2482b8e6698ab57bac604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.913341 12718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 890890786d914eb1b5b9320f4b44ef72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.916905 12717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dca1bea92694b299ce398c63da689e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.919840 12714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a29ce65f52462ca9512d6224788249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.923012 12713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 280a1b9b1db447cf8fc2d88b199b7a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.926735 12716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ffbf58766f147a7810738b9963ab238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.945832 12921 tablet_bootstrap.cc:654] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:05.977608 12924 tablet_bootstrap.cc:492] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371: Bootstrap starting.
W20260709 13:05:05.977713 12904 tablet.cc:2406] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:06.010936 12924 tablet_bootstrap.cc:654] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.035178 12926 tablet_bootstrap.cc:492] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b: Bootstrap starting.
I20260709 13:05:06.036499 12921 tablet_bootstrap.cc:492] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165: No bootstrap required, opened a new log
I20260709 13:05:06.036970 12921 ts_tablet_manager.cc:1403] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165: Time spent bootstrapping tablet: real 0.194s	user 0.015s	sys 0.029s
I20260709 13:05:06.039841 12921 raft_consensus.cc:359] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.040596 12921 raft_consensus.cc:385] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.040916 12921 raft_consensus.cc:740] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63cb25bafe234674bb565bce1f4f1165, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.042366 12926 tablet_bootstrap.cc:654] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.041877 12921 consensus_queue.cc:260] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.044325 12921 ts_tablet_manager.cc:1434] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:05:06.045250 12921 tablet_bootstrap.cc:492] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165: Bootstrap starting.
I20260709 13:05:06.060289 12924 tablet_bootstrap.cc:492] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371: No bootstrap required, opened a new log
I20260709 13:05:06.060818 12924 ts_tablet_manager.cc:1403] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371: Time spent bootstrapping tablet: real 0.133s	user 0.014s	sys 0.036s
I20260709 13:05:06.063738 12924 raft_consensus.cc:359] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.064357 12921 tablet_bootstrap.cc:654] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.064483 12924 raft_consensus.cc:385] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.066075 12924 raft_consensus.cc:740] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0326743a82cc473d8ed3fe0a55739371, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.067044 12926 tablet_bootstrap.cc:492] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b: No bootstrap required, opened a new log
I20260709 13:05:06.066933 12924 consensus_queue.cc:260] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.067551 12926 ts_tablet_manager.cc:1403] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.008s
I20260709 13:05:06.071084 12926 raft_consensus.cc:359] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.072031 12926 raft_consensus.cc:385] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.072404 12926 raft_consensus.cc:740] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.073400 12926 consensus_queue.cc:260] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.084908 12829 heartbeater.cc:499] Master 127.12.76.190:46863 was elected leader, sending a full tablet report...
I20260709 13:05:06.088989 12754 heartbeater.cc:499] Master 127.12.76.190:46863 was elected leader, sending a full tablet report...
I20260709 13:05:06.090706 12921 tablet_bootstrap.cc:492] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165: No bootstrap required, opened a new log
I20260709 13:05:06.092018 12924 ts_tablet_manager.cc:1434] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371: Time spent starting tablet: real 0.031s	user 0.018s	sys 0.005s
I20260709 13:05:06.094105 12924 tablet_bootstrap.cc:492] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371: Bootstrap starting.
I20260709 13:05:06.096614 12926 ts_tablet_manager.cc:1434] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.003s
I20260709 13:05:06.097635 12926 tablet_bootstrap.cc:492] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b: Bootstrap starting.
I20260709 13:05:06.100394 12924 tablet_bootstrap.cc:654] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.100489 12921 ts_tablet_manager.cc:1403] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165: Time spent bootstrapping tablet: real 0.055s	user 0.005s	sys 0.024s
I20260709 13:05:06.103740 12921 raft_consensus.cc:359] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.104494 12921 raft_consensus.cc:385] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.104795 12921 raft_consensus.cc:740] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63cb25bafe234674bb565bce1f4f1165, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.105687 12921 consensus_queue.cc:260] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.110669 12921 ts_tablet_manager.cc:1434] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.005s
I20260709 13:05:06.111797 12921 tablet_bootstrap.cc:492] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165: Bootstrap starting.
I20260709 13:05:06.116950 12923 raft_consensus.cc:493] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.117435 12923 raft_consensus.cc:515] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.132107 12923 leader_election.cc:290] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657)
I20260709 13:05:06.133256 12929 raft_consensus.cc:493] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.133944 12929 raft_consensus.cc:515] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.133250 12926 tablet_bootstrap.cc:654] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.137369 12929 leader_election.cc:290] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191)
I20260709 13:05:06.147298 12923 raft_consensus.cc:493] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.147922 12923 raft_consensus.cc:515] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } }
I20260709 13:05:06.150346 12923 leader_election.cc:290] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657), 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503)
I20260709 13:05:06.161871 12924 tablet_bootstrap.cc:492] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371: No bootstrap required, opened a new log
I20260709 13:05:06.162106 12926 tablet_bootstrap.cc:492] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b: No bootstrap required, opened a new log
I20260709 13:05:06.167552 12926 ts_tablet_manager.cc:1403] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b: Time spent bootstrapping tablet: real 0.070s	user 0.021s	sys 0.012s
I20260709 13:05:06.167027 12924 ts_tablet_manager.cc:1403] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371: Time spent bootstrapping tablet: real 0.073s	user 0.028s	sys 0.020s
I20260709 13:05:06.165946 12921 tablet_bootstrap.cc:654] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.171391 12926 raft_consensus.cc:359] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.174177 12926 raft_consensus.cc:385] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.174239 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb03269b69b4e18b194b0483dc85796" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0326743a82cc473d8ed3fe0a55739371" is_pre_election: true
I20260709 13:05:06.174743 12926 raft_consensus.cc:740] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.176257 12926 consensus_queue.cc:260] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.177556 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9427963bcadf4b2395fd95d57b3a33b7" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0326743a82cc473d8ed3fe0a55739371" is_pre_election: true
I20260709 13:05:06.178481 12926 ts_tablet_manager.cc:1434] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:05:06.180272 12926 tablet_bootstrap.cc:492] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b: Bootstrap starting.
I20260709 13:05:06.178933 12924 raft_consensus.cc:359] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.183997 12924 raft_consensus.cc:385] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.184315 12924 raft_consensus.cc:740] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0326743a82cc473d8ed3fe0a55739371, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.185226 12924 consensus_queue.cc:260] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.188701 12924 ts_tablet_manager.cc:1434] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:05:06.189623 12924 tablet_bootstrap.cc:492] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371: Bootstrap starting.
I20260709 13:05:06.178946 12923 raft_consensus.cc:493] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.195263 12923 raft_consensus.cc:515] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.197530 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb03269b69b4e18b194b0483dc85796" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b" is_pre_election: true
I20260709 13:05:06.199981 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9427963bcadf4b2395fd95d57b3a33b7" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b" is_pre_election: true
W20260709 13:05:06.204756 12841 leader_election.cc:343] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.205344 12926 tablet_bootstrap.cc:654] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:06.208773 12842 leader_election.cc:343] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:06.212240 12841 leader_election.cc:343] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.209972 12923 leader_election.cc:290] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657)
I20260709 13:05:06.216711 12924 tablet_bootstrap.cc:654] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.213714 12842 leader_election.cc:304] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63cb25bafe234674bb565bce1f4f1165; no voters: 0326743a82cc473d8ed3fe0a55739371, 79ed44dc9d5c41eea3c6823463824f7b
I20260709 13:05:06.221045 12923 raft_consensus.cc:2749] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:06.221132 12842 leader_election.cc:343] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.223774 12842 leader_election.cc:304] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63cb25bafe234674bb565bce1f4f1165; no voters: 0326743a82cc473d8ed3fe0a55739371, 79ed44dc9d5c41eea3c6823463824f7b
I20260709 13:05:06.227623 12923 raft_consensus.cc:2749] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:06.229351 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890890786d914eb1b5b9320f4b44ef72" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0326743a82cc473d8ed3fe0a55739371" is_pre_election: true
I20260709 13:05:06.231076 12804 raft_consensus.cc:2468] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63cb25bafe234674bb565bce1f4f1165 in term 0.
I20260709 13:05:06.235155 12842 leader_election.cc:304] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371, 63cb25bafe234674bb565bce1f4f1165; no voters: 
I20260709 13:05:06.236068 12921 tablet_bootstrap.cc:492] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165: No bootstrap required, opened a new log
I20260709 13:05:06.239046 12923 raft_consensus.cc:2804] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:06.239179 12921 ts_tablet_manager.cc:1403] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165: Time spent bootstrapping tablet: real 0.128s	user 0.011s	sys 0.006s
I20260709 13:05:06.239552 12923 raft_consensus.cc:493] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.239466 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca1bea92694b299ce398c63da689e2" candidate_uuid: "0326743a82cc473d8ed3fe0a55739371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b" is_pre_election: true
I20260709 13:05:06.240491 12923 raft_consensus.cc:3060] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:06.241873 12767 leader_election.cc:343] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.243376 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca1bea92694b299ce398c63da689e2" candidate_uuid: "0326743a82cc473d8ed3fe0a55739371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63cb25bafe234674bb565bce1f4f1165" is_pre_election: true
I20260709 13:05:06.246937 12926 tablet_bootstrap.cc:492] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b: No bootstrap required, opened a new log
I20260709 13:05:06.248077 12926 ts_tablet_manager.cc:1403] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b: Time spent bootstrapping tablet: real 0.068s	user 0.020s	sys 0.007s
I20260709 13:05:06.246583 12921 raft_consensus.cc:359] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.253749 12921 raft_consensus.cc:385] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.254130 12921 raft_consensus.cc:740] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63cb25bafe234674bb565bce1f4f1165, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.254884 12921 consensus_queue.cc:260] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
W20260709 13:05:06.247233 12770 leader_election.cc:343] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.256103 12770 leader_election.cc:304] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371; no voters: 63cb25bafe234674bb565bce1f4f1165, 79ed44dc9d5c41eea3c6823463824f7b
I20260709 13:05:06.256057 12923 raft_consensus.cc:515] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.257128 12929 raft_consensus.cc:2749] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:06.256738 12926 raft_consensus.cc:359] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.258971 12926 raft_consensus.cc:385] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.259644 12926 raft_consensus.cc:740] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.262041 12924 tablet_bootstrap.cc:492] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371: No bootstrap required, opened a new log
I20260709 13:05:06.262712 12924 ts_tablet_manager.cc:1403] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.015s
I20260709 13:05:06.262807 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890890786d914eb1b5b9320f4b44ef72" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
I20260709 13:05:06.263620 12804 raft_consensus.cc:3060] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.263881 12926 consensus_queue.cc:260] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.266572 12926 ts_tablet_manager.cc:1434] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:06.266498 12924 raft_consensus.cc:359] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } }
I20260709 13:05:06.267282 12924 raft_consensus.cc:385] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.267589 12926 tablet_bootstrap.cc:492] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 79ed44dc9d5c41eea3c6823463824f7b: Bootstrap starting.
I20260709 13:05:06.267829 12924 raft_consensus.cc:740] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0326743a82cc473d8ed3fe0a55739371, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.268649 12924 consensus_queue.cc:260] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } }
I20260709 13:05:06.271063 12924 ts_tablet_manager.cc:1434] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:05:06.272367 12924 tablet_bootstrap.cc:492] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371: Bootstrap starting.
I20260709 13:05:06.274684 12926 tablet_bootstrap.cc:654] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 79ed44dc9d5c41eea3c6823463824f7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.262032 12923 leader_election.cc:290] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 election: Requested vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657)
W20260709 13:05:06.263629 12841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:35503, user_credentials={real_user=slave}} blocked reactor thread for 58144.6us
I20260709 13:05:06.280217 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890890786d914eb1b5b9320f4b44ef72" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b" is_pre_election: true
I20260709 13:05:06.280932 12729 raft_consensus.cc:2468] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63cb25bafe234674bb565bce1f4f1165 in term 0.
I20260709 13:05:06.284346 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890890786d914eb1b5b9320f4b44ef72" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
I20260709 13:05:06.284940 12729 raft_consensus.cc:3060] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.286725 12924 tablet_bootstrap.cc:654] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.298697 12921 ts_tablet_manager.cc:1434] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165: Time spent starting tablet: real 0.059s	user 0.018s	sys 0.000s
I20260709 13:05:06.300037 12921 tablet_bootstrap.cc:492] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165: Bootstrap starting.
I20260709 13:05:06.316812 12921 tablet_bootstrap.cc:654] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.320225 12804 raft_consensus.cc:2468] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63cb25bafe234674bb565bce1f4f1165 in term 1.
I20260709 13:05:06.321544 12842 leader_election.cc:304] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371, 63cb25bafe234674bb565bce1f4f1165; no voters: 
I20260709 13:05:06.322393 12923 raft_consensus.cc:2804] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.322902 12923 raft_consensus.cc:697] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 1 LEADER]: Becoming Leader. State: Replica: 63cb25bafe234674bb565bce1f4f1165, State: Running, Role: LEADER
I20260709 13:05:06.323797 12729 raft_consensus.cc:2468] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63cb25bafe234674bb565bce1f4f1165 in term 1.
I20260709 13:05:06.323902 12923 consensus_queue.cc:237] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.328665 12926 tablet_bootstrap.cc:492] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 79ed44dc9d5c41eea3c6823463824f7b: No bootstrap required, opened a new log
I20260709 13:05:06.329200 12926 ts_tablet_manager.cc:1403] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 79ed44dc9d5c41eea3c6823463824f7b: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.025s
I20260709 13:05:06.334901 12926 raft_consensus.cc:359] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.335634 12926 raft_consensus.cc:385] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.336031 12926 raft_consensus.cc:740] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.336797 12926 consensus_queue.cc:260] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 79ed44dc9d5c41eea3c6823463824f7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.337303 12624 catalog_manager.cc:5697] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "63cb25bafe234674bb565bce1f4f1165" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:06.345381 12924 tablet_bootstrap.cc:492] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371: No bootstrap required, opened a new log
I20260709 13:05:06.345763 12926 ts_tablet_manager.cc:1434] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 79ed44dc9d5c41eea3c6823463824f7b: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:05:06.345955 12924 ts_tablet_manager.cc:1403] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.026s
I20260709 13:05:06.349762 12926 tablet_bootstrap.cc:492] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b: Bootstrap starting.
I20260709 13:05:06.350322 12924 raft_consensus.cc:359] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.352205 12924 raft_consensus.cc:385] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.352684 12924 raft_consensus.cc:740] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0326743a82cc473d8ed3fe0a55739371, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.353621 12924 consensus_queue.cc:260] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.356480 12924 ts_tablet_manager.cc:1434] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:05:06.358096 12921 tablet_bootstrap.cc:492] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165: No bootstrap required, opened a new log
I20260709 13:05:06.358554 12921 ts_tablet_manager.cc:1403] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165: Time spent bootstrapping tablet: real 0.059s	user 0.017s	sys 0.014s
I20260709 13:05:06.358628 12924 tablet_bootstrap.cc:492] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371: Bootstrap starting.
I20260709 13:05:06.359654 12926 tablet_bootstrap.cc:654] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.360391 12931 raft_consensus.cc:493] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.360847 12931 raft_consensus.cc:515] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.361555 12921 raft_consensus.cc:359] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.362313 12921 raft_consensus.cc:385] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.362630 12921 raft_consensus.cc:740] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63cb25bafe234674bb565bce1f4f1165, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.363457 12931 leader_election.cc:290] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657), 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191)
I20260709 13:05:06.367863 12924 tablet_bootstrap.cc:654] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.369100 12923 raft_consensus.cc:493] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.369586 12923 raft_consensus.cc:515] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.372008 12923 leader_election.cc:290] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657)
I20260709 13:05:06.372668 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ffbf58766f147a7810738b9963ab238" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b" is_pre_election: true
I20260709 13:05:06.373327 12729 raft_consensus.cc:2468] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63cb25bafe234674bb565bce1f4f1165 in term 0.
I20260709 13:05:06.374359 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ffbf58766f147a7810738b9963ab238" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0326743a82cc473d8ed3fe0a55739371" is_pre_election: true
I20260709 13:05:06.374706 12841 leader_election.cc:304] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63cb25bafe234674bb565bce1f4f1165, 79ed44dc9d5c41eea3c6823463824f7b; no voters: 
I20260709 13:05:06.375185 12804 raft_consensus.cc:2468] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63cb25bafe234674bb565bce1f4f1165 in term 0.
I20260709 13:05:06.376034 12923 raft_consensus.cc:2804] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:06.376513 12923 raft_consensus.cc:493] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.376986 12923 raft_consensus.cc:3060] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.383775 12923 raft_consensus.cc:515] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.384966 12921 consensus_queue.cc:260] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.387306 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ffbf58766f147a7810738b9963ab238" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
I20260709 13:05:06.387904 12729 raft_consensus.cc:3060] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.391865 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffe8e9b6ec2482b8e6698ab57bac604" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63cb25bafe234674bb565bce1f4f1165" is_pre_election: true
W20260709 13:05:06.393371 12695 leader_election.cc:343] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.394464 12921 ts_tablet_manager.cc:1434] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:05:06.406386 12729 raft_consensus.cc:2468] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63cb25bafe234674bb565bce1f4f1165 in term 1.
I20260709 13:05:06.407622 12841 leader_election.cc:304] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63cb25bafe234674bb565bce1f4f1165, 79ed44dc9d5c41eea3c6823463824f7b; no voters: 
I20260709 13:05:06.408636 12943 raft_consensus.cc:2804] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.409507 12921 tablet_bootstrap.cc:492] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165: Bootstrap starting.
I20260709 13:05:06.411445 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffe8e9b6ec2482b8e6698ab57bac604" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0326743a82cc473d8ed3fe0a55739371" is_pre_election: true
W20260709 13:05:06.412976 12693 leader_election.cc:343] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.413415 12693 leader_election.cc:304] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ed44dc9d5c41eea3c6823463824f7b; no voters: 0326743a82cc473d8ed3fe0a55739371, 63cb25bafe234674bb565bce1f4f1165
I20260709 13:05:06.414525 12931 raft_consensus.cc:2749] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:06.415549 12926 tablet_bootstrap.cc:492] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b: No bootstrap required, opened a new log
I20260709 13:05:06.416059 12926 ts_tablet_manager.cc:1403] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.027s
I20260709 13:05:06.417439 12924 tablet_bootstrap.cc:492] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371: No bootstrap required, opened a new log
I20260709 13:05:06.418165 12921 tablet_bootstrap.cc:654] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.419353 12924 ts_tablet_manager.cc:1403] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.006s
I20260709 13:05:06.422829 12923 leader_election.cc:290] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 election: Requested vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657)
I20260709 13:05:06.420159 12943 raft_consensus.cc:697] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 1 LEADER]: Becoming Leader. State: Replica: 63cb25bafe234674bb565bce1f4f1165, State: Running, Role: LEADER
I20260709 13:05:06.425942 12921 tablet_bootstrap.cc:492] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165: No bootstrap required, opened a new log
I20260709 13:05:06.426503 12921 ts_tablet_manager.cc:1403] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.000s
I20260709 13:05:06.425982 12943 consensus_queue.cc:237] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.418960 12926 raft_consensus.cc:359] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.423967 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ffbf58766f147a7810738b9963ab238" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
I20260709 13:05:06.427771 12804 raft_consensus.cc:3060] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.429425 12921 raft_consensus.cc:359] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.430172 12921 raft_consensus.cc:385] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.424650 12924 raft_consensus.cc:359] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.430524 12921 raft_consensus.cc:740] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63cb25bafe234674bb565bce1f4f1165, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.431022 12924 raft_consensus.cc:385] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.431382 12924 raft_consensus.cc:740] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0326743a82cc473d8ed3fe0a55739371, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.431483 12921 consensus_queue.cc:260] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.432363 12924 consensus_queue.cc:260] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.434177 12921 ts_tablet_manager.cc:1434] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:06.435199 12921 tablet_bootstrap.cc:492] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165: Bootstrap starting.
I20260709 13:05:06.436318 12804 raft_consensus.cc:2468] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63cb25bafe234674bb565bce1f4f1165 in term 1.
I20260709 13:05:06.436497 12924 ts_tablet_manager.cc:1434] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 13:05:06.437183 12926 raft_consensus.cc:385] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.437731 12926 raft_consensus.cc:740] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.438737 12924 tablet_bootstrap.cc:492] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371: Bootstrap starting.
I20260709 13:05:06.438535 12926 consensus_queue.cc:260] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.442143 12926 ts_tablet_manager.cc:1434] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.002s
I20260709 13:05:06.442167 12921 tablet_bootstrap.cc:654] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.444825 12926 tablet_bootstrap.cc:492] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b: Bootstrap starting.
I20260709 13:05:06.455906 12921 tablet_bootstrap.cc:492] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165: No bootstrap required, opened a new log
I20260709 13:05:06.457005 12921 ts_tablet_manager.cc:1403] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.003s
I20260709 13:05:06.460009 12921 raft_consensus.cc:359] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.460968 12921 raft_consensus.cc:385] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.461313 12921 raft_consensus.cc:740] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63cb25bafe234674bb565bce1f4f1165, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.459771 12624 catalog_manager.cc:5697] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "63cb25bafe234674bb565bce1f4f1165" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:06.462165 12921 consensus_queue.cc:260] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.464351 12924 tablet_bootstrap.cc:654] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.464819 12921 ts_tablet_manager.cc:1434] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:06.468650 12921 tablet_bootstrap.cc:492] T 280a1b9b1db447cf8fc2d88b199b7a82 P 63cb25bafe234674bb565bce1f4f1165: Bootstrap starting.
I20260709 13:05:06.466619 12926 tablet_bootstrap.cc:654] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.472805 12943 raft_consensus.cc:493] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.473358 12943 raft_consensus.cc:515] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.475262 12921 tablet_bootstrap.cc:654] T 280a1b9b1db447cf8fc2d88b199b7a82 P 63cb25bafe234674bb565bce1f4f1165: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.478261 12943 leader_election.cc:290] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657)
I20260709 13:05:06.478188 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca1bea92694b299ce398c63da689e2" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b" is_pre_election: true
I20260709 13:05:06.478188 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca1bea92694b299ce398c63da689e2" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0326743a82cc473d8ed3fe0a55739371" is_pre_election: true
I20260709 13:05:06.479826 12804 raft_consensus.cc:2468] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63cb25bafe234674bb565bce1f4f1165 in term 0.
W20260709 13:05:06.480161 12841 leader_election.cc:343] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.483717 12842 leader_election.cc:304] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371, 63cb25bafe234674bb565bce1f4f1165; no voters: 79ed44dc9d5c41eea3c6823463824f7b
I20260709 13:05:06.484268 12924 tablet_bootstrap.cc:492] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371: No bootstrap required, opened a new log
I20260709 13:05:06.484752 12924 ts_tablet_manager.cc:1403] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371: Time spent bootstrapping tablet: real 0.046s	user 0.006s	sys 0.008s
I20260709 13:05:06.488771 12926 tablet_bootstrap.cc:492] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b: No bootstrap required, opened a new log
I20260709 13:05:06.489318 12926 ts_tablet_manager.cc:1403] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.002s
I20260709 13:05:06.491007 12943 raft_consensus.cc:2804] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:06.491392 12943 raft_consensus.cc:493] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.491756 12943 raft_consensus.cc:3060] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.492515 12926 raft_consensus.cc:359] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } }
I20260709 13:05:06.495810 12926 raft_consensus.cc:385] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.496217 12926 raft_consensus.cc:740] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.495078 12924 raft_consensus.cc:359] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.497064 12924 raft_consensus.cc:385] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.497409 12924 raft_consensus.cc:740] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0326743a82cc473d8ed3fe0a55739371, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.498194 12924 consensus_queue.cc:260] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.500872 12924 ts_tablet_manager.cc:1434] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:05:06.500948 12923 raft_consensus.cc:493] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.500923 12943 raft_consensus.cc:515] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.502334 12923 raft_consensus.cc:515] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.504345 12923 leader_election.cc:290] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657)
I20260709 13:05:06.501427 12926 consensus_queue.cc:260] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } }
I20260709 13:05:06.504345 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca1bea92694b299ce398c63da689e2" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
I20260709 13:05:06.506489 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffe8e9b6ec2482b8e6698ab57bac604" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0326743a82cc473d8ed3fe0a55739371" is_pre_election: true
I20260709 13:05:06.507697 12924 tablet_bootstrap.cc:492] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371: Bootstrap starting.
W20260709 13:05:06.507989 12841 leader_election.cc:343] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.506776 12926 ts_tablet_manager.cc:1434] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:05:06.512418 12926 tablet_bootstrap.cc:492] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b: Bootstrap starting.
W20260709 13:05:06.509531 12842 leader_election.cc:343] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.513506 12931 raft_consensus.cc:493] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.510150 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffe8e9b6ec2482b8e6698ab57bac604" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b" is_pre_election: true
I20260709 13:05:06.514184 12729 raft_consensus.cc:2468] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63cb25bafe234674bb565bce1f4f1165 in term 0.
I20260709 13:05:06.514065 12931 raft_consensus.cc:515] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } }
I20260709 13:05:06.515431 12841 leader_election.cc:304] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63cb25bafe234674bb565bce1f4f1165, 79ed44dc9d5c41eea3c6823463824f7b; no voters: 0326743a82cc473d8ed3fe0a55739371
I20260709 13:05:06.516070 12931 leader_election.cc:290] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191), 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657)
I20260709 13:05:06.516587 12923 raft_consensus.cc:493] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.517058 12923 raft_consensus.cc:515] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.517843 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9427963bcadf4b2395fd95d57b3a33b7" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63cb25bafe234674bb565bce1f4f1165" is_pre_election: true
I20260709 13:05:06.518438 12878 raft_consensus.cc:2468] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 0.
I20260709 13:05:06.517022 12955 raft_consensus.cc:2804] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:06.519595 12955 raft_consensus.cc:493] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.519109 12923 leader_election.cc:290] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657)
I20260709 13:05:06.519948 12955 raft_consensus.cc:3060] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.523008 12695 leader_election.cc:304] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63cb25bafe234674bb565bce1f4f1165, 79ed44dc9d5c41eea3c6823463824f7b; no voters: 
I20260709 13:05:06.523916 12931 raft_consensus.cc:2804] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:06.524273 12931 raft_consensus.cc:493] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.524600 12931 raft_consensus.cc:3060] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.525844 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60751a71baea43abac2fca83e8a6dd4f" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0326743a82cc473d8ed3fe0a55739371" is_pre_election: true
I20260709 13:05:06.527124 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9427963bcadf4b2395fd95d57b3a33b7" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0326743a82cc473d8ed3fe0a55739371" is_pre_election: true
I20260709 13:05:06.527765 12804 raft_consensus.cc:2468] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 0.
W20260709 13:05:06.529822 12842 leader_election.cc:343] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.531114 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60751a71baea43abac2fca83e8a6dd4f" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b" is_pre_election: true
W20260709 13:05:06.532569 12841 leader_election.cc:343] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.533007 12841 leader_election.cc:304] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63cb25bafe234674bb565bce1f4f1165; no voters: 0326743a82cc473d8ed3fe0a55739371, 79ed44dc9d5c41eea3c6823463824f7b
I20260709 13:05:06.533736 12923 raft_consensus.cc:2749] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:06.533197 12931 raft_consensus.cc:515] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } }
I20260709 13:05:06.536772 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9427963bcadf4b2395fd95d57b3a33b7" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
I20260709 13:05:06.537317 12878 raft_consensus.cc:3060] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.538743 12924 tablet_bootstrap.cc:654] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.539497 12931 leader_election.cc:290] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 1 election: Requested vote from peers 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191), 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657)
I20260709 13:05:06.540148 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9427963bcadf4b2395fd95d57b3a33b7" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
I20260709 13:05:06.543666 12804 raft_consensus.cc:3060] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.545256 12926 tablet_bootstrap.cc:654] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.543685 12931 raft_consensus.cc:493] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.548394 12943 leader_election.cc:290] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 election: Requested vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657)
I20260709 13:05:06.548930 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca1bea92694b299ce398c63da689e2" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
I20260709 13:05:06.549510 12803 raft_consensus.cc:3060] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.552088 12804 raft_consensus.cc:2468] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 1.
I20260709 13:05:06.553162 12693 leader_election.cc:304] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371, 79ed44dc9d5c41eea3c6823463824f7b; no voters: 
I20260709 13:05:06.547369 12931 raft_consensus.cc:515] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.558421 12878 raft_consensus.cc:2468] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 1.
I20260709 13:05:06.558951 12955 raft_consensus.cc:515] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.564100 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffe8e9b6ec2482b8e6698ab57bac604" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
I20260709 13:05:06.565279 12729 raft_consensus.cc:3060] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.565356 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffe8e9b6ec2482b8e6698ab57bac604" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
I20260709 13:05:06.559394 12803 raft_consensus.cc:2468] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63cb25bafe234674bb565bce1f4f1165 in term 1.
W20260709 13:05:06.568467 12842 leader_election.cc:343] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.569779 12955 leader_election.cc:290] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 election: Requested vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657)
I20260709 13:05:06.572681 12921 tablet_bootstrap.cc:492] T 280a1b9b1db447cf8fc2d88b199b7a82 P 63cb25bafe234674bb565bce1f4f1165: No bootstrap required, opened a new log
I20260709 13:05:06.573077 12921 ts_tablet_manager.cc:1403] T 280a1b9b1db447cf8fc2d88b199b7a82 P 63cb25bafe234674bb565bce1f4f1165: Time spent bootstrapping tablet: real 0.105s	user 0.030s	sys 0.036s
I20260709 13:05:06.573709 12842 leader_election.cc:304] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371, 63cb25bafe234674bb565bce1f4f1165; no voters: 79ed44dc9d5c41eea3c6823463824f7b
I20260709 13:05:06.574855 12955 raft_consensus.cc:2804] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.575316 12955 raft_consensus.cc:697] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 1 LEADER]: Becoming Leader. State: Replica: 63cb25bafe234674bb565bce1f4f1165, State: Running, Role: LEADER
I20260709 13:05:06.576273 12955 consensus_queue.cc:237] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.578428 12729 raft_consensus.cc:2468] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63cb25bafe234674bb565bce1f4f1165 in term 1.
I20260709 13:05:06.579653 12841 leader_election.cc:304] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63cb25bafe234674bb565bce1f4f1165, 79ed44dc9d5c41eea3c6823463824f7b; no voters: 0326743a82cc473d8ed3fe0a55739371
I20260709 13:05:06.588209 12962 raft_consensus.cc:2804] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.589080 12921 raft_consensus.cc:359] T 280a1b9b1db447cf8fc2d88b199b7a82 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.589823 12921 raft_consensus.cc:385] T 280a1b9b1db447cf8fc2d88b199b7a82 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.590131 12921 raft_consensus.cc:740] T 280a1b9b1db447cf8fc2d88b199b7a82 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63cb25bafe234674bb565bce1f4f1165, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.590759 12921 consensus_queue.cc:260] T 280a1b9b1db447cf8fc2d88b199b7a82 P 63cb25bafe234674bb565bce1f4f1165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.596460 12924 tablet_bootstrap.cc:492] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371: No bootstrap required, opened a new log
I20260709 13:05:06.597049 12921 ts_tablet_manager.cc:1434] T 280a1b9b1db447cf8fc2d88b199b7a82 P 63cb25bafe234674bb565bce1f4f1165: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:05:06.596999 12924 ts_tablet_manager.cc:1403] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371: Time spent bootstrapping tablet: real 0.090s	user 0.003s	sys 0.021s
I20260709 13:05:06.598639 12921 tablet_bootstrap.cc:492] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165: Bootstrap starting.
I20260709 13:05:06.595566 12955 raft_consensus.cc:2804] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.599156 12962 raft_consensus.cc:697] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 LEADER]: Becoming Leader. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Running, Role: LEADER
I20260709 13:05:06.602317 12955 raft_consensus.cc:697] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165 [term 1 LEADER]: Becoming Leader. State: Replica: 63cb25bafe234674bb565bce1f4f1165, State: Running, Role: LEADER
I20260709 13:05:06.602566 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb03269b69b4e18b194b0483dc85796" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0326743a82cc473d8ed3fe0a55739371" is_pre_election: true
I20260709 13:05:06.597075 12624 catalog_manager.cc:5697] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "63cb25bafe234674bb565bce1f4f1165" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:06.603289 12803 raft_consensus.cc:2468] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 0.
I20260709 13:05:06.603518 12955 consensus_queue.cc:237] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.605332 12926 tablet_bootstrap.cc:492] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b: No bootstrap required, opened a new log
I20260709 13:05:06.605832 12926 ts_tablet_manager.cc:1403] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b: Time spent bootstrapping tablet: real 0.094s	user 0.003s	sys 0.016s
I20260709 13:05:06.608064 12931 leader_election.cc:290] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657), 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191)
I20260709 13:05:06.608596 12931 raft_consensus.cc:493] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.609270 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb03269b69b4e18b194b0483dc85796" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63cb25bafe234674bb565bce1f4f1165" is_pre_election: true
I20260709 13:05:06.609105 12931 raft_consensus.cc:515] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.610759 12878 raft_consensus.cc:2468] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 0.
I20260709 13:05:06.603005 12962 consensus_queue.cc:237] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } }
I20260709 13:05:06.616225 12924 raft_consensus.cc:359] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.616976 12924 raft_consensus.cc:385] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.617267 12924 raft_consensus.cc:740] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0326743a82cc473d8ed3fe0a55739371, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.617996 12924 consensus_queue.cc:260] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.618826 12931 leader_election.cc:290] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657), 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191)
I20260709 13:05:06.619647 12693 leader_election.cc:304] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371, 79ed44dc9d5c41eea3c6823463824f7b; no voters: 
I20260709 13:05:06.622028 12926 raft_consensus.cc:359] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.624359 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "280a1b9b1db447cf8fc2d88b199b7a82" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63cb25bafe234674bb565bce1f4f1165" is_pre_election: true
I20260709 13:05:06.624967 12878 raft_consensus.cc:2468] T 280a1b9b1db447cf8fc2d88b199b7a82 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 0.
I20260709 13:05:06.626230 12695 leader_election.cc:304] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63cb25bafe234674bb565bce1f4f1165, 79ed44dc9d5c41eea3c6823463824f7b; no voters: 
I20260709 13:05:06.627511 12966 raft_consensus.cc:2804] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:06.622946 12926 raft_consensus.cc:385] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.628540 12967 raft_consensus.cc:2804] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:06.632259 12966 raft_consensus.cc:493] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.632398 12967 raft_consensus.cc:493] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.632699 12966 raft_consensus.cc:3060] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.632750 12967 raft_consensus.cc:3060] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.628057 12924 ts_tablet_manager.cc:1434] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:05:06.631692 12926 raft_consensus.cc:740] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.635766 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "280a1b9b1db447cf8fc2d88b199b7a82" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0326743a82cc473d8ed3fe0a55739371" is_pre_election: true
W20260709 13:05:06.639353 12693 leader_election.cc:343] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.641157 12924 tablet_bootstrap.cc:492] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 0326743a82cc473d8ed3fe0a55739371: Bootstrap starting.
I20260709 13:05:06.638792 12926 consensus_queue.cc:260] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.645642 12626 catalog_manager.cc:5697] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129). New cstate: current_term: 1 leader_uuid: "79ed44dc9d5c41eea3c6823463824f7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:06.647115 12921 tablet_bootstrap.cc:654] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.647683 12967 raft_consensus.cc:515] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.658041 12924 tablet_bootstrap.cc:654] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 0326743a82cc473d8ed3fe0a55739371: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.658720 12926 ts_tablet_manager.cc:1434] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 13:05:06.661432 12926 tablet_bootstrap.cc:492] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b: Bootstrap starting.
I20260709 13:05:06.668072 12966 raft_consensus.cc:515] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.669930 12967 leader_election.cc:290] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 1 election: Requested vote from peers 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657), 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191)
I20260709 13:05:06.673535 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "280a1b9b1db447cf8fc2d88b199b7a82" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
I20260709 13:05:06.675275 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "280a1b9b1db447cf8fc2d88b199b7a82" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
I20260709 13:05:06.675872 12878 raft_consensus.cc:3060] T 280a1b9b1db447cf8fc2d88b199b7a82 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:06.679476 12693 leader_election.cc:343] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:06.679492 12626 catalog_manager.cc:5697] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "63cb25bafe234674bb565bce1f4f1165" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:06.684774 12878 raft_consensus.cc:2468] T 280a1b9b1db447cf8fc2d88b199b7a82 P 63cb25bafe234674bb565bce1f4f1165 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 1.
I20260709 13:05:06.686264 12966 leader_election.cc:290] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 1 election: Requested vote from peers 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657), 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191)
I20260709 13:05:06.686331 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb03269b69b4e18b194b0483dc85796" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
I20260709 13:05:06.687112 12803 raft_consensus.cc:3060] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.692955 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb03269b69b4e18b194b0483dc85796" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
I20260709 13:05:06.693658 12877 raft_consensus.cc:3060] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.695544 12803 raft_consensus.cc:2468] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 1.
I20260709 13:05:06.696659 12695 leader_election.cc:304] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63cb25bafe234674bb565bce1f4f1165, 79ed44dc9d5c41eea3c6823463824f7b; no voters: 0326743a82cc473d8ed3fe0a55739371
I20260709 13:05:06.704493 12966 raft_consensus.cc:2804] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.704618 12693 leader_election.cc:304] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371, 79ed44dc9d5c41eea3c6823463824f7b; no voters: 
I20260709 13:05:06.700807 12877 raft_consensus.cc:2468] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 1.
I20260709 13:05:06.701104 12921 tablet_bootstrap.cc:492] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165: No bootstrap required, opened a new log
I20260709 13:05:06.705500 12926 tablet_bootstrap.cc:654] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.705888 12921 ts_tablet_manager.cc:1403] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165: Time spent bootstrapping tablet: real 0.108s	user 0.017s	sys 0.002s
I20260709 13:05:06.705528 12962 raft_consensus.cc:2804] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.706789 12962 raft_consensus.cc:697] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 LEADER]: Becoming Leader. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Running, Role: LEADER
I20260709 13:05:06.707710 12962 consensus_queue.cc:237] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.709416 12921 raft_consensus.cc:359] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.710160 12921 raft_consensus.cc:385] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.710475 12921 raft_consensus.cc:740] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63cb25bafe234674bb565bce1f4f1165, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.711177 12921 consensus_queue.cc:260] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.705273 12966 raft_consensus.cc:697] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 LEADER]: Becoming Leader. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Running, Role: LEADER
I20260709 13:05:06.713689 12921 ts_tablet_manager.cc:1434] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:06.702145 12924 tablet_bootstrap.cc:492] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 0326743a82cc473d8ed3fe0a55739371: No bootstrap required, opened a new log
I20260709 13:05:06.716077 12924 ts_tablet_manager.cc:1403] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 0326743a82cc473d8ed3fe0a55739371: Time spent bootstrapping tablet: real 0.075s	user 0.017s	sys 0.019s
I20260709 13:05:06.713227 12966 consensus_queue.cc:237] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.719131 12924 raft_consensus.cc:359] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.719910 12924 raft_consensus.cc:385] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.720283 12924 raft_consensus.cc:740] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0326743a82cc473d8ed3fe0a55739371, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.721103 12924 consensus_queue.cc:260] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 0326743a82cc473d8ed3fe0a55739371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.724231 12924 ts_tablet_manager.cc:1434] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 0326743a82cc473d8ed3fe0a55739371: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:05:06.728904 12926 tablet_bootstrap.cc:492] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b: No bootstrap required, opened a new log
I20260709 13:05:06.729423 12926 ts_tablet_manager.cc:1403] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.015s
I20260709 13:05:06.732180 12926 raft_consensus.cc:359] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.732920 12926 raft_consensus.cc:385] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.733250 12926 raft_consensus.cc:740] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.733953 12926 consensus_queue.cc:260] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.735930 12926 ts_tablet_manager.cc:1434] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:06.736827 12926 tablet_bootstrap.cc:492] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b: Bootstrap starting.
I20260709 13:05:06.737368 12924 tablet_bootstrap.cc:492] T 280a1b9b1db447cf8fc2d88b199b7a82 P 0326743a82cc473d8ed3fe0a55739371: Bootstrap starting.
I20260709 13:05:06.742647 12926 tablet_bootstrap.cc:654] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.745450 12924 tablet_bootstrap.cc:654] T 280a1b9b1db447cf8fc2d88b199b7a82 P 0326743a82cc473d8ed3fe0a55739371: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.745788 12626 catalog_manager.cc:5697] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129). New cstate: current_term: 1 leader_uuid: "79ed44dc9d5c41eea3c6823463824f7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.757712 12924 tablet_bootstrap.cc:492] T 280a1b9b1db447cf8fc2d88b199b7a82 P 0326743a82cc473d8ed3fe0a55739371: No bootstrap required, opened a new log
I20260709 13:05:06.758466 12924 ts_tablet_manager.cc:1403] T 280a1b9b1db447cf8fc2d88b199b7a82 P 0326743a82cc473d8ed3fe0a55739371: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:05:06.760808 12926 tablet_bootstrap.cc:492] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b: No bootstrap required, opened a new log
I20260709 13:05:06.761317 12926 ts_tablet_manager.cc:1403] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.003s
I20260709 13:05:06.761752 12924 raft_consensus.cc:359] T 280a1b9b1db447cf8fc2d88b199b7a82 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.762508 12924 raft_consensus.cc:385] T 280a1b9b1db447cf8fc2d88b199b7a82 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.762830 12924 raft_consensus.cc:740] T 280a1b9b1db447cf8fc2d88b199b7a82 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0326743a82cc473d8ed3fe0a55739371, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.763681 12924 consensus_queue.cc:260] T 280a1b9b1db447cf8fc2d88b199b7a82 P 0326743a82cc473d8ed3fe0a55739371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.764035 12926 raft_consensus.cc:359] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.766013 12924 ts_tablet_manager.cc:1434] T 280a1b9b1db447cf8fc2d88b199b7a82 P 0326743a82cc473d8ed3fe0a55739371: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:06.771500 12955 consensus_queue.cc:1048] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:06.769943 12626 catalog_manager.cc:5697] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129). New cstate: current_term: 1 leader_uuid: "79ed44dc9d5c41eea3c6823463824f7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.771728 12926 raft_consensus.cc:385] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.774372 12926 raft_consensus.cc:740] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.778754 12926 consensus_queue.cc:260] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.779284 12955 raft_consensus.cc:493] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.779870 12955 raft_consensus.cc:515] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.780720 12926 ts_tablet_manager.cc:1434] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:05:06.782632 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a29ce65f52462ca9512d6224788249" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b" is_pre_election: true
I20260709 13:05:06.783279 12728 raft_consensus.cc:2468] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63cb25bafe234674bb565bce1f4f1165 in term 0.
I20260709 13:05:06.784511 12841 leader_election.cc:304] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63cb25bafe234674bb565bce1f4f1165, 79ed44dc9d5c41eea3c6823463824f7b; no voters: 
I20260709 13:05:06.785286 12943 raft_consensus.cc:2804] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:06.785634 12943 raft_consensus.cc:493] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.785697 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a29ce65f52462ca9512d6224788249" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0326743a82cc473d8ed3fe0a55739371" is_pre_election: true
I20260709 13:05:06.786013 12943 raft_consensus.cc:3060] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.786371 12803 raft_consensus.cc:2468] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63cb25bafe234674bb565bce1f4f1165 in term 0.
W20260709 13:05:06.787174 12673 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:06.792956 12943 raft_consensus.cc:515] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.795090 12943 leader_election.cc:290] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 election: Requested vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657)
I20260709 13:05:06.786417 12955 leader_election.cc:290] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657)
I20260709 13:05:06.796134 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a29ce65f52462ca9512d6224788249" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
I20260709 13:05:06.798179 12729 raft_consensus.cc:3060] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.796574 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a29ce65f52462ca9512d6224788249" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
I20260709 13:05:06.803745 12803 raft_consensus.cc:3060] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.811002 12943 consensus_queue.cc:1048] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:06.812824 12803 raft_consensus.cc:2468] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63cb25bafe234674bb565bce1f4f1165 in term 1.
I20260709 13:05:06.818116 12842 leader_election.cc:304] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371, 63cb25bafe234674bb565bce1f4f1165; no voters: 
I20260709 13:05:06.820075 12943 raft_consensus.cc:2804] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.821094 12943 raft_consensus.cc:697] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 1 LEADER]: Becoming Leader. State: Replica: 63cb25bafe234674bb565bce1f4f1165, State: Running, Role: LEADER
I20260709 13:05:06.822494 12943 consensus_queue.cc:237] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.816577 12729 raft_consensus.cc:2468] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63cb25bafe234674bb565bce1f4f1165 in term 1.
I20260709 13:05:06.836004 12626 catalog_manager.cc:5697] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "63cb25bafe234674bb565bce1f4f1165" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:06.880523 12962 raft_consensus.cc:493] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.881106 12962 raft_consensus.cc:515] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.883160 12962 leader_election.cc:290] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657), 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191)
I20260709 13:05:06.883912 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60751a71baea43abac2fca83e8a6dd4f" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0326743a82cc473d8ed3fe0a55739371" is_pre_election: true
I20260709 13:05:06.884266 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60751a71baea43abac2fca83e8a6dd4f" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63cb25bafe234674bb565bce1f4f1165" is_pre_election: true
I20260709 13:05:06.884469 12804 raft_consensus.cc:2468] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 0.
I20260709 13:05:06.884857 12877 raft_consensus.cc:2468] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 0.
I20260709 13:05:06.885460 12693 leader_election.cc:304] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371, 79ed44dc9d5c41eea3c6823463824f7b; no voters: 
I20260709 13:05:06.886217 12962 raft_consensus.cc:2804] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:06.886523 12962 raft_consensus.cc:493] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.886787 12962 raft_consensus.cc:3060] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.891340 12962 raft_consensus.cc:515] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.892966 12962 leader_election.cc:290] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 1 election: Requested vote from peers 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657), 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191)
I20260709 13:05:06.893748 12804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60751a71baea43abac2fca83e8a6dd4f" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
I20260709 13:05:06.893954 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60751a71baea43abac2fca83e8a6dd4f" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
I20260709 13:05:06.894338 12804 raft_consensus.cc:3060] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.894488 12877 raft_consensus.cc:3060] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.899596 12877 raft_consensus.cc:2468] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 1.
I20260709 13:05:06.900745 12695 leader_election.cc:304] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63cb25bafe234674bb565bce1f4f1165, 79ed44dc9d5c41eea3c6823463824f7b; no voters: 
I20260709 13:05:06.901405 12962 raft_consensus.cc:2804] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.901435 12804 raft_consensus.cc:2468] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 1.
I20260709 13:05:06.901914 12962 raft_consensus.cc:697] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 1 LEADER]: Becoming Leader. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Running, Role: LEADER
I20260709 13:05:06.903167 12962 consensus_queue.cc:237] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:06.910915 12978 consensus_queue.cc:1048] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:06.911744 12624 catalog_manager.cc:5697] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129). New cstate: current_term: 1 leader_uuid: "79ed44dc9d5c41eea3c6823463824f7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.924214 12923 consensus_queue.cc:1048] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:07.009514 12929 raft_consensus.cc:493] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.010044 12929 raft_consensus.cc:515] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:07.010630 12923 consensus_queue.cc:1048] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.012053 12929 leader_election.cc:290] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 0326743a82cc473d8ed3fe0a55739371 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191)
I20260709 13:05:07.012892 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffe8e9b6ec2482b8e6698ab57bac604" candidate_uuid: "0326743a82cc473d8ed3fe0a55739371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b" is_pre_election: true
I20260709 13:05:07.013103 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffe8e9b6ec2482b8e6698ab57bac604" candidate_uuid: "0326743a82cc473d8ed3fe0a55739371" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63cb25bafe234674bb565bce1f4f1165" is_pre_election: true
I20260709 13:05:07.015159 12770 leader_election.cc:304] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 0326743a82cc473d8ed3fe0a55739371 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371; no voters: 63cb25bafe234674bb565bce1f4f1165, 79ed44dc9d5c41eea3c6823463824f7b
I20260709 13:05:07.016515 12929 raft_consensus.cc:2749] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:07.023280 12804 raft_consensus.cc:3060] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.033388 12955 consensus_queue.cc:1048] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.056861 12729 raft_consensus.cc:3060] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.062417 12955 consensus_queue.cc:1048] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.076249 12955 consensus_queue.cc:1048] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.124444 12962 consensus_queue.cc:1048] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.137914 12962 consensus_queue.cc:1048] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.148653 12962 consensus_queue.cc:1048] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.154951 12878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "890890786d914eb1b5b9320f4b44ef72"
dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
mode: GRACEFUL
new_leader_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
 from {username='slave'} at 127.0.0.1:46946
I20260709 13:05:07.155665 12878 raft_consensus.cc:606] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 1 LEADER]: Received request to transfer leadership to TS 79ed44dc9d5c41eea3c6823463824f7b
I20260709 13:05:07.164368 12877 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dca1bea92694b299ce398c63da689e2"
dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
mode: GRACEFUL
new_leader_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
 from {username='slave'} at 127.0.0.1:46946
I20260709 13:05:07.165043 12877 raft_consensus.cc:606] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 1 LEADER]: Received request to transfer leadership to TS 79ed44dc9d5c41eea3c6823463824f7b
I20260709 13:05:07.167692 12803 raft_consensus.cc:3060] T 280a1b9b1db447cf8fc2d88b199b7a82 P 0326743a82cc473d8ed3fe0a55739371 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.173421 12966 consensus_queue.cc:1048] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.175565 12966 consensus_queue.cc:1048] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.185554 12877 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ffbf58766f147a7810738b9963ab238"
dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
mode: GRACEFUL
new_leader_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
 from {username='slave'} at 127.0.0.1:46946
I20260709 13:05:07.186259 12877 raft_consensus.cc:606] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 1 LEADER]: Received request to transfer leadership to TS 79ed44dc9d5c41eea3c6823463824f7b
I20260709 13:05:07.201485 12962 consensus_queue.cc:1048] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:07.220019 12729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60751a71baea43abac2fca83e8a6dd4f"
dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
mode: GRACEFUL
new_leader_uuid: "0326743a82cc473d8ed3fe0a55739371"
 from {username='slave'} at 127.0.0.1:34454
I20260709 13:05:07.220650 12729 raft_consensus.cc:606] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 1 LEADER]: Received request to transfer leadership to TS 0326743a82cc473d8ed3fe0a55739371
I20260709 13:05:07.227300 12878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10a29ce65f52462ca9512d6224788249"
dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
mode: GRACEFUL
new_leader_uuid: "0326743a82cc473d8ed3fe0a55739371"
 from {username='slave'} at 127.0.0.1:46946
I20260709 13:05:07.228073 12878 raft_consensus.cc:606] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 1 LEADER]: Received request to transfer leadership to TS 0326743a82cc473d8ed3fe0a55739371
I20260709 13:05:07.233403 12729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "280a1b9b1db447cf8fc2d88b199b7a82"
dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
mode: GRACEFUL
new_leader_uuid: "0326743a82cc473d8ed3fe0a55739371"
 from {username='slave'} at 127.0.0.1:34454
I20260709 13:05:07.233929 12729 raft_consensus.cc:606] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 LEADER]: Received request to transfer leadership to TS 0326743a82cc473d8ed3fe0a55739371
I20260709 13:05:07.238708 12729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afb03269b69b4e18b194b0483dc85796"
dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
mode: GRACEFUL
new_leader_uuid: "0326743a82cc473d8ed3fe0a55739371"
 from {username='slave'} at 127.0.0.1:34454
I20260709 13:05:07.239188 12729 raft_consensus.cc:606] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 LEADER]: Received request to transfer leadership to TS 0326743a82cc473d8ed3fe0a55739371
I20260709 13:05:07.280480 12955 consensus_queue.cc:1048] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.285434 12943 raft_consensus.cc:993] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165: : Instructing follower 79ed44dc9d5c41eea3c6823463824f7b to start an election
I20260709 13:05:07.285866 12943 raft_consensus.cc:1081] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 1 LEADER]: Signalling peer 79ed44dc9d5c41eea3c6823463824f7b to start an election
I20260709 13:05:07.287659 12729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "890890786d914eb1b5b9320f4b44ef72"
dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
 from {username='slave'} at 127.0.0.1:34444
I20260709 13:05:07.288254 12729 raft_consensus.cc:493] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:07.288610 12729 raft_consensus.cc:3060] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.289014 12955 raft_consensus.cc:993] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165: : Instructing follower 0326743a82cc473d8ed3fe0a55739371 to start an election
I20260709 13:05:07.289398 12955 raft_consensus.cc:1081] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 1 LEADER]: Signalling peer 0326743a82cc473d8ed3fe0a55739371 to start an election
I20260709 13:05:07.292001 12803 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10a29ce65f52462ca9512d6224788249"
dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
 from {username='slave'} at 127.0.0.1:33036
I20260709 13:05:07.292526 12803 raft_consensus.cc:493] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:07.292883 12803 raft_consensus.cc:3060] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.295593 12923 consensus_queue.cc:1048] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.298271 12729 raft_consensus.cc:515] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:07.300870 12729 leader_election.cc:290] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 2 election: Requested vote from peers 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657), 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191)
I20260709 13:05:07.301833 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890890786d914eb1b5b9320f4b44ef72" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
I20260709 13:05:07.302404 12878 raft_consensus.cc:3055] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:07.302723 12878 raft_consensus.cc:740] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63cb25bafe234674bb565bce1f4f1165, State: Running, Role: LEADER
I20260709 13:05:07.302577 12803 raft_consensus.cc:515] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:07.303651 12878 consensus_queue.cc:260] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:07.304454 12803 leader_election.cc:290] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [CANDIDATE]: Term 2 election: Requested vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191)
I20260709 13:05:07.304828 12878 raft_consensus.cc:3060] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.305526 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a29ce65f52462ca9512d6224788249" candidate_uuid: "0326743a82cc473d8ed3fe0a55739371" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
I20260709 13:05:07.306103 12877 raft_consensus.cc:3055] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:07.306401 12877 raft_consensus.cc:740] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63cb25bafe234674bb565bce1f4f1165, State: Running, Role: LEADER
I20260709 13:05:07.307165 12877 consensus_queue.cc:260] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:07.307938 12804 raft_consensus.cc:1240] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Rejecting Update request from peer 63cb25bafe234674bb565bce1f4f1165 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:07.308091 12877 raft_consensus.cc:3060] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.308964 12729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a29ce65f52462ca9512d6224788249" candidate_uuid: "0326743a82cc473d8ed3fe0a55739371" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
I20260709 13:05:07.310454 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890890786d914eb1b5b9320f4b44ef72" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
I20260709 13:05:07.311022 12803 raft_consensus.cc:3060] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.315299 12877 raft_consensus.cc:2468] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0326743a82cc473d8ed3fe0a55739371 in term 2.
I20260709 13:05:07.317358 12803 raft_consensus.cc:2468] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 2.
I20260709 13:05:07.317677 12770 leader_election.cc:304] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371, 63cb25bafe234674bb565bce1f4f1165; no voters: 79ed44dc9d5c41eea3c6823463824f7b
I20260709 13:05:07.318423 12693 leader_election.cc:304] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371, 79ed44dc9d5c41eea3c6823463824f7b; no voters: 
I20260709 13:05:07.316083 12878 raft_consensus.cc:2468] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 2.
I20260709 13:05:07.319569 12962 raft_consensus.cc:2804] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:07.320022 12962 raft_consensus.cc:697] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 LEADER]: Becoming Leader. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Running, Role: LEADER
I20260709 13:05:07.318445 12929 raft_consensus.cc:2804] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:07.320797 12962 consensus_queue.cc:237] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:07.321941 12929 raft_consensus.cc:697] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 2 LEADER]: Becoming Leader. State: Replica: 0326743a82cc473d8ed3fe0a55739371, State: Running, Role: LEADER
I20260709 13:05:07.322721 12929 consensus_queue.cc:237] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:07.330432 12623 catalog_manager.cc:5697] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 reported cstate change: term changed from 1 to 2, leader changed from 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131) to 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130). New cstate: current_term: 2 leader_uuid: "0326743a82cc473d8ed3fe0a55739371" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.345570 12624 catalog_manager.cc:5697] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b reported cstate change: term changed from 1 to 2, leader changed from 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131) to 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129). New cstate: current_term: 2 leader_uuid: "79ed44dc9d5c41eea3c6823463824f7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.461339 12962 consensus_queue.cc:1048] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.468542 12966 raft_consensus.cc:993] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b: : Instructing follower 0326743a82cc473d8ed3fe0a55739371 to start an election
I20260709 13:05:07.469117 12966 raft_consensus.cc:1081] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 1 LEADER]: Signalling peer 0326743a82cc473d8ed3fe0a55739371 to start an election
I20260709 13:05:07.471442 12804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60751a71baea43abac2fca83e8a6dd4f"
dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
 from {username='slave'} at 127.0.0.1:33044
I20260709 13:05:07.472124 12804 raft_consensus.cc:493] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:07.472589 12804 raft_consensus.cc:3060] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.476210 12966 consensus_queue.cc:1048] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:07.479727 12804 raft_consensus.cc:515] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:07.482440 12804 leader_election.cc:290] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [CANDIDATE]: Term 2 election: Requested vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191)
I20260709 13:05:07.483094 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60751a71baea43abac2fca83e8a6dd4f" candidate_uuid: "0326743a82cc473d8ed3fe0a55739371" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
I20260709 13:05:07.483942 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60751a71baea43abac2fca83e8a6dd4f" candidate_uuid: "0326743a82cc473d8ed3fe0a55739371" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
I20260709 13:05:07.484465 12728 raft_consensus.cc:3055] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:07.484745 12728 raft_consensus.cc:740] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Running, Role: LEADER
I20260709 13:05:07.485452 12728 consensus_queue.cc:260] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:07.486321 12728 raft_consensus.cc:3060] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.488170 12803 raft_consensus.cc:1240] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Rejecting Update request from peer 79ed44dc9d5c41eea3c6823463824f7b for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:07.493852 12728 raft_consensus.cc:2468] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0326743a82cc473d8ed3fe0a55739371 in term 2.
I20260709 13:05:07.495532 12767 leader_election.cc:304] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371, 79ed44dc9d5c41eea3c6823463824f7b; no voters: 63cb25bafe234674bb565bce1f4f1165
I20260709 13:05:07.497150 12929 raft_consensus.cc:2804] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:07.497639 12929 raft_consensus.cc:697] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [term 2 LEADER]: Becoming Leader. State: Replica: 0326743a82cc473d8ed3fe0a55739371, State: Running, Role: LEADER
I20260709 13:05:07.498461 12929 consensus_queue.cc:237] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:07.507128 12955 raft_consensus.cc:993] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165: : Instructing follower 79ed44dc9d5c41eea3c6823463824f7b to start an election
I20260709 13:05:07.507634 12955 raft_consensus.cc:1081] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 1 LEADER]: Signalling peer 79ed44dc9d5c41eea3c6823463824f7b to start an election
I20260709 13:05:07.507951 12623 catalog_manager.cc:5697] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 reported cstate change: term changed from 1 to 2, leader changed from 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129) to 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130). New cstate: current_term: 2 leader_uuid: "0326743a82cc473d8ed3fe0a55739371" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.509559 12728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ffbf58766f147a7810738b9963ab238"
dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
 from {username='slave'} at 127.0.0.1:34444
I20260709 13:05:07.510136 12728 raft_consensus.cc:493] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:07.510507 12728 raft_consensus.cc:3060] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.517508 12728 raft_consensus.cc:515] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:07.520145 12728 leader_election.cc:290] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 2 election: Requested vote from peers 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657), 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191)
I20260709 13:05:07.520323 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ffbf58766f147a7810738b9963ab238" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
I20260709 13:05:07.520965 12803 raft_consensus.cc:3060] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.522382 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ffbf58766f147a7810738b9963ab238" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
I20260709 13:05:07.522881 12878 raft_consensus.cc:3055] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:07.523140 12878 raft_consensus.cc:740] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63cb25bafe234674bb565bce1f4f1165, State: Running, Role: LEADER
I20260709 13:05:07.523881 12878 consensus_queue.cc:260] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:07.524745 12878 raft_consensus.cc:3060] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.527235 12803 raft_consensus.cc:2468] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 2.
I20260709 13:05:07.528436 12693 leader_election.cc:304] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371, 79ed44dc9d5c41eea3c6823463824f7b; no voters: 
I20260709 13:05:07.529222 12962 raft_consensus.cc:2804] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:07.529321 12878 raft_consensus.cc:2468] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 2.
I20260709 13:05:07.529726 12962 raft_consensus.cc:697] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 LEADER]: Becoming Leader. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Running, Role: LEADER
I20260709 13:05:07.530542 12962 consensus_queue.cc:237] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:07.536866 12624 catalog_manager.cc:5697] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b reported cstate change: term changed from 1 to 2, leader changed from 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131) to 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129). New cstate: current_term: 2 leader_uuid: "79ed44dc9d5c41eea3c6823463824f7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.645781 12955 raft_consensus.cc:993] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165: : Instructing follower 79ed44dc9d5c41eea3c6823463824f7b to start an election
I20260709 13:05:07.646219 12955 raft_consensus.cc:1081] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 1 LEADER]: Signalling peer 79ed44dc9d5c41eea3c6823463824f7b to start an election
I20260709 13:05:07.647688 12728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8dca1bea92694b299ce398c63da689e2"
dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
 from {username='slave'} at 127.0.0.1:34444
I20260709 13:05:07.648137 12728 raft_consensus.cc:493] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:07.648480 12728 raft_consensus.cc:3060] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.653055 12728 raft_consensus.cc:515] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:07.654548 12728 leader_election.cc:290] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 2 election: Requested vote from peers 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657), 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191)
I20260709 13:05:07.655400 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca1bea92694b299ce398c63da689e2" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
I20260709 13:05:07.655645 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca1bea92694b299ce398c63da689e2" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
I20260709 13:05:07.655965 12803 raft_consensus.cc:3060] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.656206 12878 raft_consensus.cc:3055] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:07.656562 12878 raft_consensus.cc:740] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63cb25bafe234674bb565bce1f4f1165, State: Running, Role: LEADER
I20260709 13:05:07.657289 12878 consensus_queue.cc:260] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:07.658155 12878 raft_consensus.cc:3060] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.660826 12803 raft_consensus.cc:2468] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 2.
I20260709 13:05:07.661777 12693 leader_election.cc:304] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371, 79ed44dc9d5c41eea3c6823463824f7b; no voters: 
I20260709 13:05:07.662549 12962 raft_consensus.cc:2804] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:07.662710 12878 raft_consensus.cc:2468] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 2.
I20260709 13:05:07.662954 12962 raft_consensus.cc:697] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 LEADER]: Becoming Leader. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Running, Role: LEADER
I20260709 13:05:07.663870 12962 consensus_queue.cc:237] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:07.669824 12624 catalog_manager.cc:5697] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b reported cstate change: term changed from 1 to 2, leader changed from 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131) to 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129). New cstate: current_term: 2 leader_uuid: "79ed44dc9d5c41eea3c6823463824f7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.762722 12966 raft_consensus.cc:993] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b: : Instructing follower 0326743a82cc473d8ed3fe0a55739371 to start an election
I20260709 13:05:07.763149 12962 raft_consensus.cc:1081] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 LEADER]: Signalling peer 0326743a82cc473d8ed3fe0a55739371 to start an election
I20260709 13:05:07.764755 12803 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "280a1b9b1db447cf8fc2d88b199b7a82"
dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
 from {username='slave'} at 127.0.0.1:33044
I20260709 13:05:07.765300 12803 raft_consensus.cc:493] T 280a1b9b1db447cf8fc2d88b199b7a82 P 0326743a82cc473d8ed3fe0a55739371 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:07.765666 12803 raft_consensus.cc:3060] T 280a1b9b1db447cf8fc2d88b199b7a82 P 0326743a82cc473d8ed3fe0a55739371 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.770117 12803 raft_consensus.cc:515] T 280a1b9b1db447cf8fc2d88b199b7a82 P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:07.771705 12803 leader_election.cc:290] T 280a1b9b1db447cf8fc2d88b199b7a82 P 0326743a82cc473d8ed3fe0a55739371 [CANDIDATE]: Term 2 election: Requested vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191)
I20260709 13:05:07.772572 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "280a1b9b1db447cf8fc2d88b199b7a82" candidate_uuid: "0326743a82cc473d8ed3fe0a55739371" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
I20260709 13:05:07.772660 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "280a1b9b1db447cf8fc2d88b199b7a82" candidate_uuid: "0326743a82cc473d8ed3fe0a55739371" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
I20260709 13:05:07.773253 12728 raft_consensus.cc:3055] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:07.773351 12878 raft_consensus.cc:3060] T 280a1b9b1db447cf8fc2d88b199b7a82 P 63cb25bafe234674bb565bce1f4f1165 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.773562 12728 raft_consensus.cc:740] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Running, Role: LEADER
I20260709 13:05:07.774389 12728 consensus_queue.cc:260] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:07.775442 12728 raft_consensus.cc:3060] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.778088 12878 raft_consensus.cc:2468] T 280a1b9b1db447cf8fc2d88b199b7a82 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0326743a82cc473d8ed3fe0a55739371 in term 2.
I20260709 13:05:07.779089 12770 leader_election.cc:304] T 280a1b9b1db447cf8fc2d88b199b7a82 P 0326743a82cc473d8ed3fe0a55739371 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371, 63cb25bafe234674bb565bce1f4f1165; no voters: 
I20260709 13:05:07.779913 12929 raft_consensus.cc:2804] T 280a1b9b1db447cf8fc2d88b199b7a82 P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:07.780151 12728 raft_consensus.cc:2468] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0326743a82cc473d8ed3fe0a55739371 in term 2.
I20260709 13:05:07.780354 12929 raft_consensus.cc:697] T 280a1b9b1db447cf8fc2d88b199b7a82 P 0326743a82cc473d8ed3fe0a55739371 [term 2 LEADER]: Becoming Leader. State: Replica: 0326743a82cc473d8ed3fe0a55739371, State: Running, Role: LEADER
I20260709 13:05:07.781520 12929 consensus_queue.cc:237] T 280a1b9b1db447cf8fc2d88b199b7a82 P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:07.786216 12967 raft_consensus.cc:993] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b: : Instructing follower 0326743a82cc473d8ed3fe0a55739371 to start an election
I20260709 13:05:07.786665 12962 raft_consensus.cc:1081] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 LEADER]: Signalling peer 0326743a82cc473d8ed3fe0a55739371 to start an election
I20260709 13:05:07.789870 12623 catalog_manager.cc:5697] T 280a1b9b1db447cf8fc2d88b199b7a82 P 0326743a82cc473d8ed3fe0a55739371 reported cstate change: term changed from 1 to 2, leader changed from 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129) to 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130). New cstate: current_term: 2 leader_uuid: "0326743a82cc473d8ed3fe0a55739371" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.790639 12803 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afb03269b69b4e18b194b0483dc85796"
dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
 from {username='slave'} at 127.0.0.1:33044
I20260709 13:05:07.791273 12803 raft_consensus.cc:493] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:07.791694 12803 raft_consensus.cc:3060] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.796926 12803 raft_consensus.cc:515] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:07.799026 12803 leader_election.cc:290] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [CANDIDATE]: Term 2 election: Requested vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191)
I20260709 13:05:07.799865 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb03269b69b4e18b194b0483dc85796" candidate_uuid: "0326743a82cc473d8ed3fe0a55739371" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
I20260709 13:05:07.799935 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb03269b69b4e18b194b0483dc85796" candidate_uuid: "0326743a82cc473d8ed3fe0a55739371" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
I20260709 13:05:07.800595 12878 raft_consensus.cc:3060] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.800544 12728 raft_consensus.cc:3055] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:07.801007 12728 raft_consensus.cc:740] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Running, Role: LEADER
I20260709 13:05:07.801816 12728 consensus_queue.cc:260] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:07.803048 12728 raft_consensus.cc:3060] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.808902 12877 raft_consensus.cc:1275] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Refusing update from remote peer 0326743a82cc473d8ed3fe0a55739371: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.809080 12878 raft_consensus.cc:2468] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0326743a82cc473d8ed3fe0a55739371 in term 2.
I20260709 13:05:07.810315 12770 leader_election.cc:304] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371, 63cb25bafe234674bb565bce1f4f1165; no voters: 
I20260709 13:05:07.810185 12929 consensus_queue.cc:1048] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.811076 13002 raft_consensus.cc:2804] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:07.811622 13002 raft_consensus.cc:697] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [term 2 LEADER]: Becoming Leader. State: Replica: 0326743a82cc473d8ed3fe0a55739371, State: Running, Role: LEADER
I20260709 13:05:07.812206 12728 raft_consensus.cc:2468] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0326743a82cc473d8ed3fe0a55739371 in term 2.
I20260709 13:05:07.812424 13002 consensus_queue.cc:237] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:07.820834 12624 catalog_manager.cc:5697] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 reported cstate change: term changed from 1 to 2, leader changed from 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129) to 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130). New cstate: current_term: 2 leader_uuid: "0326743a82cc473d8ed3fe0a55739371" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.828974 12728 raft_consensus.cc:3060] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.835093 12728 raft_consensus.cc:1275] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Refusing update from remote peer 0326743a82cc473d8ed3fe0a55739371: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.836405 13002 consensus_queue.cc:1048] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.843405 12803 raft_consensus.cc:1275] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Refusing update from remote peer 79ed44dc9d5c41eea3c6823463824f7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.844777 12962 consensus_queue.cc:1048] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.853688 12878 raft_consensus.cc:1275] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Refusing update from remote peer 79ed44dc9d5c41eea3c6823463824f7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.855230 12962 consensus_queue.cc:1048] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:05:07.916803 12803 raft_consensus.cc:1275] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Refusing update from remote peer 79ed44dc9d5c41eea3c6823463824f7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.918071 12962 consensus_queue.cc:1048] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.927105 12878 raft_consensus.cc:1275] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Refusing update from remote peer 79ed44dc9d5c41eea3c6823463824f7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.927278 12877 raft_consensus.cc:3060] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.928943 12962 consensus_queue.cc:1048] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.935513 12877 raft_consensus.cc:1275] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Refusing update from remote peer 0326743a82cc473d8ed3fe0a55739371: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.936899 13002 consensus_queue.cc:1048] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.945477 12728 raft_consensus.cc:1275] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Refusing update from remote peer 0326743a82cc473d8ed3fe0a55739371: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.947177 13002 consensus_queue.cc:1048] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.065956 12803 raft_consensus.cc:1275] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Refusing update from remote peer 79ed44dc9d5c41eea3c6823463824f7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.067291 12962 consensus_queue.cc:1048] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.078240 12877 raft_consensus.cc:1275] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Refusing update from remote peer 79ed44dc9d5c41eea3c6823463824f7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.080462 12966 consensus_queue.cc:1048] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.238773 12728 raft_consensus.cc:1275] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Refusing update from remote peer 0326743a82cc473d8ed3fe0a55739371: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.240015 13002 consensus_queue.cc:1048] T 280a1b9b1db447cf8fc2d88b199b7a82 P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.248343 12877 raft_consensus.cc:1275] T 280a1b9b1db447cf8fc2d88b199b7a82 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Refusing update from remote peer 0326743a82cc473d8ed3fe0a55739371: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.249903 13002 consensus_queue.cc:1048] T 280a1b9b1db447cf8fc2d88b199b7a82 P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:08.349164 12728 raft_consensus.cc:1275] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Refusing update from remote peer 0326743a82cc473d8ed3fe0a55739371: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.350395 13002 consensus_queue.cc:1048] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.358780 12877 raft_consensus.cc:1275] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Refusing update from remote peer 0326743a82cc473d8ed3fe0a55739371: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.360633 13006 consensus_queue.cc:1048] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:10.272082 12594 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:05:10.273164 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:10.292789 12804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10a29ce65f52462ca9512d6224788249"
dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
mode: GRACEFUL
new_leader_uuid: "63cb25bafe234674bb565bce1f4f1165"
 from {username='slave'} at 127.0.0.1:33052
I20260709 13:05:10.293356 12804 raft_consensus.cc:606] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 2 LEADER]: Received request to transfer leadership to TS 63cb25bafe234674bb565bce1f4f1165
I20260709 13:05:10.303960 12728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "890890786d914eb1b5b9320f4b44ef72"
dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
mode: GRACEFUL
new_leader_uuid: "63cb25bafe234674bb565bce1f4f1165"
 from {username='slave'} at 127.0.0.1:34460
I20260709 13:05:10.304500 12728 raft_consensus.cc:606] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 LEADER]: Received request to transfer leadership to TS 63cb25bafe234674bb565bce1f4f1165
I20260709 13:05:10.305660 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:10.306097 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:10.683149 13019 raft_consensus.cc:993] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b: : Instructing follower 63cb25bafe234674bb565bce1f4f1165 to start an election
I20260709 13:05:10.683904 12966 raft_consensus.cc:1081] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 LEADER]: Signalling peer 63cb25bafe234674bb565bce1f4f1165 to start an election
I20260709 13:05:10.900665 12877 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "890890786d914eb1b5b9320f4b44ef72"
dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
 from {username='slave'} at 127.0.0.1:46942
I20260709 13:05:10.901732 12877 raft_consensus.cc:493] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:10.902844 12877 raft_consensus.cc:3060] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.906581 13021 raft_consensus.cc:993] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371: : Instructing follower 63cb25bafe234674bb565bce1f4f1165 to start an election
I20260709 13:05:10.907099 13023 raft_consensus.cc:1081] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 2 LEADER]: Signalling peer 63cb25bafe234674bb565bce1f4f1165 to start an election
I20260709 13:05:10.909897 12877 raft_consensus.cc:515] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:10.910776 12876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10a29ce65f52462ca9512d6224788249"
dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
 from {username='slave'} at 127.0.0.1:46928
I20260709 13:05:10.922462 12876 raft_consensus.cc:493] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:10.922912 12876 raft_consensus.cc:3060] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.929863 12876 raft_consensus.cc:515] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:10.931982 12877 leader_election.cc:290] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 3 election: Requested vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657)
I20260709 13:05:10.933286 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890890786d914eb1b5b9320f4b44ef72" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
I20260709 13:05:10.934543 12876 leader_election.cc:290] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 3 election: Requested vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657)
I20260709 13:05:10.934985 12728 raft_consensus.cc:3055] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:10.935756 12728 raft_consensus.cc:740] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Running, Role: LEADER
I20260709 13:05:10.936663 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a29ce65f52462ca9512d6224788249" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
I20260709 13:05:10.937275 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a29ce65f52462ca9512d6224788249" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
I20260709 13:05:10.937747 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890890786d914eb1b5b9320f4b44ef72" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
I20260709 13:05:10.938388 12802 raft_consensus.cc:3060] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.937899 12801 raft_consensus.cc:3055] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:10.943228 12801 raft_consensus.cc:740] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0326743a82cc473d8ed3fe0a55739371, State: Running, Role: LEADER
I20260709 13:05:10.944133 12801 consensus_queue.cc:260] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:10.944983 12802 raft_consensus.cc:2468] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63cb25bafe234674bb565bce1f4f1165 in term 3.
I20260709 13:05:10.945295 12801 raft_consensus.cc:3060] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.946143 12842 leader_election.cc:304] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371, 63cb25bafe234674bb565bce1f4f1165; no voters: 
I20260709 13:05:10.946880 12923 raft_consensus.cc:2804] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:10.937284 12727 raft_consensus.cc:3060] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.952070 12728 consensus_queue.cc:260] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:10.954459 12728 raft_consensus.cc:3060] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.955071 12801 raft_consensus.cc:2468] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63cb25bafe234674bb565bce1f4f1165 in term 3.
I20260709 13:05:10.957255 12842 leader_election.cc:304] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371, 63cb25bafe234674bb565bce1f4f1165; no voters: 
I20260709 13:05:10.960453 13025 raft_consensus.cc:2804] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:10.956350 12923 raft_consensus.cc:697] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 3 LEADER]: Becoming Leader. State: Replica: 63cb25bafe234674bb565bce1f4f1165, State: Running, Role: LEADER
I20260709 13:05:10.960966 13025 raft_consensus.cc:697] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 3 LEADER]: Becoming Leader. State: Replica: 63cb25bafe234674bb565bce1f4f1165, State: Running, Role: LEADER
I20260709 13:05:10.961804 12727 raft_consensus.cc:2468] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63cb25bafe234674bb565bce1f4f1165 in term 3.
I20260709 13:05:10.961961 13025 consensus_queue.cc:237] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:10.961701 12923 consensus_queue.cc:237] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:10.964454 12728 raft_consensus.cc:2468] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63cb25bafe234674bb565bce1f4f1165 in term 3.
I20260709 13:05:10.972838 12876 raft_consensus.cc:1240] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 3 LEADER]: Rejecting Update request from peer 79ed44dc9d5c41eea3c6823463824f7b for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:10.981570 12623 catalog_manager.cc:5697] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 reported cstate change: term changed from 2 to 3, leader changed from 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129) to 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131). New cstate: current_term: 3 leader_uuid: "63cb25bafe234674bb565bce1f4f1165" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:10.982918 12623 catalog_manager.cc:5697] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 reported cstate change: term changed from 2 to 3, leader changed from 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130) to 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131). New cstate: current_term: 3 leader_uuid: "63cb25bafe234674bb565bce1f4f1165" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:11.478375 12728 raft_consensus.cc:1275] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b [term 3 FOLLOWER]: Refusing update from remote peer 63cb25bafe234674bb565bce1f4f1165: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:11.479555 13025 consensus_queue.cc:1048] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:11.489416 12801 raft_consensus.cc:1275] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 3 FOLLOWER]: Refusing update from remote peer 63cb25bafe234674bb565bce1f4f1165: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:11.490872 13036 consensus_queue.cc:1048] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:11.534129 12728 raft_consensus.cc:1275] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [term 3 FOLLOWER]: Refusing update from remote peer 63cb25bafe234674bb565bce1f4f1165: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:11.535627 13036 consensus_queue.cc:1048] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:11.544479 12801 raft_consensus.cc:1275] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [term 3 FOLLOWER]: Refusing update from remote peer 63cb25bafe234674bb565bce1f4f1165: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:11.545835 13025 consensus_queue.cc:1048] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:11.785756 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:11.795914 12728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9427963bcadf4b2395fd95d57b3a33b7"
dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
mode: GRACEFUL
new_leader_uuid: "0326743a82cc473d8ed3fe0a55739371"
 from {username='slave'} at 127.0.0.1:34454
I20260709 13:05:11.796417 12728 raft_consensus.cc:606] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 LEADER]: Received request to transfer leadership to TS 0326743a82cc473d8ed3fe0a55739371
I20260709 13:05:11.801335 12876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "890890786d914eb1b5b9320f4b44ef72"
dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
mode: GRACEFUL
new_leader_uuid: "0326743a82cc473d8ed3fe0a55739371"
 from {username='slave'} at 127.0.0.1:46946
I20260709 13:05:11.801822 12876 raft_consensus.cc:606] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 3 LEADER]: Received request to transfer leadership to TS 0326743a82cc473d8ed3fe0a55739371
I20260709 13:05:11.806505 12728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dca1bea92694b299ce398c63da689e2"
dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
mode: GRACEFUL
new_leader_uuid: "0326743a82cc473d8ed3fe0a55739371"
 from {username='slave'} at 127.0.0.1:34454
I20260709 13:05:11.807015 12728 raft_consensus.cc:606] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 LEADER]: Received request to transfer leadership to TS 0326743a82cc473d8ed3fe0a55739371
I20260709 13:05:11.811573 12728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ffbf58766f147a7810738b9963ab238"
dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
mode: GRACEFUL
new_leader_uuid: "0326743a82cc473d8ed3fe0a55739371"
 from {username='slave'} at 127.0.0.1:34454
I20260709 13:05:11.812074 12728 raft_consensus.cc:606] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 LEADER]: Received request to transfer leadership to TS 0326743a82cc473d8ed3fe0a55739371
I20260709 13:05:11.819231 12876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10a29ce65f52462ca9512d6224788249"
dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
mode: GRACEFUL
new_leader_uuid: "0326743a82cc473d8ed3fe0a55739371"
 from {username='slave'} at 127.0.0.1:46946
I20260709 13:05:11.819494 12966 raft_consensus.cc:993] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b: : Instructing follower 0326743a82cc473d8ed3fe0a55739371 to start an election
I20260709 13:05:11.819784 12876 raft_consensus.cc:606] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 3 LEADER]: Received request to transfer leadership to TS 0326743a82cc473d8ed3fe0a55739371
I20260709 13:05:11.819973 13039 raft_consensus.cc:1081] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 LEADER]: Signalling peer 0326743a82cc473d8ed3fe0a55739371 to start an election
I20260709 13:05:11.821524 12801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ffbf58766f147a7810738b9963ab238"
dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
 from {username='slave'} at 127.0.0.1:33044
I20260709 13:05:11.821960 12801 raft_consensus.cc:493] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:11.822304 12801 raft_consensus.cc:3060] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:11.828066 12801 raft_consensus.cc:515] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:11.830044 12801 leader_election.cc:290] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [CANDIDATE]: Term 3 election: Requested vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191)
I20260709 13:05:11.830961 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ffbf58766f147a7810738b9963ab238" candidate_uuid: "0326743a82cc473d8ed3fe0a55739371" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
I20260709 13:05:11.830961 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ffbf58766f147a7810738b9963ab238" candidate_uuid: "0326743a82cc473d8ed3fe0a55739371" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
I20260709 13:05:11.831708 12728 raft_consensus.cc:3055] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:11.831758 12876 raft_consensus.cc:3060] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:11.831990 12728 raft_consensus.cc:740] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Running, Role: LEADER
I20260709 13:05:11.832743 12728 consensus_queue.cc:260] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:11.833531 12728 raft_consensus.cc:3060] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:11.836506 12876 raft_consensus.cc:2468] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0326743a82cc473d8ed3fe0a55739371 in term 3.
I20260709 13:05:11.837509 12728 raft_consensus.cc:2468] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0326743a82cc473d8ed3fe0a55739371 in term 3.
I20260709 13:05:11.837563 12770 leader_election.cc:304] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371, 63cb25bafe234674bb565bce1f4f1165; no voters: 
I20260709 13:05:11.838384 12929 raft_consensus.cc:2804] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:11.839604 12929 raft_consensus.cc:697] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [term 3 LEADER]: Becoming Leader. State: Replica: 0326743a82cc473d8ed3fe0a55739371, State: Running, Role: LEADER
I20260709 13:05:11.840469 12929 consensus_queue.cc:237] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:11.841509 12966 raft_consensus.cc:993] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b: : Instructing follower 0326743a82cc473d8ed3fe0a55739371 to start an election
I20260709 13:05:11.841939 13039 raft_consensus.cc:1081] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 LEADER]: Signalling peer 0326743a82cc473d8ed3fe0a55739371 to start an election
I20260709 13:05:11.843501 12801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8dca1bea92694b299ce398c63da689e2"
dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
 from {username='slave'} at 127.0.0.1:33044
I20260709 13:05:11.844143 12801 raft_consensus.cc:493] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:11.844565 12801 raft_consensus.cc:3060] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:11.847736 12624 catalog_manager.cc:5697] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 reported cstate change: term changed from 2 to 3, leader changed from 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129) to 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130). New cstate: current_term: 3 leader_uuid: "0326743a82cc473d8ed3fe0a55739371" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:11.849862 12801 raft_consensus.cc:515] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:11.852191 12801 leader_election.cc:290] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [CANDIDATE]: Term 3 election: Requested vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191)
I20260709 13:05:11.852723 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca1bea92694b299ce398c63da689e2" candidate_uuid: "0326743a82cc473d8ed3fe0a55739371" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
I20260709 13:05:11.853228 12728 raft_consensus.cc:3055] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:11.853163 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca1bea92694b299ce398c63da689e2" candidate_uuid: "0326743a82cc473d8ed3fe0a55739371" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
I20260709 13:05:11.853600 12728 raft_consensus.cc:740] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Running, Role: LEADER
I20260709 13:05:11.853783 12876 raft_consensus.cc:3060] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:11.854310 12728 consensus_queue.cc:260] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:11.855405 12728 raft_consensus.cc:3060] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:11.860196 12876 raft_consensus.cc:2468] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0326743a82cc473d8ed3fe0a55739371 in term 3.
I20260709 13:05:11.861346 12728 raft_consensus.cc:2468] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0326743a82cc473d8ed3fe0a55739371 in term 3.
I20260709 13:05:11.861393 12770 leader_election.cc:304] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371, 63cb25bafe234674bb565bce1f4f1165; no voters: 
I20260709 13:05:11.862282 12929 raft_consensus.cc:2804] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:11.862737 12929 raft_consensus.cc:697] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 3 LEADER]: Becoming Leader. State: Replica: 0326743a82cc473d8ed3fe0a55739371, State: Running, Role: LEADER
I20260709 13:05:11.863529 12929 consensus_queue.cc:237] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:11.870363 12624 catalog_manager.cc:5697] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 reported cstate change: term changed from 2 to 3, leader changed from 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129) to 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130). New cstate: current_term: 3 leader_uuid: "0326743a82cc473d8ed3fe0a55739371" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:11.878700 12899 debug-util.cc:398] Leaking SignalData structure 0x7b080016c060 after lost signal to thread 12597
W20260709 13:05:11.879403 12899 debug-util.cc:398] Leaking SignalData structure 0x7b080016c740 after lost signal to thread 12660
W20260709 13:05:11.880165 12899 debug-util.cc:398] Leaking SignalData structure 0x7b0800107520 after lost signal to thread 12753
W20260709 13:05:11.880854 12899 debug-util.cc:398] Leaking SignalData structure 0x7b08001ec340 after lost signal to thread 12828
W20260709 13:05:11.881543 12899 debug-util.cc:398] Leaking SignalData structure 0x7b08000ed1e0 after lost signal to thread 12902
I20260709 13:05:11.988333 12966 raft_consensus.cc:993] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b: : Instructing follower 0326743a82cc473d8ed3fe0a55739371 to start an election
I20260709 13:05:11.988826 13039 raft_consensus.cc:1081] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 LEADER]: Signalling peer 0326743a82cc473d8ed3fe0a55739371 to start an election
I20260709 13:05:11.990218 12801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9427963bcadf4b2395fd95d57b3a33b7"
dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
 from {username='slave'} at 127.0.0.1:33044
I20260709 13:05:11.990688 12801 raft_consensus.cc:493] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:11.991014 12801 raft_consensus.cc:3060] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:11.995304 12801 raft_consensus.cc:515] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } }
I20260709 13:05:11.997090 12801 leader_election.cc:290] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371 [CANDIDATE]: Term 2 election: Requested vote from peers 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191), 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503)
I20260709 13:05:11.998310 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9427963bcadf4b2395fd95d57b3a33b7" candidate_uuid: "0326743a82cc473d8ed3fe0a55739371" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
I20260709 13:05:11.998908 12876 raft_consensus.cc:3060] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:12.000101 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9427963bcadf4b2395fd95d57b3a33b7" candidate_uuid: "0326743a82cc473d8ed3fe0a55739371" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
I20260709 13:05:12.000752 12728 raft_consensus.cc:3055] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:12.001070 12728 raft_consensus.cc:740] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Running, Role: LEADER
I20260709 13:05:12.001820 12728 consensus_queue.cc:260] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } }
I20260709 13:05:12.003013 12728 raft_consensus.cc:3060] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:12.003871 12876 raft_consensus.cc:2468] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0326743a82cc473d8ed3fe0a55739371 in term 2.
I20260709 13:05:12.004829 12770 leader_election.cc:304] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371, 63cb25bafe234674bb565bce1f4f1165; no voters: 
I20260709 13:05:12.005481 13043 raft_consensus.cc:2804] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:12.005911 13043 raft_consensus.cc:697] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371 [term 2 LEADER]: Becoming Leader. State: Replica: 0326743a82cc473d8ed3fe0a55739371, State: Running, Role: LEADER
I20260709 13:05:12.006681 13043 consensus_queue.cc:237] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } }
I20260709 13:05:12.009531 12728 raft_consensus.cc:2468] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0326743a82cc473d8ed3fe0a55739371 in term 2.
I20260709 13:05:12.013908 12624 catalog_manager.cc:5697] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371 reported cstate change: term changed from 1 to 2, leader changed from 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129) to 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130). New cstate: current_term: 2 leader_uuid: "0326743a82cc473d8ed3fe0a55739371" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.100626 13050 raft_consensus.cc:993] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165: : Instructing follower 0326743a82cc473d8ed3fe0a55739371 to start an election
I20260709 13:05:12.101194 13051 raft_consensus.cc:1081] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 3 LEADER]: Signalling peer 0326743a82cc473d8ed3fe0a55739371 to start an election
I20260709 13:05:12.102922 12801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10a29ce65f52462ca9512d6224788249"
dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
 from {username='slave'} at 127.0.0.1:33036
I20260709 13:05:12.103646 12801 raft_consensus.cc:493] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:12.104094 12801 raft_consensus.cc:3060] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:12.112720 12801 raft_consensus.cc:515] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:12.114369 13051 raft_consensus.cc:993] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165: : Instructing follower 0326743a82cc473d8ed3fe0a55739371 to start an election
I20260709 13:05:12.114849 13025 raft_consensus.cc:1081] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 3 LEADER]: Signalling peer 0326743a82cc473d8ed3fe0a55739371 to start an election
I20260709 13:05:12.116807 12802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "890890786d914eb1b5b9320f4b44ef72"
dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
 from {username='slave'} at 127.0.0.1:33036
I20260709 13:05:12.117035 12801 leader_election.cc:290] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [CANDIDATE]: Term 4 election: Requested vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191)
I20260709 13:05:12.117434 12802 raft_consensus.cc:493] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:12.117883 12802 raft_consensus.cc:3060] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:12.118382 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a29ce65f52462ca9512d6224788249" candidate_uuid: "0326743a82cc473d8ed3fe0a55739371" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
I20260709 13:05:12.118892 12728 raft_consensus.cc:3060] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:12.119472 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a29ce65f52462ca9512d6224788249" candidate_uuid: "0326743a82cc473d8ed3fe0a55739371" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
I20260709 13:05:12.119993 12876 raft_consensus.cc:3055] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:12.120271 12876 raft_consensus.cc:740] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 63cb25bafe234674bb565bce1f4f1165, State: Running, Role: LEADER
I20260709 13:05:12.121017 12876 consensus_queue.cc:260] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:12.122144 12876 raft_consensus.cc:3060] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:12.124830 12728 raft_consensus.cc:2468] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0326743a82cc473d8ed3fe0a55739371 in term 4.
I20260709 13:05:12.126047 12767 leader_election.cc:304] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371, 79ed44dc9d5c41eea3c6823463824f7b; no voters: 
I20260709 13:05:12.126120 12802 raft_consensus.cc:515] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:12.126967 13043 raft_consensus.cc:2804] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:12.127511 13043 raft_consensus.cc:697] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 4 LEADER]: Becoming Leader. State: Replica: 0326743a82cc473d8ed3fe0a55739371, State: Running, Role: LEADER
I20260709 13:05:12.128377 13043 consensus_queue.cc:237] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:12.129117 12728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890890786d914eb1b5b9320f4b44ef72" candidate_uuid: "0326743a82cc473d8ed3fe0a55739371" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
I20260709 13:05:12.129626 12728 raft_consensus.cc:3060] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:12.130411 12876 raft_consensus.cc:2468] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0326743a82cc473d8ed3fe0a55739371 in term 4.
I20260709 13:05:12.133658 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890890786d914eb1b5b9320f4b44ef72" candidate_uuid: "0326743a82cc473d8ed3fe0a55739371" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
I20260709 13:05:12.134649 12876 raft_consensus.cc:3055] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:12.135048 12876 raft_consensus.cc:740] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 63cb25bafe234674bb565bce1f4f1165, State: Running, Role: LEADER
I20260709 13:05:12.134164 12802 leader_election.cc:290] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [CANDIDATE]: Term 4 election: Requested vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191)
I20260709 13:05:12.136159 12728 raft_consensus.cc:2468] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0326743a82cc473d8ed3fe0a55739371 in term 4.
I20260709 13:05:12.136756 12876 consensus_queue.cc:260] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:12.137567 12767 leader_election.cc:304] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0326743a82cc473d8ed3fe0a55739371, 79ed44dc9d5c41eea3c6823463824f7b; no voters: 
I20260709 13:05:12.137974 12876 raft_consensus.cc:3060] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:12.138551 13043 raft_consensus.cc:2804] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:12.138110 12624 catalog_manager.cc:5697] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 reported cstate change: term changed from 3 to 4, leader changed from 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131) to 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130). New cstate: current_term: 4 leader_uuid: "0326743a82cc473d8ed3fe0a55739371" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.139390 13043 raft_consensus.cc:697] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [term 4 LEADER]: Becoming Leader. State: Replica: 0326743a82cc473d8ed3fe0a55739371, State: Running, Role: LEADER
I20260709 13:05:12.140363 13043 consensus_queue.cc:237] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:12.145061 12876 raft_consensus.cc:2468] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0326743a82cc473d8ed3fe0a55739371 in term 4.
I20260709 13:05:12.152513 12624 catalog_manager.cc:5697] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 reported cstate change: term changed from 3 to 4, leader changed from 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131) to 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130). New cstate: current_term: 4 leader_uuid: "0326743a82cc473d8ed3fe0a55739371" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.280193 12876 raft_consensus.cc:1275] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 3 FOLLOWER]: Refusing update from remote peer 0326743a82cc473d8ed3fe0a55739371: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:12.281410 13043 consensus_queue.cc:1048] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:12.292428 12728 raft_consensus.cc:1275] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [term 3 FOLLOWER]: Refusing update from remote peer 0326743a82cc473d8ed3fe0a55739371: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:12.294059 12929 consensus_queue.cc:1048] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:12.386181 12877 raft_consensus.cc:1275] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 3 FOLLOWER]: Refusing update from remote peer 0326743a82cc473d8ed3fe0a55739371: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:12.387570 13043 consensus_queue.cc:1048] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:12.396513 12728 raft_consensus.cc:1275] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 3 FOLLOWER]: Refusing update from remote peer 0326743a82cc473d8ed3fe0a55739371: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:12.398185 12929 consensus_queue.cc:1048] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:12.508795 12877 raft_consensus.cc:1275] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Refusing update from remote peer 0326743a82cc473d8ed3fe0a55739371: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:12.510068 12929 consensus_queue.cc:1048] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:12.518476 12728 raft_consensus.cc:1275] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Refusing update from remote peer 0326743a82cc473d8ed3fe0a55739371: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:12.520196 13054 consensus_queue.cc:1048] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:12.603545 12877 raft_consensus.cc:1275] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 4 FOLLOWER]: Refusing update from remote peer 0326743a82cc473d8ed3fe0a55739371: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:12.604966 13054 consensus_queue.cc:1048] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:12.613919 12728 raft_consensus.cc:1275] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b [term 4 FOLLOWER]: Refusing update from remote peer 0326743a82cc473d8ed3fe0a55739371: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:12.615664 13054 consensus_queue.cc:1048] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:05:12.633634 12877 raft_consensus.cc:1275] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 4 FOLLOWER]: Refusing update from remote peer 0326743a82cc473d8ed3fe0a55739371: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:12.634810 13055 consensus_queue.cc:1048] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:12.643602 12728 raft_consensus.cc:1275] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [term 4 FOLLOWER]: Refusing update from remote peer 0326743a82cc473d8ed3fe0a55739371: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:12.644863 13054 consensus_queue.cc:1048] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:14.830679 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:14.838124 12802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10a29ce65f52462ca9512d6224788249"
dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
mode: GRACEFUL
new_leader_uuid: "63cb25bafe234674bb565bce1f4f1165"
 from {username='slave'} at 127.0.0.1:33052
I20260709 13:05:14.838816 12802 raft_consensus.cc:606] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 4 LEADER]: Received request to transfer leadership to TS 63cb25bafe234674bb565bce1f4f1165
I20260709 13:05:14.841429 12802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60751a71baea43abac2fca83e8a6dd4f"
dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
mode: GRACEFUL
new_leader_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
 from {username='slave'} at 127.0.0.1:33052
I20260709 13:05:14.841878 12802 raft_consensus.cc:606] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [term 2 LEADER]: Received request to transfer leadership to TS 79ed44dc9d5c41eea3c6823463824f7b
I20260709 13:05:14.844332 12802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ffbf58766f147a7810738b9963ab238"
dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
mode: GRACEFUL
new_leader_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
 from {username='slave'} at 127.0.0.1:33052
I20260709 13:05:14.844787 12802 raft_consensus.cc:606] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [term 3 LEADER]: Received request to transfer leadership to TS 79ed44dc9d5c41eea3c6823463824f7b
I20260709 13:05:14.846933 12802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dca1bea92694b299ce398c63da689e2"
dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
mode: GRACEFUL
new_leader_uuid: "63cb25bafe234674bb565bce1f4f1165"
 from {username='slave'} at 127.0.0.1:33052
I20260709 13:05:14.847378 12802 raft_consensus.cc:606] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 3 LEADER]: Received request to transfer leadership to TS 63cb25bafe234674bb565bce1f4f1165
I20260709 13:05:14.849462 12802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afb03269b69b4e18b194b0483dc85796"
dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
mode: GRACEFUL
new_leader_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
 from {username='slave'} at 127.0.0.1:33052
I20260709 13:05:14.849874 12802 raft_consensus.cc:606] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [term 2 LEADER]: Received request to transfer leadership to TS 79ed44dc9d5c41eea3c6823463824f7b
I20260709 13:05:14.850914 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:14.851325 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:14.854900 13068 raft_consensus.cc:993] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371: : Instructing follower 79ed44dc9d5c41eea3c6823463824f7b to start an election
I20260709 13:05:14.855400 13069 raft_consensus.cc:1081] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [term 3 LEADER]: Signalling peer 79ed44dc9d5c41eea3c6823463824f7b to start an election
I20260709 13:05:14.856765 12727 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ffbf58766f147a7810738b9963ab238"
dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
 from {username='slave'} at 127.0.0.1:34452
I20260709 13:05:14.857169 12727 raft_consensus.cc:493] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:14.857439 12727 raft_consensus.cc:3060] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:14.862439 12727 raft_consensus.cc:515] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:14.865557 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ffbf58766f147a7810738b9963ab238" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
I20260709 13:05:14.866093 12727 leader_election.cc:290] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 4 election: Requested vote from peers 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657), 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191)
I20260709 13:05:14.866307 12802 raft_consensus.cc:3055] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:14.866647 12802 raft_consensus.cc:740] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0326743a82cc473d8ed3fe0a55739371, State: Running, Role: LEADER
I20260709 13:05:14.867524 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ffbf58766f147a7810738b9963ab238" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
I20260709 13:05:14.867569 12802 consensus_queue.cc:260] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:14.868188 12876 raft_consensus.cc:3060] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:14.869025 12802 raft_consensus.cc:3060] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:14.875536 12876 raft_consensus.cc:2468] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 4.
I20260709 13:05:14.876101 12802 raft_consensus.cc:2468] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 4.
I20260709 13:05:14.877079 12695 leader_election.cc:304] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63cb25bafe234674bb565bce1f4f1165, 79ed44dc9d5c41eea3c6823463824f7b; no voters: 
I20260709 13:05:14.878605 13070 raft_consensus.cc:2804] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:14.879626 13070 raft_consensus.cc:697] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 4 LEADER]: Becoming Leader. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Running, Role: LEADER
I20260709 13:05:14.880534 13070 consensus_queue.cc:237] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:14.887619 12623 catalog_manager.cc:5697] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b reported cstate change: term changed from 3 to 4, leader changed from 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130) to 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129). New cstate: current_term: 4 leader_uuid: "79ed44dc9d5c41eea3c6823463824f7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:15.038094 13069 raft_consensus.cc:993] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371: : Instructing follower 63cb25bafe234674bb565bce1f4f1165 to start an election
I20260709 13:05:15.038597 13069 raft_consensus.cc:1081] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 4 LEADER]: Signalling peer 63cb25bafe234674bb565bce1f4f1165 to start an election
I20260709 13:05:15.040452 12876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10a29ce65f52462ca9512d6224788249"
dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
 from {username='slave'} at 127.0.0.1:46928
I20260709 13:05:15.040923 12876 raft_consensus.cc:493] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:15.041217 12876 raft_consensus.cc:3060] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:15.046708 12876 raft_consensus.cc:515] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:15.048383 12876 leader_election.cc:290] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 5 election: Requested vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657)
I20260709 13:05:15.049283 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a29ce65f52462ca9512d6224788249" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
I20260709 13:05:15.049403 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a29ce65f52462ca9512d6224788249" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
I20260709 13:05:15.049765 12727 raft_consensus.cc:3060] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:15.049954 12802 raft_consensus.cc:3055] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:15.050308 12802 raft_consensus.cc:740] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0326743a82cc473d8ed3fe0a55739371, State: Running, Role: LEADER
I20260709 13:05:15.051039 12802 consensus_queue.cc:260] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:15.051885 12802 raft_consensus.cc:3060] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:15.054518 12727 raft_consensus.cc:2468] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63cb25bafe234674bb565bce1f4f1165 in term 5.
I20260709 13:05:15.055775 12841 leader_election.cc:304] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63cb25bafe234674bb565bce1f4f1165, 79ed44dc9d5c41eea3c6823463824f7b; no voters: 
I20260709 13:05:15.056545 13025 raft_consensus.cc:2804] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:15.056614 12802 raft_consensus.cc:2468] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63cb25bafe234674bb565bce1f4f1165 in term 5.
I20260709 13:05:15.057848 13025 raft_consensus.cc:697] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 5 LEADER]: Becoming Leader. State: Replica: 63cb25bafe234674bb565bce1f4f1165, State: Running, Role: LEADER
I20260709 13:05:15.058652 13025 consensus_queue.cc:237] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:15.065500 12623 catalog_manager.cc:5697] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 reported cstate change: term changed from 4 to 5, leader changed from 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130) to 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131). New cstate: current_term: 5 leader_uuid: "63cb25bafe234674bb565bce1f4f1165" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:15.214524 13068 raft_consensus.cc:993] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371: : Instructing follower 79ed44dc9d5c41eea3c6823463824f7b to start an election
I20260709 13:05:15.215210 13068 raft_consensus.cc:1081] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [term 2 LEADER]: Signalling peer 79ed44dc9d5c41eea3c6823463824f7b to start an election
I20260709 13:05:15.216792 12727 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60751a71baea43abac2fca83e8a6dd4f"
dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
 from {username='slave'} at 127.0.0.1:34452
I20260709 13:05:15.217208 12727 raft_consensus.cc:493] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:15.217783 12727 raft_consensus.cc:3060] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.222883 12727 raft_consensus.cc:515] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:15.224673 12727 leader_election.cc:290] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 3 election: Requested vote from peers 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657), 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191)
I20260709 13:05:15.225692 12876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60751a71baea43abac2fca83e8a6dd4f" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
I20260709 13:05:15.225688 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60751a71baea43abac2fca83e8a6dd4f" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
I20260709 13:05:15.226287 12876 raft_consensus.cc:3060] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.226420 12802 raft_consensus.cc:3055] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:15.227170 12802 raft_consensus.cc:740] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0326743a82cc473d8ed3fe0a55739371, State: Running, Role: LEADER
I20260709 13:05:15.227963 12802 consensus_queue.cc:260] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:15.228868 12802 raft_consensus.cc:3060] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.231314 12876 raft_consensus.cc:2468] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 3.
I20260709 13:05:15.232375 12695 leader_election.cc:304] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63cb25bafe234674bb565bce1f4f1165, 79ed44dc9d5c41eea3c6823463824f7b; no voters: 
I20260709 13:05:15.233060 13070 raft_consensus.cc:2804] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:15.233522 13070 raft_consensus.cc:697] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 3 LEADER]: Becoming Leader. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Running, Role: LEADER
I20260709 13:05:15.234035 12802 raft_consensus.cc:2468] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 3.
I20260709 13:05:15.234503 13070 consensus_queue.cc:237] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:15.241743 12623 catalog_manager.cc:5697] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b reported cstate change: term changed from 2 to 3, leader changed from 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130) to 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129). New cstate: current_term: 3 leader_uuid: "79ed44dc9d5c41eea3c6823463824f7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:15.254376 13069 raft_consensus.cc:993] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371: : Instructing follower 79ed44dc9d5c41eea3c6823463824f7b to start an election
I20260709 13:05:15.255638 13068 raft_consensus.cc:1081] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [term 2 LEADER]: Signalling peer 79ed44dc9d5c41eea3c6823463824f7b to start an election
I20260709 13:05:15.257161 12727 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afb03269b69b4e18b194b0483dc85796"
dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
 from {username='slave'} at 127.0.0.1:34452
I20260709 13:05:15.257752 12727 raft_consensus.cc:493] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:15.258085 12727 raft_consensus.cc:3060] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.258313 13080 raft_consensus.cc:993] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371: : Instructing follower 63cb25bafe234674bb565bce1f4f1165 to start an election
I20260709 13:05:15.258752 13068 raft_consensus.cc:1081] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 3 LEADER]: Signalling peer 63cb25bafe234674bb565bce1f4f1165 to start an election
I20260709 13:05:15.260157 12876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8dca1bea92694b299ce398c63da689e2"
dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
 from {username='slave'} at 127.0.0.1:46928
I20260709 13:05:15.260686 12876 raft_consensus.cc:493] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:15.261056 12876 raft_consensus.cc:3060] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:15.264796 12727 raft_consensus.cc:515] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:15.266950 12727 leader_election.cc:290] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 3 election: Requested vote from peers 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657), 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131:37191)
I20260709 13:05:15.268172 12877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb03269b69b4e18b194b0483dc85796" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63cb25bafe234674bb565bce1f4f1165"
I20260709 13:05:15.267961 12876 raft_consensus.cc:515] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:15.268275 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb03269b69b4e18b194b0483dc85796" candidate_uuid: "79ed44dc9d5c41eea3c6823463824f7b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
I20260709 13:05:15.268675 12877 raft_consensus.cc:3060] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.268905 12802 raft_consensus.cc:3055] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:15.269304 12802 raft_consensus.cc:740] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0326743a82cc473d8ed3fe0a55739371, State: Running, Role: LEADER
I20260709 13:05:15.270045 12876 leader_election.cc:290] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 4 election: Requested vote from peers 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503), 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130:39657)
I20260709 13:05:15.270138 12802 consensus_queue.cc:260] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:15.270848 12727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca1bea92694b299ce398c63da689e2" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "79ed44dc9d5c41eea3c6823463824f7b"
I20260709 13:05:15.271778 12802 raft_consensus.cc:3060] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.271570 12727 raft_consensus.cc:3060] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:15.272794 12801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca1bea92694b299ce398c63da689e2" candidate_uuid: "63cb25bafe234674bb565bce1f4f1165" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0326743a82cc473d8ed3fe0a55739371"
I20260709 13:05:15.273337 12801 raft_consensus.cc:3055] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:15.273689 12801 raft_consensus.cc:740] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0326743a82cc473d8ed3fe0a55739371, State: Running, Role: LEADER
I20260709 13:05:15.274499 12801 consensus_queue.cc:260] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:15.275573 12801 raft_consensus.cc:3060] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:15.275633 12877 raft_consensus.cc:2468] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 3.
I20260709 13:05:15.277006 12695 leader_election.cc:304] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63cb25bafe234674bb565bce1f4f1165, 79ed44dc9d5c41eea3c6823463824f7b; no voters: 
I20260709 13:05:15.278004 13070 raft_consensus.cc:2804] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:15.278528 13070 raft_consensus.cc:697] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 3 LEADER]: Becoming Leader. State: Replica: 79ed44dc9d5c41eea3c6823463824f7b, State: Running, Role: LEADER
I20260709 13:05:15.279567 13070 consensus_queue.cc:237] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:15.279568 12802 raft_consensus.cc:2468] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ed44dc9d5c41eea3c6823463824f7b in term 3.
I20260709 13:05:15.282689 12727 raft_consensus.cc:2468] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63cb25bafe234674bb565bce1f4f1165 in term 4.
I20260709 13:05:15.283624 12801 raft_consensus.cc:2468] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63cb25bafe234674bb565bce1f4f1165 in term 4.
I20260709 13:05:15.284029 12841 leader_election.cc:304] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63cb25bafe234674bb565bce1f4f1165, 79ed44dc9d5c41eea3c6823463824f7b; no voters: 
I20260709 13:05:15.285012 13025 raft_consensus.cc:2804] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:15.285563 13025 raft_consensus.cc:697] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 4 LEADER]: Becoming Leader. State: Replica: 63cb25bafe234674bb565bce1f4f1165, State: Running, Role: LEADER
I20260709 13:05:15.286408 13025 consensus_queue.cc:237] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } }
I20260709 13:05:15.288776 12623 catalog_manager.cc:5697] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b reported cstate change: term changed from 2 to 3, leader changed from 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130) to 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129). New cstate: current_term: 3 leader_uuid: "79ed44dc9d5c41eea3c6823463824f7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:15.294479 12624 catalog_manager.cc:5697] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 reported cstate change: term changed from 3 to 4, leader changed from 0326743a82cc473d8ed3fe0a55739371 (127.12.76.130) to 63cb25bafe234674bb565bce1f4f1165 (127.12.76.131). New cstate: current_term: 4 leader_uuid: "63cb25bafe234674bb565bce1f4f1165" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:15.381804 12877 raft_consensus.cc:1275] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 4 FOLLOWER]: Refusing update from remote peer 79ed44dc9d5c41eea3c6823463824f7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:15.383102 13070 consensus_queue.cc:1048] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:15.393296 12801 raft_consensus.cc:1275] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [term 4 FOLLOWER]: Refusing update from remote peer 79ed44dc9d5c41eea3c6823463824f7b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:15.394884 13070 consensus_queue.cc:1048] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:15.562685 12801 raft_consensus.cc:1275] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 5 FOLLOWER]: Refusing update from remote peer 63cb25bafe234674bb565bce1f4f1165: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:15.563949 13025 consensus_queue.cc:1048] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:15.573256 12727 raft_consensus.cc:1275] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b [term 5 FOLLOWER]: Refusing update from remote peer 63cb25bafe234674bb565bce1f4f1165: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:15.576200 13025 consensus_queue.cc:1048] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:15.621448 12877 raft_consensus.cc:1275] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165 [term 3 FOLLOWER]: Refusing update from remote peer 79ed44dc9d5c41eea3c6823463824f7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:15.622697 13070 consensus_queue.cc:1048] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:15.631249 12801 raft_consensus.cc:1275] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [term 3 FOLLOWER]: Refusing update from remote peer 79ed44dc9d5c41eea3c6823463824f7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:15.633401 13071 consensus_queue.cc:1048] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:15.755029 12801 raft_consensus.cc:1275] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [term 3 FOLLOWER]: Refusing update from remote peer 79ed44dc9d5c41eea3c6823463824f7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:15.755304 12727 raft_consensus.cc:1275] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [term 4 FOLLOWER]: Refusing update from remote peer 63cb25bafe234674bb565bce1f4f1165: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:15.756438 13071 consensus_queue.cc:1048] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:15.756841 13089 consensus_queue.cc:1048] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ed44dc9d5c41eea3c6823463824f7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:15.769474 12802 raft_consensus.cc:1275] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 4 FOLLOWER]: Refusing update from remote peer 63cb25bafe234674bb565bce1f4f1165: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:15.771977 13077 consensus_queue.cc:1048] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0326743a82cc473d8ed3fe0a55739371" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:15.772907 12877 raft_consensus.cc:1275] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165 [term 3 FOLLOWER]: Refusing update from remote peer 79ed44dc9d5c41eea3c6823463824f7b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:15.774259 13071 consensus_queue.cc:1048] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "63cb25bafe234674bb565bce1f4f1165" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:15.852218 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:15.857313 12594 tablet_server.cc:179] TabletServer@127.12.76.129:0 shutting down...
I20260709 13:05:15.882349 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:15.883172 12594 tablet_replica.cc:333] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b: stopping tablet replica
I20260709 13:05:15.884195 12594 raft_consensus.cc:2243] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:15.884968 12594 raft_consensus.cc:2272] T 60751a71baea43abac2fca83e8a6dd4f P 79ed44dc9d5c41eea3c6823463824f7b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:15.887907 12594 tablet_replica.cc:333] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b: stopping tablet replica
I20260709 13:05:15.888496 12594 raft_consensus.cc:2243] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:15.888921 12594 raft_consensus.cc:2272] T 8dca1bea92694b299ce398c63da689e2 P 79ed44dc9d5c41eea3c6823463824f7b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:15.890677 12594 tablet_replica.cc:333] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b: stopping tablet replica
I20260709 13:05:15.891098 12594 raft_consensus.cc:2243] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:15.891515 12594 raft_consensus.cc:2272] T 9427963bcadf4b2395fd95d57b3a33b7 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:15.892884 12594 tablet_replica.cc:333] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 79ed44dc9d5c41eea3c6823463824f7b: stopping tablet replica
I20260709 13:05:15.893294 12594 raft_consensus.cc:2243] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:15.893627 12594 raft_consensus.cc:2272] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 79ed44dc9d5c41eea3c6823463824f7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:15.895067 12594 tablet_replica.cc:333] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b: stopping tablet replica
I20260709 13:05:15.895569 12594 raft_consensus.cc:2243] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:15.896199 12594 raft_consensus.cc:2272] T 7ffbf58766f147a7810738b9963ab238 P 79ed44dc9d5c41eea3c6823463824f7b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:15.898064 12594 tablet_replica.cc:333] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b: stopping tablet replica
I20260709 13:05:15.898571 12594 raft_consensus.cc:2243] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:15.899055 12594 raft_consensus.cc:2272] T 10a29ce65f52462ca9512d6224788249 P 79ed44dc9d5c41eea3c6823463824f7b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:15.901398 12594 tablet_replica.cc:333] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b: stopping tablet replica
I20260709 13:05:15.901885 12594 raft_consensus.cc:2243] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:15.902266 12594 raft_consensus.cc:2272] T 280a1b9b1db447cf8fc2d88b199b7a82 P 79ed44dc9d5c41eea3c6823463824f7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:15.903889 12594 tablet_replica.cc:333] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b: stopping tablet replica
I20260709 13:05:15.904315 12594 raft_consensus.cc:2243] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:15.905014 12594 raft_consensus.cc:2272] T afb03269b69b4e18b194b0483dc85796 P 79ed44dc9d5c41eea3c6823463824f7b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:15.906710 12594 tablet_replica.cc:333] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b: stopping tablet replica
I20260709 13:05:15.907146 12594 raft_consensus.cc:2243] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:15.907558 12594 raft_consensus.cc:2272] T 890890786d914eb1b5b9320f4b44ef72 P 79ed44dc9d5c41eea3c6823463824f7b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.006824 12594 tablet_server.cc:196] TabletServer@127.12.76.129:0 shutdown complete.
W20260709 13:05:16.016162 12767 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35503: connect: Connection refused (error 111)
W20260709 13:05:16.020569 12767 consensus_peers.cc:597] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371 -> Peer 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503): Couldn't send request to peer 79ed44dc9d5c41eea3c6823463824f7b. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:16.027859 12594 tablet_server.cc:179] TabletServer@127.12.76.130:0 shutting down...
I20260709 13:05:16.051890 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:16.052707 12594 tablet_replica.cc:333] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 0326743a82cc473d8ed3fe0a55739371: stopping tablet replica
I20260709 13:05:16.053615 12594 raft_consensus.cc:2243] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 0326743a82cc473d8ed3fe0a55739371 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:16.054078 12594 raft_consensus.cc:2272] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 0326743a82cc473d8ed3fe0a55739371 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.055788 12594 tablet_replica.cc:333] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371: stopping tablet replica
I20260709 13:05:16.056232 12594 raft_consensus.cc:2243] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:16.056560 12594 raft_consensus.cc:2272] T 60751a71baea43abac2fca83e8a6dd4f P 0326743a82cc473d8ed3fe0a55739371 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.058513 12594 tablet_replica.cc:333] T 280a1b9b1db447cf8fc2d88b199b7a82 P 0326743a82cc473d8ed3fe0a55739371: stopping tablet replica
I20260709 13:05:16.058987 12594 raft_consensus.cc:2243] T 280a1b9b1db447cf8fc2d88b199b7a82 P 0326743a82cc473d8ed3fe0a55739371 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:16.059772 12594 raft_consensus.cc:2272] T 280a1b9b1db447cf8fc2d88b199b7a82 P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.061203 12594 tablet_replica.cc:333] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371: stopping tablet replica
I20260709 13:05:16.061600 12594 raft_consensus.cc:2243] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:16.061919 12594 raft_consensus.cc:2272] T 10a29ce65f52462ca9512d6224788249 P 0326743a82cc473d8ed3fe0a55739371 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.063999 12594 tablet_replica.cc:333] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371: stopping tablet replica
I20260709 13:05:16.064492 12594 raft_consensus.cc:2243] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:16.064814 12594 raft_consensus.cc:2272] T 8dca1bea92694b299ce398c63da689e2 P 0326743a82cc473d8ed3fe0a55739371 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.066642 12594 tablet_replica.cc:333] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371: stopping tablet replica
I20260709 13:05:16.067075 12594 raft_consensus.cc:2243] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:16.067823 12594 raft_consensus.cc:2272] T 9427963bcadf4b2395fd95d57b3a33b7 P 0326743a82cc473d8ed3fe0a55739371 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.069309 12594 tablet_replica.cc:333] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371: stopping tablet replica
I20260709 13:05:16.069693 12594 raft_consensus.cc:2243] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:16.069993 12594 raft_consensus.cc:2272] T afb03269b69b4e18b194b0483dc85796 P 0326743a82cc473d8ed3fe0a55739371 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.071744 12594 tablet_replica.cc:333] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371: stopping tablet replica
I20260709 13:05:16.072149 12594 raft_consensus.cc:2243] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:16.072781 12594 raft_consensus.cc:2272] T 890890786d914eb1b5b9320f4b44ef72 P 0326743a82cc473d8ed3fe0a55739371 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.074296 12594 tablet_replica.cc:333] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371: stopping tablet replica
I20260709 13:05:16.074888 12594 raft_consensus.cc:2243] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:16.075446 12594 raft_consensus.cc:2272] T 7ffbf58766f147a7810738b9963ab238 P 0326743a82cc473d8ed3fe0a55739371 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.104286 12594 tablet_server.cc:196] TabletServer@127.12.76.130:0 shutdown complete.
W20260709 13:05:16.112228 12841 consensus_peers.cc:597] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 -> Peer 79ed44dc9d5c41eea3c6823463824f7b (127.12.76.129:35503): Couldn't send request to peer 79ed44dc9d5c41eea3c6823463824f7b. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:16.122856 12594 tablet_server.cc:179] TabletServer@127.12.76.131:0 shutting down...
I20260709 13:05:16.143608 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:16.144245 12594 tablet_replica.cc:333] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165: stopping tablet replica
I20260709 13:05:16.145200 12594 raft_consensus.cc:2243] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:16.146116 12594 raft_consensus.cc:2272] T 10a29ce65f52462ca9512d6224788249 P 63cb25bafe234674bb565bce1f4f1165 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.147964 12594 tablet_replica.cc:333] T 280a1b9b1db447cf8fc2d88b199b7a82 P 63cb25bafe234674bb565bce1f4f1165: stopping tablet replica
I20260709 13:05:16.148396 12594 raft_consensus.cc:2243] T 280a1b9b1db447cf8fc2d88b199b7a82 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:16.148729 12594 raft_consensus.cc:2272] T 280a1b9b1db447cf8fc2d88b199b7a82 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.150216 12594 tablet_replica.cc:333] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165: stopping tablet replica
I20260709 13:05:16.150626 12594 raft_consensus.cc:2243] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:16.151232 12594 raft_consensus.cc:2272] T 3ffe8e9b6ec2482b8e6698ab57bac604 P 63cb25bafe234674bb565bce1f4f1165 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.152789 12594 tablet_replica.cc:333] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165: stopping tablet replica
I20260709 13:05:16.153211 12594 raft_consensus.cc:2243] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:16.153612 12594 raft_consensus.cc:2272] T 60751a71baea43abac2fca83e8a6dd4f P 63cb25bafe234674bb565bce1f4f1165 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.155829 12594 tablet_replica.cc:333] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165: stopping tablet replica
I20260709 13:05:16.156332 12594 raft_consensus.cc:2243] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:16.156721 12594 raft_consensus.cc:2272] T 9427963bcadf4b2395fd95d57b3a33b7 P 63cb25bafe234674bb565bce1f4f1165 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.158237 12594 tablet_replica.cc:333] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165: stopping tablet replica
I20260709 13:05:16.158680 12594 raft_consensus.cc:2243] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:16.159343 12594 raft_consensus.cc:2272] T 8dca1bea92694b299ce398c63da689e2 P 63cb25bafe234674bb565bce1f4f1165 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.161142 12594 tablet_replica.cc:333] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165: stopping tablet replica
I20260709 13:05:16.161593 12594 raft_consensus.cc:2243] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:16.161993 12594 raft_consensus.cc:2272] T 7ffbf58766f147a7810738b9963ab238 P 63cb25bafe234674bb565bce1f4f1165 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.163805 12594 tablet_replica.cc:333] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165: stopping tablet replica
I20260709 13:05:16.164304 12594 raft_consensus.cc:2243] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:16.164660 12594 raft_consensus.cc:2272] T afb03269b69b4e18b194b0483dc85796 P 63cb25bafe234674bb565bce1f4f1165 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.166363 12594 tablet_replica.cc:333] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165: stopping tablet replica
I20260709 13:05:16.166777 12594 raft_consensus.cc:2243] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:16.167146 12594 raft_consensus.cc:2272] T 890890786d914eb1b5b9320f4b44ef72 P 63cb25bafe234674bb565bce1f4f1165 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.213740 12594 tablet_server.cc:196] TabletServer@127.12.76.131:0 shutdown complete.
I20260709 13:05:16.230088 12594 master.cc:562] Master@127.12.76.190:46863 shutting down...
I20260709 13:05:16.440701 12594 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:16.441202 12594 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.441488 12594 tablet_replica.cc:333] T 00000000000000000000000000000000 P 365c0a939a374e4cb76669b507376ee3: stopping tablet replica
I20260709 13:05:16.460773 12594 master.cc:584] Master@127.12.76.190:46863 shutdown complete.
0326743a82cc473d8ed3fe0a55739371  4
63cb25bafe234674bb565bce1f4f1165  1
79ed44dc9d5c41eea3c6823463824f7b  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (13234 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:05:16.498512 12594 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.76.190:41267
I20260709 13:05:16.499667 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:16.504877 13103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:16.505369 13104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:16.506125 13106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:16.506603 12594 server_base.cc:1061] running on GCE node
I20260709 13:05:16.507462 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:16.507649 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:16.507759 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602316507748 us; error 0 us; skew 500 ppm
I20260709 13:05:16.508198 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:16.510316 12594 webserver.cc:533] Webserver started at http://127.12.76.190:37547/ using document root <none> and password file <none>
I20260709 13:05:16.510726 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:16.510869 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:16.511075 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:16.512359 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602303087285-12594-0/minicluster-data/master-0-root/instance:
uuid: "eecd9659a8df43aea2f990ebb35b9adf"
format_stamp: "Formatted at 2026-07-09 13:05:16 on dist-test-slave-th5x"
I20260709 13:05:16.516347 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:16.519188 13111 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:16.519876 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:05:16.520141 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602303087285-12594-0/minicluster-data/master-0-root
uuid: "eecd9659a8df43aea2f990ebb35b9adf"
format_stamp: "Formatted at 2026-07-09 13:05:16 on dist-test-slave-th5x"
I20260709 13:05:16.520426 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602303087285-12594-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602303087285-12594-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602303087285-12594-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:16.530702 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:16.531956 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:16.568373 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.190:41267
I20260709 13:05:16.568467 13162 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.190:41267 every 8 connection(s)
I20260709 13:05:16.572082 13163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.581363 13163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf: Bootstrap starting.
I20260709 13:05:16.585798 13163 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.589663 13163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf: No bootstrap required, opened a new log
I20260709 13:05:16.591765 13163 raft_consensus.cc:359] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eecd9659a8df43aea2f990ebb35b9adf" member_type: VOTER }
I20260709 13:05:16.592134 13163 raft_consensus.cc:385] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.592334 13163 raft_consensus.cc:740] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eecd9659a8df43aea2f990ebb35b9adf, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.592820 13163 consensus_queue.cc:260] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eecd9659a8df43aea2f990ebb35b9adf" member_type: VOTER }
I20260709 13:05:16.593197 13163 raft_consensus.cc:399] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:16.593387 13163 raft_consensus.cc:493] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:16.593604 13163 raft_consensus.cc:3060] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.597307 13163 raft_consensus.cc:515] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eecd9659a8df43aea2f990ebb35b9adf" member_type: VOTER }
I20260709 13:05:16.597733 13163 leader_election.cc:304] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eecd9659a8df43aea2f990ebb35b9adf; no voters: 
I20260709 13:05:16.598711 13163 leader_election.cc:290] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:16.599025 13166 raft_consensus.cc:2804] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:16.600276 13166 raft_consensus.cc:697] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf [term 1 LEADER]: Becoming Leader. State: Replica: eecd9659a8df43aea2f990ebb35b9adf, State: Running, Role: LEADER
I20260709 13:05:16.600939 13166 consensus_queue.cc:237] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eecd9659a8df43aea2f990ebb35b9adf" member_type: VOTER }
I20260709 13:05:16.601840 13163 sys_catalog.cc:565] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:16.605971 13167 sys_catalog.cc:455] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eecd9659a8df43aea2f990ebb35b9adf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eecd9659a8df43aea2f990ebb35b9adf" member_type: VOTER } }
I20260709 13:05:16.606176 13168 sys_catalog.cc:455] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf [sys.catalog]: SysCatalogTable state changed. Reason: New leader eecd9659a8df43aea2f990ebb35b9adf. Latest consensus state: current_term: 1 leader_uuid: "eecd9659a8df43aea2f990ebb35b9adf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eecd9659a8df43aea2f990ebb35b9adf" member_type: VOTER } }
I20260709 13:05:16.606799 13167 sys_catalog.cc:458] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:16.606917 13168 sys_catalog.cc:458] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:16.611886 13173 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:16.616506 13173 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:16.618840 12594 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:16.624428 13173 catalog_manager.cc:1383] Generated new cluster ID: 5be3b56f23d34e0daca82a4c42aee2ac
I20260709 13:05:16.624643 13173 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:16.656677 13173 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:16.657884 13173 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:16.675554 13173 catalog_manager.cc:6070] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf: Generated new TSK 0
I20260709 13:05:16.676151 13173 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:16.685444 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:16.691272 13184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:16.692606 13185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:16.694264 12594 server_base.cc:1061] running on GCE node
W20260709 13:05:16.694514 13187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:16.695470 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:16.695719 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:16.695899 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602316695879 us; error 0 us; skew 500 ppm
I20260709 13:05:16.696440 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:16.698714 12594 webserver.cc:533] Webserver started at http://127.12.76.129:35749/ using document root <none> and password file <none>
I20260709 13:05:16.699198 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:16.699436 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:16.699725 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:16.700821 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602303087285-12594-0/minicluster-data/ts-0-root/instance:
uuid: "533c00b18a1345068c467160b9a85bb3"
format_stamp: "Formatted at 2026-07-09 13:05:16 on dist-test-slave-th5x"
I20260709 13:05:16.705240 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:05:16.708498 13192 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:16.709342 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:05:16.709685 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602303087285-12594-0/minicluster-data/ts-0-root
uuid: "533c00b18a1345068c467160b9a85bb3"
format_stamp: "Formatted at 2026-07-09 13:05:16 on dist-test-slave-th5x"
I20260709 13:05:16.710032 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602303087285-12594-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602303087285-12594-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602303087285-12594-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:16.723037 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:16.724395 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:16.725917 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:16.728379 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:16.728612 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:16.728904 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:16.729120 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:16.770640 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.129:39285
I20260709 13:05:16.770818 13254 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.129:39285 every 8 connection(s)
I20260709 13:05:16.775864 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:16.783370 13259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:16.784053 13260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:16.786636 13262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:16.788134 12594 server_base.cc:1061] running on GCE node
I20260709 13:05:16.788975 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:16.789166 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:16.789289 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602316789278 us; error 0 us; skew 500 ppm
I20260709 13:05:16.789726 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:16.792069 12594 webserver.cc:533] Webserver started at http://127.12.76.130:44405/ using document root <none> and password file <none>
I20260709 13:05:16.792730 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:16.792945 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:16.793267 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:16.794860 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602303087285-12594-0/minicluster-data/ts-1-root/instance:
uuid: "5dc262ea4f614d39aacea282a4df8324"
format_stamp: "Formatted at 2026-07-09 13:05:16 on dist-test-slave-th5x"
I20260709 13:05:16.795593 13255 heartbeater.cc:344] Connected to a master server at 127.12.76.190:41267
I20260709 13:05:16.795990 13255 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:16.796821 13255 heartbeater.cc:507] Master 127.12.76.190:41267 requested a full tablet report, sending...
I20260709 13:05:16.799109 13128 ts_manager.cc:194] Registered new tserver with Master: 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285)
I20260709 13:05:16.800051 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.001s
I20260709 13:05:16.801460 13128 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33952
I20260709 13:05:16.804526 13267 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:16.805397 12594 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:05:16.805706 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602303087285-12594-0/minicluster-data/ts-1-root
uuid: "5dc262ea4f614d39aacea282a4df8324"
format_stamp: "Formatted at 2026-07-09 13:05:16 on dist-test-slave-th5x"
I20260709 13:05:16.806016 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602303087285-12594-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602303087285-12594-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602303087285-12594-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:16.819361 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:16.820573 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:16.822064 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:16.824239 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:16.824457 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:16.824702 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:16.824882 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:16.864166 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.130:33693
I20260709 13:05:16.864256 13329 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.130:33693 every 8 connection(s)
I20260709 13:05:16.868732 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:16.875310 13333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:16.877681 13334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:16.878007 13336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:16.878336 12594 server_base.cc:1061] running on GCE node
I20260709 13:05:16.879554 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:16.879807 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:16.880013 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602316879994 us; error 0 us; skew 500 ppm
I20260709 13:05:16.880666 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:16.881269 13330 heartbeater.cc:344] Connected to a master server at 127.12.76.190:41267
I20260709 13:05:16.881604 13330 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:16.882328 13330 heartbeater.cc:507] Master 127.12.76.190:41267 requested a full tablet report, sending...
I20260709 13:05:16.883499 12594 webserver.cc:533] Webserver started at http://127.12.76.131:41109/ using document root <none> and password file <none>
I20260709 13:05:16.884078 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:16.884235 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:16.884428 13128 ts_manager.cc:194] Registered new tserver with Master: 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693)
I20260709 13:05:16.884548 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:16.885830 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602303087285-12594-0/minicluster-data/ts-2-root/instance:
uuid: "8622d9c551284c64bf6c7823b884931e"
format_stamp: "Formatted at 2026-07-09 13:05:16 on dist-test-slave-th5x"
I20260709 13:05:16.885900 13128 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33954
I20260709 13:05:16.890316 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:05:16.893491 13341 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:16.894338 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:05:16.894618 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602303087285-12594-0/minicluster-data/ts-2-root
uuid: "8622d9c551284c64bf6c7823b884931e"
format_stamp: "Formatted at 2026-07-09 13:05:16 on dist-test-slave-th5x"
I20260709 13:05:16.894858 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602303087285-12594-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602303087285-12594-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602303087285-12594-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:16.912741 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:16.914042 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:16.915557 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:16.917622 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:16.917829 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:16.918084 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:16.918246 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:16.957582 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.131:33597
I20260709 13:05:16.957690 13403 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.131:33597 every 8 connection(s)
I20260709 13:05:16.971623 13404 heartbeater.cc:344] Connected to a master server at 127.12.76.190:41267
I20260709 13:05:16.972029 13404 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:16.972856 13404 heartbeater.cc:507] Master 127.12.76.190:41267 requested a full tablet report, sending...
I20260709 13:05:16.974822 13128 ts_manager.cc:194] Registered new tserver with Master: 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:16.975257 12594 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014604259s
I20260709 13:05:16.976253 13128 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33960
I20260709 13:05:17.000511 13128 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33976:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:17.003660 13128 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:17.071261 13295 tablet_service.cc:1511] Processing CreateTablet for tablet ec35bffd03ef4c0f9d9d70c26cfcc766 (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:17.072808 13295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec35bffd03ef4c0f9d9d70c26cfcc766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.075129 13294 tablet_service.cc:1511] Processing CreateTablet for tablet 3099712325a14ecab36ee23e1d9c9662 (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:17.078191 13293 tablet_service.cc:1511] Processing CreateTablet for tablet b4ad90cfb88b4e7da57828e306d4a826 (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:17.080119 13294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3099712325a14ecab36ee23e1d9c9662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.081547 13293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ad90cfb88b4e7da57828e306d4a826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.082377 13292 tablet_service.cc:1511] Processing CreateTablet for tablet e49fda44f3f44c5eb31ca3b3f22ae75b (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:17.083664 13292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e49fda44f3f44c5eb31ca3b3f22ae75b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.094340 13369 tablet_service.cc:1511] Processing CreateTablet for tablet ec35bffd03ef4c0f9d9d70c26cfcc766 (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:17.094563 13368 tablet_service.cc:1511] Processing CreateTablet for tablet 3099712325a14ecab36ee23e1d9c9662 (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:17.096035 13369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec35bffd03ef4c0f9d9d70c26cfcc766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.096390 13367 tablet_service.cc:1511] Processing CreateTablet for tablet b4ad90cfb88b4e7da57828e306d4a826 (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:17.097532 13368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3099712325a14ecab36ee23e1d9c9662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.100069 13217 tablet_service.cc:1511] Processing CreateTablet for tablet e49fda44f3f44c5eb31ca3b3f22ae75b (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:17.101398 13217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e49fda44f3f44c5eb31ca3b3f22ae75b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.101203 13219 tablet_service.cc:1511] Processing CreateTablet for tablet 3099712325a14ecab36ee23e1d9c9662 (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:17.102445 13219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3099712325a14ecab36ee23e1d9c9662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.100069 13220 tablet_service.cc:1511] Processing CreateTablet for tablet ec35bffd03ef4c0f9d9d70c26cfcc766 (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:17.103513 13220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec35bffd03ef4c0f9d9d70c26cfcc766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.104420 13218 tablet_service.cc:1511] Processing CreateTablet for tablet b4ad90cfb88b4e7da57828e306d4a826 (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:17.105610 13218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ad90cfb88b4e7da57828e306d4a826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.105423 13291 tablet_service.cc:1511] Processing CreateTablet for tablet 4d865fbf795f4c298e057cb83a90facf (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:17.106658 13291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d865fbf795f4c298e057cb83a90facf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.108578 13366 tablet_service.cc:1511] Processing CreateTablet for tablet e49fda44f3f44c5eb31ca3b3f22ae75b (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:17.108844 13365 tablet_service.cc:1511] Processing CreateTablet for tablet 4d865fbf795f4c298e057cb83a90facf (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:17.109989 13366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e49fda44f3f44c5eb31ca3b3f22ae75b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.110162 13290 tablet_service.cc:1511] Processing CreateTablet for tablet eb86f5947d5b4026a6ab05840d002510 (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:17.111455 13290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb86f5947d5b4026a6ab05840d002510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.111822 13216 tablet_service.cc:1511] Processing CreateTablet for tablet 4d865fbf795f4c298e057cb83a90facf (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:17.111935 13364 tablet_service.cc:1511] Processing CreateTablet for tablet eb86f5947d5b4026a6ab05840d002510 (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:17.113195 13216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d865fbf795f4c298e057cb83a90facf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.116147 13289 tablet_service.cc:1511] Processing CreateTablet for tablet b8b12f66d7be4f3e921385efe5928af6 (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:17.116484 13215 tablet_service.cc:1511] Processing CreateTablet for tablet eb86f5947d5b4026a6ab05840d002510 (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:17.117406 13289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b12f66d7be4f3e921385efe5928af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.117758 13364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb86f5947d5b4026a6ab05840d002510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.117419 13363 tablet_service.cc:1511] Processing CreateTablet for tablet b8b12f66d7be4f3e921385efe5928af6 (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:17.121833 13213 tablet_service.cc:1511] Processing CreateTablet for tablet fd5735d383ce4c88a68c42640f1d7018 (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:17.117784 13215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb86f5947d5b4026a6ab05840d002510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.140426 13214 tablet_service.cc:1511] Processing CreateTablet for tablet b8b12f66d7be4f3e921385efe5928af6 (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:17.143911 13214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b12f66d7be4f3e921385efe5928af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.120282 13365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d865fbf795f4c298e057cb83a90facf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.148365 13367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ad90cfb88b4e7da57828e306d4a826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.153878 13363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b12f66d7be4f3e921385efe5928af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.154565 13213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd5735d383ce4c88a68c42640f1d7018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.247484 13420 tablet_bootstrap.cc:492] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e: Bootstrap starting.
I20260709 13:05:17.248903 13295 tablet_service.cc:1511] Processing CreateTablet for tablet fd5735d383ce4c88a68c42640f1d7018 (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:17.250133 13295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd5735d383ce4c88a68c42640f1d7018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.254539 13212 tablet_service.cc:1511] Processing CreateTablet for tablet 6d85ee6760334c4fac4fb91bc0f604cb (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:17.257622 13364 tablet_service.cc:1511] Processing CreateTablet for tablet 6d85ee6760334c4fac4fb91bc0f604cb (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:17.258653 13419 tablet_bootstrap.cc:492] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324: Bootstrap starting.
I20260709 13:05:17.258364 13290 tablet_service.cc:1511] Processing CreateTablet for tablet 6d85ee6760334c4fac4fb91bc0f604cb (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:17.258757 13364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d85ee6760334c4fac4fb91bc0f604cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.259593 13290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d85ee6760334c4fac4fb91bc0f604cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.264117 13212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d85ee6760334c4fac4fb91bc0f604cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.264257 13421 tablet_bootstrap.cc:492] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3: Bootstrap starting.
I20260709 13:05:17.267833 13419 tablet_bootstrap.cc:654] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.272513 13366 tablet_service.cc:1511] Processing CreateTablet for tablet fd5735d383ce4c88a68c42640f1d7018 (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:17.273797 13366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd5735d383ce4c88a68c42640f1d7018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.284513 13220 tablet_service.cc:1511] Processing CreateTablet for tablet 328f1a117e8240b0bdf504a180570a87 (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:17.285774 13220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 328f1a117e8240b0bdf504a180570a87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.285864 13291 tablet_service.cc:1511] Processing CreateTablet for tablet 328f1a117e8240b0bdf504a180570a87 (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:17.287040 13291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 328f1a117e8240b0bdf504a180570a87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.292809 13420 tablet_bootstrap.cc:654] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.299635 13421 tablet_bootstrap.cc:654] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.305496 13363 tablet_service.cc:1511] Processing CreateTablet for tablet 328f1a117e8240b0bdf504a180570a87 (DEFAULT_TABLE table=test-workload [id=f235e1b340564f66a4daa173b56a8b7f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:17.306743 13363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 328f1a117e8240b0bdf504a180570a87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:17.331367 13419 tablet_bootstrap.cc:492] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324: No bootstrap required, opened a new log
I20260709 13:05:17.331871 13419 ts_tablet_manager.cc:1403] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324: Time spent bootstrapping tablet: real 0.074s	user 0.019s	sys 0.022s
I20260709 13:05:17.333802 13419 raft_consensus.cc:359] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.334313 13419 raft_consensus.cc:385] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.334600 13419 raft_consensus.cc:740] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dc262ea4f614d39aacea282a4df8324, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.335281 13419 consensus_queue.cc:260] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.338469 13420 tablet_bootstrap.cc:492] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e: No bootstrap required, opened a new log
I20260709 13:05:17.338984 13420 ts_tablet_manager.cc:1403] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e: Time spent bootstrapping tablet: real 0.092s	user 0.026s	sys 0.014s
I20260709 13:05:17.339998 13421 tablet_bootstrap.cc:492] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3: No bootstrap required, opened a new log
I20260709 13:05:17.340528 13421 ts_tablet_manager.cc:1403] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3: Time spent bootstrapping tablet: real 0.077s	user 0.008s	sys 0.020s
I20260709 13:05:17.341854 13420 raft_consensus.cc:359] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.342600 13420 raft_consensus.cc:385] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.342939 13420 raft_consensus.cc:740] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8622d9c551284c64bf6c7823b884931e, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.344043 13330 heartbeater.cc:499] Master 127.12.76.190:41267 was elected leader, sending a full tablet report...
I20260709 13:05:17.343781 13420 consensus_queue.cc:260] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.343833 13421 raft_consensus.cc:359] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.344405 13419 ts_tablet_manager.cc:1434] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 13:05:17.344743 13421 raft_consensus.cc:385] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.345083 13421 raft_consensus.cc:740] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.345496 13419 tablet_bootstrap.cc:492] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324: Bootstrap starting.
I20260709 13:05:17.345954 13421 consensus_queue.cc:260] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.353322 13419 tablet_bootstrap.cc:654] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.368885 13420 ts_tablet_manager.cc:1434] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e: Time spent starting tablet: real 0.030s	user 0.012s	sys 0.014s
I20260709 13:05:17.369647 13404 heartbeater.cc:499] Master 127.12.76.190:41267 was elected leader, sending a full tablet report...
I20260709 13:05:17.369956 13420 tablet_bootstrap.cc:492] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e: Bootstrap starting.
I20260709 13:05:17.370134 13421 ts_tablet_manager.cc:1434] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3: Time spent starting tablet: real 0.029s	user 0.012s	sys 0.017s
I20260709 13:05:17.371034 13421 tablet_bootstrap.cc:492] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3: Bootstrap starting.
I20260709 13:05:17.372208 13419 tablet_bootstrap.cc:492] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324: No bootstrap required, opened a new log
I20260709 13:05:17.372709 13419 ts_tablet_manager.cc:1403] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.005s
I20260709 13:05:17.373905 13255 heartbeater.cc:499] Master 127.12.76.190:41267 was elected leader, sending a full tablet report...
I20260709 13:05:17.376199 13420 tablet_bootstrap.cc:654] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.375651 13419 raft_consensus.cc:359] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.376603 13419 raft_consensus.cc:385] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.377067 13421 tablet_bootstrap.cc:654] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.376960 13419 raft_consensus.cc:740] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dc262ea4f614d39aacea282a4df8324, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.377964 13419 consensus_queue.cc:260] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.380683 13419 ts_tablet_manager.cc:1434] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:05:17.381870 13419 tablet_bootstrap.cc:492] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324: Bootstrap starting.
I20260709 13:05:17.388401 13421 tablet_bootstrap.cc:492] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3: No bootstrap required, opened a new log
I20260709 13:05:17.388856 13421 ts_tablet_manager.cc:1403] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 13:05:17.389011 13419 tablet_bootstrap.cc:654] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.391927 13421 raft_consensus.cc:359] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.392881 13421 raft_consensus.cc:385] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.393270 13421 raft_consensus.cc:740] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.394387 13421 consensus_queue.cc:260] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.397495 13421 ts_tablet_manager.cc:1434] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:17.398505 13421 tablet_bootstrap.cc:492] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3: Bootstrap starting.
I20260709 13:05:17.401299 13419 tablet_bootstrap.cc:492] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324: No bootstrap required, opened a new log
I20260709 13:05:17.401840 13419 ts_tablet_manager.cc:1403] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.005s
I20260709 13:05:17.404721 13421 tablet_bootstrap.cc:654] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.404642 13419 raft_consensus.cc:359] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.405616 13419 raft_consensus.cc:385] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.405984 13419 raft_consensus.cc:740] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dc262ea4f614d39aacea282a4df8324, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.406914 13419 consensus_queue.cc:260] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.410174 13419 ts_tablet_manager.cc:1434] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.005s
I20260709 13:05:17.411443 13419 tablet_bootstrap.cc:492] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324: Bootstrap starting.
I20260709 13:05:17.416003 13421 tablet_bootstrap.cc:492] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3: No bootstrap required, opened a new log
I20260709 13:05:17.416463 13421 ts_tablet_manager.cc:1403] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.011s
I20260709 13:05:17.418138 13419 tablet_bootstrap.cc:654] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.419355 13421 raft_consensus.cc:359] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.420101 13421 raft_consensus.cc:385] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.420388 13421 raft_consensus.cc:740] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.421384 13421 consensus_queue.cc:260] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.424549 13421 ts_tablet_manager.cc:1434] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:17.425706 13421 tablet_bootstrap.cc:492] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3: Bootstrap starting.
I20260709 13:05:17.429888 13419 tablet_bootstrap.cc:492] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324: No bootstrap required, opened a new log
I20260709 13:05:17.430436 13419 ts_tablet_manager.cc:1403] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.009s
I20260709 13:05:17.432260 13421 tablet_bootstrap.cc:654] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.433502 13419 raft_consensus.cc:359] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.434303 13419 raft_consensus.cc:385] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.434651 13419 raft_consensus.cc:740] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dc262ea4f614d39aacea282a4df8324, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.435686 13419 consensus_queue.cc:260] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.439098 13419 ts_tablet_manager.cc:1434] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:05:17.440478 13419 tablet_bootstrap.cc:492] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 5dc262ea4f614d39aacea282a4df8324: Bootstrap starting.
I20260709 13:05:17.443755 13421 tablet_bootstrap.cc:492] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3: No bootstrap required, opened a new log
I20260709 13:05:17.444275 13421 ts_tablet_manager.cc:1403] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 13:05:17.447857 13419 tablet_bootstrap.cc:654] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 5dc262ea4f614d39aacea282a4df8324: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.448521 13421 raft_consensus.cc:359] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.449429 13421 raft_consensus.cc:385] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.449988 13421 raft_consensus.cc:740] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.450928 13421 consensus_queue.cc:260] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.455309 13420 tablet_bootstrap.cc:492] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e: No bootstrap required, opened a new log
I20260709 13:05:17.455837 13420 ts_tablet_manager.cc:1403] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e: Time spent bootstrapping tablet: real 0.086s	user 0.030s	sys 0.053s
I20260709 13:05:17.457803 13421 ts_tablet_manager.cc:1434] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:05:17.458985 13421 tablet_bootstrap.cc:492] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3: Bootstrap starting.
I20260709 13:05:17.458770 13420 raft_consensus.cc:359] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } } peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } }
I20260709 13:05:17.459794 13420 raft_consensus.cc:385] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.460187 13420 raft_consensus.cc:740] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8622d9c551284c64bf6c7823b884931e, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.461282 13420 consensus_queue.cc:260] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } } peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } }
I20260709 13:05:17.463508 13420 ts_tablet_manager.cc:1434] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:05:17.464659 13420 tablet_bootstrap.cc:492] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e: Bootstrap starting.
I20260709 13:05:17.466006 13421 tablet_bootstrap.cc:654] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.468465 13427 raft_consensus.cc:493] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.468963 13427 raft_consensus.cc:515] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.472679 13420 tablet_bootstrap.cc:654] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.476876 13427 leader_election.cc:290] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:17.487205 13420 tablet_bootstrap.cc:492] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e: No bootstrap required, opened a new log
I20260709 13:05:17.487893 13420 ts_tablet_manager.cc:1403] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
I20260709 13:05:17.491314 13420 raft_consensus.cc:359] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.492010 13420 raft_consensus.cc:385] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.492404 13420 raft_consensus.cc:740] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8622d9c551284c64bf6c7823b884931e, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.494071 13425 raft_consensus.cc:493] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.493815 13420 consensus_queue.cc:260] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.494519 13425 raft_consensus.cc:515] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.497300 13420 ts_tablet_manager.cc:1434] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:05:17.498544 13420 tablet_bootstrap.cc:492] T b4ad90cfb88b4e7da57828e306d4a826 P 8622d9c551284c64bf6c7823b884931e: Bootstrap starting.
I20260709 13:05:17.507694 13420 tablet_bootstrap.cc:654] T b4ad90cfb88b4e7da57828e306d4a826 P 8622d9c551284c64bf6c7823b884931e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.512938 13425 leader_election.cc:290] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:17.516911 13427 raft_consensus.cc:493] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.517489 13427 raft_consensus.cc:515] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.520063 13427 leader_election.cc:290] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:17.520715 13420 tablet_bootstrap.cc:492] T b4ad90cfb88b4e7da57828e306d4a826 P 8622d9c551284c64bf6c7823b884931e: No bootstrap required, opened a new log
I20260709 13:05:17.521325 13420 ts_tablet_manager.cc:1403] T b4ad90cfb88b4e7da57828e306d4a826 P 8622d9c551284c64bf6c7823b884931e: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.015s
I20260709 13:05:17.525070 13420 raft_consensus.cc:359] T b4ad90cfb88b4e7da57828e306d4a826 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.525993 13420 raft_consensus.cc:385] T b4ad90cfb88b4e7da57828e306d4a826 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.526341 13420 raft_consensus.cc:740] T b4ad90cfb88b4e7da57828e306d4a826 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8622d9c551284c64bf6c7823b884931e, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.527220 13420 consensus_queue.cc:260] T b4ad90cfb88b4e7da57828e306d4a826 P 8622d9c551284c64bf6c7823b884931e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.530362 13420 ts_tablet_manager.cc:1434] T b4ad90cfb88b4e7da57828e306d4a826 P 8622d9c551284c64bf6c7823b884931e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:05:17.531198 13420 tablet_bootstrap.cc:492] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e: Bootstrap starting.
I20260709 13:05:17.532701 13419 tablet_bootstrap.cc:492] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 5dc262ea4f614d39aacea282a4df8324: No bootstrap required, opened a new log
I20260709 13:05:17.533222 13419 ts_tablet_manager.cc:1403] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 5dc262ea4f614d39aacea282a4df8324: Time spent bootstrapping tablet: real 0.093s	user 0.039s	sys 0.042s
I20260709 13:05:17.536216 13419 raft_consensus.cc:359] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } } peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } }
I20260709 13:05:17.536947 13419 raft_consensus.cc:385] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.537357 13420 tablet_bootstrap.cc:654] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.537307 13419 raft_consensus.cc:740] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dc262ea4f614d39aacea282a4df8324, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.538322 13419 consensus_queue.cc:260] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 5dc262ea4f614d39aacea282a4df8324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } } peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } }
I20260709 13:05:17.540637 13379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e49fda44f3f44c5eb31ca3b3f22ae75b" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8622d9c551284c64bf6c7823b884931e" is_pre_election: true
I20260709 13:05:17.541247 13379 raft_consensus.cc:2468] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 0.
I20260709 13:05:17.542382 13378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb86f5947d5b4026a6ab05840d002510" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8622d9c551284c64bf6c7823b884931e" is_pre_election: true
I20260709 13:05:17.543556 13419 ts_tablet_manager.cc:1434] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 5dc262ea4f614d39aacea282a4df8324: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:05:17.544886 13419 tablet_bootstrap.cc:492] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324: Bootstrap starting.
I20260709 13:05:17.553654 13419 tablet_bootstrap.cc:654] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.556190 13193 leader_election.cc:304] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 8622d9c551284c64bf6c7823b884931e; no voters: 
I20260709 13:05:17.557024 13427 raft_consensus.cc:2804] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.557416 13427 raft_consensus.cc:493] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.557610 13425 raft_consensus.cc:493] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.557778 13427 raft_consensus.cc:3060] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.558068 13425 raft_consensus.cc:515] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.560081 13425 leader_election.cc:290] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
W20260709 13:05:17.563707 13193 leader_election.cc:343] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.564425 13425 raft_consensus.cc:493] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.564842 13425 raft_consensus.cc:515] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.565657 13427 raft_consensus.cc:515] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.566803 13425 leader_election.cc:290] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:17.567589 13419 tablet_bootstrap.cc:492] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324: No bootstrap required, opened a new log
I20260709 13:05:17.568274 13419 ts_tablet_manager.cc:1403] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324: Time spent bootstrapping tablet: real 0.024s	user 0.020s	sys 0.002s
I20260709 13:05:17.569228 13427 leader_election.cc:290] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 1 election: Requested vote from peers 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:17.569280 13305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e49fda44f3f44c5eb31ca3b3f22ae75b" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc262ea4f614d39aacea282a4df8324" is_pre_election: true
I20260709 13:05:17.570159 13305 raft_consensus.cc:2468] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 0.
I20260709 13:05:17.570942 13421 tablet_bootstrap.cc:492] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3: No bootstrap required, opened a new log
I20260709 13:05:17.571269 13421 ts_tablet_manager.cc:1403] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3: Time spent bootstrapping tablet: real 0.112s	user 0.013s	sys 0.021s
I20260709 13:05:17.571169 13304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb86f5947d5b4026a6ab05840d002510" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc262ea4f614d39aacea282a4df8324" is_pre_election: true
I20260709 13:05:17.569316 13378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e49fda44f3f44c5eb31ca3b3f22ae75b" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8622d9c551284c64bf6c7823b884931e"
I20260709 13:05:17.571938 13303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e49fda44f3f44c5eb31ca3b3f22ae75b" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
I20260709 13:05:17.572678 13304 raft_consensus.cc:2468] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 0.
I20260709 13:05:17.572867 13303 raft_consensus.cc:3060] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.572679 13378 raft_consensus.cc:3060] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.577992 13421 raft_consensus.cc:359] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.578454 13421 raft_consensus.cc:385] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.578629 13421 raft_consensus.cc:740] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.579201 13421 consensus_queue.cc:260] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.579803 13303 raft_consensus.cc:2468] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 1.
I20260709 13:05:17.572237 13420 tablet_bootstrap.cc:492] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e: No bootstrap required, opened a new log
I20260709 13:05:17.580346 13196 leader_election.cc:304] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 5dc262ea4f614d39aacea282a4df8324; no voters: 8622d9c551284c64bf6c7823b884931e
I20260709 13:05:17.580806 13420 ts_tablet_manager.cc:1403] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.022s
I20260709 13:05:17.583707 13196 leader_election.cc:304] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 5dc262ea4f614d39aacea282a4df8324; no voters: 
I20260709 13:05:17.583583 13420 raft_consensus.cc:359] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.584244 13427 raft_consensus.cc:2804] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.584263 13420 raft_consensus.cc:385] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.584748 13427 raft_consensus.cc:493] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.584806 13420 raft_consensus.cc:740] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8622d9c551284c64bf6c7823b884931e, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.585201 13427 raft_consensus.cc:3060] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.585992 13420 consensus_queue.cc:260] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.587116 13378 raft_consensus.cc:2468] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 1.
I20260709 13:05:17.587873 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e49fda44f3f44c5eb31ca3b3f22ae75b" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "533c00b18a1345068c467160b9a85bb3" is_pre_election: true
I20260709 13:05:17.588766 13230 raft_consensus.cc:2393] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dc262ea4f614d39aacea282a4df8324 in current term 1: Already voted for candidate 533c00b18a1345068c467160b9a85bb3 in this term.
I20260709 13:05:17.588809 13420 ts_tablet_manager.cc:1434] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:17.589897 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b12f66d7be4f3e921385efe5928af6" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "533c00b18a1345068c467160b9a85bb3" is_pre_election: true
I20260709 13:05:17.591210 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3099712325a14ecab36ee23e1d9c9662" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "533c00b18a1345068c467160b9a85bb3" is_pre_election: true
I20260709 13:05:17.591945 13228 raft_consensus.cc:2468] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dc262ea4f614d39aacea282a4df8324 in term 0.
I20260709 13:05:17.593024 13420 tablet_bootstrap.cc:492] T 6d85ee6760334c4fac4fb91bc0f604cb P 8622d9c551284c64bf6c7823b884931e: Bootstrap starting.
I20260709 13:05:17.594648 13421 ts_tablet_manager.cc:1434] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260709 13:05:17.594336 13419 raft_consensus.cc:359] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.595050 13419 raft_consensus.cc:385] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.595341 13419 raft_consensus.cc:740] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dc262ea4f614d39aacea282a4df8324, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.592530 13379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b12f66d7be4f3e921385efe5928af6" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8622d9c551284c64bf6c7823b884931e" is_pre_election: true
I20260709 13:05:17.596065 13419 consensus_queue.cc:260] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.597491 13379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3099712325a14ecab36ee23e1d9c9662" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8622d9c551284c64bf6c7823b884931e" is_pre_election: true
I20260709 13:05:17.598073 13379 raft_consensus.cc:2468] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dc262ea4f614d39aacea282a4df8324 in term 0.
I20260709 13:05:17.598253 13419 ts_tablet_manager.cc:1434] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.000s
I20260709 13:05:17.599275 13420 tablet_bootstrap.cc:654] T 6d85ee6760334c4fac4fb91bc0f604cb P 8622d9c551284c64bf6c7823b884931e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.592675 13378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e49fda44f3f44c5eb31ca3b3f22ae75b" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8622d9c551284c64bf6c7823b884931e" is_pre_election: true
I20260709 13:05:17.600744 13378 raft_consensus.cc:2393] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5dc262ea4f614d39aacea282a4df8324 in current term 1: Already voted for candidate 533c00b18a1345068c467160b9a85bb3 in this term.
I20260709 13:05:17.591173 13446 raft_consensus.cc:2804] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:05:17.599220 13268 leader_election.cc:343] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.602335 13268 leader_election.cc:304] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dc262ea4f614d39aacea282a4df8324, 8622d9c551284c64bf6c7823b884931e; no voters: 
I20260709 13:05:17.592381 13427 raft_consensus.cc:515] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.603281 13268 leader_election.cc:304] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dc262ea4f614d39aacea282a4df8324; no voters: 533c00b18a1345068c467160b9a85bb3, 8622d9c551284c64bf6c7823b884931e
I20260709 13:05:17.604262 13421 tablet_bootstrap.cc:492] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3: Bootstrap starting.
I20260709 13:05:17.605386 13425 raft_consensus.cc:2804] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.605756 13425 raft_consensus.cc:493] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.606089 13425 raft_consensus.cc:3060] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.607808 13419 tablet_bootstrap.cc:492] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324: Bootstrap starting.
I20260709 13:05:17.607944 13378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb86f5947d5b4026a6ab05840d002510" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8622d9c551284c64bf6c7823b884931e"
I20260709 13:05:17.608944 13378 raft_consensus.cc:3060] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.611162 13427 leader_election.cc:290] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 1 election: Requested vote from peers 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:17.615000 13421 tablet_bootstrap.cc:654] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.618101 13446 raft_consensus.cc:697] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 1 LEADER]: Becoming Leader. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Running, Role: LEADER
I20260709 13:05:17.619539 13446 consensus_queue.cc:237] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
W20260709 13:05:17.620962 13176 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:17.623718 13419 tablet_bootstrap.cc:654] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:17.627892 13269 leader_election.cc:343] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.630796 13269 leader_election.cc:304] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dc262ea4f614d39aacea282a4df8324; no voters: 533c00b18a1345068c467160b9a85bb3, 8622d9c551284c64bf6c7823b884931e
I20260709 13:05:17.633592 13420 tablet_bootstrap.cc:492] T 6d85ee6760334c4fac4fb91bc0f604cb P 8622d9c551284c64bf6c7823b884931e: No bootstrap required, opened a new log
I20260709 13:05:17.640482 13420 ts_tablet_manager.cc:1403] T 6d85ee6760334c4fac4fb91bc0f604cb P 8622d9c551284c64bf6c7823b884931e: Time spent bootstrapping tablet: real 0.051s	user 0.023s	sys 0.017s
I20260709 13:05:17.641640 13449 raft_consensus.cc:2749] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:17.633430 13425 raft_consensus.cc:515] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.644179 13425 leader_election.cc:290] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 1 election: Requested vote from peers 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:17.644137 13420 raft_consensus.cc:359] T 6d85ee6760334c4fac4fb91bc0f604cb P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.645262 13420 raft_consensus.cc:385] T 6d85ee6760334c4fac4fb91bc0f604cb P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.645684 13420 raft_consensus.cc:740] T 6d85ee6760334c4fac4fb91bc0f604cb P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8622d9c551284c64bf6c7823b884931e, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.646620 13379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3099712325a14ecab36ee23e1d9c9662" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8622d9c551284c64bf6c7823b884931e"
I20260709 13:05:17.646401 13124 catalog_manager.cc:5697] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 533c00b18a1345068c467160b9a85bb3 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "533c00b18a1345068c467160b9a85bb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.633359 13378 raft_consensus.cc:2468] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 1.
I20260709 13:05:17.647495 13379 raft_consensus.cc:3060] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.639074 13453 raft_consensus.cc:2749] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:17.646703 13420 consensus_queue.cc:260] T 6d85ee6760334c4fac4fb91bc0f604cb P 8622d9c551284c64bf6c7823b884931e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.648705 13193 leader_election.cc:304] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 8622d9c551284c64bf6c7823b884931e; no voters: 
I20260709 13:05:17.650686 13420 ts_tablet_manager.cc:1434] T 6d85ee6760334c4fac4fb91bc0f604cb P 8622d9c551284c64bf6c7823b884931e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:05:17.650913 13446 raft_consensus.cc:2804] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.651473 13446 raft_consensus.cc:697] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 1 LEADER]: Becoming Leader. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Running, Role: LEADER
I20260709 13:05:17.651921 13420 tablet_bootstrap.cc:492] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e: Bootstrap starting.
I20260709 13:05:17.652359 13446 consensus_queue.cc:237] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.657084 13379 raft_consensus.cc:2468] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dc262ea4f614d39aacea282a4df8324 in term 1.
I20260709 13:05:17.658488 13268 leader_election.cc:304] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dc262ea4f614d39aacea282a4df8324, 8622d9c551284c64bf6c7823b884931e; no voters: 
I20260709 13:05:17.659400 13420 tablet_bootstrap.cc:654] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.659469 13453 raft_consensus.cc:2804] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.660187 13453 raft_consensus.cc:697] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [term 1 LEADER]: Becoming Leader. State: Replica: 5dc262ea4f614d39aacea282a4df8324, State: Running, Role: LEADER
I20260709 13:05:17.661331 13453 consensus_queue.cc:237] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.667595 13425 raft_consensus.cc:493] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.669214 13303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb86f5947d5b4026a6ab05840d002510" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
I20260709 13:05:17.669939 13303 raft_consensus.cc:3060] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.680996 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3099712325a14ecab36ee23e1d9c9662" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "533c00b18a1345068c467160b9a85bb3"
I20260709 13:05:17.679349 13303 raft_consensus.cc:2468] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 1.
I20260709 13:05:17.681921 13228 raft_consensus.cc:3060] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.668181 13425 raft_consensus.cc:515] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.697597 13426 raft_consensus.cc:493] T b4ad90cfb88b4e7da57828e306d4a826 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.698257 13426 raft_consensus.cc:515] T b4ad90cfb88b4e7da57828e306d4a826 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.707834 13425 leader_election.cc:290] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:17.708917 13379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ad90cfb88b4e7da57828e306d4a826" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8622d9c551284c64bf6c7823b884931e" is_pre_election: true
I20260709 13:05:17.709529 13379 raft_consensus.cc:2468] T b4ad90cfb88b4e7da57828e306d4a826 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dc262ea4f614d39aacea282a4df8324 in term 0.
I20260709 13:05:17.709836 13426 leader_election.cc:290] T b4ad90cfb88b4e7da57828e306d4a826 P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285), 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693)
I20260709 13:05:17.710299 13426 raft_consensus.cc:493] T 6d85ee6760334c4fac4fb91bc0f604cb P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.710760 13426 raft_consensus.cc:515] T 6d85ee6760334c4fac4fb91bc0f604cb P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.715086 13128 catalog_manager.cc:5697] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "5dc262ea4f614d39aacea282a4df8324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.716126 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ad90cfb88b4e7da57828e306d4a826" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "533c00b18a1345068c467160b9a85bb3" is_pre_election: true
I20260709 13:05:17.716744 13229 raft_consensus.cc:2468] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dc262ea4f614d39aacea282a4df8324 in term 0.
I20260709 13:05:17.715137 13426 leader_election.cc:290] T 6d85ee6760334c4fac4fb91bc0f604cb P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285), 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693)
I20260709 13:05:17.720135 13228 raft_consensus.cc:2468] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dc262ea4f614d39aacea282a4df8324 in term 1.
I20260709 13:05:17.724013 13269 leader_election.cc:304] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 5dc262ea4f614d39aacea282a4df8324; no voters: 
I20260709 13:05:17.724906 13421 tablet_bootstrap.cc:492] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3: No bootstrap required, opened a new log
I20260709 13:05:17.725375 13421 ts_tablet_manager.cc:1403] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3: Time spent bootstrapping tablet: real 0.121s	user 0.023s	sys 0.023s
I20260709 13:05:17.725311 13425 raft_consensus.cc:2804] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.726078 13425 raft_consensus.cc:493] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.726652 13425 raft_consensus.cc:3060] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.728940 13420 tablet_bootstrap.cc:492] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e: No bootstrap required, opened a new log
I20260709 13:05:17.729583 13420 ts_tablet_manager.cc:1403] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e: Time spent bootstrapping tablet: real 0.078s	user 0.023s	sys 0.031s
I20260709 13:05:17.733371 13420 raft_consensus.cc:359] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.734247 13420 raft_consensus.cc:385] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.734617 13420 raft_consensus.cc:740] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8622d9c551284c64bf6c7823b884931e, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.736406 13419 tablet_bootstrap.cc:492] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324: No bootstrap required, opened a new log
I20260709 13:05:17.735787 13420 consensus_queue.cc:260] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.737128 13419 ts_tablet_manager.cc:1403] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324: Time spent bootstrapping tablet: real 0.130s	user 0.023s	sys 0.030s
I20260709 13:05:17.734560 13421 raft_consensus.cc:359] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } } peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } }
I20260709 13:05:17.740692 13421 raft_consensus.cc:385] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.741118 13421 raft_consensus.cc:740] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.741487 13420 ts_tablet_manager.cc:1434] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 13:05:17.742771 13420 tablet_bootstrap.cc:492] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e: Bootstrap starting.
I20260709 13:05:17.745083 13419 raft_consensus.cc:359] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.746057 13419 raft_consensus.cc:385] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.746448 13419 raft_consensus.cc:740] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dc262ea4f614d39aacea282a4df8324, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.747469 13421 consensus_queue.cc:260] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } } peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } }
I20260709 13:05:17.749677 13421 ts_tablet_manager.cc:1434] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:05:17.750578 13421 tablet_bootstrap.cc:492] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3: Bootstrap starting.
I20260709 13:05:17.753877 13425 raft_consensus.cc:515] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.756696 13421 tablet_bootstrap.cc:654] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.760056 13419 consensus_queue.cc:260] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.763595 13419 ts_tablet_manager.cc:1434] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.001s
I20260709 13:05:17.764917 13419 tablet_bootstrap.cc:492] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324: Bootstrap starting.
I20260709 13:05:17.766253 13124 catalog_manager.cc:5697] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 533c00b18a1345068c467160b9a85bb3 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "533c00b18a1345068c467160b9a85bb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.772833 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ad90cfb88b4e7da57828e306d4a826" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "533c00b18a1345068c467160b9a85bb3"
I20260709 13:05:17.773471 13228 raft_consensus.cc:3060] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.780017 13228 raft_consensus.cc:2468] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dc262ea4f614d39aacea282a4df8324 in term 1.
I20260709 13:05:17.781113 13269 leader_election.cc:304] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 5dc262ea4f614d39aacea282a4df8324; no voters: 
I20260709 13:05:17.781970 13453 raft_consensus.cc:2804] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.782451 13453 raft_consensus.cc:697] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [term 1 LEADER]: Becoming Leader. State: Replica: 5dc262ea4f614d39aacea282a4df8324, State: Running, Role: LEADER
I20260709 13:05:17.783253 13453 consensus_queue.cc:237] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.783998 13419 tablet_bootstrap.cc:654] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.785290 13379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ad90cfb88b4e7da57828e306d4a826" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8622d9c551284c64bf6c7823b884931e"
I20260709 13:05:17.785985 13379 raft_consensus.cc:3060] T b4ad90cfb88b4e7da57828e306d4a826 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.786302 13304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d85ee6760334c4fac4fb91bc0f604cb" candidate_uuid: "8622d9c551284c64bf6c7823b884931e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc262ea4f614d39aacea282a4df8324" is_pre_election: true
I20260709 13:05:17.787077 13426 raft_consensus.cc:493] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.787552 13426 raft_consensus.cc:515] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } } peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } }
I20260709 13:05:17.789283 13426 leader_election.cc:290] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693), 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285)
I20260709 13:05:17.772863 13425 leader_election.cc:290] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 1 election: Requested vote from peers 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:17.786691 13420 tablet_bootstrap.cc:654] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.791836 13303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ad90cfb88b4e7da57828e306d4a826" candidate_uuid: "8622d9c551284c64bf6c7823b884931e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc262ea4f614d39aacea282a4df8324" is_pre_election: true
I20260709 13:05:17.794166 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d85ee6760334c4fac4fb91bc0f604cb" candidate_uuid: "8622d9c551284c64bf6c7823b884931e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "533c00b18a1345068c467160b9a85bb3" is_pre_election: true
I20260709 13:05:17.794737 13303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec35bffd03ef4c0f9d9d70c26cfcc766" candidate_uuid: "8622d9c551284c64bf6c7823b884931e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc262ea4f614d39aacea282a4df8324" is_pre_election: true
I20260709 13:05:17.794706 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ad90cfb88b4e7da57828e306d4a826" candidate_uuid: "8622d9c551284c64bf6c7823b884931e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "533c00b18a1345068c467160b9a85bb3" is_pre_election: true
I20260709 13:05:17.795286 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec35bffd03ef4c0f9d9d70c26cfcc766" candidate_uuid: "8622d9c551284c64bf6c7823b884931e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "533c00b18a1345068c467160b9a85bb3" is_pre_election: true
I20260709 13:05:17.795572 13303 raft_consensus.cc:2468] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8622d9c551284c64bf6c7823b884931e in term 0.
I20260709 13:05:17.795977 13228 raft_consensus.cc:2393] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8622d9c551284c64bf6c7823b884931e in current term 1: Already voted for candidate 5dc262ea4f614d39aacea282a4df8324 in this term.
I20260709 13:05:17.795914 13230 raft_consensus.cc:2468] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8622d9c551284c64bf6c7823b884931e in term 0.
W20260709 13:05:17.797706 13343 leader_election.cc:343] T 6d85ee6760334c4fac4fb91bc0f604cb P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.799355 13343 leader_election.cc:304] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 8622d9c551284c64bf6c7823b884931e; no voters: 
W20260709 13:05:17.799660 13345 leader_election.cc:343] T 6d85ee6760334c4fac4fb91bc0f604cb P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.800091 13345 leader_election.cc:304] T 6d85ee6760334c4fac4fb91bc0f604cb P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8622d9c551284c64bf6c7823b884931e; no voters: 533c00b18a1345068c467160b9a85bb3, 5dc262ea4f614d39aacea282a4df8324
I20260709 13:05:17.800256 13426 raft_consensus.cc:2804] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.800642 13426 raft_consensus.cc:493] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.800981 13426 raft_consensus.cc:3060] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.801291 13345 leader_election.cc:304] T b4ad90cfb88b4e7da57828e306d4a826 P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8622d9c551284c64bf6c7823b884931e; no voters: 533c00b18a1345068c467160b9a85bb3, 5dc262ea4f614d39aacea282a4df8324
I20260709 13:05:17.803915 13459 raft_consensus.cc:2749] T 6d85ee6760334c4fac4fb91bc0f604cb P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:17.806958 13379 raft_consensus.cc:2468] T b4ad90cfb88b4e7da57828e306d4a826 P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dc262ea4f614d39aacea282a4df8324 in term 1.
I20260709 13:05:17.807507 13459 raft_consensus.cc:2749] T b4ad90cfb88b4e7da57828e306d4a826 P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:17.810910 13426 raft_consensus.cc:515] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } } peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } }
I20260709 13:05:17.815032 13421 tablet_bootstrap.cc:492] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3: No bootstrap required, opened a new log
I20260709 13:05:17.815508 13419 tablet_bootstrap.cc:492] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324: No bootstrap required, opened a new log
I20260709 13:05:17.815514 13426 leader_election.cc:290] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 1 election: Requested vote from peers 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693), 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285)
I20260709 13:05:17.815752 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec35bffd03ef4c0f9d9d70c26cfcc766" candidate_uuid: "8622d9c551284c64bf6c7823b884931e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "533c00b18a1345068c467160b9a85bb3"
I20260709 13:05:17.816195 13419 ts_tablet_manager.cc:1403] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324: Time spent bootstrapping tablet: real 0.052s	user 0.006s	sys 0.010s
I20260709 13:05:17.815923 13124 catalog_manager.cc:5697] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "5dc262ea4f614d39aacea282a4df8324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.816491 13230 raft_consensus.cc:3060] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.818969 13419 raft_consensus.cc:359] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.819621 13419 raft_consensus.cc:385] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.819880 13419 raft_consensus.cc:740] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dc262ea4f614d39aacea282a4df8324, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.821645 13419 consensus_queue.cc:260] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.823500 13419 ts_tablet_manager.cc:1434] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:17.823659 13421 ts_tablet_manager.cc:1403] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3: Time spent bootstrapping tablet: real 0.073s	user 0.020s	sys 0.024s
I20260709 13:05:17.824390 13419 tablet_bootstrap.cc:492] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324: Bootstrap starting.
I20260709 13:05:17.827389 13421 raft_consensus.cc:359] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.832571 13421 raft_consensus.cc:385] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.832998 13421 raft_consensus.cc:740] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.830368 13230 raft_consensus.cc:2468] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8622d9c551284c64bf6c7823b884931e in term 1.
I20260709 13:05:17.829988 13419 tablet_bootstrap.cc:654] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.834034 13453 raft_consensus.cc:493] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.837723 13453 raft_consensus.cc:515] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.834043 13421 consensus_queue.cc:260] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.839510 13343 leader_election.cc:304] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 8622d9c551284c64bf6c7823b884931e; no voters: 
I20260709 13:05:17.841123 13426 raft_consensus.cc:2804] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.841637 13426 raft_consensus.cc:697] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [term 1 LEADER]: Becoming Leader. State: Replica: 8622d9c551284c64bf6c7823b884931e, State: Running, Role: LEADER
I20260709 13:05:17.842511 13426 consensus_queue.cc:237] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } } peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } }
I20260709 13:05:17.843321 13421 ts_tablet_manager.cc:1434] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.006s
I20260709 13:05:17.845357 13421 tablet_bootstrap.cc:492] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3: Bootstrap starting.
I20260709 13:05:17.846884 13420 tablet_bootstrap.cc:492] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e: No bootstrap required, opened a new log
I20260709 13:05:17.847326 13420 ts_tablet_manager.cc:1403] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e: Time spent bootstrapping tablet: real 0.105s	user 0.009s	sys 0.003s
I20260709 13:05:17.849861 13420 raft_consensus.cc:359] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.850515 13420 raft_consensus.cc:385] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.850780 13420 raft_consensus.cc:740] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8622d9c551284c64bf6c7823b884931e, State: Initialized, Role: FOLLOWER
W20260709 13:05:17.851850 13345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:33693, user_credentials={real_user=slave}} blocked reactor thread for 50637.4us
I20260709 13:05:17.844456 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5735d383ce4c88a68c42640f1d7018" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "533c00b18a1345068c467160b9a85bb3" is_pre_election: true
I20260709 13:05:17.855195 13420 consensus_queue.cc:260] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
W20260709 13:05:17.856036 13269 leader_election.cc:343] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.857007 13453 leader_election.cc:290] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:17.859673 13420 ts_tablet_manager.cc:1434] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:05:17.859754 13379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5735d383ce4c88a68c42640f1d7018" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8622d9c551284c64bf6c7823b884931e" is_pre_election: true
I20260709 13:05:17.860615 13420 tablet_bootstrap.cc:492] T fd5735d383ce4c88a68c42640f1d7018 P 8622d9c551284c64bf6c7823b884931e: Bootstrap starting.
I20260709 13:05:17.860734 13303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec35bffd03ef4c0f9d9d70c26cfcc766" candidate_uuid: "8622d9c551284c64bf6c7823b884931e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
I20260709 13:05:17.861297 13303 raft_consensus.cc:3060] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.862247 13419 tablet_bootstrap.cc:492] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324: No bootstrap required, opened a new log
I20260709 13:05:17.862665 13419 ts_tablet_manager.cc:1403] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.008s
I20260709 13:05:17.862941 13426 raft_consensus.cc:493] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.863379 13426 raft_consensus.cc:515] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.865231 13419 raft_consensus.cc:359] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.866039 13419 raft_consensus.cc:385] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.865222 13124 catalog_manager.cc:5697] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8622d9c551284c64bf6c7823b884931e (127.12.76.131). New cstate: current_term: 1 leader_uuid: "8622d9c551284c64bf6c7823b884931e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.866096 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b12f66d7be4f3e921385efe5928af6" candidate_uuid: "8622d9c551284c64bf6c7823b884931e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "533c00b18a1345068c467160b9a85bb3" is_pre_election: true
I20260709 13:05:17.866365 13419 raft_consensus.cc:740] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dc262ea4f614d39aacea282a4df8324, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.866727 13230 raft_consensus.cc:2468] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8622d9c551284c64bf6c7823b884931e in term 0.
I20260709 13:05:17.867059 13419 consensus_queue.cc:260] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.867705 13343 leader_election.cc:304] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 8622d9c551284c64bf6c7823b884931e; no voters: 
I20260709 13:05:17.868670 13466 raft_consensus.cc:2804] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.869021 13466 raft_consensus.cc:493] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.869150 13419 ts_tablet_manager.cc:1434] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:17.869377 13466 raft_consensus.cc:3060] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.870012 13419 tablet_bootstrap.cc:492] T 328f1a117e8240b0bdf504a180570a87 P 5dc262ea4f614d39aacea282a4df8324: Bootstrap starting.
W20260709 13:05:17.871645 13268 leader_election.cc:343] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.872102 13268 leader_election.cc:304] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5dc262ea4f614d39aacea282a4df8324; no voters: 533c00b18a1345068c467160b9a85bb3, 8622d9c551284c64bf6c7823b884931e
I20260709 13:05:17.873121 13453 raft_consensus.cc:2749] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:17.875895 13419 tablet_bootstrap.cc:654] T 328f1a117e8240b0bdf504a180570a87 P 5dc262ea4f614d39aacea282a4df8324: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.878208 13446 raft_consensus.cc:493] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.879334 13426 leader_election.cc:290] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285), 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693)
I20260709 13:05:17.879120 13446 raft_consensus.cc:515] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.881287 13446 leader_election.cc:290] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:17.883235 13453 raft_consensus.cc:493] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.881954 13305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d865fbf795f4c298e057cb83a90facf" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc262ea4f614d39aacea282a4df8324" is_pre_election: true
I20260709 13:05:17.883977 13305 raft_consensus.cc:2468] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 0.
I20260709 13:05:17.883755 13453 raft_consensus.cc:515] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.884487 13420 tablet_bootstrap.cc:654] T fd5735d383ce4c88a68c42640f1d7018 P 8622d9c551284c64bf6c7823b884931e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.882239 13304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b12f66d7be4f3e921385efe5928af6" candidate_uuid: "8622d9c551284c64bf6c7823b884931e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc262ea4f614d39aacea282a4df8324" is_pre_election: true
I20260709 13:05:17.885196 13304 raft_consensus.cc:2468] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8622d9c551284c64bf6c7823b884931e in term 0.
I20260709 13:05:17.885684 13453 leader_election.cc:290] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:17.879350 13421 tablet_bootstrap.cc:654] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.882444 13379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d865fbf795f4c298e057cb83a90facf" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8622d9c551284c64bf6c7823b884931e" is_pre_election: true
I20260709 13:05:17.886165 13303 raft_consensus.cc:2468] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8622d9c551284c64bf6c7823b884931e in term 1.
I20260709 13:05:17.881333 13466 raft_consensus.cc:515] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.888911 13378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d85ee6760334c4fac4fb91bc0f604cb" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8622d9c551284c64bf6c7823b884931e" is_pre_election: true
I20260709 13:05:17.888743 13196 leader_election.cc:304] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 5dc262ea4f614d39aacea282a4df8324; no voters: 
I20260709 13:05:17.887243 13379 raft_consensus.cc:2468] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 0.
I20260709 13:05:17.890654 13446 raft_consensus.cc:2804] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.889868 13378 raft_consensus.cc:2468] T 6d85ee6760334c4fac4fb91bc0f604cb P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dc262ea4f614d39aacea282a4df8324 in term 0.
I20260709 13:05:17.891633 13446 raft_consensus.cc:493] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.892061 13446 raft_consensus.cc:3060] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.892464 13268 leader_election.cc:304] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dc262ea4f614d39aacea282a4df8324, 8622d9c551284c64bf6c7823b884931e; no voters: 
I20260709 13:05:17.894519 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d85ee6760334c4fac4fb91bc0f604cb" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "533c00b18a1345068c467160b9a85bb3" is_pre_election: true
I20260709 13:05:17.896639 13466 leader_election.cc:290] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 1 election: Requested vote from peers 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285), 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693)
I20260709 13:05:17.897648 13453 raft_consensus.cc:2804] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.898030 13453 raft_consensus.cc:493] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.898383 13453 raft_consensus.cc:3060] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.898175 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b12f66d7be4f3e921385efe5928af6" candidate_uuid: "8622d9c551284c64bf6c7823b884931e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "533c00b18a1345068c467160b9a85bb3"
I20260709 13:05:17.898979 13230 raft_consensus.cc:3060] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.900275 13446 raft_consensus.cc:515] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
W20260709 13:05:17.895995 13269 leader_election.cc:343] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.904776 13378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d865fbf795f4c298e057cb83a90facf" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8622d9c551284c64bf6c7823b884931e"
I20260709 13:05:17.904968 13446 leader_election.cc:290] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 1 election: Requested vote from peers 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:17.905018 13303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d865fbf795f4c298e057cb83a90facf" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
I20260709 13:05:17.905066 13304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b12f66d7be4f3e921385efe5928af6" candidate_uuid: "8622d9c551284c64bf6c7823b884931e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
I20260709 13:05:17.905356 13378 raft_consensus.cc:3060] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.905848 13304 raft_consensus.cc:3060] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.907230 13420 tablet_bootstrap.cc:492] T fd5735d383ce4c88a68c42640f1d7018 P 8622d9c551284c64bf6c7823b884931e: No bootstrap required, opened a new log
I20260709 13:05:17.905748 13303 raft_consensus.cc:3060] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.907902 13420 ts_tablet_manager.cc:1403] T fd5735d383ce4c88a68c42640f1d7018 P 8622d9c551284c64bf6c7823b884931e: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.004s
I20260709 13:05:17.910748 13230 raft_consensus.cc:2468] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8622d9c551284c64bf6c7823b884931e in term 1.
I20260709 13:05:17.910831 13420 raft_consensus.cc:359] T fd5735d383ce4c88a68c42640f1d7018 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.912335 13378 raft_consensus.cc:2468] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 1.
I20260709 13:05:17.915376 13420 raft_consensus.cc:385] T fd5735d383ce4c88a68c42640f1d7018 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.916039 13420 raft_consensus.cc:740] T fd5735d383ce4c88a68c42640f1d7018 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8622d9c551284c64bf6c7823b884931e, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.916167 13343 leader_election.cc:304] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 8622d9c551284c64bf6c7823b884931e; no voters: 
I20260709 13:05:17.916934 13466 raft_consensus.cc:2804] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.916756 13420 consensus_queue.cc:260] T fd5735d383ce4c88a68c42640f1d7018 P 8622d9c551284c64bf6c7823b884931e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.917145 13193 leader_election.cc:304] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 8622d9c551284c64bf6c7823b884931e; no voters: 
I20260709 13:05:17.917459 13466 raft_consensus.cc:697] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [term 1 LEADER]: Becoming Leader. State: Replica: 8622d9c551284c64bf6c7823b884931e, State: Running, Role: LEADER
I20260709 13:05:17.917891 13304 raft_consensus.cc:2468] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8622d9c551284c64bf6c7823b884931e in term 1.
I20260709 13:05:17.914526 13453 raft_consensus.cc:515] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.918318 13466 consensus_queue.cc:237] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.919694 13420 ts_tablet_manager.cc:1434] T fd5735d383ce4c88a68c42640f1d7018 P 8622d9c551284c64bf6c7823b884931e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:05:17.920149 13453 leader_election.cc:290] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 1 election: Requested vote from peers 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:17.917958 13446 raft_consensus.cc:2804] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.920553 13420 tablet_bootstrap.cc:492] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e: Bootstrap starting.
I20260709 13:05:17.920846 13446 raft_consensus.cc:697] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 1 LEADER]: Becoming Leader. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Running, Role: LEADER
I20260709 13:05:17.914108 13419 tablet_bootstrap.cc:492] T 328f1a117e8240b0bdf504a180570a87 P 5dc262ea4f614d39aacea282a4df8324: No bootstrap required, opened a new log
I20260709 13:05:17.921609 13419 ts_tablet_manager.cc:1403] T 328f1a117e8240b0bdf504a180570a87 P 5dc262ea4f614d39aacea282a4df8324: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.003s
I20260709 13:05:17.921715 13446 consensus_queue.cc:237] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.924197 13419 raft_consensus.cc:359] T 328f1a117e8240b0bdf504a180570a87 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.924870 13419 raft_consensus.cc:385] T 328f1a117e8240b0bdf504a180570a87 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.925173 13419 raft_consensus.cc:740] T 328f1a117e8240b0bdf504a180570a87 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dc262ea4f614d39aacea282a4df8324, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.925714 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d85ee6760334c4fac4fb91bc0f604cb" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "533c00b18a1345068c467160b9a85bb3"
I20260709 13:05:17.926018 13378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d85ee6760334c4fac4fb91bc0f604cb" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8622d9c551284c64bf6c7823b884931e"
I20260709 13:05:17.926584 13419 consensus_queue.cc:260] T 328f1a117e8240b0bdf504a180570a87 P 5dc262ea4f614d39aacea282a4df8324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.926901 13303 raft_consensus.cc:2468] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 1.
I20260709 13:05:17.927364 13378 raft_consensus.cc:3060] T 6d85ee6760334c4fac4fb91bc0f604cb P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.927614 13420 tablet_bootstrap.cc:654] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.929541 13419 ts_tablet_manager.cc:1434] T 328f1a117e8240b0bdf504a180570a87 P 5dc262ea4f614d39aacea282a4df8324: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
W20260709 13:05:17.935292 13269 leader_election.cc:343] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.936888 13421 tablet_bootstrap.cc:492] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3: No bootstrap required, opened a new log
I20260709 13:05:17.937755 13421 ts_tablet_manager.cc:1403] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3: Time spent bootstrapping tablet: real 0.093s	user 0.007s	sys 0.005s
I20260709 13:05:17.940047 13127 catalog_manager.cc:5697] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8622d9c551284c64bf6c7823b884931e (127.12.76.131). New cstate: current_term: 1 leader_uuid: "8622d9c551284c64bf6c7823b884931e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:17.945084 13378 raft_consensus.cc:2468] T 6d85ee6760334c4fac4fb91bc0f604cb P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dc262ea4f614d39aacea282a4df8324 in term 1.
I20260709 13:05:17.947629 13268 leader_election.cc:304] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5dc262ea4f614d39aacea282a4df8324, 8622d9c551284c64bf6c7823b884931e; no voters: 533c00b18a1345068c467160b9a85bb3
I20260709 13:05:17.945753 13421 raft_consensus.cc:359] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.948846 13421 raft_consensus.cc:385] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.949376 13420 tablet_bootstrap.cc:492] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e: No bootstrap required, opened a new log
I20260709 13:05:17.948750 13124 catalog_manager.cc:5697] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 533c00b18a1345068c467160b9a85bb3 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "533c00b18a1345068c467160b9a85bb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.949391 13421 raft_consensus.cc:740] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.949954 13420 ts_tablet_manager.cc:1403] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.002s
I20260709 13:05:17.950577 13421 consensus_queue.cc:260] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.952898 13421 ts_tablet_manager.cc:1434] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 13:05:17.952674 13420 raft_consensus.cc:359] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.953418 13420 raft_consensus.cc:385] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.953717 13420 raft_consensus.cc:740] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8622d9c551284c64bf6c7823b884931e, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.953917 13421 tablet_bootstrap.cc:492] T 6d85ee6760334c4fac4fb91bc0f604cb P 533c00b18a1345068c467160b9a85bb3: Bootstrap starting.
I20260709 13:05:17.954520 13420 consensus_queue.cc:260] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.958230 13420 ts_tablet_manager.cc:1434] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:17.949781 13453 raft_consensus.cc:2804] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.959227 13453 raft_consensus.cc:697] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324 [term 1 LEADER]: Becoming Leader. State: Replica: 5dc262ea4f614d39aacea282a4df8324, State: Running, Role: LEADER
I20260709 13:05:17.960075 13453 consensus_queue.cc:237] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.960532 13421 tablet_bootstrap.cc:654] T 6d85ee6760334c4fac4fb91bc0f604cb P 533c00b18a1345068c467160b9a85bb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.970000 13126 catalog_manager.cc:5697] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "5dc262ea4f614d39aacea282a4df8324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.974191 13421 tablet_bootstrap.cc:492] T 6d85ee6760334c4fac4fb91bc0f604cb P 533c00b18a1345068c467160b9a85bb3: No bootstrap required, opened a new log
I20260709 13:05:17.974692 13421 ts_tablet_manager.cc:1403] T 6d85ee6760334c4fac4fb91bc0f604cb P 533c00b18a1345068c467160b9a85bb3: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.009s
I20260709 13:05:17.977401 13421 raft_consensus.cc:359] T 6d85ee6760334c4fac4fb91bc0f604cb P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.977919 13421 raft_consensus.cc:385] T 6d85ee6760334c4fac4fb91bc0f604cb P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.978168 13421 raft_consensus.cc:740] T 6d85ee6760334c4fac4fb91bc0f604cb P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.978727 13421 consensus_queue.cc:260] T 6d85ee6760334c4fac4fb91bc0f604cb P 533c00b18a1345068c467160b9a85bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.980499 13421 ts_tablet_manager.cc:1434] T 6d85ee6760334c4fac4fb91bc0f604cb P 533c00b18a1345068c467160b9a85bb3: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:05:17.981284 13421 tablet_bootstrap.cc:492] T 328f1a117e8240b0bdf504a180570a87 P 533c00b18a1345068c467160b9a85bb3: Bootstrap starting.
I20260709 13:05:17.985747 13421 tablet_bootstrap.cc:654] T 328f1a117e8240b0bdf504a180570a87 P 533c00b18a1345068c467160b9a85bb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.990051 13421 tablet_bootstrap.cc:492] T 328f1a117e8240b0bdf504a180570a87 P 533c00b18a1345068c467160b9a85bb3: No bootstrap required, opened a new log
I20260709 13:05:17.990487 13421 ts_tablet_manager.cc:1403] T 328f1a117e8240b0bdf504a180570a87 P 533c00b18a1345068c467160b9a85bb3: Time spent bootstrapping tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:17.992421 13421 raft_consensus.cc:359] T 328f1a117e8240b0bdf504a180570a87 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.992890 13421 raft_consensus.cc:385] T 328f1a117e8240b0bdf504a180570a87 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.993103 13421 raft_consensus.cc:740] T 328f1a117e8240b0bdf504a180570a87 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.993889 13421 consensus_queue.cc:260] T 328f1a117e8240b0bdf504a180570a87 P 533c00b18a1345068c467160b9a85bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:17.995870 13421 ts_tablet_manager.cc:1434] T 328f1a117e8240b0bdf504a180570a87 P 533c00b18a1345068c467160b9a85bb3: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:05:17.998041 13446 raft_consensus.cc:493] T 6d85ee6760334c4fac4fb91bc0f604cb P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.998445 13446 raft_consensus.cc:515] T 6d85ee6760334c4fac4fb91bc0f604cb P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:18.000660 13446 leader_election.cc:290] T 6d85ee6760334c4fac4fb91bc0f604cb P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:18.001091 13303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d85ee6760334c4fac4fb91bc0f604cb" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc262ea4f614d39aacea282a4df8324" is_pre_election: true
I20260709 13:05:18.001281 13378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d85ee6760334c4fac4fb91bc0f604cb" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8622d9c551284c64bf6c7823b884931e" is_pre_election: true
I20260709 13:05:18.001962 13378 raft_consensus.cc:2393] T 6d85ee6760334c4fac4fb91bc0f604cb P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 533c00b18a1345068c467160b9a85bb3 in current term 1: Already voted for candidate 5dc262ea4f614d39aacea282a4df8324 in this term.
I20260709 13:05:18.002841 13193 leader_election.cc:304] T 6d85ee6760334c4fac4fb91bc0f604cb P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3; no voters: 5dc262ea4f614d39aacea282a4df8324, 8622d9c551284c64bf6c7823b884931e
I20260709 13:05:18.003616 13446 raft_consensus.cc:3060] T 6d85ee6760334c4fac4fb91bc0f604cb P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.008685 13446 raft_consensus.cc:2749] T 6d85ee6760334c4fac4fb91bc0f604cb P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.077709 13453 consensus_queue.cc:1048] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.092200 13453 consensus_queue.cc:1048] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.123004 13466 raft_consensus.cc:493] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.123507 13466 raft_consensus.cc:515] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:18.125133 13466 leader_election.cc:290] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285), 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693)
I20260709 13:05:18.125872 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "328f1a117e8240b0bdf504a180570a87" candidate_uuid: "8622d9c551284c64bf6c7823b884931e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "533c00b18a1345068c467160b9a85bb3" is_pre_election: true
I20260709 13:05:18.126055 13303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "328f1a117e8240b0bdf504a180570a87" candidate_uuid: "8622d9c551284c64bf6c7823b884931e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc262ea4f614d39aacea282a4df8324" is_pre_election: true
I20260709 13:05:18.126518 13230 raft_consensus.cc:2468] T 328f1a117e8240b0bdf504a180570a87 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8622d9c551284c64bf6c7823b884931e in term 0.
I20260709 13:05:18.126567 13303 raft_consensus.cc:2468] T 328f1a117e8240b0bdf504a180570a87 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8622d9c551284c64bf6c7823b884931e in term 0.
I20260709 13:05:18.127652 13345 leader_election.cc:304] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dc262ea4f614d39aacea282a4df8324, 8622d9c551284c64bf6c7823b884931e; no voters: 
I20260709 13:05:18.128316 13466 raft_consensus.cc:2804] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.128634 13466 raft_consensus.cc:493] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.128880 13466 raft_consensus.cc:3060] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.134491 13466 raft_consensus.cc:515] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:18.136034 13466 leader_election.cc:290] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 1 election: Requested vote from peers 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285), 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693)
I20260709 13:05:18.137066 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "328f1a117e8240b0bdf504a180570a87" candidate_uuid: "8622d9c551284c64bf6c7823b884931e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "533c00b18a1345068c467160b9a85bb3"
I20260709 13:05:18.137492 13303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "328f1a117e8240b0bdf504a180570a87" candidate_uuid: "8622d9c551284c64bf6c7823b884931e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
I20260709 13:05:18.137705 13230 raft_consensus.cc:3060] T 328f1a117e8240b0bdf504a180570a87 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.138010 13303 raft_consensus.cc:3060] T 328f1a117e8240b0bdf504a180570a87 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.141821 13446 consensus_queue.cc:1048] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.144479 13303 raft_consensus.cc:2468] T 328f1a117e8240b0bdf504a180570a87 P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8622d9c551284c64bf6c7823b884931e in term 1.
I20260709 13:05:18.144541 13230 raft_consensus.cc:2468] T 328f1a117e8240b0bdf504a180570a87 P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8622d9c551284c64bf6c7823b884931e in term 1.
I20260709 13:05:18.145756 13343 leader_election.cc:304] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 8622d9c551284c64bf6c7823b884931e; no voters: 
I20260709 13:05:18.146659 13466 raft_consensus.cc:2804] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.147130 13466 raft_consensus.cc:697] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e [term 1 LEADER]: Becoming Leader. State: Replica: 8622d9c551284c64bf6c7823b884931e, State: Running, Role: LEADER
I20260709 13:05:18.147936 13466 consensus_queue.cc:237] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:18.158138 13446 consensus_queue.cc:1048] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:18.160027 13485 consensus_queue.cc:1048] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.164217 13126 catalog_manager.cc:5697] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8622d9c551284c64bf6c7823b884931e (127.12.76.131). New cstate: current_term: 1 leader_uuid: "8622d9c551284c64bf6c7823b884931e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:18.177767 13446 consensus_queue.cc:1048] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.268440 13489 raft_consensus.cc:493] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.268908 13489 raft_consensus.cc:515] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:18.270680 13489 leader_election.cc:290] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:18.271605 13303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5735d383ce4c88a68c42640f1d7018" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc262ea4f614d39aacea282a4df8324" is_pre_election: true
I20260709 13:05:18.271826 13378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5735d383ce4c88a68c42640f1d7018" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8622d9c551284c64bf6c7823b884931e" is_pre_election: true
I20260709 13:05:18.272133 13303 raft_consensus.cc:2468] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 0.
I20260709 13:05:18.272434 13378 raft_consensus.cc:2468] T fd5735d383ce4c88a68c42640f1d7018 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 0.
I20260709 13:05:18.273175 13196 leader_election.cc:304] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 5dc262ea4f614d39aacea282a4df8324; no voters: 
I20260709 13:05:18.273913 13489 raft_consensus.cc:2804] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.274276 13489 raft_consensus.cc:493] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.274518 13489 raft_consensus.cc:3060] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.279146 13489 raft_consensus.cc:515] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:18.280917 13489 leader_election.cc:290] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 1 election: Requested vote from peers 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:18.281752 13303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5735d383ce4c88a68c42640f1d7018" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
I20260709 13:05:18.282294 13303 raft_consensus.cc:3060] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.282200 13378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5735d383ce4c88a68c42640f1d7018" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8622d9c551284c64bf6c7823b884931e"
I20260709 13:05:18.282266 13453 consensus_queue.cc:1048] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:18.283008 13378 raft_consensus.cc:3060] T fd5735d383ce4c88a68c42640f1d7018 P 8622d9c551284c64bf6c7823b884931e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.289646 13303 raft_consensus.cc:2468] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 1.
I20260709 13:05:18.290820 13196 leader_election.cc:304] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 5dc262ea4f614d39aacea282a4df8324; no voters: 
I20260709 13:05:18.290997 13378 raft_consensus.cc:2468] T fd5735d383ce4c88a68c42640f1d7018 P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 1.
I20260709 13:05:18.291611 13489 raft_consensus.cc:2804] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.292076 13489 raft_consensus.cc:697] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 1 LEADER]: Becoming Leader. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Running, Role: LEADER
I20260709 13:05:18.292927 13489 consensus_queue.cc:237] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:18.300169 13466 consensus_queue.cc:1048] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.300417 13453 consensus_queue.cc:1048] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.307936 13126 catalog_manager.cc:5697] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 533c00b18a1345068c467160b9a85bb3 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "533c00b18a1345068c467160b9a85bb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.314419 13426 consensus_queue.cc:1048] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [LEADER]: Connected to new peer: Peer: permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.350099 13489 consensus_queue.cc:1048] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.353786 13453 consensus_queue.cc:1048] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.360747 13448 consensus_queue.cc:1048] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.370146 13425 consensus_queue.cc:1048] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.469776 13426 consensus_queue.cc:1048] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.479497 13466 consensus_queue.cc:1048] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [LEADER]: Connected to new peer: Peer: permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.508664 13379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec35bffd03ef4c0f9d9d70c26cfcc766"
dest_uuid: "8622d9c551284c64bf6c7823b884931e"
mode: GRACEFUL
new_leader_uuid: "533c00b18a1345068c467160b9a85bb3"
 from {username='slave'} at 127.0.0.1:58860
I20260709 13:05:18.509194 13379 raft_consensus.cc:606] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [term 1 LEADER]: Received request to transfer leadership to TS 533c00b18a1345068c467160b9a85bb3
I20260709 13:05:18.522395 13303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3099712325a14ecab36ee23e1d9c9662"
dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
mode: GRACEFUL
new_leader_uuid: "533c00b18a1345068c467160b9a85bb3"
 from {username='slave'} at 127.0.0.1:34420
I20260709 13:05:18.522985 13303 raft_consensus.cc:606] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [term 1 LEADER]: Received request to transfer leadership to TS 533c00b18a1345068c467160b9a85bb3
I20260709 13:05:18.527868 13303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4ad90cfb88b4e7da57828e306d4a826"
dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
mode: GRACEFUL
new_leader_uuid: "533c00b18a1345068c467160b9a85bb3"
 from {username='slave'} at 127.0.0.1:34420
I20260709 13:05:18.528434 13303 raft_consensus.cc:606] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [term 1 LEADER]: Received request to transfer leadership to TS 533c00b18a1345068c467160b9a85bb3
I20260709 13:05:18.545782 13230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb86f5947d5b4026a6ab05840d002510"
dest_uuid: "533c00b18a1345068c467160b9a85bb3"
mode: GRACEFUL
new_leader_uuid: "5dc262ea4f614d39aacea282a4df8324"
 from {username='slave'} at 127.0.0.1:45496
I20260709 13:05:18.546238 13230 raft_consensus.cc:606] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 1 LEADER]: Received request to transfer leadership to TS 5dc262ea4f614d39aacea282a4df8324
I20260709 13:05:18.551525 13379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8b12f66d7be4f3e921385efe5928af6"
dest_uuid: "8622d9c551284c64bf6c7823b884931e"
mode: GRACEFUL
new_leader_uuid: "5dc262ea4f614d39aacea282a4df8324"
 from {username='slave'} at 127.0.0.1:58860
I20260709 13:05:18.551942 13379 raft_consensus.cc:606] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [term 1 LEADER]: Received request to transfer leadership to TS 5dc262ea4f614d39aacea282a4df8324
I20260709 13:05:18.556383 13230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd5735d383ce4c88a68c42640f1d7018"
dest_uuid: "533c00b18a1345068c467160b9a85bb3"
mode: GRACEFUL
new_leader_uuid: "5dc262ea4f614d39aacea282a4df8324"
 from {username='slave'} at 127.0.0.1:45496
I20260709 13:05:18.556782 13230 raft_consensus.cc:606] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 1 LEADER]: Received request to transfer leadership to TS 5dc262ea4f614d39aacea282a4df8324
I20260709 13:05:18.560528 13426 consensus_queue.cc:1048] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.570822 13466 consensus_queue.cc:1048] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e [LEADER]: Connected to new peer: Peer: permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.633124 13449 raft_consensus.cc:993] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324: : Instructing follower 533c00b18a1345068c467160b9a85bb3 to start an election
I20260709 13:05:18.633595 13449 raft_consensus.cc:1081] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [term 1 LEADER]: Signalling peer 533c00b18a1345068c467160b9a85bb3 to start an election
I20260709 13:05:18.634948 13230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3099712325a14ecab36ee23e1d9c9662"
dest_uuid: "533c00b18a1345068c467160b9a85bb3"
 from {username='slave'} at 127.0.0.1:45490
I20260709 13:05:18.635406 13230 raft_consensus.cc:493] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:18.635784 13230 raft_consensus.cc:3060] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:18.640465 13230 raft_consensus.cc:515] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:18.642019 13230 leader_election.cc:290] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 2 election: Requested vote from peers 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:18.642870 13303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3099712325a14ecab36ee23e1d9c9662" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
I20260709 13:05:18.643059 13379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3099712325a14ecab36ee23e1d9c9662" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8622d9c551284c64bf6c7823b884931e"
I20260709 13:05:18.643483 13303 raft_consensus.cc:3055] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:18.643689 13379 raft_consensus.cc:3060] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:18.643769 13303 raft_consensus.cc:740] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5dc262ea4f614d39aacea282a4df8324, State: Running, Role: LEADER
I20260709 13:05:18.644661 13303 consensus_queue.cc:260] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:18.645514 13303 raft_consensus.cc:3060] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:18.648674 13379 raft_consensus.cc:2468] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 2.
I20260709 13:05:18.649854 13303 raft_consensus.cc:2468] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 2.
I20260709 13:05:18.649850 13193 leader_election.cc:304] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 8622d9c551284c64bf6c7823b884931e; no voters: 
I20260709 13:05:18.650794 13446 raft_consensus.cc:2804] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:18.651443 13446 raft_consensus.cc:697] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [term 2 LEADER]: Becoming Leader. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Running, Role: LEADER
I20260709 13:05:18.652165 13446 consensus_queue.cc:237] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:18.658272 13126 catalog_manager.cc:5697] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 reported cstate change: term changed from 1 to 2, leader changed from 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130) to 533c00b18a1345068c467160b9a85bb3 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "533c00b18a1345068c467160b9a85bb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.663930 13448 raft_consensus.cc:993] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3: : Instructing follower 5dc262ea4f614d39aacea282a4df8324 to start an election
I20260709 13:05:18.664376 13446 raft_consensus.cc:1081] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 1 LEADER]: Signalling peer 5dc262ea4f614d39aacea282a4df8324 to start an election
I20260709 13:05:18.665891 13303 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb86f5947d5b4026a6ab05840d002510"
dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
 from {username='slave'} at 127.0.0.1:34404
I20260709 13:05:18.666417 13303 raft_consensus.cc:493] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:18.666669 13303 raft_consensus.cc:3060] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:18.670958 13303 raft_consensus.cc:515] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:18.672627 13303 leader_election.cc:290] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 2 election: Requested vote from peers 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:18.673327 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb86f5947d5b4026a6ab05840d002510" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "533c00b18a1345068c467160b9a85bb3"
I20260709 13:05:18.673573 13379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb86f5947d5b4026a6ab05840d002510" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8622d9c551284c64bf6c7823b884931e"
I20260709 13:05:18.673957 13230 raft_consensus.cc:3055] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:18.674074 13379 raft_consensus.cc:3060] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:18.674263 13230 raft_consensus.cc:740] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Running, Role: LEADER
I20260709 13:05:18.674981 13230 consensus_queue.cc:260] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:18.675853 13230 raft_consensus.cc:3060] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:18.678650 13379 raft_consensus.cc:2468] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dc262ea4f614d39aacea282a4df8324 in term 2.
I20260709 13:05:18.679646 13268 leader_election.cc:304] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dc262ea4f614d39aacea282a4df8324, 8622d9c551284c64bf6c7823b884931e; no voters: 
I20260709 13:05:18.680287 13449 raft_consensus.cc:2804] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:18.680542 13230 raft_consensus.cc:2468] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dc262ea4f614d39aacea282a4df8324 in term 2.
I20260709 13:05:18.680779 13449 raft_consensus.cc:697] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [term 2 LEADER]: Becoming Leader. State: Replica: 5dc262ea4f614d39aacea282a4df8324, State: Running, Role: LEADER
I20260709 13:05:18.681614 13449 consensus_queue.cc:237] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:18.687352 13126 catalog_manager.cc:5697] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 reported cstate change: term changed from 1 to 2, leader changed from 533c00b18a1345068c467160b9a85bb3 (127.12.76.129) to 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130). New cstate: current_term: 2 leader_uuid: "5dc262ea4f614d39aacea282a4df8324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.716882 13446 consensus_queue.cc:1048] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.728533 13448 consensus_queue.cc:1048] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.736655 13448 raft_consensus.cc:993] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3: : Instructing follower 5dc262ea4f614d39aacea282a4df8324 to start an election
I20260709 13:05:18.737059 13485 raft_consensus.cc:1081] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 1 LEADER]: Signalling peer 5dc262ea4f614d39aacea282a4df8324 to start an election
I20260709 13:05:18.738597 13303 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd5735d383ce4c88a68c42640f1d7018"
dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
 from {username='slave'} at 127.0.0.1:34404
I20260709 13:05:18.739055 13303 raft_consensus.cc:493] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:18.739355 13303 raft_consensus.cc:3060] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:18.743672 13303 raft_consensus.cc:515] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:18.745121 13303 leader_election.cc:290] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 2 election: Requested vote from peers 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:18.745999 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5735d383ce4c88a68c42640f1d7018" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "533c00b18a1345068c467160b9a85bb3"
I20260709 13:05:18.746377 13378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5735d383ce4c88a68c42640f1d7018" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8622d9c551284c64bf6c7823b884931e"
I20260709 13:05:18.746590 13230 raft_consensus.cc:3055] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:18.746912 13378 raft_consensus.cc:3060] T fd5735d383ce4c88a68c42640f1d7018 P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:18.746948 13230 raft_consensus.cc:740] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Running, Role: LEADER
I20260709 13:05:18.747907 13230 consensus_queue.cc:260] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:18.749059 13230 raft_consensus.cc:3060] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:18.751959 13378 raft_consensus.cc:2468] T fd5735d383ce4c88a68c42640f1d7018 P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dc262ea4f614d39aacea282a4df8324 in term 2.
I20260709 13:05:18.752987 13268 leader_election.cc:304] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dc262ea4f614d39aacea282a4df8324, 8622d9c551284c64bf6c7823b884931e; no voters: 
I20260709 13:05:18.753652 13449 raft_consensus.cc:2804] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:18.754122 13449 raft_consensus.cc:697] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 2 LEADER]: Becoming Leader. State: Replica: 5dc262ea4f614d39aacea282a4df8324, State: Running, Role: LEADER
I20260709 13:05:18.754555 13230 raft_consensus.cc:2468] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dc262ea4f614d39aacea282a4df8324 in term 2.
I20260709 13:05:18.754959 13449 consensus_queue.cc:237] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:18.760721 13128 catalog_manager.cc:5697] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 reported cstate change: term changed from 1 to 2, leader changed from 533c00b18a1345068c467160b9a85bb3 (127.12.76.129) to 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130). New cstate: current_term: 2 leader_uuid: "5dc262ea4f614d39aacea282a4df8324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.877210 13425 raft_consensus.cc:993] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324: : Instructing follower 533c00b18a1345068c467160b9a85bb3 to start an election
I20260709 13:05:18.877645 13449 raft_consensus.cc:1081] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [term 1 LEADER]: Signalling peer 533c00b18a1345068c467160b9a85bb3 to start an election
I20260709 13:05:18.878993 13230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4ad90cfb88b4e7da57828e306d4a826"
dest_uuid: "533c00b18a1345068c467160b9a85bb3"
 from {username='slave'} at 127.0.0.1:45490
I20260709 13:05:18.879531 13230 raft_consensus.cc:493] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:18.879927 13230 raft_consensus.cc:3060] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:18.884284 13230 raft_consensus.cc:515] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:18.885720 13230 leader_election.cc:290] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 2 election: Requested vote from peers 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:18.886678 13303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ad90cfb88b4e7da57828e306d4a826" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
I20260709 13:05:18.886758 13378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ad90cfb88b4e7da57828e306d4a826" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8622d9c551284c64bf6c7823b884931e"
I20260709 13:05:18.887532 13378 raft_consensus.cc:3060] T b4ad90cfb88b4e7da57828e306d4a826 P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:18.887540 13303 raft_consensus.cc:3055] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:18.888154 13303 raft_consensus.cc:740] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5dc262ea4f614d39aacea282a4df8324, State: Running, Role: LEADER
I20260709 13:05:18.889077 13303 consensus_queue.cc:260] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:18.890447 13303 raft_consensus.cc:3060] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:18.895051 13378 raft_consensus.cc:2468] T b4ad90cfb88b4e7da57828e306d4a826 P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 2.
I20260709 13:05:18.896404 13193 leader_election.cc:304] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 8622d9c551284c64bf6c7823b884931e; no voters: 
I20260709 13:05:18.897168 13485 raft_consensus.cc:2804] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:18.897550 13485 raft_consensus.cc:697] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3 [term 2 LEADER]: Becoming Leader. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Running, Role: LEADER
I20260709 13:05:18.898093 13303 raft_consensus.cc:2468] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 2.
I20260709 13:05:18.898319 13485 consensus_queue.cc:237] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:18.904434 13128 catalog_manager.cc:5697] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3 reported cstate change: term changed from 1 to 2, leader changed from 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130) to 533c00b18a1345068c467160b9a85bb3 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "533c00b18a1345068c467160b9a85bb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.931200 13459 raft_consensus.cc:993] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e: : Instructing follower 533c00b18a1345068c467160b9a85bb3 to start an election
I20260709 13:05:18.931699 13466 raft_consensus.cc:1081] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [term 1 LEADER]: Signalling peer 533c00b18a1345068c467160b9a85bb3 to start an election
I20260709 13:05:18.933327 13230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec35bffd03ef4c0f9d9d70c26cfcc766"
dest_uuid: "533c00b18a1345068c467160b9a85bb3"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:05:18.933800 13230 raft_consensus.cc:493] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:18.934124 13230 raft_consensus.cc:3060] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:18.938745 13230 raft_consensus.cc:515] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } } peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } }
I20260709 13:05:18.940399 13230 leader_election.cc:290] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 2 election: Requested vote from peers 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:18.941243 13303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec35bffd03ef4c0f9d9d70c26cfcc766" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
I20260709 13:05:18.941423 13378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec35bffd03ef4c0f9d9d70c26cfcc766" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8622d9c551284c64bf6c7823b884931e"
I20260709 13:05:18.941779 13303 raft_consensus.cc:3060] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:18.941926 13378 raft_consensus.cc:3055] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:18.942258 13378 raft_consensus.cc:740] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8622d9c551284c64bf6c7823b884931e, State: Running, Role: LEADER
I20260709 13:05:18.942879 13378 consensus_queue.cc:260] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } } peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } }
I20260709 13:05:18.943778 13378 raft_consensus.cc:3060] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:18.946503 13303 raft_consensus.cc:2468] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 2.
I20260709 13:05:18.947522 13196 leader_election.cc:304] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 5dc262ea4f614d39aacea282a4df8324; no voters: 
I20260709 13:05:18.948313 13485 raft_consensus.cc:2804] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:18.948441 13378 raft_consensus.cc:2468] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 2.
I20260709 13:05:18.948734 13485 raft_consensus.cc:697] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3 [term 2 LEADER]: Becoming Leader. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Running, Role: LEADER
I20260709 13:05:18.949556 13485 consensus_queue.cc:237] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } } peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } }
I20260709 13:05:18.955386 13128 catalog_manager.cc:5697] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3 reported cstate change: term changed from 1 to 2, leader changed from 8622d9c551284c64bf6c7823b884931e (127.12.76.131) to 533c00b18a1345068c467160b9a85bb3 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "533c00b18a1345068c467160b9a85bb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:19.014082 13466 raft_consensus.cc:993] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e: : Instructing follower 5dc262ea4f614d39aacea282a4df8324 to start an election
I20260709 13:05:19.014519 13466 raft_consensus.cc:1081] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [term 1 LEADER]: Signalling peer 5dc262ea4f614d39aacea282a4df8324 to start an election
I20260709 13:05:19.016022 13303 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8b12f66d7be4f3e921385efe5928af6"
dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
 from {username='slave'} at 127.0.0.1:34418
I20260709 13:05:19.016458 13303 raft_consensus.cc:493] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:19.016700 13303 raft_consensus.cc:3060] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.021068 13303 raft_consensus.cc:515] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:19.022707 13303 leader_election.cc:290] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 2 election: Requested vote from peers 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:19.023494 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b12f66d7be4f3e921385efe5928af6" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "533c00b18a1345068c467160b9a85bb3"
I20260709 13:05:19.023818 13378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b12f66d7be4f3e921385efe5928af6" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8622d9c551284c64bf6c7823b884931e"
I20260709 13:05:19.024058 13230 raft_consensus.cc:3060] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.024364 13378 raft_consensus.cc:3055] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:19.024665 13378 raft_consensus.cc:740] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8622d9c551284c64bf6c7823b884931e, State: Running, Role: LEADER
I20260709 13:05:19.025342 13378 consensus_queue.cc:260] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:19.026203 13378 raft_consensus.cc:3060] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.028774 13230 raft_consensus.cc:2468] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dc262ea4f614d39aacea282a4df8324 in term 2.
I20260709 13:05:19.029865 13269 leader_election.cc:304] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 5dc262ea4f614d39aacea282a4df8324; no voters: 
I20260709 13:05:19.030539 13378 raft_consensus.cc:2468] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dc262ea4f614d39aacea282a4df8324 in term 2.
I20260709 13:05:19.030622 13449 raft_consensus.cc:2804] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:19.031116 13449 raft_consensus.cc:697] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [term 2 LEADER]: Becoming Leader. State: Replica: 5dc262ea4f614d39aacea282a4df8324, State: Running, Role: LEADER
I20260709 13:05:19.031950 13449 consensus_queue.cc:237] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:19.038208 13128 catalog_manager.cc:5697] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 reported cstate change: term changed from 1 to 2, leader changed from 8622d9c551284c64bf6c7823b884931e (127.12.76.131) to 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130). New cstate: current_term: 2 leader_uuid: "5dc262ea4f614d39aacea282a4df8324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.063180 13304 raft_consensus.cc:1275] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Refusing update from remote peer 533c00b18a1345068c467160b9a85bb3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.064406 13448 consensus_queue.cc:1048] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.071301 13378 raft_consensus.cc:1275] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Refusing update from remote peer 533c00b18a1345068c467160b9a85bb3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.071693 13379 raft_consensus.cc:1275] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Refusing update from remote peer 5dc262ea4f614d39aacea282a4df8324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.072518 13489 consensus_queue.cc:1048] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.073213 13449 consensus_queue.cc:1048] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.082713 13230 raft_consensus.cc:1275] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Refusing update from remote peer 5dc262ea4f614d39aacea282a4df8324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.084391 13510 consensus_queue.cc:1048] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.140076 13378 raft_consensus.cc:1275] T fd5735d383ce4c88a68c42640f1d7018 P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Refusing update from remote peer 5dc262ea4f614d39aacea282a4df8324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.141264 13510 consensus_queue.cc:1048] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.148401 13230 raft_consensus.cc:1275] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Refusing update from remote peer 5dc262ea4f614d39aacea282a4df8324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.150311 13453 consensus_queue.cc:1048] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.290918 13304 raft_consensus.cc:1275] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Refusing update from remote peer 533c00b18a1345068c467160b9a85bb3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.292141 13489 consensus_queue.cc:1048] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.300419 13378 raft_consensus.cc:1275] T b4ad90cfb88b4e7da57828e306d4a826 P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Refusing update from remote peer 533c00b18a1345068c467160b9a85bb3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.302033 13485 consensus_queue.cc:1048] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.410993 13304 raft_consensus.cc:1275] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Refusing update from remote peer 533c00b18a1345068c467160b9a85bb3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.412407 13485 consensus_queue.cc:1048] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.421286 13379 raft_consensus.cc:1275] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Refusing update from remote peer 533c00b18a1345068c467160b9a85bb3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.422995 13489 consensus_queue.cc:1048] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.423545 13378 raft_consensus.cc:1275] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Refusing update from remote peer 5dc262ea4f614d39aacea282a4df8324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.424928 13453 consensus_queue.cc:1048] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.433326 13230 raft_consensus.cc:1275] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Refusing update from remote peer 5dc262ea4f614d39aacea282a4df8324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.434672 13510 consensus_queue.cc:1048] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:21.595929 12594 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:05:21.596740 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:21.613462 13230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d865fbf795f4c298e057cb83a90facf"
dest_uuid: "533c00b18a1345068c467160b9a85bb3"
mode: GRACEFUL
new_leader_uuid: "8622d9c551284c64bf6c7823b884931e"
 from {username='slave'} at 127.0.0.1:43100
I20260709 13:05:21.613903 13230 raft_consensus.cc:606] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 1 LEADER]: Received request to transfer leadership to TS 8622d9c551284c64bf6c7823b884931e
I20260709 13:05:21.616109 13230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e49fda44f3f44c5eb31ca3b3f22ae75b"
dest_uuid: "533c00b18a1345068c467160b9a85bb3"
mode: GRACEFUL
new_leader_uuid: "8622d9c551284c64bf6c7823b884931e"
 from {username='slave'} at 127.0.0.1:43100
I20260709 13:05:21.616496 13230 raft_consensus.cc:606] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 1 LEADER]: Received request to transfer leadership to TS 8622d9c551284c64bf6c7823b884931e
I20260709 13:05:21.617338 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:21.617712 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:21.669799 13446 raft_consensus.cc:993] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3: : Instructing follower 8622d9c551284c64bf6c7823b884931e to start an election
I20260709 13:05:21.670326 13518 raft_consensus.cc:1081] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 1 LEADER]: Signalling peer 8622d9c551284c64bf6c7823b884931e to start an election
I20260709 13:05:21.672456 13379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e49fda44f3f44c5eb31ca3b3f22ae75b"
dest_uuid: "8622d9c551284c64bf6c7823b884931e"
 from {username='slave'} at 127.0.0.1:58850
I20260709 13:05:21.673043 13379 raft_consensus.cc:493] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:21.673424 13379 raft_consensus.cc:3060] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.678279 13379 raft_consensus.cc:515] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:21.679884 13379 leader_election.cc:290] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 2 election: Requested vote from peers 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285), 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693)
I20260709 13:05:21.680665 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e49fda44f3f44c5eb31ca3b3f22ae75b" candidate_uuid: "8622d9c551284c64bf6c7823b884931e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "533c00b18a1345068c467160b9a85bb3"
I20260709 13:05:21.680979 13304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e49fda44f3f44c5eb31ca3b3f22ae75b" candidate_uuid: "8622d9c551284c64bf6c7823b884931e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
I20260709 13:05:21.681229 13230 raft_consensus.cc:3055] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:21.681486 13304 raft_consensus.cc:3060] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.681531 13230 raft_consensus.cc:740] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Running, Role: LEADER
I20260709 13:05:21.682389 13230 consensus_queue.cc:260] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:21.683483 13230 raft_consensus.cc:3060] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.688015 13304 raft_consensus.cc:2468] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8622d9c551284c64bf6c7823b884931e in term 2.
I20260709 13:05:21.689234 13345 leader_election.cc:304] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dc262ea4f614d39aacea282a4df8324, 8622d9c551284c64bf6c7823b884931e; no voters: 
I20260709 13:05:21.689651 13230 raft_consensus.cc:2468] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8622d9c551284c64bf6c7823b884931e in term 2.
I20260709 13:05:21.690137 13515 raft_consensus.cc:2804] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:21.691519 13515 raft_consensus.cc:697] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [term 2 LEADER]: Becoming Leader. State: Replica: 8622d9c551284c64bf6c7823b884931e, State: Running, Role: LEADER
I20260709 13:05:21.692257 13515 consensus_queue.cc:237] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:21.700242 13126 catalog_manager.cc:5697] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e reported cstate change: term changed from 1 to 2, leader changed from 533c00b18a1345068c467160b9a85bb3 (127.12.76.129) to 8622d9c551284c64bf6c7823b884931e (127.12.76.131). New cstate: current_term: 2 leader_uuid: "8622d9c551284c64bf6c7823b884931e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.927878 13446 raft_consensus.cc:993] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3: : Instructing follower 8622d9c551284c64bf6c7823b884931e to start an election
I20260709 13:05:21.928313 13446 raft_consensus.cc:1081] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 1 LEADER]: Signalling peer 8622d9c551284c64bf6c7823b884931e to start an election
I20260709 13:05:21.929837 13379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d865fbf795f4c298e057cb83a90facf"
dest_uuid: "8622d9c551284c64bf6c7823b884931e"
 from {username='slave'} at 127.0.0.1:58850
I20260709 13:05:21.930305 13379 raft_consensus.cc:493] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:21.930627 13379 raft_consensus.cc:3060] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.935518 13379 raft_consensus.cc:515] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:21.937265 13379 leader_election.cc:290] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 2 election: Requested vote from peers 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285), 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693)
I20260709 13:05:21.938172 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d865fbf795f4c298e057cb83a90facf" candidate_uuid: "8622d9c551284c64bf6c7823b884931e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "533c00b18a1345068c467160b9a85bb3"
I20260709 13:05:21.938290 13304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d865fbf795f4c298e057cb83a90facf" candidate_uuid: "8622d9c551284c64bf6c7823b884931e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
I20260709 13:05:21.938735 13230 raft_consensus.cc:3055] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:21.938875 13304 raft_consensus.cc:3060] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.939076 13230 raft_consensus.cc:740] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Running, Role: LEADER
I20260709 13:05:21.939765 13230 consensus_queue.cc:260] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:21.940517 13230 raft_consensus.cc:3060] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.943832 13304 raft_consensus.cc:2468] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8622d9c551284c64bf6c7823b884931e in term 2.
I20260709 13:05:21.944272 13230 raft_consensus.cc:2468] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8622d9c551284c64bf6c7823b884931e in term 2.
I20260709 13:05:21.944911 13345 leader_election.cc:304] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dc262ea4f614d39aacea282a4df8324, 8622d9c551284c64bf6c7823b884931e; no voters: 
I20260709 13:05:21.945582 13515 raft_consensus.cc:2804] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:21.946013 13515 raft_consensus.cc:697] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [term 2 LEADER]: Becoming Leader. State: Replica: 8622d9c551284c64bf6c7823b884931e, State: Running, Role: LEADER
I20260709 13:05:21.946722 13515 consensus_queue.cc:237] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:21.953435 13126 catalog_manager.cc:5697] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e reported cstate change: term changed from 1 to 2, leader changed from 533c00b18a1345068c467160b9a85bb3 (127.12.76.129) to 8622d9c551284c64bf6c7823b884931e (127.12.76.131). New cstate: current_term: 2 leader_uuid: "8622d9c551284c64bf6c7823b884931e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.206570 13303 raft_consensus.cc:1275] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Refusing update from remote peer 8622d9c551284c64bf6c7823b884931e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.207728 13515 consensus_queue.cc:1048] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.217207 13230 raft_consensus.cc:1275] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Refusing update from remote peer 8622d9c551284c64bf6c7823b884931e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.218473 13519 consensus_queue.cc:1048] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [LEADER]: Connected to new peer: Peer: permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.329473 13230 raft_consensus.cc:1275] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Refusing update from remote peer 8622d9c551284c64bf6c7823b884931e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.330492 13519 consensus_queue.cc:1048] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [LEADER]: Connected to new peer: Peer: permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.338613 13303 raft_consensus.cc:1275] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Refusing update from remote peer 8622d9c551284c64bf6c7823b884931e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.340351 13532 consensus_queue.cc:1048] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.618384 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:22.635504 13377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e49fda44f3f44c5eb31ca3b3f22ae75b"
dest_uuid: "8622d9c551284c64bf6c7823b884931e"
mode: GRACEFUL
new_leader_uuid: "533c00b18a1345068c467160b9a85bb3"
 from {username='slave'} at 127.0.0.1:58860
I20260709 13:05:22.636005 13377 raft_consensus.cc:606] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [term 2 LEADER]: Received request to transfer leadership to TS 533c00b18a1345068c467160b9a85bb3
I20260709 13:05:22.640754 13377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d865fbf795f4c298e057cb83a90facf"
dest_uuid: "8622d9c551284c64bf6c7823b884931e"
mode: GRACEFUL
new_leader_uuid: "533c00b18a1345068c467160b9a85bb3"
 from {username='slave'} at 127.0.0.1:58860
I20260709 13:05:22.641234 13377 raft_consensus.cc:606] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [term 2 LEADER]: Received request to transfer leadership to TS 533c00b18a1345068c467160b9a85bb3
I20260709 13:05:22.645666 13303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb86f5947d5b4026a6ab05840d002510"
dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
mode: GRACEFUL
new_leader_uuid: "533c00b18a1345068c467160b9a85bb3"
 from {username='slave'} at 127.0.0.1:34420
I20260709 13:05:22.646135 13303 raft_consensus.cc:606] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [term 2 LEADER]: Received request to transfer leadership to TS 533c00b18a1345068c467160b9a85bb3
I20260709 13:05:22.650549 13303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8b12f66d7be4f3e921385efe5928af6"
dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
mode: GRACEFUL
new_leader_uuid: "533c00b18a1345068c467160b9a85bb3"
 from {username='slave'} at 127.0.0.1:34420
I20260709 13:05:22.651036 13303 raft_consensus.cc:606] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [term 2 LEADER]: Received request to transfer leadership to TS 533c00b18a1345068c467160b9a85bb3
I20260709 13:05:22.655515 13303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd5735d383ce4c88a68c42640f1d7018"
dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
mode: GRACEFUL
new_leader_uuid: "533c00b18a1345068c467160b9a85bb3"
 from {username='slave'} at 127.0.0.1:34420
I20260709 13:05:22.655934 13303 raft_consensus.cc:606] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 2 LEADER]: Received request to transfer leadership to TS 533c00b18a1345068c467160b9a85bb3
I20260709 13:05:22.672673 13510 raft_consensus.cc:993] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324: : Instructing follower 533c00b18a1345068c467160b9a85bb3 to start an election
I20260709 13:05:22.673112 13534 raft_consensus.cc:1081] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 2 LEADER]: Signalling peer 533c00b18a1345068c467160b9a85bb3 to start an election
I20260709 13:05:22.674496 13230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd5735d383ce4c88a68c42640f1d7018"
dest_uuid: "533c00b18a1345068c467160b9a85bb3"
 from {username='slave'} at 127.0.0.1:45490
I20260709 13:05:22.674944 13230 raft_consensus.cc:493] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:22.675262 13230 raft_consensus.cc:3060] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.681272 13230 raft_consensus.cc:515] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:22.682627 13230 leader_election.cc:290] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 3 election: Requested vote from peers 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:22.683672 13377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5735d383ce4c88a68c42640f1d7018" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8622d9c551284c64bf6c7823b884931e"
I20260709 13:05:22.683574 13303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5735d383ce4c88a68c42640f1d7018" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
I20260709 13:05:22.684191 13377 raft_consensus.cc:3060] T fd5735d383ce4c88a68c42640f1d7018 P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.684363 13303 raft_consensus.cc:3055] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:22.684679 13303 raft_consensus.cc:740] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5dc262ea4f614d39aacea282a4df8324, State: Running, Role: LEADER
I20260709 13:05:22.685415 13303 consensus_queue.cc:260] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:22.686540 13303 raft_consensus.cc:3060] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.690902 13377 raft_consensus.cc:2468] T fd5735d383ce4c88a68c42640f1d7018 P 8622d9c551284c64bf6c7823b884931e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 3.
I20260709 13:05:22.692247 13193 leader_election.cc:304] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 8622d9c551284c64bf6c7823b884931e; no voters: 
I20260709 13:05:22.692665 13303 raft_consensus.cc:2468] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 3.
I20260709 13:05:22.692976 13446 raft_consensus.cc:2804] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:22.694095 13446 raft_consensus.cc:697] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 3 LEADER]: Becoming Leader. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Running, Role: LEADER
I20260709 13:05:22.694993 13446 consensus_queue.cc:237] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:22.701105 13127 catalog_manager.cc:5697] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 reported cstate change: term changed from 2 to 3, leader changed from 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130) to 533c00b18a1345068c467160b9a85bb3 (127.12.76.129). New cstate: current_term: 3 leader_uuid: "533c00b18a1345068c467160b9a85bb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.717808 13532 raft_consensus.cc:993] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e: : Instructing follower 533c00b18a1345068c467160b9a85bb3 to start an election
I20260709 13:05:22.718266 13519 raft_consensus.cc:1081] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [term 2 LEADER]: Signalling peer 533c00b18a1345068c467160b9a85bb3 to start an election
I20260709 13:05:22.719624 13230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e49fda44f3f44c5eb31ca3b3f22ae75b"
dest_uuid: "533c00b18a1345068c467160b9a85bb3"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:05:22.720170 13230 raft_consensus.cc:493] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:22.720556 13230 raft_consensus.cc:3060] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.725139 13230 raft_consensus.cc:515] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:22.726419 13230 leader_election.cc:290] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 3 election: Requested vote from peers 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:22.727283 13303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e49fda44f3f44c5eb31ca3b3f22ae75b" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
I20260709 13:05:22.727530 13377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e49fda44f3f44c5eb31ca3b3f22ae75b" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8622d9c551284c64bf6c7823b884931e"
I20260709 13:05:22.727805 13303 raft_consensus.cc:3060] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.728081 13377 raft_consensus.cc:3055] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:22.728406 13377 raft_consensus.cc:740] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8622d9c551284c64bf6c7823b884931e, State: Running, Role: LEADER
I20260709 13:05:22.728988 13377 consensus_queue.cc:260] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:22.729830 13377 raft_consensus.cc:3060] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.732013 13303 raft_consensus.cc:2468] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 3.
I20260709 13:05:22.733109 13196 leader_election.cc:304] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 5dc262ea4f614d39aacea282a4df8324; no voters: 
I20260709 13:05:22.733853 13446 raft_consensus.cc:2804] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:22.734279 13446 raft_consensus.cc:697] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 3 LEADER]: Becoming Leader. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Running, Role: LEADER
I20260709 13:05:22.735057 13377 raft_consensus.cc:2468] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 3.
I20260709 13:05:22.735037 13446 consensus_queue.cc:237] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:22.740927 13127 catalog_manager.cc:5697] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 reported cstate change: term changed from 2 to 3, leader changed from 8622d9c551284c64bf6c7823b884931e (127.12.76.131) to 533c00b18a1345068c467160b9a85bb3 (127.12.76.129). New cstate: current_term: 3 leader_uuid: "533c00b18a1345068c467160b9a85bb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.901839 13510 raft_consensus.cc:993] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324: : Instructing follower 533c00b18a1345068c467160b9a85bb3 to start an election
I20260709 13:05:22.902278 13534 raft_consensus.cc:1081] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [term 2 LEADER]: Signalling peer 533c00b18a1345068c467160b9a85bb3 to start an election
I20260709 13:05:22.903617 13230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8b12f66d7be4f3e921385efe5928af6"
dest_uuid: "533c00b18a1345068c467160b9a85bb3"
 from {username='slave'} at 127.0.0.1:45490
I20260709 13:05:22.904163 13230 raft_consensus.cc:493] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:22.904443 13230 raft_consensus.cc:3060] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.908981 13230 raft_consensus.cc:515] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:22.910411 13230 leader_election.cc:290] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 3 election: Requested vote from peers 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:22.911154 13303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b12f66d7be4f3e921385efe5928af6" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
I20260709 13:05:22.911509 13377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b12f66d7be4f3e921385efe5928af6" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8622d9c551284c64bf6c7823b884931e"
I20260709 13:05:22.911708 13303 raft_consensus.cc:3055] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:22.912019 13377 raft_consensus.cc:3060] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.912047 13303 raft_consensus.cc:740] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5dc262ea4f614d39aacea282a4df8324, State: Running, Role: LEADER
I20260709 13:05:22.912931 13303 consensus_queue.cc:260] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:22.913786 13303 raft_consensus.cc:3060] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.916945 13377 raft_consensus.cc:2468] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 3.
I20260709 13:05:22.917513 13303 raft_consensus.cc:2468] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 3.
I20260709 13:05:22.917934 13193 leader_election.cc:304] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 8622d9c551284c64bf6c7823b884931e; no voters: 
I20260709 13:05:22.918663 13446 raft_consensus.cc:2804] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:22.919116 13446 raft_consensus.cc:697] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3 [term 3 LEADER]: Becoming Leader. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Running, Role: LEADER
I20260709 13:05:22.919850 13446 consensus_queue.cc:237] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:22.925630 13127 catalog_manager.cc:5697] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3 reported cstate change: term changed from 2 to 3, leader changed from 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130) to 533c00b18a1345068c467160b9a85bb3 (127.12.76.129). New cstate: current_term: 3 leader_uuid: "533c00b18a1345068c467160b9a85bb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.930310 13532 raft_consensus.cc:993] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e: : Instructing follower 533c00b18a1345068c467160b9a85bb3 to start an election
I20260709 13:05:22.930751 13519 raft_consensus.cc:1081] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [term 2 LEADER]: Signalling peer 533c00b18a1345068c467160b9a85bb3 to start an election
I20260709 13:05:22.932262 13230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d865fbf795f4c298e057cb83a90facf"
dest_uuid: "533c00b18a1345068c467160b9a85bb3"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:05:22.932775 13230 raft_consensus.cc:493] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:22.933147 13230 raft_consensus.cc:3060] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.937753 13230 raft_consensus.cc:515] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:22.939204 13230 leader_election.cc:290] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 3 election: Requested vote from peers 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:22.939930 13303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d865fbf795f4c298e057cb83a90facf" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
I20260709 13:05:22.940312 13377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d865fbf795f4c298e057cb83a90facf" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8622d9c551284c64bf6c7823b884931e"
I20260709 13:05:22.940513 13303 raft_consensus.cc:3060] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.940887 13377 raft_consensus.cc:3055] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:22.941151 13377 raft_consensus.cc:740] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8622d9c551284c64bf6c7823b884931e, State: Running, Role: LEADER
I20260709 13:05:22.941826 13377 consensus_queue.cc:260] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:22.942678 13377 raft_consensus.cc:3060] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.944847 13303 raft_consensus.cc:2468] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 3.
I20260709 13:05:22.945780 13196 leader_election.cc:304] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 5dc262ea4f614d39aacea282a4df8324; no voters: 
I20260709 13:05:22.946540 13446 raft_consensus.cc:2804] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:22.946935 13446 raft_consensus.cc:697] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 3 LEADER]: Becoming Leader. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Running, Role: LEADER
I20260709 13:05:22.947707 13377 raft_consensus.cc:2468] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 3.
I20260709 13:05:22.947672 13446 consensus_queue.cc:237] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:22.953301 13127 catalog_manager.cc:5697] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 reported cstate change: term changed from 2 to 3, leader changed from 8622d9c551284c64bf6c7823b884931e (127.12.76.131) to 533c00b18a1345068c467160b9a85bb3 (127.12.76.129). New cstate: current_term: 3 leader_uuid: "533c00b18a1345068c467160b9a85bb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.963011 13510 raft_consensus.cc:993] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324: : Instructing follower 533c00b18a1345068c467160b9a85bb3 to start an election
I20260709 13:05:22.963472 13534 raft_consensus.cc:1081] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [term 2 LEADER]: Signalling peer 533c00b18a1345068c467160b9a85bb3 to start an election
I20260709 13:05:22.964826 13230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb86f5947d5b4026a6ab05840d002510"
dest_uuid: "533c00b18a1345068c467160b9a85bb3"
 from {username='slave'} at 127.0.0.1:45490
I20260709 13:05:22.965251 13230 raft_consensus.cc:493] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:22.965502 13230 raft_consensus.cc:3060] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.969383 13230 raft_consensus.cc:515] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:22.970748 13230 leader_election.cc:290] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 3 election: Requested vote from peers 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:22.971632 13303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb86f5947d5b4026a6ab05840d002510" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
I20260709 13:05:22.971799 13377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb86f5947d5b4026a6ab05840d002510" candidate_uuid: "533c00b18a1345068c467160b9a85bb3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8622d9c551284c64bf6c7823b884931e"
I20260709 13:05:22.972071 13303 raft_consensus.cc:3055] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:22.972271 13377 raft_consensus.cc:3060] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.972388 13303 raft_consensus.cc:740] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5dc262ea4f614d39aacea282a4df8324, State: Running, Role: LEADER
I20260709 13:05:22.973052 13303 consensus_queue.cc:260] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:22.973979 13303 raft_consensus.cc:3060] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.977257 13377 raft_consensus.cc:2468] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 3.
I20260709 13:05:22.977783 13303 raft_consensus.cc:2468] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 533c00b18a1345068c467160b9a85bb3 in term 3.
I20260709 13:05:22.978196 13193 leader_election.cc:304] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 8622d9c551284c64bf6c7823b884931e; no voters: 
I20260709 13:05:22.978937 13446 raft_consensus.cc:2804] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:22.979315 13446 raft_consensus.cc:697] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 3 LEADER]: Becoming Leader. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Running, Role: LEADER
I20260709 13:05:22.980000 13446 consensus_queue.cc:237] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:22.986176 13127 catalog_manager.cc:5697] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 reported cstate change: term changed from 2 to 3, leader changed from 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130) to 533c00b18a1345068c467160b9a85bb3 (127.12.76.129). New cstate: current_term: 3 leader_uuid: "533c00b18a1345068c467160b9a85bb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.095638 13303 raft_consensus.cc:1275] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 3 FOLLOWER]: Refusing update from remote peer 533c00b18a1345068c467160b9a85bb3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:23.096827 13446 consensus_queue.cc:1048] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:23.107745 13377 raft_consensus.cc:1275] T fd5735d383ce4c88a68c42640f1d7018 P 8622d9c551284c64bf6c7823b884931e [term 3 FOLLOWER]: Refusing update from remote peer 533c00b18a1345068c467160b9a85bb3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:23.109297 13544 consensus_queue.cc:1048] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:23.139775 13303 raft_consensus.cc:1275] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324 [term 3 FOLLOWER]: Refusing update from remote peer 533c00b18a1345068c467160b9a85bb3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:23.140784 13544 consensus_queue.cc:1048] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:23.149320 13377 raft_consensus.cc:1275] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [term 3 FOLLOWER]: Refusing update from remote peer 533c00b18a1345068c467160b9a85bb3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:23.150691 13544 consensus_queue.cc:1048] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:23.353451 13379 raft_consensus.cc:1275] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [term 3 FOLLOWER]: Refusing update from remote peer 533c00b18a1345068c467160b9a85bb3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:23.353545 13377 raft_consensus.cc:1275] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [term 3 FOLLOWER]: Refusing update from remote peer 533c00b18a1345068c467160b9a85bb3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:23.356294 13544 consensus_queue.cc:1048] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:23.356022 13446 consensus_queue.cc:1048] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:23.370107 13303 raft_consensus.cc:1275] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [term 3 FOLLOWER]: Refusing update from remote peer 533c00b18a1345068c467160b9a85bb3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:23.372720 13544 consensus_queue.cc:1048] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:23.384343 13304 raft_consensus.cc:1275] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [term 3 FOLLOWER]: Refusing update from remote peer 533c00b18a1345068c467160b9a85bb3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:23.386628 13535 consensus_queue.cc:1048] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:23.430487 13304 raft_consensus.cc:1275] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [term 3 FOLLOWER]: Refusing update from remote peer 533c00b18a1345068c467160b9a85bb3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:23.431874 13551 consensus_queue.cc:1048] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:23.444116 13379 raft_consensus.cc:1275] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e [term 3 FOLLOWER]: Refusing update from remote peer 533c00b18a1345068c467160b9a85bb3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:23.445990 13551 consensus_queue.cc:1048] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:25.662968 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:25.670761 13228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3099712325a14ecab36ee23e1d9c9662"
dest_uuid: "533c00b18a1345068c467160b9a85bb3"
mode: GRACEFUL
new_leader_uuid: "8622d9c551284c64bf6c7823b884931e"
 from {username='slave'} at 127.0.0.1:43100
I20260709 13:05:25.671542 13228 raft_consensus.cc:606] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [term 2 LEADER]: Received request to transfer leadership to TS 8622d9c551284c64bf6c7823b884931e
I20260709 13:05:25.673974 13558 raft_consensus.cc:993] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3: : Instructing follower 8622d9c551284c64bf6c7823b884931e to start an election
I20260709 13:05:25.674468 13535 raft_consensus.cc:1081] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [term 2 LEADER]: Signalling peer 8622d9c551284c64bf6c7823b884931e to start an election
I20260709 13:05:25.674474 13228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d865fbf795f4c298e057cb83a90facf"
dest_uuid: "533c00b18a1345068c467160b9a85bb3"
mode: GRACEFUL
new_leader_uuid: "5dc262ea4f614d39aacea282a4df8324"
 from {username='slave'} at 127.0.0.1:43100
I20260709 13:05:25.675242 13228 raft_consensus.cc:606] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 3 LEADER]: Received request to transfer leadership to TS 5dc262ea4f614d39aacea282a4df8324
I20260709 13:05:25.676375 13377 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3099712325a14ecab36ee23e1d9c9662"
dest_uuid: "8622d9c551284c64bf6c7823b884931e"
 from {username='slave'} at 127.0.0.1:58850
I20260709 13:05:25.676890 13377 raft_consensus.cc:493] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:25.677222 13377 raft_consensus.cc:3060] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:25.677623 13228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb86f5947d5b4026a6ab05840d002510"
dest_uuid: "533c00b18a1345068c467160b9a85bb3"
mode: GRACEFUL
new_leader_uuid: "8622d9c551284c64bf6c7823b884931e"
 from {username='slave'} at 127.0.0.1:43100
I20260709 13:05:25.678110 13228 raft_consensus.cc:606] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 3 LEADER]: Received request to transfer leadership to TS 8622d9c551284c64bf6c7823b884931e
I20260709 13:05:25.680408 13228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd5735d383ce4c88a68c42640f1d7018"
dest_uuid: "533c00b18a1345068c467160b9a85bb3"
mode: GRACEFUL
new_leader_uuid: "5dc262ea4f614d39aacea282a4df8324"
 from {username='slave'} at 127.0.0.1:43100
I20260709 13:05:25.680859 13228 raft_consensus.cc:606] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 3 LEADER]: Received request to transfer leadership to TS 5dc262ea4f614d39aacea282a4df8324
I20260709 13:05:25.681790 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:05:25.682231 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:25.683890 13377 raft_consensus.cc:515] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:25.685482 13377 leader_election.cc:290] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 3 election: Requested vote from peers 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285), 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693)
I20260709 13:05:25.686286 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3099712325a14ecab36ee23e1d9c9662" candidate_uuid: "8622d9c551284c64bf6c7823b884931e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "533c00b18a1345068c467160b9a85bb3"
I20260709 13:05:25.686713 13304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3099712325a14ecab36ee23e1d9c9662" candidate_uuid: "8622d9c551284c64bf6c7823b884931e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
I20260709 13:05:25.686959 13228 raft_consensus.cc:3055] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:25.687237 13304 raft_consensus.cc:3060] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:25.687273 13228 raft_consensus.cc:740] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Running, Role: LEADER
I20260709 13:05:25.688228 13228 consensus_queue.cc:260] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:25.689164 13228 raft_consensus.cc:3060] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:25.693178 13558 raft_consensus.cc:993] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3: : Instructing follower 5dc262ea4f614d39aacea282a4df8324 to start an election
I20260709 13:05:25.693356 13304 raft_consensus.cc:2468] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8622d9c551284c64bf6c7823b884931e in term 3.
I20260709 13:05:25.693683 13535 raft_consensus.cc:1081] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 3 LEADER]: Signalling peer 5dc262ea4f614d39aacea282a4df8324 to start an election
I20260709 13:05:25.694811 13345 leader_election.cc:304] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dc262ea4f614d39aacea282a4df8324, 8622d9c551284c64bf6c7823b884931e; no voters: 
I20260709 13:05:25.695699 13228 raft_consensus.cc:2468] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8622d9c551284c64bf6c7823b884931e in term 3.
I20260709 13:05:25.695833 13532 raft_consensus.cc:2804] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:25.696178 13304 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d865fbf795f4c298e057cb83a90facf"
dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
 from {username='slave'} at 127.0.0.1:34404
I20260709 13:05:25.696821 13304 raft_consensus.cc:493] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:25.697142 13304 raft_consensus.cc:3060] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.699887 13532 raft_consensus.cc:697] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e [term 3 LEADER]: Becoming Leader. State: Replica: 8622d9c551284c64bf6c7823b884931e, State: Running, Role: LEADER
I20260709 13:05:25.700946 13532 consensus_queue.cc:237] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:25.702131 13304 raft_consensus.cc:515] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:25.704269 13304 leader_election.cc:290] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 4 election: Requested vote from peers 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:25.705643 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d865fbf795f4c298e057cb83a90facf" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "533c00b18a1345068c467160b9a85bb3"
I20260709 13:05:25.706223 13228 raft_consensus.cc:3055] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:25.706132 13377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d865fbf795f4c298e057cb83a90facf" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8622d9c551284c64bf6c7823b884931e"
I20260709 13:05:25.706610 13228 raft_consensus.cc:740] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Running, Role: LEADER
I20260709 13:05:25.706812 13377 raft_consensus.cc:3060] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.707562 13228 consensus_queue.cc:260] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:25.708735 13228 raft_consensus.cc:3060] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.709003 13128 catalog_manager.cc:5697] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e reported cstate change: term changed from 2 to 3, leader changed from 533c00b18a1345068c467160b9a85bb3 (127.12.76.129) to 8622d9c551284c64bf6c7823b884931e (127.12.76.131). New cstate: current_term: 3 leader_uuid: "8622d9c551284c64bf6c7823b884931e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:25.712741 13377 raft_consensus.cc:2468] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dc262ea4f614d39aacea282a4df8324 in term 4.
I20260709 13:05:25.714262 13268 leader_election.cc:304] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dc262ea4f614d39aacea282a4df8324, 8622d9c551284c64bf6c7823b884931e; no voters: 
I20260709 13:05:25.715286 13534 raft_consensus.cc:2804] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:25.716220 13228 raft_consensus.cc:2468] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dc262ea4f614d39aacea282a4df8324 in term 4.
I20260709 13:05:25.722616 13558 raft_consensus.cc:993] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3: : Instructing follower 5dc262ea4f614d39aacea282a4df8324 to start an election
I20260709 13:05:25.724485 13558 raft_consensus.cc:1081] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 3 LEADER]: Signalling peer 5dc262ea4f614d39aacea282a4df8324 to start an election
I20260709 13:05:25.726233 13304 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd5735d383ce4c88a68c42640f1d7018"
dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
 from {username='slave'} at 127.0.0.1:34404
I20260709 13:05:25.726986 13304 raft_consensus.cc:493] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:25.727499 13304 raft_consensus.cc:3060] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.729745 13534 raft_consensus.cc:697] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [term 4 LEADER]: Becoming Leader. State: Replica: 5dc262ea4f614d39aacea282a4df8324, State: Running, Role: LEADER
I20260709 13:05:25.731295 13534 consensus_queue.cc:237] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:25.735731 13304 raft_consensus.cc:515] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:25.739123 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5735d383ce4c88a68c42640f1d7018" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "533c00b18a1345068c467160b9a85bb3"
I20260709 13:05:25.739715 13228 raft_consensus.cc:3055] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:25.740046 13228 raft_consensus.cc:740] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Running, Role: LEADER
I20260709 13:05:25.740757 13228 consensus_queue.cc:260] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:25.741515 13228 raft_consensus.cc:3060] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.742137 13128 catalog_manager.cc:5697] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 reported cstate change: term changed from 3 to 4, leader changed from 533c00b18a1345068c467160b9a85bb3 (127.12.76.129) to 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130). New cstate: current_term: 4 leader_uuid: "5dc262ea4f614d39aacea282a4df8324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:25.743930 13304 leader_election.cc:290] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 4 election: Requested vote from peers 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285), 8622d9c551284c64bf6c7823b884931e (127.12.76.131:33597)
I20260709 13:05:25.745041 13377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5735d383ce4c88a68c42640f1d7018" candidate_uuid: "5dc262ea4f614d39aacea282a4df8324" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8622d9c551284c64bf6c7823b884931e"
I20260709 13:05:25.745502 13377 raft_consensus.cc:3060] T fd5735d383ce4c88a68c42640f1d7018 P 8622d9c551284c64bf6c7823b884931e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.748484 13228 raft_consensus.cc:2468] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dc262ea4f614d39aacea282a4df8324 in term 4.
I20260709 13:05:25.749653 13269 leader_election.cc:304] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533c00b18a1345068c467160b9a85bb3, 5dc262ea4f614d39aacea282a4df8324; no voters: 
I20260709 13:05:25.751292 13534 raft_consensus.cc:2804] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:25.751777 13534 raft_consensus.cc:697] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 4 LEADER]: Becoming Leader. State: Replica: 5dc262ea4f614d39aacea282a4df8324, State: Running, Role: LEADER
I20260709 13:05:25.752308 13377 raft_consensus.cc:2468] T fd5735d383ce4c88a68c42640f1d7018 P 8622d9c551284c64bf6c7823b884931e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dc262ea4f614d39aacea282a4df8324 in term 4.
I20260709 13:05:25.752543 13534 consensus_queue.cc:237] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:25.760247 13128 catalog_manager.cc:5697] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 reported cstate change: term changed from 3 to 4, leader changed from 533c00b18a1345068c467160b9a85bb3 (127.12.76.129) to 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130). New cstate: current_term: 4 leader_uuid: "5dc262ea4f614d39aacea282a4df8324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:25.908386 13565 raft_consensus.cc:993] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3: : Instructing follower 8622d9c551284c64bf6c7823b884931e to start an election
I20260709 13:05:25.908811 13564 raft_consensus.cc:1081] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 3 LEADER]: Signalling peer 8622d9c551284c64bf6c7823b884931e to start an election
I20260709 13:05:25.910183 13377 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb86f5947d5b4026a6ab05840d002510"
dest_uuid: "8622d9c551284c64bf6c7823b884931e"
 from {username='slave'} at 127.0.0.1:58850
I20260709 13:05:25.910619 13377 raft_consensus.cc:493] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:25.910895 13377 raft_consensus.cc:3060] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.915964 13377 raft_consensus.cc:515] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:25.917392 13377 leader_election.cc:290] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 4 election: Requested vote from peers 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285), 5dc262ea4f614d39aacea282a4df8324 (127.12.76.130:33693)
I20260709 13:05:25.918154 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb86f5947d5b4026a6ab05840d002510" candidate_uuid: "8622d9c551284c64bf6c7823b884931e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "533c00b18a1345068c467160b9a85bb3"
I20260709 13:05:25.918331 13304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb86f5947d5b4026a6ab05840d002510" candidate_uuid: "8622d9c551284c64bf6c7823b884931e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5dc262ea4f614d39aacea282a4df8324"
I20260709 13:05:25.918676 13230 raft_consensus.cc:3055] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:25.918824 13304 raft_consensus.cc:3060] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.918974 13230 raft_consensus.cc:740] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 533c00b18a1345068c467160b9a85bb3, State: Running, Role: LEADER
I20260709 13:05:25.919719 13230 consensus_queue.cc:260] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:25.920539 13230 raft_consensus.cc:3060] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.923005 13304 raft_consensus.cc:2468] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8622d9c551284c64bf6c7823b884931e in term 4.
I20260709 13:05:25.923883 13345 leader_election.cc:304] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dc262ea4f614d39aacea282a4df8324, 8622d9c551284c64bf6c7823b884931e; no voters: 
I20260709 13:05:25.924532 13532 raft_consensus.cc:2804] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:25.925009 13532 raft_consensus.cc:697] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e [term 4 LEADER]: Becoming Leader. State: Replica: 8622d9c551284c64bf6c7823b884931e, State: Running, Role: LEADER
I20260709 13:05:25.925112 13230 raft_consensus.cc:2468] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8622d9c551284c64bf6c7823b884931e in term 4.
I20260709 13:05:25.925892 13532 consensus_queue.cc:237] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } }
I20260709 13:05:25.932987 13128 catalog_manager.cc:5697] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e reported cstate change: term changed from 3 to 4, leader changed from 533c00b18a1345068c467160b9a85bb3 (127.12.76.129) to 8622d9c551284c64bf6c7823b884931e (127.12.76.131). New cstate: current_term: 4 leader_uuid: "8622d9c551284c64bf6c7823b884931e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:26.086447 13304 raft_consensus.cc:1275] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [term 3 FOLLOWER]: Refusing update from remote peer 8622d9c551284c64bf6c7823b884931e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:26.087493 13532 consensus_queue.cc:1048] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:26.098798 13230 raft_consensus.cc:1275] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [term 3 FOLLOWER]: Refusing update from remote peer 8622d9c551284c64bf6c7823b884931e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:26.100250 13559 consensus_queue.cc:1048] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e [LEADER]: Connected to new peer: Peer: permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:26.267701 13377 raft_consensus.cc:1275] T fd5735d383ce4c88a68c42640f1d7018 P 8622d9c551284c64bf6c7823b884931e [term 4 FOLLOWER]: Refusing update from remote peer 5dc262ea4f614d39aacea282a4df8324: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:26.268911 13534 consensus_queue.cc:1048] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:26.278846 13230 raft_consensus.cc:1275] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 4 FOLLOWER]: Refusing update from remote peer 5dc262ea4f614d39aacea282a4df8324: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:26.280107 13534 consensus_queue.cc:1048] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:26.316035 13377 raft_consensus.cc:1275] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [term 4 FOLLOWER]: Refusing update from remote peer 5dc262ea4f614d39aacea282a4df8324: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:26.317131 13534 consensus_queue.cc:1048] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8622d9c551284c64bf6c7823b884931e" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 33597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:26.325977 13230 raft_consensus.cc:1275] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 4 FOLLOWER]: Refusing update from remote peer 5dc262ea4f614d39aacea282a4df8324: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:26.327472 13534 consensus_queue.cc:1048] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:26.419762 13230 raft_consensus.cc:1275] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 4 FOLLOWER]: Refusing update from remote peer 8622d9c551284c64bf6c7823b884931e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:26.420861 13559 consensus_queue.cc:1048] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e [LEADER]: Connected to new peer: Peer: permanent_uuid: "533c00b18a1345068c467160b9a85bb3" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 39285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:26.428690 13304 raft_consensus.cc:1275] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [term 4 FOLLOWER]: Refusing update from remote peer 8622d9c551284c64bf6c7823b884931e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:26.430395 13532 consensus_queue.cc:1048] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dc262ea4f614d39aacea282a4df8324" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:26.682996 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:26.689186 12594 tablet_server.cc:179] TabletServer@127.12.76.129:0 shutting down...
W20260709 13:05:26.707857 13343 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:05:26.712421 13343 consensus_peers.cc:597] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e -> Peer 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285): Couldn't send request to peer 533c00b18a1345068c467160b9a85bb3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:26.717131 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:26.717830 12594 tablet_replica.cc:333] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3: stopping tablet replica
I20260709 13:05:26.718467 12594 raft_consensus.cc:2243] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:26.719233 12594 raft_consensus.cc:2272] T e49fda44f3f44c5eb31ca3b3f22ae75b P 533c00b18a1345068c467160b9a85bb3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.721136 12594 tablet_replica.cc:333] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3: stopping tablet replica
I20260709 13:05:26.721745 12594 raft_consensus.cc:2243] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.722193 12594 raft_consensus.cc:2272] T 4d865fbf795f4c298e057cb83a90facf P 533c00b18a1345068c467160b9a85bb3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.724263 12594 tablet_replica.cc:333] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3: stopping tablet replica
I20260709 13:05:26.724809 12594 raft_consensus.cc:2243] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.725232 12594 raft_consensus.cc:2272] T fd5735d383ce4c88a68c42640f1d7018 P 533c00b18a1345068c467160b9a85bb3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.728001 12594 tablet_replica.cc:333] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3: stopping tablet replica
I20260709 13:05:26.728582 12594 raft_consensus.cc:2243] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:26.729535 12594 raft_consensus.cc:2272] T b8b12f66d7be4f3e921385efe5928af6 P 533c00b18a1345068c467160b9a85bb3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.732419 12594 tablet_replica.cc:333] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3: stopping tablet replica
I20260709 13:05:26.733217 12594 raft_consensus.cc:2243] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:26.734529 12594 raft_consensus.cc:2272] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.737059 12594 tablet_replica.cc:333] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3: stopping tablet replica
I20260709 13:05:26.737677 12594 raft_consensus.cc:2243] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:26.737877 13269 consensus_peers.cc:597] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 -> Peer 533c00b18a1345068c467160b9a85bb3 (127.12.76.129:39285): Couldn't send request to peer 533c00b18a1345068c467160b9a85bb3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:26.738149 12594 raft_consensus.cc:2272] T 3099712325a14ecab36ee23e1d9c9662 P 533c00b18a1345068c467160b9a85bb3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.740509 12594 tablet_replica.cc:333] T 328f1a117e8240b0bdf504a180570a87 P 533c00b18a1345068c467160b9a85bb3: stopping tablet replica
I20260709 13:05:26.740994 12594 raft_consensus.cc:2243] T 328f1a117e8240b0bdf504a180570a87 P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.741417 12594 raft_consensus.cc:2272] T 328f1a117e8240b0bdf504a180570a87 P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.743314 12594 tablet_replica.cc:333] T 6d85ee6760334c4fac4fb91bc0f604cb P 533c00b18a1345068c467160b9a85bb3: stopping tablet replica
I20260709 13:05:26.743806 12594 raft_consensus.cc:2243] T 6d85ee6760334c4fac4fb91bc0f604cb P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.744179 12594 raft_consensus.cc:2272] T 6d85ee6760334c4fac4fb91bc0f604cb P 533c00b18a1345068c467160b9a85bb3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.745661 12594 tablet_replica.cc:333] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3: stopping tablet replica
I20260709 13:05:26.746105 12594 raft_consensus.cc:2243] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:26.746788 12594 raft_consensus.cc:2272] T b4ad90cfb88b4e7da57828e306d4a826 P 533c00b18a1345068c467160b9a85bb3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.748320 12594 tablet_replica.cc:333] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3: stopping tablet replica
I20260709 13:05:26.748731 12594 raft_consensus.cc:2243] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.749095 12594 raft_consensus.cc:2272] T eb86f5947d5b4026a6ab05840d002510 P 533c00b18a1345068c467160b9a85bb3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.778074 12594 tablet_server.cc:196] TabletServer@127.12.76.129:0 shutdown complete.
I20260709 13:05:26.799911 12594 tablet_server.cc:179] TabletServer@127.12.76.130:0 shutting down...
I20260709 13:05:26.825598 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:26.826275 12594 tablet_replica.cc:333] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324: stopping tablet replica
I20260709 13:05:26.827255 12594 raft_consensus.cc:2243] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:26.828183 12594 raft_consensus.cc:2272] T 4d865fbf795f4c298e057cb83a90facf P 5dc262ea4f614d39aacea282a4df8324 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.830585 12594 tablet_replica.cc:333] T 328f1a117e8240b0bdf504a180570a87 P 5dc262ea4f614d39aacea282a4df8324: stopping tablet replica
I20260709 13:05:26.831141 12594 raft_consensus.cc:2243] T 328f1a117e8240b0bdf504a180570a87 P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.831688 12594 raft_consensus.cc:2272] T 328f1a117e8240b0bdf504a180570a87 P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.833551 12594 tablet_replica.cc:333] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324: stopping tablet replica
I20260709 13:05:26.834059 12594 raft_consensus.cc:2243] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:26.834754 12594 raft_consensus.cc:2272] T 6d85ee6760334c4fac4fb91bc0f604cb P 5dc262ea4f614d39aacea282a4df8324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.836380 12594 tablet_replica.cc:333] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324: stopping tablet replica
I20260709 13:05:26.836854 12594 raft_consensus.cc:2243] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.837265 12594 raft_consensus.cc:2272] T b4ad90cfb88b4e7da57828e306d4a826 P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.838934 12594 tablet_replica.cc:333] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324: stopping tablet replica
I20260709 13:05:26.839491 12594 raft_consensus.cc:2243] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:26.840149 12594 raft_consensus.cc:2272] T fd5735d383ce4c88a68c42640f1d7018 P 5dc262ea4f614d39aacea282a4df8324 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.842173 12594 tablet_replica.cc:333] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324: stopping tablet replica
I20260709 13:05:26.842674 12594 raft_consensus.cc:2243] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.843093 12594 raft_consensus.cc:2272] T 3099712325a14ecab36ee23e1d9c9662 P 5dc262ea4f614d39aacea282a4df8324 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.845329 12594 tablet_replica.cc:333] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324: stopping tablet replica
I20260709 13:05:26.845932 12594 raft_consensus.cc:2243] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.846380 12594 raft_consensus.cc:2272] T b8b12f66d7be4f3e921385efe5928af6 P 5dc262ea4f614d39aacea282a4df8324 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.848187 12594 tablet_replica.cc:333] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 5dc262ea4f614d39aacea282a4df8324: stopping tablet replica
I20260709 13:05:26.848703 12594 raft_consensus.cc:2243] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.849095 12594 raft_consensus.cc:2272] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 5dc262ea4f614d39aacea282a4df8324 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.850598 12594 tablet_replica.cc:333] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324: stopping tablet replica
I20260709 13:05:26.851027 12594 raft_consensus.cc:2243] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.851444 12594 raft_consensus.cc:2272] T eb86f5947d5b4026a6ab05840d002510 P 5dc262ea4f614d39aacea282a4df8324 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.853539 12594 tablet_replica.cc:333] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324: stopping tablet replica
I20260709 13:05:26.854012 12594 raft_consensus.cc:2243] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.854389 12594 raft_consensus.cc:2272] T e49fda44f3f44c5eb31ca3b3f22ae75b P 5dc262ea4f614d39aacea282a4df8324 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.882535 12594 tablet_server.cc:196] TabletServer@127.12.76.130:0 shutdown complete.
I20260709 13:05:26.900157 12594 tablet_server.cc:179] TabletServer@127.12.76.131:0 shutting down...
I20260709 13:05:26.923781 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:26.924427 12594 tablet_replica.cc:333] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e: stopping tablet replica
I20260709 13:05:26.925066 12594 raft_consensus.cc:2243] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.925526 12594 raft_consensus.cc:2272] T 4d865fbf795f4c298e057cb83a90facf P 8622d9c551284c64bf6c7823b884931e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.928192 12594 tablet_replica.cc:333] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e: stopping tablet replica
I20260709 13:05:26.928743 12594 raft_consensus.cc:2243] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.929289 12594 raft_consensus.cc:2272] T e49fda44f3f44c5eb31ca3b3f22ae75b P 8622d9c551284c64bf6c7823b884931e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.931064 12594 tablet_replica.cc:333] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e: stopping tablet replica
I20260709 13:05:26.931658 12594 raft_consensus.cc:2243] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:26.932354 12594 raft_consensus.cc:2272] T eb86f5947d5b4026a6ab05840d002510 P 8622d9c551284c64bf6c7823b884931e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.934224 12594 tablet_replica.cc:333] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e: stopping tablet replica
I20260709 13:05:26.934706 12594 raft_consensus.cc:2243] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:26.935391 12594 raft_consensus.cc:2272] T 328f1a117e8240b0bdf504a180570a87 P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.937033 12594 tablet_replica.cc:333] T 6d85ee6760334c4fac4fb91bc0f604cb P 8622d9c551284c64bf6c7823b884931e: stopping tablet replica
I20260709 13:05:26.937530 12594 raft_consensus.cc:2243] T 6d85ee6760334c4fac4fb91bc0f604cb P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.937932 12594 raft_consensus.cc:2272] T 6d85ee6760334c4fac4fb91bc0f604cb P 8622d9c551284c64bf6c7823b884931e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.939576 12594 tablet_replica.cc:333] T b4ad90cfb88b4e7da57828e306d4a826 P 8622d9c551284c64bf6c7823b884931e: stopping tablet replica
I20260709 13:05:26.940055 12594 raft_consensus.cc:2243] T b4ad90cfb88b4e7da57828e306d4a826 P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.940420 12594 raft_consensus.cc:2272] T b4ad90cfb88b4e7da57828e306d4a826 P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.941956 12594 tablet_replica.cc:333] T fd5735d383ce4c88a68c42640f1d7018 P 8622d9c551284c64bf6c7823b884931e: stopping tablet replica
I20260709 13:05:26.942458 12594 raft_consensus.cc:2243] T fd5735d383ce4c88a68c42640f1d7018 P 8622d9c551284c64bf6c7823b884931e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.942837 12594 raft_consensus.cc:2272] T fd5735d383ce4c88a68c42640f1d7018 P 8622d9c551284c64bf6c7823b884931e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.944680 12594 tablet_replica.cc:333] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e: stopping tablet replica
I20260709 13:05:26.945151 12594 raft_consensus.cc:2243] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.945528 12594 raft_consensus.cc:2272] T b8b12f66d7be4f3e921385efe5928af6 P 8622d9c551284c64bf6c7823b884931e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.946986 12594 tablet_replica.cc:333] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e: stopping tablet replica
I20260709 13:05:26.947463 12594 raft_consensus.cc:2243] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.947887 12594 raft_consensus.cc:2272] T ec35bffd03ef4c0f9d9d70c26cfcc766 P 8622d9c551284c64bf6c7823b884931e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.949446 12594 tablet_replica.cc:333] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e: stopping tablet replica
I20260709 13:05:26.949851 12594 raft_consensus.cc:2243] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:26.950479 12594 raft_consensus.cc:2272] T 3099712325a14ecab36ee23e1d9c9662 P 8622d9c551284c64bf6c7823b884931e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.977265 12594 tablet_server.cc:196] TabletServer@127.12.76.131:0 shutdown complete.
I20260709 13:05:26.994287 12594 master.cc:562] Master@127.12.76.190:41267 shutting down...
I20260709 13:05:27.013680 12594 raft_consensus.cc:2243] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.014236 12594 raft_consensus.cc:2272] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.014514 12594 tablet_replica.cc:333] T 00000000000000000000000000000000 P eecd9659a8df43aea2f990ebb35b9adf: stopping tablet replica
I20260709 13:05:27.034219 12594 master.cc:584] Master@127.12.76.190:41267 shutdown complete.
533c00b18a1345068c467160b9a85bb3  5
5dc262ea4f614d39aacea282a4df8324  4
8622d9c551284c64bf6c7823b884931e  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10575 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:05:27.073997 12594 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.76.190:43389
I20260709 13:05:27.075220 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:27.080420 13589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:27.080443 13590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:27.082072 13592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:27.082840 12594 server_base.cc:1061] running on GCE node
I20260709 13:05:27.083701 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:27.083873 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:27.084053 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602327084025 us; error 0 us; skew 500 ppm
I20260709 13:05:27.084571 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:27.086885 12594 webserver.cc:533] Webserver started at http://127.12.76.190:37575/ using document root <none> and password file <none>
I20260709 13:05:27.087354 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:27.087857 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:27.088133 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:27.089195 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/master-0-root/instance:
uuid: "a8849f59e7a642f3b694e3e403857ae7"
format_stamp: "Formatted at 2026-07-09 13:05:27 on dist-test-slave-th5x"
I20260709 13:05:27.093299 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:05:27.096418 13597 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:27.097105 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:05:27.097375 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/master-0-root
uuid: "a8849f59e7a642f3b694e3e403857ae7"
format_stamp: "Formatted at 2026-07-09 13:05:27 on dist-test-slave-th5x"
I20260709 13:05:27.097667 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:27.133509 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:27.134727 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:27.171274 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.190:43389
I20260709 13:05:27.171381 13648 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.190:43389 every 8 connection(s)
I20260709 13:05:27.175168 13649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.184444 13649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7: Bootstrap starting.
I20260709 13:05:27.188918 13649 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.193009 13649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7: No bootstrap required, opened a new log
I20260709 13:05:27.195094 13649 raft_consensus.cc:359] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8849f59e7a642f3b694e3e403857ae7" member_type: VOTER }
I20260709 13:05:27.195493 13649 raft_consensus.cc:385] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.195701 13649 raft_consensus.cc:740] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8849f59e7a642f3b694e3e403857ae7, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.196337 13649 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8849f59e7a642f3b694e3e403857ae7" member_type: VOTER }
I20260709 13:05:27.196779 13649 raft_consensus.cc:399] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:27.197017 13649 raft_consensus.cc:493] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:27.197293 13649 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.201483 13649 raft_consensus.cc:515] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8849f59e7a642f3b694e3e403857ae7" member_type: VOTER }
I20260709 13:05:27.201980 13649 leader_election.cc:304] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a8849f59e7a642f3b694e3e403857ae7; no voters: 
I20260709 13:05:27.203161 13649 leader_election.cc:290] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:27.203554 13652 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:27.204779 13652 raft_consensus.cc:697] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7 [term 1 LEADER]: Becoming Leader. State: Replica: a8849f59e7a642f3b694e3e403857ae7, State: Running, Role: LEADER
I20260709 13:05:27.205425 13652 consensus_queue.cc:237] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8849f59e7a642f3b694e3e403857ae7" member_type: VOTER }
I20260709 13:05:27.206019 13649 sys_catalog.cc:565] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:27.209965 13653 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a8849f59e7a642f3b694e3e403857ae7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8849f59e7a642f3b694e3e403857ae7" member_type: VOTER } }
I20260709 13:05:27.210253 13654 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8849f59e7a642f3b694e3e403857ae7. Latest consensus state: current_term: 1 leader_uuid: "a8849f59e7a642f3b694e3e403857ae7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8849f59e7a642f3b694e3e403857ae7" member_type: VOTER } }
I20260709 13:05:27.210634 13653 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:27.210775 13654 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:27.212364 13659 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:27.218717 13659 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:27.221313 12594 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:27.227885 13659 catalog_manager.cc:1383] Generated new cluster ID: aad7e0d9fb794328983ff5b29abaca91
I20260709 13:05:27.228183 13659 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:27.270470 13659 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:27.271785 13659 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:27.284289 13659 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7: Generated new TSK 0
I20260709 13:05:27.284924 13659 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:27.351935 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:27.357999 13670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:27.358911 13671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:27.361814 13673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:27.362821 12594 server_base.cc:1061] running on GCE node
I20260709 13:05:27.363703 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:27.363893 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:27.364012 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602327364001 us; error 0 us; skew 500 ppm
I20260709 13:05:27.364459 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:27.366787 12594 webserver.cc:533] Webserver started at http://127.12.76.129:39439/ using document root <none> and password file <none>
I20260709 13:05:27.367208 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:27.367357 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:27.367651 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:27.368623 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-0-root/instance:
uuid: "b9d194f45e044e0988d5de1a99e5cd02"
format_stamp: "Formatted at 2026-07-09 13:05:27 on dist-test-slave-th5x"
I20260709 13:05:27.373010 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:05:27.376231 13678 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:27.377012 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:05:27.377291 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-0-root
uuid: "b9d194f45e044e0988d5de1a99e5cd02"
format_stamp: "Formatted at 2026-07-09 13:05:27 on dist-test-slave-th5x"
I20260709 13:05:27.377609 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:27.390494 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:27.391778 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:27.393256 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:27.395493 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:27.395722 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:27.395959 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:27.396139 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:27.436970 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.129:37533
I20260709 13:05:27.437067 13740 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.129:37533 every 8 connection(s)
I20260709 13:05:27.441831 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:27.450356 13746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:27.450954 13745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:27.451368 12594 server_base.cc:1061] running on GCE node
W20260709 13:05:27.452311 13748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:27.453490 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:27.453707 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:27.453884 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602327453865 us; error 0 us; skew 500 ppm
I20260709 13:05:27.454412 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:27.457103 12594 webserver.cc:533] Webserver started at http://127.12.76.130:36193/ using document root <none> and password file <none>
I20260709 13:05:27.457623 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:27.457826 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:27.458097 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:27.458587 13741 heartbeater.cc:344] Connected to a master server at 127.12.76.190:43389
I20260709 13:05:27.458999 13741 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:27.459587 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-1-root/instance:
uuid: "35ecb005831740438d7537dd4b840e03"
format_stamp: "Formatted at 2026-07-09 13:05:27 on dist-test-slave-th5x"
I20260709 13:05:27.459851 13741 heartbeater.cc:507] Master 127.12.76.190:43389 requested a full tablet report, sending...
I20260709 13:05:27.462255 13614 ts_manager.cc:194] Registered new tserver with Master: b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533)
I20260709 13:05:27.464602 13614 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49428
I20260709 13:05:27.465253 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:05:27.469352 13753 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:27.470155 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:05:27.470398 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-1-root
uuid: "35ecb005831740438d7537dd4b840e03"
format_stamp: "Formatted at 2026-07-09 13:05:27 on dist-test-slave-th5x"
I20260709 13:05:27.470692 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:27.489415 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:27.490567 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:27.491968 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:27.494145 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:27.494364 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:27.494613 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:27.494781 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:27.534865 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.130:36047
I20260709 13:05:27.534960 13815 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.130:36047 every 8 connection(s)
I20260709 13:05:27.539749 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:27.546818 13819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:27.547448 13820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:27.549193 13822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:27.550475 12594 server_base.cc:1061] running on GCE node
I20260709 13:05:27.551384 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:27.551729 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:27.551995 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602327551974 us; error 0 us; skew 500 ppm
I20260709 13:05:27.552727 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:27.553076 13816 heartbeater.cc:344] Connected to a master server at 127.12.76.190:43389
I20260709 13:05:27.553505 13816 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:27.554478 13816 heartbeater.cc:507] Master 127.12.76.190:43389 requested a full tablet report, sending...
I20260709 13:05:27.555786 12594 webserver.cc:533] Webserver started at http://127.12.76.131:37009/ using document root <none> and password file <none>
I20260709 13:05:27.556353 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:27.556588 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:27.556886 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:27.557036 13614 ts_manager.cc:194] Registered new tserver with Master: 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:27.558380 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-2-root/instance:
uuid: "b5029654a4384e43a68eb67b794949b7"
format_stamp: "Formatted at 2026-07-09 13:05:27 on dist-test-slave-th5x"
I20260709 13:05:27.558840 13614 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49436
I20260709 13:05:27.563818 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.003s
I20260709 13:05:27.567268 13827 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:27.568102 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:05:27.568343 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-2-root
uuid: "b5029654a4384e43a68eb67b794949b7"
format_stamp: "Formatted at 2026-07-09 13:05:27 on dist-test-slave-th5x"
I20260709 13:05:27.568576 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:27.587209 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:27.588413 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:27.589800 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:27.591984 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:27.592167 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:27.592447 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:27.592604 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:27.632390 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.131:46015
I20260709 13:05:27.632519 13889 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.131:46015 every 8 connection(s)
I20260709 13:05:27.645785 13890 heartbeater.cc:344] Connected to a master server at 127.12.76.190:43389
I20260709 13:05:27.646134 13890 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:27.646826 13890 heartbeater.cc:507] Master 127.12.76.190:43389 requested a full tablet report, sending...
I20260709 13:05:27.648689 13614 ts_manager.cc:194] Registered new tserver with Master: b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:27.648777 12594 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013253811s
I20260709 13:05:27.650079 13614 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49444
I20260709 13:05:27.675594 13614 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49454:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:27.681743 13614 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:27.879499 13706 tablet_service.cc:1511] Processing CreateTablet for tablet de09d01498e547e591ce4ebe62e59488 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:27.881096 13706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de09d01498e547e591ce4ebe62e59488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.879592 13705 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff0635cc3464389804f1758fde23012 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:27.884297 13705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff0635cc3464389804f1758fde23012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.887646 13704 tablet_service.cc:1511] Processing CreateTablet for tablet ab01257d4e56488eba41a0ce5c5e9954 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:27.889091 13704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab01257d4e56488eba41a0ce5c5e9954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.888743 13703 tablet_service.cc:1511] Processing CreateTablet for tablet 9c37f25da53241cd98c09e4525d9e23c (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:27.890033 13703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c37f25da53241cd98c09e4525d9e23c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.897043 13702 tablet_service.cc:1511] Processing CreateTablet for tablet 82e0eeb1582143a09acf311171812faa (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:27.898420 13702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e0eeb1582143a09acf311171812faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.905021 13701 tablet_service.cc:1511] Processing CreateTablet for tablet ebc19cb1c68943cba711cd721c8caa91 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:27.906418 13701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebc19cb1c68943cba711cd721c8caa91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.913020 13700 tablet_service.cc:1511] Processing CreateTablet for tablet 8591822f3dc3430e935360afdb260fce (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:27.914366 13700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8591822f3dc3430e935360afdb260fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.924938 13699 tablet_service.cc:1511] Processing CreateTablet for tablet ca5b6ba16dba4c529324c949c6b9ac85 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:27.926347 13699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca5b6ba16dba4c529324c949c6b9ac85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.928543 13698 tablet_service.cc:1511] Processing CreateTablet for tablet aa43b4c4d63f407c90aa0154dfcc1063 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:27.929852 13698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa43b4c4d63f407c90aa0154dfcc1063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.932600 13697 tablet_service.cc:1511] Processing CreateTablet for tablet c9e22f0634b34971aed9c5b948f3275e (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:27.933912 13697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9e22f0634b34971aed9c5b948f3275e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.943600 13853 tablet_service.cc:1511] Processing CreateTablet for tablet ab01257d4e56488eba41a0ce5c5e9954 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:27.944474 13854 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff0635cc3464389804f1758fde23012 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:27.945060 13853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab01257d4e56488eba41a0ce5c5e9954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.945143 13848 tablet_service.cc:1511] Processing CreateTablet for tablet ca5b6ba16dba4c529324c949c6b9ac85 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:27.945808 13854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff0635cc3464389804f1758fde23012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.946529 13848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca5b6ba16dba4c529324c949c6b9ac85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.947984 13855 tablet_service.cc:1511] Processing CreateTablet for tablet de09d01498e547e591ce4ebe62e59488 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:27.949244 13855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de09d01498e547e591ce4ebe62e59488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.948891 13852 tablet_service.cc:1511] Processing CreateTablet for tablet 9c37f25da53241cd98c09e4525d9e23c (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:27.952353 13852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c37f25da53241cd98c09e4525d9e23c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.952451 13849 tablet_service.cc:1511] Processing CreateTablet for tablet 8591822f3dc3430e935360afdb260fce (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:27.952672 13847 tablet_service.cc:1511] Processing CreateTablet for tablet aa43b4c4d63f407c90aa0154dfcc1063 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:27.953830 13849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8591822f3dc3430e935360afdb260fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.956568 13846 tablet_service.cc:1511] Processing CreateTablet for tablet c9e22f0634b34971aed9c5b948f3275e (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:27.958263 13851 tablet_service.cc:1511] Processing CreateTablet for tablet 82e0eeb1582143a09acf311171812faa (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:27.951007 13850 tablet_service.cc:1511] Processing CreateTablet for tablet ebc19cb1c68943cba711cd721c8caa91 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:27.961110 13846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9e22f0634b34971aed9c5b948f3275e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.964577 13781 tablet_service.cc:1511] Processing CreateTablet for tablet de09d01498e547e591ce4ebe62e59488 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:27.965855 13781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de09d01498e547e591ce4ebe62e59488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.968734 13779 tablet_service.cc:1511] Processing CreateTablet for tablet ab01257d4e56488eba41a0ce5c5e9954 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:27.970074 13779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab01257d4e56488eba41a0ce5c5e9954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.974285 13776 tablet_service.cc:1511] Processing CreateTablet for tablet ebc19cb1c68943cba711cd721c8caa91 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:27.979027 13774 tablet_service.cc:1511] Processing CreateTablet for tablet ca5b6ba16dba4c529324c949c6b9ac85 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:27.981467 13773 tablet_service.cc:1511] Processing CreateTablet for tablet aa43b4c4d63f407c90aa0154dfcc1063 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:27.989095 13706 tablet_service.cc:1511] Processing CreateTablet for tablet 2e2aec8e942e44d9b699829a1e6de4b3 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:27.983145 13772 tablet_service.cc:1511] Processing CreateTablet for tablet c9e22f0634b34971aed9c5b948f3275e (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:27.990981 13706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e2aec8e942e44d9b699829a1e6de4b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.984675 13778 tablet_service.cc:1511] Processing CreateTablet for tablet 9c37f25da53241cd98c09e4525d9e23c (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:27.972560 13777 tablet_service.cc:1511] Processing CreateTablet for tablet 82e0eeb1582143a09acf311171812faa (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:27.976931 13775 tablet_service.cc:1511] Processing CreateTablet for tablet 8591822f3dc3430e935360afdb260fce (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:27.993422 13851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e0eeb1582143a09acf311171812faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.995862 13847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa43b4c4d63f407c90aa0154dfcc1063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.999806 13850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebc19cb1c68943cba711cd721c8caa91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.004159 13776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebc19cb1c68943cba711cd721c8caa91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.986382 13704 tablet_service.cc:1511] Processing CreateTablet for tablet c7cc0929e3a64836993d9ee880b12800 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:27.987454 13780 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff0635cc3464389804f1758fde23012 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:28.010524 13777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e0eeb1582143a09acf311171812faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.012454 13697 tablet_service.cc:1511] Processing CreateTablet for tablet eb0e4fb02d3a45d4a6cc322c544fbf80 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:28.016175 13775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8591822f3dc3430e935360afdb260fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.020246 13774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca5b6ba16dba4c529324c949c6b9ac85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.024163 13778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c37f25da53241cd98c09e4525d9e23c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.028195 13780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff0635cc3464389804f1758fde23012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.032264 13697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb0e4fb02d3a45d4a6cc322c544fbf80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.032560 13773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa43b4c4d63f407c90aa0154dfcc1063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.035992 13772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9e22f0634b34971aed9c5b948f3275e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.039722 13704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7cc0929e3a64836993d9ee880b12800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.041854 13701 tablet_service.cc:1511] Processing CreateTablet for tablet 8d8b741328f1468cb4ac726ffe62e9e8 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:28.046216 13703 tablet_service.cc:1511] Processing CreateTablet for tablet 0b0054f48c4947acaea83521993a8f01 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:28.105377 13849 tablet_service.cc:1511] Processing CreateTablet for tablet c7cc0929e3a64836993d9ee880b12800 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:28.106658 13849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7cc0929e3a64836993d9ee880b12800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.120460 13847 tablet_service.cc:1511] Processing CreateTablet for tablet 2e2aec8e942e44d9b699829a1e6de4b3 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:28.038322 13698 tablet_service.cc:1511] Processing CreateTablet for tablet ac7aedfecb9c482a9cf59234dff1e9f8 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:28.122426 13698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac7aedfecb9c482a9cf59234dff1e9f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.123387 13705 tablet_service.cc:1511] Processing CreateTablet for tablet 3618fd55609843fca70082d3565b459b (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:28.124576 13850 tablet_service.cc:1511] Processing CreateTablet for tablet eb0e4fb02d3a45d4a6cc322c544fbf80 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:28.125782 13702 tablet_service.cc:1511] Processing CreateTablet for tablet 79adc3f3cf6a48518016b2d56c531dbd (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:28.126556 13700 tablet_service.cc:1511] Processing CreateTablet for tablet 19de5233e495495dbff7c520c86d37c7 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:28.127516 13701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d8b741328f1468cb4ac726ffe62e9e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.128130 13705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3618fd55609843fca70082d3565b459b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.129434 13699 tablet_service.cc:1511] Processing CreateTablet for tablet d07097a615d345468e43de064c67057d (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:28.130585 13699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d07097a615d345468e43de064c67057d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.132632 13700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19de5233e495495dbff7c520c86d37c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.133985 13704 tablet_service.cc:1511] Processing CreateTablet for tablet 82aefa8c282f4143b3c3d55f5a4d0bcf (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:28.135191 13702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79adc3f3cf6a48518016b2d56c531dbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.139926 13847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e2aec8e942e44d9b699829a1e6de4b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.148700 13697 tablet_service.cc:1511] Processing CreateTablet for tablet f09ef105d67b41dba510b44a6567d790 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:28.149760 13780 tablet_service.cc:1511] Processing CreateTablet for tablet c7cc0929e3a64836993d9ee880b12800 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:28.149857 13848 tablet_service.cc:1511] Processing CreateTablet for tablet ac7aedfecb9c482a9cf59234dff1e9f8 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:28.151007 13780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7cc0929e3a64836993d9ee880b12800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.151588 13704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82aefa8c282f4143b3c3d55f5a4d0bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.155732 13697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09ef105d67b41dba510b44a6567d790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.156008 13906 tablet_bootstrap.cc:492] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:28.158452 13703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b0054f48c4947acaea83521993a8f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.156097 13905 tablet_bootstrap.cc:492] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:28.164738 13777 tablet_service.cc:1511] Processing CreateTablet for tablet 2e2aec8e942e44d9b699829a1e6de4b3 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:28.155576 13852 tablet_service.cc:1511] Processing CreateTablet for tablet 8d8b741328f1468cb4ac726ffe62e9e8 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:28.168680 13848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac7aedfecb9c482a9cf59234dff1e9f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.179472 13777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e2aec8e942e44d9b699829a1e6de4b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.180716 13906 tablet_bootstrap.cc:654] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.185976 13854 tablet_service.cc:1511] Processing CreateTablet for tablet 0b0054f48c4947acaea83521993a8f01 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:28.186689 13774 tablet_service.cc:1511] Processing CreateTablet for tablet 8d8b741328f1468cb4ac726ffe62e9e8 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:28.196311 13774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d8b741328f1468cb4ac726ffe62e9e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.202706 13849 tablet_service.cc:1511] Processing CreateTablet for tablet f09ef105d67b41dba510b44a6567d790 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:28.204476 13704 tablet_service.cc:1511] Processing CreateTablet for tablet 03391a24625846c6997759d9b34dc4b4 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:28.205734 13704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03391a24625846c6997759d9b34dc4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.214201 13776 tablet_service.cc:1511] Processing CreateTablet for tablet 0b0054f48c4947acaea83521993a8f01 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
W20260709 13:05:28.218115 13662 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:28.207304 13907 tablet_bootstrap.cc:492] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:28.214794 13697 tablet_service.cc:1511] Processing CreateTablet for tablet f3cfef71353344f180965689d6ec9166 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:28.229476 13779 tablet_service.cc:1511] Processing CreateTablet for tablet ac7aedfecb9c482a9cf59234dff1e9f8 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:28.231837 13778 tablet_service.cc:1511] Processing CreateTablet for tablet 79adc3f3cf6a48518016b2d56c531dbd (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:28.227085 13777 tablet_service.cc:1511] Processing CreateTablet for tablet 3618fd55609843fca70082d3565b459b (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:28.236645 13855 tablet_service.cc:1511] Processing CreateTablet for tablet 79adc3f3cf6a48518016b2d56c531dbd (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:28.227509 13781 tablet_service.cc:1511] Processing CreateTablet for tablet eb0e4fb02d3a45d4a6cc322c544fbf80 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:28.219597 13850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb0e4fb02d3a45d4a6cc322c544fbf80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.242347 13697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3cfef71353344f180965689d6ec9166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.246011 13907 tablet_bootstrap.cc:654] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.240758 13776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b0054f48c4947acaea83521993a8f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.263507 13852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d8b741328f1468cb4ac726ffe62e9e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.264052 13779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac7aedfecb9c482a9cf59234dff1e9f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.264262 13854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b0054f48c4947acaea83521993a8f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.248778 13853 tablet_service.cc:1511] Processing CreateTablet for tablet 19de5233e495495dbff7c520c86d37c7 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:28.267325 13781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb0e4fb02d3a45d4a6cc322c544fbf80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.267568 13855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79adc3f3cf6a48518016b2d56c531dbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.268185 13853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19de5233e495495dbff7c520c86d37c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.269097 13849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09ef105d67b41dba510b44a6567d790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.271585 13777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3618fd55609843fca70082d3565b459b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.262964 13775 tablet_service.cc:1511] Processing CreateTablet for tablet d07097a615d345468e43de064c67057d (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:28.272264 13778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79adc3f3cf6a48518016b2d56c531dbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.272524 13699 tablet_service.cc:1511] Processing CreateTablet for tablet 8446dab661a64f9b8075d7586f1197f4 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:28.249586 13702 tablet_service.cc:1511] Processing CreateTablet for tablet 5171bcd42ea14ad3af7399ab8c6a7e35 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:28.251176 13851 tablet_service.cc:1511] Processing CreateTablet for tablet d07097a615d345468e43de064c67057d (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:28.273979 13775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d07097a615d345468e43de064c67057d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.251912 13906 tablet_bootstrap.cc:492] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:28.240805 13846 tablet_service.cc:1511] Processing CreateTablet for tablet 3618fd55609843fca70082d3565b459b (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:28.274722 13906 ts_tablet_manager.cc:1403] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.119s	user 0.006s	sys 0.012s
I20260709 13:05:28.275648 13846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3618fd55609843fca70082d3565b459b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.279827 13851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d07097a615d345468e43de064c67057d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.255307 13706 tablet_service.cc:1511] Processing CreateTablet for tablet cd386d71cc264abca3dbfa88ffd4e951 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:28.281594 13773 tablet_service.cc:1511] Processing CreateTablet for tablet 19de5233e495495dbff7c520c86d37c7 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:28.273931 13699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8446dab661a64f9b8075d7586f1197f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.282927 13773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19de5233e495495dbff7c520c86d37c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.259775 13905 tablet_bootstrap.cc:654] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.283790 13706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd386d71cc264abca3dbfa88ffd4e951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.258590 13772 tablet_service.cc:1511] Processing CreateTablet for tablet f09ef105d67b41dba510b44a6567d790 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:28.278448 13906 raft_consensus.cc:359] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.304100 13772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09ef105d67b41dba510b44a6567d790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.307608 13702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5171bcd42ea14ad3af7399ab8c6a7e35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.315510 13906 raft_consensus.cc:385] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.315951 13906 raft_consensus.cc:740] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.316864 13906 consensus_queue.cc:260] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.324777 13774 tablet_service.cc:1511] Processing CreateTablet for tablet 03391a24625846c6997759d9b34dc4b4 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:28.326275 13774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03391a24625846c6997759d9b34dc4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.330420 13701 tablet_service.cc:1511] Processing CreateTablet for tablet e7c254367a594ceb8d4a3db25a715ae1 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:28.336699 13848 tablet_service.cc:1511] Processing CreateTablet for tablet 82aefa8c282f4143b3c3d55f5a4d0bcf (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:28.338238 13848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82aefa8c282f4143b3c3d55f5a4d0bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.340402 13705 tablet_service.cc:1511] Processing CreateTablet for tablet 106d35c470db4341b591e5268b81a3f3 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:28.341789 13705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 106d35c470db4341b591e5268b81a3f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.342133 13890 heartbeater.cc:499] Master 127.12.76.190:43389 was elected leader, sending a full tablet report...
I20260709 13:05:28.354044 13906 ts_tablet_manager.cc:1434] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.079s	user 0.005s	sys 0.001s
I20260709 13:05:28.355211 13906 tablet_bootstrap.cc:492] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:28.356241 13701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7c254367a594ceb8d4a3db25a715ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.324913 13780 tablet_service.cc:1511] Processing CreateTablet for tablet 82aefa8c282f4143b3c3d55f5a4d0bcf (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:28.362706 13700 tablet_service.cc:1511] Processing CreateTablet for tablet 0a31d8aefe71401dadd16c2c0a9e9ecf (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:28.364174 13780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82aefa8c282f4143b3c3d55f5a4d0bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.364341 13700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a31d8aefe71401dadd16c2c0a9e9ecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.369113 13853 tablet_service.cc:1511] Processing CreateTablet for tablet 03391a24625846c6997759d9b34dc4b4 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:28.370515 13853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03391a24625846c6997759d9b34dc4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.371709 13847 tablet_service.cc:1511] Processing CreateTablet for tablet f3cfef71353344f180965689d6ec9166 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:28.372934 13847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3cfef71353344f180965689d6ec9166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.375021 13775 tablet_service.cc:1511] Processing CreateTablet for tablet f3cfef71353344f180965689d6ec9166 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:28.376334 13775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3cfef71353344f180965689d6ec9166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.382170 13704 tablet_service.cc:1511] Processing CreateTablet for tablet ca53eab03a80405b9ebe6f6a25d8e30b (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:28.387532 13776 tablet_service.cc:1511] Processing CreateTablet for tablet 5171bcd42ea14ad3af7399ab8c6a7e35 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:28.388833 13776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5171bcd42ea14ad3af7399ab8c6a7e35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.389420 13704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca53eab03a80405b9ebe6f6a25d8e30b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.390882 13907 tablet_bootstrap.cc:492] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:28.395820 13907 ts_tablet_manager.cc:1403] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.189s	user 0.020s	sys 0.014s
I20260709 13:05:28.398779 13907 raft_consensus.cc:359] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.405037 13907 raft_consensus.cc:385] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.405444 13907 raft_consensus.cc:740] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.407891 13907 consensus_queue.cc:260] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.409554 13906 tablet_bootstrap.cc:654] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.429277 13779 tablet_service.cc:1511] Processing CreateTablet for tablet cd386d71cc264abca3dbfa88ffd4e951 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:28.430872 13779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd386d71cc264abca3dbfa88ffd4e951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.435953 13777 tablet_service.cc:1511] Processing CreateTablet for tablet 106d35c470db4341b591e5268b81a3f3 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:28.437312 13777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 106d35c470db4341b591e5268b81a3f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.453755 13854 tablet_service.cc:1511] Processing CreateTablet for tablet cd386d71cc264abca3dbfa88ffd4e951 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:28.455106 13854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd386d71cc264abca3dbfa88ffd4e951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.460253 13851 tablet_service.cc:1511] Processing CreateTablet for tablet 5171bcd42ea14ad3af7399ab8c6a7e35 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:28.460587 13704 tablet_service.cc:1511] Processing CreateTablet for tablet 397ec99b74c24481a69c1f4a7c294a73 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:28.461707 13704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 397ec99b74c24481a69c1f4a7c294a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.462472 13852 tablet_service.cc:1511] Processing CreateTablet for tablet 8446dab661a64f9b8075d7586f1197f4 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:28.463774 13772 tablet_service.cc:1511] Processing CreateTablet for tablet 8446dab661a64f9b8075d7586f1197f4 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:28.469439 13741 heartbeater.cc:499] Master 127.12.76.190:43389 was elected leader, sending a full tablet report...
I20260709 13:05:28.471392 13907 ts_tablet_manager.cc:1434] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.075s	user 0.005s	sys 0.015s
I20260709 13:05:28.472805 13816 heartbeater.cc:499] Master 127.12.76.190:43389 was elected leader, sending a full tablet report...
I20260709 13:05:28.474246 13905 tablet_bootstrap.cc:492] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:28.474715 13905 ts_tablet_manager.cc:1403] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.319s	user 0.020s	sys 0.022s
I20260709 13:05:28.477591 13905 raft_consensus.cc:359] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.478310 13905 raft_consensus.cc:385] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.478605 13905 raft_consensus.cc:740] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.483515 13851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5171bcd42ea14ad3af7399ab8c6a7e35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.473073 13907 tablet_bootstrap.cc:492] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:28.485754 13852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8446dab661a64f9b8075d7586f1197f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.490247 13855 tablet_service.cc:1511] Processing CreateTablet for tablet 106d35c470db4341b591e5268b81a3f3 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:28.494244 13855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 106d35c470db4341b591e5268b81a3f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.496176 13846 tablet_service.cc:1511] Processing CreateTablet for tablet e7c254367a594ceb8d4a3db25a715ae1 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:28.496444 13849 tablet_service.cc:1511] Processing CreateTablet for tablet 0a31d8aefe71401dadd16c2c0a9e9ecf (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:28.497594 13846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7c254367a594ceb8d4a3db25a715ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.499401 13849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a31d8aefe71401dadd16c2c0a9e9ecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.499655 13775 tablet_service.cc:1511] Processing CreateTablet for tablet 0a31d8aefe71401dadd16c2c0a9e9ecf (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:28.509197 13850 tablet_service.cc:1511] Processing CreateTablet for tablet ca53eab03a80405b9ebe6f6a25d8e30b (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:28.510478 13850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca53eab03a80405b9ebe6f6a25d8e30b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.485188 13772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8446dab661a64f9b8075d7586f1197f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.512739 13700 tablet_service.cc:1511] Processing CreateTablet for tablet 2d32f086650d45b7b7ae3e0d858e360b (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:28.513968 13700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d32f086650d45b7b7ae3e0d858e360b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.522953 13781 tablet_service.cc:1511] Processing CreateTablet for tablet e7c254367a594ceb8d4a3db25a715ae1 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:28.524363 13781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7c254367a594ceb8d4a3db25a715ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.534147 13780 tablet_service.cc:1511] Processing CreateTablet for tablet 397ec99b74c24481a69c1f4a7c294a73 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:28.535517 13905 consensus_queue.cc:260] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.538980 13906 tablet_bootstrap.cc:492] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:28.539520 13906 ts_tablet_manager.cc:1403] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.185s	user 0.010s	sys 0.008s
I20260709 13:05:28.541570 13849 tablet_service.cc:1511] Processing CreateTablet for tablet 397ec99b74c24481a69c1f4a7c294a73 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:28.542313 13906 raft_consensus.cc:359] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.545233 13906 raft_consensus.cc:385] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.545536 13906 raft_consensus.cc:740] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.546317 13906 consensus_queue.cc:260] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.523187 13776 tablet_service.cc:1511] Processing CreateTablet for tablet ca53eab03a80405b9ebe6f6a25d8e30b (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:28.550642 13906 ts_tablet_manager.cc:1434] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:05:28.551604 13906 tablet_bootstrap.cc:492] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:28.555837 13849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 397ec99b74c24481a69c1f4a7c294a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.556371 13847 tablet_service.cc:1511] Processing CreateTablet for tablet 2d32f086650d45b7b7ae3e0d858e360b (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:28.557597 13847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d32f086650d45b7b7ae3e0d858e360b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.559214 13780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 397ec99b74c24481a69c1f4a7c294a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.563745 13776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca53eab03a80405b9ebe6f6a25d8e30b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.564375 13775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a31d8aefe71401dadd16c2c0a9e9ecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.570709 13779 tablet_service.cc:1511] Processing CreateTablet for tablet 2d32f086650d45b7b7ae3e0d858e360b (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:28.573441 13906 tablet_bootstrap.cc:654] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.574100 13779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d32f086650d45b7b7ae3e0d858e360b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.598004 13907 tablet_bootstrap.cc:654] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.602551 13705 tablet_service.cc:1511] Processing CreateTablet for tablet b1367b7b65234b7fbaacfcd765b3a6e5 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:28.604102 13705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1367b7b65234b7fbaacfcd765b3a6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.620465 13905 ts_tablet_manager.cc:1434] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.145s	user 0.007s	sys 0.007s
I20260709 13:05:28.622396 13905 tablet_bootstrap.cc:492] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:28.621393 13772 tablet_service.cc:1511] Processing CreateTablet for tablet b1367b7b65234b7fbaacfcd765b3a6e5 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:28.623520 13772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1367b7b65234b7fbaacfcd765b3a6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.634454 13912 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.634941 13912 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.641568 13912 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:28.644495 13907 tablet_bootstrap.cc:492] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:28.644997 13907 ts_tablet_manager.cc:1403] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.172s	user 0.005s	sys 0.008s
I20260709 13:05:28.647655 13907 raft_consensus.cc:359] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.648249 13907 raft_consensus.cc:385] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.648519 13907 raft_consensus.cc:740] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.649200 13907 consensus_queue.cc:260] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.650869 13850 tablet_service.cc:1511] Processing CreateTablet for tablet b1367b7b65234b7fbaacfcd765b3a6e5 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:28.651571 13907 ts_tablet_manager.cc:1434] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:05:28.652593 13907 tablet_bootstrap.cc:492] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:28.653005 13850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1367b7b65234b7fbaacfcd765b3a6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.655762 13847 tablet_service.cc:1511] Processing CreateTablet for tablet ac05b1933cb74e488759c38bd76d8d00 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:28.656949 13704 tablet_service.cc:1511] Processing CreateTablet for tablet 44fb07fff88a4dcf97841a29f2641f66 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:28.658228 13704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44fb07fff88a4dcf97841a29f2641f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.659720 13847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac05b1933cb74e488759c38bd76d8d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.665331 13906 tablet_bootstrap.cc:492] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:28.659731 13907 tablet_bootstrap.cc:654] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.665827 13906 ts_tablet_manager.cc:1403] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.114s	user 0.010s	sys 0.012s
I20260709 13:05:28.666178 13705 tablet_service.cc:1511] Processing CreateTablet for tablet ac05b1933cb74e488759c38bd76d8d00 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:28.667470 13705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac05b1933cb74e488759c38bd76d8d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.641573 13905 tablet_bootstrap.cc:654] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.675084 13906 raft_consensus.cc:359] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.675927 13906 raft_consensus.cc:385] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.675612 13854 tablet_service.cc:1511] Processing CreateTablet for tablet 44fb07fff88a4dcf97841a29f2641f66 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:28.675800 13700 tablet_service.cc:1511] Processing CreateTablet for tablet 7c307c37029c4b5596bad2e08bda02bf (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:28.676331 13906 raft_consensus.cc:740] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.676972 13854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44fb07fff88a4dcf97841a29f2641f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.676975 13700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c307c37029c4b5596bad2e08bda02bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.678061 13772 tablet_service.cc:1511] Processing CreateTablet for tablet ac05b1933cb74e488759c38bd76d8d00 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:28.679270 13772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac05b1933cb74e488759c38bd76d8d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.682129 13780 tablet_service.cc:1511] Processing CreateTablet for tablet 44fb07fff88a4dcf97841a29f2641f66 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:28.683354 13780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44fb07fff88a4dcf97841a29f2641f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.689720 13906 consensus_queue.cc:260] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.693132 13906 ts_tablet_manager.cc:1434] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 13:05:28.694145 13906 tablet_bootstrap.cc:492] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:28.694952 13775 tablet_service.cc:1511] Processing CreateTablet for tablet 7c307c37029c4b5596bad2e08bda02bf (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:28.696244 13775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c307c37029c4b5596bad2e08bda02bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.700618 13849 tablet_service.cc:1511] Processing CreateTablet for tablet 7c307c37029c4b5596bad2e08bda02bf (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:28.701875 13849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c307c37029c4b5596bad2e08bda02bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.702564 13779 tablet_service.cc:1511] Processing CreateTablet for tablet bb9ba3c4f4a14a57b28d5cf2b9cf5afd (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:28.703806 13779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb9ba3c4f4a14a57b28d5cf2b9cf5afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.715991 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:28.716434 13704 tablet_service.cc:1511] Processing CreateTablet for tablet bb9ba3c4f4a14a57b28d5cf2b9cf5afd (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
W20260709 13:05:28.717283 13757 leader_election.cc:343] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:28.717679 13704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb9ba3c4f4a14a57b28d5cf2b9cf5afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.721596 13910 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.722044 13910 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.725997 13910 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:28.737565 13906 tablet_bootstrap.cc:654] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.739895 13910 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.743331 13914 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.743458 13910 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.743825 13914 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.745416 13910 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:28.746308 13914 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:28.749442 13704 tablet_service.cc:1511] Processing CreateTablet for tablet d82f3ff70ad54875bc615804bb1a2da7 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:28.750448 13704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d82f3ff70ad54875bc615804bb1a2da7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.764493 13772 tablet_service.cc:1511] Processing CreateTablet for tablet d82f3ff70ad54875bc615804bb1a2da7 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:28.772095 13772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d82f3ff70ad54875bc615804bb1a2da7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.789602 13781 tablet_service.cc:1511] Processing CreateTablet for tablet 536b1fc131984687bf3b13417507e21d (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:28.790886 13781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 536b1fc131984687bf3b13417507e21d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.780949 13776 tablet_service.cc:1511] Processing CreateTablet for tablet 49638a262b1d4ba9b26cde1d408bf7ac (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:28.793004 13776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49638a262b1d4ba9b26cde1d408bf7ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.800470 13775 tablet_service.cc:1511] Processing CreateTablet for tablet 3e4bec6398d84f67ad839268ec8d2a12 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:28.802383 13775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e4bec6398d84f67ad839268ec8d2a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.816036 13907 tablet_bootstrap.cc:492] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:28.816767 13907 ts_tablet_manager.cc:1403] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.164s	user 0.008s	sys 0.007s
I20260709 13:05:28.819996 13777 tablet_service.cc:1511] Processing CreateTablet for tablet 60899523d3d145f58ccff5bb3438cb90 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:28.850620 13777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60899523d3d145f58ccff5bb3438cb90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.852764 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:28.853513 13716 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:28.855095 13756 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:28.855144 13907 raft_consensus.cc:359] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.855883 13905 tablet_bootstrap.cc:492] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:28.856333 13912 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:28.859333 13905 ts_tablet_manager.cc:1403] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.237s	user 0.024s	sys 0.022s
I20260709 13:05:28.859608 13912 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.860006 13912 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.862519 13905 raft_consensus.cc:359] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.857982 13854 tablet_service.cc:1511] Processing CreateTablet for tablet d82f3ff70ad54875bc615804bb1a2da7 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:28.858371 13850 tablet_service.cc:1511] Processing CreateTablet for tablet 3e4bec6398d84f67ad839268ec8d2a12 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:28.866333 13854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d82f3ff70ad54875bc615804bb1a2da7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.863322 13905 raft_consensus.cc:385] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.867660 13905 raft_consensus.cc:740] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.867893 13850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e4bec6398d84f67ad839268ec8d2a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.868815 13910 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.868490 13905 consensus_queue.cc:260] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.869324 13910 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.871328 13910 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:28.873641 13851 tablet_service.cc:1511] Processing CreateTablet for tablet 536b1fc131984687bf3b13417507e21d (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:28.875073 13851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 536b1fc131984687bf3b13417507e21d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.876590 13855 tablet_service.cc:1511] Processing CreateTablet for tablet 60899523d3d145f58ccff5bb3438cb90 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:28.881067 13855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60899523d3d145f58ccff5bb3438cb90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.857575 13907 raft_consensus.cc:385] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.871268 13905 ts_tablet_manager.cc:1434] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:05:28.883919 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:28.885285 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:28.881317 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:05:28.887472 13829 leader_election.cc:343] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:28.887807 13912 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:05:28.888827 13829 leader_election.cc:343] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:28.889452 13829 leader_election.cc:343] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:28.890563 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:28.891110 13716 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.894496 13705 tablet_service.cc:1511] Processing CreateTablet for tablet 3e4bec6398d84f67ad839268ec8d2a12 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:28.898480 13704 tablet_service.cc:1511] Processing CreateTablet for tablet 49638a262b1d4ba9b26cde1d408bf7ac (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:28.901505 13847 tablet_service.cc:1511] Processing CreateTablet for tablet 49638a262b1d4ba9b26cde1d408bf7ac (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:28.902864 13847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49638a262b1d4ba9b26cde1d408bf7ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.904670 13906 tablet_bootstrap.cc:492] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:28.905251 13906 ts_tablet_manager.cc:1403] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.211s	user 0.012s	sys 0.008s
I20260709 13:05:28.906111 13704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49638a262b1d4ba9b26cde1d408bf7ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.905869 13852 tablet_service.cc:1511] Processing CreateTablet for tablet 6f7de615f578424d8bafe69fe6bea9f9 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:28.910112 13852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7de615f578424d8bafe69fe6bea9f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.911012 13906 raft_consensus.cc:359] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.911739 13906 raft_consensus.cc:385] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.912001 13906 raft_consensus.cc:740] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.912825 13906 consensus_queue.cc:260] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.915795 13849 tablet_service.cc:1511] Processing CreateTablet for tablet bb9ba3c4f4a14a57b28d5cf2b9cf5afd (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:28.917038 13849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb9ba3c4f4a14a57b28d5cf2b9cf5afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.917315 13906 ts_tablet_manager.cc:1434] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:05:28.917740 13780 tablet_service.cc:1511] Processing CreateTablet for tablet 4648ad5742bd4fe09563b72eb2dfc059 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:28.918267 13906 tablet_bootstrap.cc:492] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:28.918980 13780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4648ad5742bd4fe09563b72eb2dfc059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.919765 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:28.905869 13772 tablet_service.cc:1511] Processing CreateTablet for tablet 68418f30a686438bba0d6ab02efa0986 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:28.920986 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:28.923074 13705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e4bec6398d84f67ad839268ec8d2a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.923740 13905 tablet_bootstrap.cc:492] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:28.927772 13700 tablet_service.cc:1511] Processing CreateTablet for tablet 536b1fc131984687bf3b13417507e21d (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:28.929036 13700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 536b1fc131984687bf3b13417507e21d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.883317 13907 raft_consensus.cc:740] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.924399 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:28.931779 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:28.931658 13779 tablet_service.cc:1511] Processing CreateTablet for tablet 6f7de615f578424d8bafe69fe6bea9f9 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:28.927704 13912 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:28.933033 13912 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:28.933239 13757 leader_election.cc:343] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:28.932960 13853 tablet_service.cc:1511] Processing CreateTablet for tablet 68418f30a686438bba0d6ab02efa0986 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:28.933547 13912 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.934484 13853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68418f30a686438bba0d6ab02efa0986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.935678 13912 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:28.936527 13907 consensus_queue.cc:260] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.938311 13848 tablet_service.cc:1511] Processing CreateTablet for tablet 4648ad5742bd4fe09563b72eb2dfc059 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:28.938763 13907 ts_tablet_manager.cc:1434] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.122s	user 0.008s	sys 0.000s
I20260709 13:05:28.939126 13772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68418f30a686438bba0d6ab02efa0986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.939579 13848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4648ad5742bd4fe09563b72eb2dfc059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.942333 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:05:28.943725 13757 leader_election.cc:343] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:28.943750 13779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7de615f578424d8bafe69fe6bea9f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.948138 13907 tablet_bootstrap.cc:492] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:28.953238 13701 tablet_service.cc:1511] Processing CreateTablet for tablet 60899523d3d145f58ccff5bb3438cb90 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:28.953890 13774 tablet_service.cc:1511] Processing CreateTablet for tablet e689999f416446c9bf87d759da2844ae (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:28.953987 13703 tablet_service.cc:1511] Processing CreateTablet for tablet 4648ad5742bd4fe09563b72eb2dfc059 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:28.954552 13701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60899523d3d145f58ccff5bb3438cb90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.955154 13774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e689999f416446c9bf87d759da2844ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.955765 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:28.957572 13702 tablet_service.cc:1511] Processing CreateTablet for tablet 6f7de615f578424d8bafe69fe6bea9f9 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:28.955231 13703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4648ad5742bd4fe09563b72eb2dfc059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.960110 13699 tablet_service.cc:1511] Processing CreateTablet for tablet 68418f30a686438bba0d6ab02efa0986 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:28.962052 13702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7de615f578424d8bafe69fe6bea9f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.961947 13716 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:28.963372 13706 tablet_service.cc:1511] Processing CreateTablet for tablet e689999f416446c9bf87d759da2844ae (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:28.964576 13706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e689999f416446c9bf87d759da2844ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.938793 13906 tablet_bootstrap.cc:654] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:28.970495 13830 leader_election.cc:343] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:28.973209 13699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68418f30a686438bba0d6ab02efa0986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.973048 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:28.974495 13791 raft_consensus.cc:2393] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 1: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:05:28.974761 13697 tablet_service.cc:1511] Processing CreateTablet for tablet b022fc3eb21246ff9f62e8a747bac6c4 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:28.976051 13697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b022fc3eb21246ff9f62e8a747bac6c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.977761 13830 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:28.978477 13910 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:28.978889 13830 leader_election.cc:343] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:28.979321 13830 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:28.980024 13910 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:28.980419 13830 leader_election.cc:343] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:28.980842 13830 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:28.981441 13910 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:28.984504 13914 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.984985 13914 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:28.987087 13914 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:28.988974 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:05:28.991448 13680 leader_election.cc:343] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:28.996045 13756 leader_election.cc:343] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:28.996515 13756 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:28.997404 13931 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:28.997665 13756 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:28.998461 13931 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:28.999362 13910 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.999843 13910 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.002830 13910 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:28.998948 13931 raft_consensus.cc:697] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:29.003615 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:05:29.004844 13829 leader_election.cc:343] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.005112 13931 consensus_queue.cc:237] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.021955 13698 tablet_service.cc:1511] Processing CreateTablet for tablet 14765cc3066247a49b29adae5e893ab8 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:29.023401 13698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14765cc3066247a49b29adae5e893ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.032475 13781 tablet_service.cc:1511] Processing CreateTablet for tablet b022fc3eb21246ff9f62e8a747bac6c4 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:29.033869 13781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b022fc3eb21246ff9f62e8a747bac6c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.987289 13905 tablet_bootstrap.cc:654] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:29.037603 13830 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.12.76.190:43389, user_credentials={real_user=slave}} blocked reactor thread for 55629.2us
I20260709 13:05:29.048820 13907 tablet_bootstrap.cc:654] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.048432 13846 tablet_service.cc:1511] Processing CreateTablet for tablet b022fc3eb21246ff9f62e8a747bac6c4 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:29.048470 13776 tablet_service.cc:1511] Processing CreateTablet for tablet 14765cc3066247a49b29adae5e893ab8 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:29.049926 13846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b022fc3eb21246ff9f62e8a747bac6c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.049926 13776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14765cc3066247a49b29adae5e893ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.076366 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:29.080211 13850 tablet_service.cc:1511] Processing CreateTablet for tablet e689999f416446c9bf87d759da2844ae (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:29.081707 13850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e689999f416446c9bf87d759da2844ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.082695 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:29.088382 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:05:29.089756 13830 leader_election.cc:343] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.090346 13830 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:29.108503 13910 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:29.115780 13906 tablet_bootstrap.cc:492] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:29.116461 13906 ts_tablet_manager.cc:1403] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.198s	user 0.020s	sys 0.044s
I20260709 13:05:29.116395 13774 tablet_service.cc:1511] Processing CreateTablet for tablet fa2169d517e24498a35dae28da79c931 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:29.117763 13774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa2169d517e24498a35dae28da79c931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.086709 13611 catalog_manager.cc:5697] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.124126 13906 raft_consensus.cc:359] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.124505 13703 tablet_service.cc:1511] Processing CreateTablet for tablet fa2169d517e24498a35dae28da79c931 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:29.124887 13906 raft_consensus.cc:385] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.125233 13906 raft_consensus.cc:740] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.140372 13703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa2169d517e24498a35dae28da79c931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.149989 13697 tablet_service.cc:1511] Processing CreateTablet for tablet 4c6f358793c54a8fa2409a5d4c5505f8 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:29.151248 13697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c6f358793c54a8fa2409a5d4c5505f8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:29.145164 13682 leader_election.cc:343] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.145737 13848 tablet_service.cc:1511] Processing CreateTablet for tablet fa2169d517e24498a35dae28da79c931 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:29.157044 13848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa2169d517e24498a35dae28da79c931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.167974 13906 consensus_queue.cc:260] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.148921 13854 tablet_service.cc:1511] Processing CreateTablet for tablet 14765cc3066247a49b29adae5e893ab8 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:29.170272 13854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14765cc3066247a49b29adae5e893ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.155923 13682 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:05:29.146242 13907 tablet_bootstrap.cc:492] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:29.173050 13907 ts_tablet_manager.cc:1403] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.225s	user 0.032s	sys 0.018s
W20260709 13:05:29.173543 13682 leader_election.cc:343] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.174474 13914 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:29.174024 13682 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:05:29.177942 13907 raft_consensus.cc:359] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.178377 13914 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:29.178563 13779 tablet_service.cc:1511] Processing CreateTablet for tablet 4c6f358793c54a8fa2409a5d4c5505f8 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:29.180105 13779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c6f358793c54a8fa2409a5d4c5505f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.178689 13907 raft_consensus.cc:385] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.183835 13907 raft_consensus.cc:740] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.190845 13906 ts_tablet_manager.cc:1434] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 13:05:29.193352 13905 tablet_bootstrap.cc:492] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:29.193981 13905 ts_tablet_manager.cc:1403] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.270s	user 0.011s	sys 0.006s
I20260709 13:05:29.196035 13907 consensus_queue.cc:260] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.191896 13906 tablet_bootstrap.cc:492] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:29.200984 13907 ts_tablet_manager.cc:1434] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.003s
I20260709 13:05:29.202333 13907 tablet_bootstrap.cc:492] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:29.202728 13906 tablet_bootstrap.cc:654] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.211545 13697 tablet_service.cc:1511] Processing CreateTablet for tablet 5fbcfa22d8b54ed5997bc6453bdf0fd3 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:29.211687 13854 tablet_service.cc:1511] Processing CreateTablet for tablet 4c6f358793c54a8fa2409a5d4c5505f8 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:29.213133 13697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fbcfa22d8b54ed5997bc6453bdf0fd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.213500 13854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c6f358793c54a8fa2409a5d4c5505f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.214573 13906 tablet_bootstrap.cc:492] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:29.215054 13906 ts_tablet_manager.cc:1403] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.006s
I20260709 13:05:29.217103 13905 raft_consensus.cc:359] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.217805 13905 raft_consensus.cc:385] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.218092 13905 raft_consensus.cc:740] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.218778 13905 consensus_queue.cc:260] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.220108 13774 tablet_service.cc:1511] Processing CreateTablet for tablet 5fbcfa22d8b54ed5997bc6453bdf0fd3 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:29.220928 13905 ts_tablet_manager.cc:1434] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 13:05:29.221328 13774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fbcfa22d8b54ed5997bc6453bdf0fd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.221868 13905 tablet_bootstrap.cc:492] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:29.224344 13907 tablet_bootstrap.cc:654] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.228778 13906 raft_consensus.cc:359] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.229488 13906 raft_consensus.cc:385] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.229781 13906 raft_consensus.cc:740] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.230538 13906 consensus_queue.cc:260] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.234894 13848 tablet_service.cc:1511] Processing CreateTablet for tablet 5fbcfa22d8b54ed5997bc6453bdf0fd3 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:29.235383 13703 tablet_service.cc:1511] Processing CreateTablet for tablet b7aeef8df5a945efb8666f30fe979ab7 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:29.236272 13848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fbcfa22d8b54ed5997bc6453bdf0fd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.237510 13703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7aeef8df5a945efb8666f30fe979ab7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:29.244617 13662 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:29.244901 13776 tablet_service.cc:1511] Processing CreateTablet for tablet b7aeef8df5a945efb8666f30fe979ab7 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:29.246186 13776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7aeef8df5a945efb8666f30fe979ab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.257951 13906 ts_tablet_manager.cc:1434] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:05:29.276423 13781 tablet_service.cc:1511] Processing CreateTablet for tablet 9a3fcea1abf04503bc26d451a56ed222 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:29.277782 13781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a3fcea1abf04503bc26d451a56ed222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.278066 13850 tablet_service.cc:1511] Processing CreateTablet for tablet b7aeef8df5a945efb8666f30fe979ab7 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:29.279937 13705 tablet_service.cc:1511] Processing CreateTablet for tablet 9a3fcea1abf04503bc26d451a56ed222 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:29.281158 13705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a3fcea1abf04503bc26d451a56ed222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.282680 13850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7aeef8df5a945efb8666f30fe979ab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.288486 13704 tablet_service.cc:1511] Processing CreateTablet for tablet 2d67d303d4784301a07a1fa014f50b98 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:29.289636 13704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d67d303d4784301a07a1fa014f50b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.291205 13846 tablet_service.cc:1511] Processing CreateTablet for tablet 9a3fcea1abf04503bc26d451a56ed222 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:29.292531 13846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a3fcea1abf04503bc26d451a56ed222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.298687 13906 tablet_bootstrap.cc:492] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:29.300868 13910 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.301376 13910 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.301385 13774 tablet_service.cc:1511] Processing CreateTablet for tablet 0e6fb0872745419da9cb9e1228d021aa (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:29.303388 13910 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:29.306870 13702 tablet_service.cc:1511] Processing CreateTablet for tablet 0e6fb0872745419da9cb9e1228d021aa (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:29.307402 13849 tablet_service.cc:1511] Processing CreateTablet for tablet 0e6fb0872745419da9cb9e1228d021aa (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:29.305744 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:29.304574 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:29.303634 13774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e6fb0872745419da9cb9e1228d021aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.310034 13702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e6fb0872745419da9cb9e1228d021aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.310092 13849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e6fb0872745419da9cb9e1228d021aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.322139 13780 tablet_service.cc:1511] Processing CreateTablet for tablet cff75d4a417e4aeab081acad01b03c36 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:29.323870 13780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff75d4a417e4aeab081acad01b03c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.331904 13706 tablet_service.cc:1511] Processing CreateTablet for tablet fe5150c5d9c445549ec6d199f2cd70e0 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:29.333262 13706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe5150c5d9c445549ec6d199f2cd70e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.331977 13703 tablet_service.cc:1511] Processing CreateTablet for tablet cff75d4a417e4aeab081acad01b03c36 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:29.334457 13703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff75d4a417e4aeab081acad01b03c36. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:29.311605 13830 leader_election.cc:343] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.335608 13906 tablet_bootstrap.cc:654] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:29.335824 13829 leader_election.cc:343] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.337357 13847 tablet_service.cc:1511] Processing CreateTablet for tablet cff75d4a417e4aeab081acad01b03c36 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:29.338326 13829 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:29.338654 13847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff75d4a417e4aeab081acad01b03c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.339136 13910 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:29.343183 13777 tablet_service.cc:1511] Processing CreateTablet for tablet fe5150c5d9c445549ec6d199f2cd70e0 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:29.344436 13777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe5150c5d9c445549ec6d199f2cd70e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.344429 13848 tablet_service.cc:1511] Processing CreateTablet for tablet fe5150c5d9c445549ec6d199f2cd70e0 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:29.345851 13848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe5150c5d9c445549ec6d199f2cd70e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.351213 13704 tablet_service.cc:1511] Processing CreateTablet for tablet ff2185b760234a0280587d4ea3f18b8a (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:29.352259 13704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2185b760234a0280587d4ea3f18b8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.355216 13775 tablet_service.cc:1511] Processing CreateTablet for tablet ff2185b760234a0280587d4ea3f18b8a (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:29.356455 13775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2185b760234a0280587d4ea3f18b8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.361397 13854 tablet_service.cc:1511] Processing CreateTablet for tablet 2d67d303d4784301a07a1fa014f50b98 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:29.362671 13854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d67d303d4784301a07a1fa014f50b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.370716 13853 tablet_service.cc:1511] Processing CreateTablet for tablet ff2185b760234a0280587d4ea3f18b8a (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:29.372140 13853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2185b760234a0280587d4ea3f18b8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.377903 13905 tablet_bootstrap.cc:654] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.381233 13931 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.381680 13931 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.383869 13931 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:29.384296 13779 tablet_service.cc:1511] Processing CreateTablet for tablet 2d67d303d4784301a07a1fa014f50b98 (DEFAULT_TABLE table=test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:29.385532 13779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d67d303d4784301a07a1fa014f50b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.386878 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:05:29.388451 13756 leader_election.cc:343] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.385357 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:05:29.389878 13757 leader_election.cc:343] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.390321 13757 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:29.391338 13931 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:29.395776 13910 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.396252 13910 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.398162 13910 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:29.400471 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:29.403578 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:29.404338 13716 raft_consensus.cc:2393] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 1: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:05:29.405385 13830 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:29.406704 13910 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.413537 13910 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:29.423336 13907 tablet_bootstrap.cc:492] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:29.423992 13907 ts_tablet_manager.cc:1403] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.222s	user 0.023s	sys 0.035s
I20260709 13:05:29.444882 13906 tablet_bootstrap.cc:492] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:29.445199 13905 tablet_bootstrap.cc:492] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:29.445374 13906 ts_tablet_manager.cc:1403] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.147s	user 0.019s	sys 0.009s
I20260709 13:05:29.445695 13905 ts_tablet_manager.cc:1403] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.224s	user 0.012s	sys 0.008s
I20260709 13:05:29.448508 13906 raft_consensus.cc:359] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.448803 13905 raft_consensus.cc:359] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.449348 13906 raft_consensus.cc:385] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.449555 13905 raft_consensus.cc:385] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.449759 13906 raft_consensus.cc:740] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.449893 13905 raft_consensus.cc:740] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.450774 13905 consensus_queue.cc:260] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.450786 13906 consensus_queue.cc:260] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.453903 13906 ts_tablet_manager.cc:1434] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:05:29.454732 13906 tablet_bootstrap.cc:492] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:29.456233 13905 ts_tablet_manager.cc:1434] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:05:29.457196 13905 tablet_bootstrap.cc:492] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:29.459944 13906 tablet_bootstrap.cc:654] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.463459 13905 tablet_bootstrap.cc:654] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.442942 13907 raft_consensus.cc:359] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.465824 13907 raft_consensus.cc:385] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.466318 13907 raft_consensus.cc:740] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.467293 13907 consensus_queue.cc:260] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.469257 13931 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:29.475508 13906 tablet_bootstrap.cc:492] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:29.479504 13906 ts_tablet_manager.cc:1403] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.007s
I20260709 13:05:29.479965 13907 ts_tablet_manager.cc:1434] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 13:05:29.481796 13907 tablet_bootstrap.cc:492] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:29.482067 13906 raft_consensus.cc:359] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.482729 13906 raft_consensus.cc:385] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.482999 13906 raft_consensus.cc:740] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.483669 13906 consensus_queue.cc:260] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.485575 13906 ts_tablet_manager.cc:1434] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:29.486505 13906 tablet_bootstrap.cc:492] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:29.489446 13907 tablet_bootstrap.cc:654] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.491652 13905 tablet_bootstrap.cc:492] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:29.492146 13905 ts_tablet_manager.cc:1403] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.007s
I20260709 13:05:29.496166 13905 raft_consensus.cc:359] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.497138 13905 raft_consensus.cc:385] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.497503 13905 raft_consensus.cc:740] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.498461 13905 consensus_queue.cc:260] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.499933 13906 tablet_bootstrap.cc:654] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.501174 13905 ts_tablet_manager.cc:1434] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:05:29.503585 13905 tablet_bootstrap.cc:492] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:29.504678 13907 tablet_bootstrap.cc:492] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:29.505174 13907 ts_tablet_manager.cc:1403] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.000s
I20260709 13:05:29.509163 13907 raft_consensus.cc:359] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.509877 13907 raft_consensus.cc:385] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.510195 13907 raft_consensus.cc:740] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.511011 13905 tablet_bootstrap.cc:654] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.510954 13907 consensus_queue.cc:260] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.520732 13907 ts_tablet_manager.cc:1434] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:05:29.521798 13907 tablet_bootstrap.cc:492] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:29.523881 13905 tablet_bootstrap.cc:492] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:29.524466 13905 ts_tablet_manager.cc:1403] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 13:05:29.527971 13905 raft_consensus.cc:359] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.528861 13905 raft_consensus.cc:385] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.529222 13905 raft_consensus.cc:740] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.530287 13905 consensus_queue.cc:260] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.533274 13905 ts_tablet_manager.cc:1434] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:29.534292 13905 tablet_bootstrap.cc:492] T 9c37f25da53241cd98c09e4525d9e23c P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:29.535601 13912 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.536198 13912 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.539853 13907 tablet_bootstrap.cc:654] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.540604 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:29.541750 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:29.542233 13912 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:29.542403 13714 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
W20260709 13:05:29.541863 13757 leader_election.cc:343] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.544664 13912 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:29.544914 13756 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:29.547727 13906 tablet_bootstrap.cc:492] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:29.548185 13906 ts_tablet_manager.cc:1403] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.011s
I20260709 13:05:29.547734 13912 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.549603 13912 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.549945 13912 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.551625 13906 raft_consensus.cc:359] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.552273 13906 raft_consensus.cc:385] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.552526 13906 raft_consensus.cc:740] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.553181 13906 consensus_queue.cc:260] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.555188 13906 ts_tablet_manager.cc:1434] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:05:29.556051 13906 tablet_bootstrap.cc:492] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:29.558209 13912 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.561501 13905 tablet_bootstrap.cc:654] T 9c37f25da53241cd98c09e4525d9e23c P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.562486 13907 tablet_bootstrap.cc:492] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:29.562958 13907 ts_tablet_manager.cc:1403] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.000s
I20260709 13:05:29.564472 13906 tablet_bootstrap.cc:654] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.572515 13907 raft_consensus.cc:359] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.573899 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:29.573652 13912 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:29.574093 13907 raft_consensus.cc:385] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.574491 13714 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.574882 13907 raft_consensus.cc:740] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.575379 13914 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.575824 13914 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.575788 13907 consensus_queue.cc:260] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.576753 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:29.577330 13864 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.577903 13914 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:29.579869 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:29.580473 13865 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:29.581763 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:29.581873 13714 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:29.582399 13791 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:29.583071 13756 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:29.583966 13682 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:29.584504 13952 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.585158 13952 raft_consensus.cc:697] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:29.585319 13914 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.585732 13914 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.586072 13914 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.586617 13907 ts_tablet_manager.cc:1434] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:05:29.586287 13952 consensus_queue.cc:237] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.587782 13907 tablet_bootstrap.cc:492] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:29.589998 13864 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:29.594411 13907 tablet_bootstrap.cc:654] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.605145 13906 tablet_bootstrap.cc:492] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:29.605614 13906 ts_tablet_manager.cc:1403] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.012s
I20260709 13:05:29.606722 13959 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.605614 13905 tablet_bootstrap.cc:492] T 9c37f25da53241cd98c09e4525d9e23c P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:29.607641 13905 ts_tablet_manager.cc:1403] T 9c37f25da53241cd98c09e4525d9e23c P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.074s	user 0.004s	sys 0.013s
I20260709 13:05:29.608651 13906 raft_consensus.cc:359] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.609308 13906 raft_consensus.cc:385] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.609577 13906 raft_consensus.cc:740] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.610287 13905 raft_consensus.cc:359] T 9c37f25da53241cd98c09e4525d9e23c P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.610308 13906 consensus_queue.cc:260] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.611058 13905 raft_consensus.cc:385] T 9c37f25da53241cd98c09e4525d9e23c P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.611388 13905 raft_consensus.cc:740] T 9c37f25da53241cd98c09e4525d9e23c P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.612092 13905 consensus_queue.cc:260] T 9c37f25da53241cd98c09e4525d9e23c P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.609848 13612 catalog_manager.cc:5697] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.614225 13914 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.607174 13959 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.617216 13959 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:29.621212 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:29.622030 13791 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:29.623973 13906 ts_tablet_manager.cc:1434] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:05:29.625167 13906 tablet_bootstrap.cc:492] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:29.633071 13906 tablet_bootstrap.cc:654] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.633363 13905 ts_tablet_manager.cc:1434] T 9c37f25da53241cd98c09e4525d9e23c P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.011s
I20260709 13:05:29.634366 13905 tablet_bootstrap.cc:492] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:29.635833 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:29.636672 13864 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:29.638336 13680 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:29.639564 13961 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.639955 13961 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.640272 13961 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.640765 13905 tablet_bootstrap.cc:654] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.641207 13914 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:29.646126 13907 tablet_bootstrap.cc:492] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:29.646668 13907 ts_tablet_manager.cc:1403] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.037s
I20260709 13:05:29.647754 13961 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.649551 13910 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.649376 13907 raft_consensus.cc:359] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.650295 13907 raft_consensus.cc:385] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.650211 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:29.650043 13910 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.650851 13791 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.650974 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:29.651547 13864 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.653085 13910 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:29.653801 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:29.654398 13789 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 0.
I20260709 13:05:29.654898 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:29.655646 13829 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:29.655712 13714 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 0.
I20260709 13:05:29.656545 13910 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.656917 13910 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.657249 13910 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.657584 13907 raft_consensus.cc:740] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.659592 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:29.659778 13907 consensus_queue.cc:260] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.660326 13789 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.658978 13791 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:29.661585 13680 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:29.662460 13914 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.662931 13914 raft_consensus.cc:697] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:05:29.663739 13914 consensus_queue.cc:237] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.668051 13907 ts_tablet_manager.cc:1434] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:05:29.669401 13789 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:29.671039 13907 tablet_bootstrap.cc:492] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:29.671227 13680 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:29.672264 13959 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.674558 13952 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.675015 13952 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.675889 13961 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:29.677388 13952 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:29.678862 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:29.679154 13907 tablet_bootstrap.cc:654] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.679559 13865 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:29.681725 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:29.682277 13757 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:29.683113 13952 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.683483 13952 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:29.683439 13756 leader_election.cc:343] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.684010 13952 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.687845 13905 tablet_bootstrap.cc:492] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:29.687845 13906 tablet_bootstrap.cc:492] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:29.688385 13905 ts_tablet_manager.cc:1403] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.054s	user 0.031s	sys 0.001s
I20260709 13:05:29.688434 13906 ts_tablet_manager.cc:1403] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.002s
I20260709 13:05:29.691156 13906 raft_consensus.cc:359] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.691994 13906 raft_consensus.cc:385] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.691910 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:29.692595 13906 raft_consensus.cc:740] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.692803 13865 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.693627 13906 consensus_queue.cc:260] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.696586 13959 raft_consensus.cc:697] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:05:29.697816 13959 consensus_queue.cc:237] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.691017 13905 raft_consensus.cc:359] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.701412 13905 raft_consensus.cc:385] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.701720 13905 raft_consensus.cc:740] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.703356 13906 ts_tablet_manager.cc:1434] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.007s
I20260709 13:05:29.703564 13905 consensus_queue.cc:260] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.704737 13906 tablet_bootstrap.cc:492] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:29.705318 13905 ts_tablet_manager.cc:1434] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:05:29.706148 13905 tablet_bootstrap.cc:492] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:29.710959 13906 tablet_bootstrap.cc:654] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.712607 13905 tablet_bootstrap.cc:654] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.670226 13864 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:29.729408 13907 tablet_bootstrap.cc:492] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:29.729880 13907 ts_tablet_manager.cc:1403] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.030s
I20260709 13:05:29.730031 13865 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:29.731190 13910 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.733180 13952 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.734258 13910 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:29.735365 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:29.736009 13714 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.736151 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:29.736918 13952 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:05:29.738710 13756 leader_election.cc:343] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.739303 13907 raft_consensus.cc:359] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.739957 13907 raft_consensus.cc:385] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.740074 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:29.740247 13907 raft_consensus.cc:740] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.740610 13789 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.740448 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:29.740903 13907 consensus_queue.cc:260] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.741279 13864 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.742869 13907 ts_tablet_manager.cc:1434] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:05:29.744086 13907 tablet_bootstrap.cc:492] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:29.750880 13864 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:29.751128 13614 catalog_manager.cc:5697] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.734972 13959 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.751978 13757 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:29.752461 13959 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.753255 13952 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.753738 13952 raft_consensus.cc:697] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:29.754529 13952 consensus_queue.cc:237] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.754901 13714 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:05:29.756148 13830 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:29.756762 13906 tablet_bootstrap.cc:492] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:29.757054 13910 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.757243 13906 ts_tablet_manager.cc:1403] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.016s
I20260709 13:05:29.757576 13614 catalog_manager.cc:5697] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.759662 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:05:29.761075 13680 leader_election.cc:343] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.761853 13910 raft_consensus.cc:697] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:05:29.757081 13789 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:05:29.763151 13910 consensus_queue.cc:237] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.768107 13907 tablet_bootstrap.cc:654] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.767966 13906 raft_consensus.cc:359] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.768841 13906 raft_consensus.cc:385] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.769186 13906 raft_consensus.cc:740] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.770205 13906 consensus_queue.cc:260] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.771962 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:29.772739 13864 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:29.774211 13906 ts_tablet_manager.cc:1434] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:05:29.774529 13682 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:05:29.775101 13959 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:29.775342 13906 tablet_bootstrap.cc:492] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:29.776896 13905 tablet_bootstrap.cc:492] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:29.777325 13905 ts_tablet_manager.cc:1403] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.006s
I20260709 13:05:29.781999 13906 tablet_bootstrap.cc:654] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.783603 13965 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.784013 13965 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.784358 13965 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.787525 13612 catalog_manager.cc:5697] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.790746 13907 tablet_bootstrap.cc:492] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:29.791199 13907 ts_tablet_manager.cc:1403] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.005s
I20260709 13:05:29.792390 13965 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.793805 13907 raft_consensus.cc:359] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.794407 13907 raft_consensus.cc:385] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.794664 13907 raft_consensus.cc:740] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.795403 13907 consensus_queue.cc:260] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.796594 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:29.797490 13907 ts_tablet_manager.cc:1434] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:29.797657 13967 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:29.798004 13680 leader_election.cc:343] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.798125 13967 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.799612 13905 raft_consensus.cc:359] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.800256 13905 raft_consensus.cc:385] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.800298 13967 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:29.800602 13905 raft_consensus.cc:740] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.801090 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:29.801247 13905 consensus_queue.cc:260] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.801911 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:29.802574 13789 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 0.
I20260709 13:05:29.802537 13714 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 0.
I20260709 13:05:29.803807 13829 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:29.804075 13965 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:29.804678 13967 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.805121 13967 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.805171 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:29.805586 13967 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.805830 13864 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.809022 13907 tablet_bootstrap.cc:492] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:29.813264 13905 ts_tablet_manager.cc:1434] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:05:29.814242 13905 tablet_bootstrap.cc:492] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:29.815796 13907 tablet_bootstrap.cc:654] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.816488 13967 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.819304 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:29.819883 13714 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.822234 13967 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:29.823938 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:29.824481 13789 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.825699 13906 tablet_bootstrap.cc:492] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:29.826159 13906 ts_tablet_manager.cc:1403] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.051s	user 0.006s	sys 0.010s
I20260709 13:05:29.827970 13864 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:29.828725 13906 raft_consensus.cc:359] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.829449 13906 raft_consensus.cc:385] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.829383 13682 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:05:29.830585 13611 catalog_manager.cc:5697] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:29.831595 13965 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.832101 13965 raft_consensus.cc:697] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:05:29.832824 13965 consensus_queue.cc:237] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.837947 13907 tablet_bootstrap.cc:492] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:29.838400 13907 ts_tablet_manager.cc:1403] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.030s	user 0.005s	sys 0.017s
I20260709 13:05:29.819977 13905 tablet_bootstrap.cc:654] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.829924 13906 raft_consensus.cc:740] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.840737 13906 consensus_queue.cc:260] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.841924 13714 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:05:29.842824 13906 ts_tablet_manager.cc:1434] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:05:29.843168 13830 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:29.843946 13906 tablet_bootstrap.cc:492] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:29.844105 13967 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.844314 13789 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:05:29.844687 13967 raft_consensus.cc:697] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:05:29.845587 13967 consensus_queue.cc:237] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.848531 13907 raft_consensus.cc:359] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.849243 13907 raft_consensus.cc:385] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.849556 13907 raft_consensus.cc:740] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.850500 13907 consensus_queue.cc:260] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.852596 13907 ts_tablet_manager.cc:1434] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:05:29.854401 13907 tablet_bootstrap.cc:492] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:29.859275 13906 tablet_bootstrap.cc:654] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.857263 13612 catalog_manager.cc:5697] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.864764 13905 tablet_bootstrap.cc:492] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:29.865185 13905 ts_tablet_manager.cc:1403] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.003s
I20260709 13:05:29.864636 13614 catalog_manager.cc:5697] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:29.866818 13907 tablet_bootstrap.cc:654] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.868206 13905 raft_consensus.cc:359] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.868862 13905 raft_consensus.cc:385] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.869124 13905 raft_consensus.cc:740] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.869853 13905 consensus_queue.cc:260] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.872632 13905 ts_tablet_manager.cc:1434] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:05:29.873574 13905 tablet_bootstrap.cc:492] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:29.879349 13905 tablet_bootstrap.cc:654] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.886390 13907 tablet_bootstrap.cc:492] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:29.886879 13907 ts_tablet_manager.cc:1403] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.033s	user 0.022s	sys 0.000s
I20260709 13:05:29.888950 13906 tablet_bootstrap.cc:492] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:29.889453 13906 ts_tablet_manager.cc:1403] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.021s
I20260709 13:05:29.889564 13907 raft_consensus.cc:359] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.890272 13907 raft_consensus.cc:385] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.890542 13907 raft_consensus.cc:740] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.891188 13907 consensus_queue.cc:260] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.892426 13906 raft_consensus.cc:359] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.893141 13906 raft_consensus.cc:385] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.893487 13907 ts_tablet_manager.cc:1434] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:05:29.894114 13905 tablet_bootstrap.cc:492] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:29.894480 13905 ts_tablet_manager.cc:1403] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:05:29.894502 13907 tablet_bootstrap.cc:492] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:29.893474 13906 raft_consensus.cc:740] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.895908 13967 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.896328 13967 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.896311 13906 consensus_queue.cc:260] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.896661 13905 raft_consensus.cc:359] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.897893 13906 ts_tablet_manager.cc:1434] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:05:29.898821 13967 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:29.900686 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:29.904675 13906 tablet_bootstrap.cc:492] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
W20260709 13:05:29.905246 13829 leader_election.cc:343] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.901043 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:05:29.906996 13830 leader_election.cc:343] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.907569 13967 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.907397 13830 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:29.908138 13967 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.908720 13910 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:29.910887 13905 raft_consensus.cc:385] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.911144 13906 tablet_bootstrap.cc:654] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.911240 13905 raft_consensus.cc:740] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.912343 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:29.913420 13967 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:05:29.913709 13830 leader_election.cc:343] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.903579 13907 tablet_bootstrap.cc:654] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.914592 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:29.915679 13789 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 0.
I20260709 13:05:29.912122 13905 consensus_queue.cc:260] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.921025 13907 tablet_bootstrap.cc:492] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:29.922148 13907 ts_tablet_manager.cc:1403] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.006s
I20260709 13:05:29.921041 13905 ts_tablet_manager.cc:1434] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:05:29.924410 13905 tablet_bootstrap.cc:492] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:29.926074 13907 raft_consensus.cc:359] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.926962 13907 raft_consensus.cc:385] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.927282 13907 raft_consensus.cc:740] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.929075 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:29.930572 13967 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.931043 13967 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.931681 13952 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.932129 13952 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.931540 13967 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.933481 13905 tablet_bootstrap.cc:654] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.934408 13952 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:29.936079 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:29.936924 13864 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:29.939808 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:29.940725 13714 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:29.941675 13757 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:29.942596 13952 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.942855 13952 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.943059 13952 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.946548 13905 tablet_bootstrap.cc:492] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:29.947023 13905 ts_tablet_manager.cc:1403] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.008s
I20260709 13:05:29.949707 13905 raft_consensus.cc:359] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.949831 13952 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.951172 13905 raft_consensus.cc:385] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.951503 13905 raft_consensus.cc:740] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.951802 13967 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.952472 13906 tablet_bootstrap.cc:492] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:29.952280 13905 consensus_queue.cc:260] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.952934 13906 ts_tablet_manager.cc:1403] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.031s
I20260709 13:05:29.953385 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:29.953929 13714 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.954345 13905 ts_tablet_manager.cc:1434] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:05:29.939879 13907 consensus_queue.cc:260] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.958437 13907 ts_tablet_manager.cc:1434] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:05:29.959371 13907 tablet_bootstrap.cc:492] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:29.960657 13714 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:29.955858 13905 tablet_bootstrap.cc:492] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:29.961817 13756 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:29.963387 13912 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.963862 13912 raft_consensus.cc:697] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:29.963925 13906 raft_consensus.cc:359] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.964907 13906 raft_consensus.cc:385] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.965245 13906 raft_consensus.cc:740] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.965025 13912 consensus_queue.cc:237] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.966195 13906 consensus_queue.cc:260] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:29.968353 13905 tablet_bootstrap.cc:654] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.972616 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:29.973301 13716 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.976794 13952 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:29.977979 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:29.978627 13864 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.981734 13716 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:05:29.983240 13830 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:29.984122 13910 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.986749 13906 ts_tablet_manager.cc:1434] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:05:29.987862 13906 tablet_bootstrap.cc:492] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:29.990969 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:29.991511 13967 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:29.991789 13789 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.994514 13864 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:29.996821 13907 tablet_bootstrap.cc:654] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:30.001452 13967 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.001834 13967 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.009115 13789 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:05:30.010725 13967 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:30.012434 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:30.011866 13612 catalog_manager.cc:5697] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.013128 13910 raft_consensus.cc:697] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:05:30.014961 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:30.016242 13905 tablet_bootstrap.cc:492] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
W20260709 13:05:30.016543 13829 leader_election.cc:343] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:30.017071 13905 ts_tablet_manager.cc:1403] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.061s	user 0.036s	sys 0.014s
W20260709 13:05:30.017349 13830 leader_election.cc:343] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:30.017848 13830 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:30.018312 13910 consensus_queue.cc:237] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.023164 13905 raft_consensus.cc:359] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.024259 13905 raft_consensus.cc:385] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:30.024689 13905 raft_consensus.cc:740] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:30.025732 13905 consensus_queue.cc:260] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.029083 13987 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:30.032604 13906 tablet_bootstrap.cc:654] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:30.035979 13905 ts_tablet_manager.cc:1434] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.001s
I20260709 13:05:30.037352 13905 tablet_bootstrap.cc:492] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:30.043309 13965 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.043889 13965 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.046058 13965 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:30.047313 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:30.047971 13789 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:30.048054 13907 tablet_bootstrap.cc:492] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:30.048529 13907 ts_tablet_manager.cc:1403] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.089s	user 0.017s	sys 0.024s
I20260709 13:05:30.049026 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:30.049918 13965 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:30.050297 13965 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.050625 13965 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.051498 13906 tablet_bootstrap.cc:492] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:30.051158 13907 raft_consensus.cc:359] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.051983 13907 raft_consensus.cc:385] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:30.052049 13906 ts_tablet_manager.cc:1403] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.003s
I20260709 13:05:30.052284 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:30.052399 13907 raft_consensus.cc:740] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:30.052902 13912 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.053254 13907 consensus_queue.cc:260] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.053422 13912 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.055085 13906 raft_consensus.cc:359] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.055814 13906 raft_consensus.cc:385] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:30.056133 13906 raft_consensus.cc:740] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:30.056834 13906 consensus_queue.cc:260] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.057372 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:30.058447 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:30.059022 13865 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:30.060207 13757 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:30.061002 13952 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:30.061358 13952 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.061604 13905 tablet_bootstrap.cc:654] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:30.061674 13952 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.061810 13611 catalog_manager.cc:5697] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:30.063805 13906 ts_tablet_manager.cc:1434] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:05:30.052896 13864 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:30.064859 13906 tablet_bootstrap.cc:492] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
W20260709 13:05:30.065960 13756 leader_election.cc:343] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:30.066701 13910 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.067147 13910 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.069342 13910 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:30.071135 13906 tablet_bootstrap.cc:654] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:30.071185 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:30.071964 13912 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:30.072984 13789 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 0.
I20260709 13:05:30.074347 13907 ts_tablet_manager.cc:1434] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:05:30.079779 13907 tablet_bootstrap.cc:492] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:30.074193 13829 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:30.084035 13952 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.085219 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:30.086329 13952 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:30.087862 13907 tablet_bootstrap.cc:654] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:30.089074 13830 leader_election.cc:343] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:30.090049 13910 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:30.090940 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:30.091586 13864 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.092417 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:05:30.095180 13756 leader_election.cc:343] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:30.083726 13959 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.096252 13961 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.096362 13959 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.098337 13959 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:30.091149 13910 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.099277 13910 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.100638 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:30.101354 13864 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
W20260709 13:05:30.102027 13680 leader_election.cc:343] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:30.102509 13757 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:30.103818 13952 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:30.106643 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:30.107290 13965 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.108063 13905 tablet_bootstrap.cc:492] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:30.105451 13952 raft_consensus.cc:697] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:05:30.108173 13682 leader_election.cc:343] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:30.108564 13905 ts_tablet_manager.cc:1403] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.071s	user 0.026s	sys 0.024s
I20260709 13:05:30.108635 13682 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:05:30.112300 13959 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:30.113273 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:30.113844 13789 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.115360 13905 raft_consensus.cc:359] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.116021 13905 raft_consensus.cc:385] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:30.116266 13905 raft_consensus.cc:740] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:30.116860 13905 consensus_queue.cc:260] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.121937 13905 ts_tablet_manager.cc:1434] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:05:30.123014 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:30.123632 13863 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.124590 13910 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.124922 13912 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.108968 13952 consensus_queue.cc:237] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.127694 13905 tablet_bootstrap.cc:492] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:30.119382 13965 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:30.141165 13789 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:30.143543 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:30.144624 13959 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.144910 13912 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:30.148609 13910 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:30.149925 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:30.150362 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:30.150920 13906 tablet_bootstrap.cc:492] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:30.150882 13791 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.151396 13906 ts_tablet_manager.cc:1403] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.087s	user 0.009s	sys 0.003s
W20260709 13:05:30.151631 13830 leader_election.cc:343] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:30.146394 13965 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:30.155293 13907 tablet_bootstrap.cc:492] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:30.155786 13907 ts_tablet_manager.cc:1403] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.005s
I20260709 13:05:30.158170 13906 raft_consensus.cc:359] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.158833 13906 raft_consensus.cc:385] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:30.159364 13906 raft_consensus.cc:740] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:30.160247 13906 consensus_queue.cc:260] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.162602 13912 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.162787 13906 ts_tablet_manager.cc:1434] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.002s
I20260709 13:05:30.167217 13906 tablet_bootstrap.cc:492] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:30.156562 13965 raft_consensus.cc:697] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:05:30.163141 13912 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.214599 13931 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.215152 13931 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.227572 13959 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.234010 13959 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.242677 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:30.251184 13987 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.252223 13987 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:05:30.264114 13662 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:30.291337 13959 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:30.291543 13931 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:30.291612 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:30.271226 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:30.282200 13987 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:30.313184 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:30.318806 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:05:30.320165 13829 leader_election.cc:343] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:30.321295 13756 leader_election.cc:343] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:30.321730 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:30.301482 13961 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:05:30.328500 13905 tablet_bootstrap.cc:654] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:30.329236 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 48973.1us
I20260709 13:05:30.329589 14002 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.330174 14002 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.337796 13907 raft_consensus.cc:359] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.341871 13907 raft_consensus.cc:385] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:30.342284 13907 raft_consensus.cc:740] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:30.345687 13907 consensus_queue.cc:260] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.322544 13959 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:05:30.353122 13907 ts_tablet_manager.cc:1434] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.197s	user 0.021s	sys 0.008s
I20260709 13:05:30.289498 13965 consensus_queue.cc:237] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.348232 13864 raft_consensus.cc:2393] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 1: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:05:30.326952 13987 consensus_queue.cc:1048] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
W20260709 13:05:30.345335 13830 leader_election.cc:343] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:30.351060 13863 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:30.363765 14002 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:30.363714 13791 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:05:30.359588 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:30.360903 13830 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:30.361642 13961 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.374768 13906 tablet_bootstrap.cc:654] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:30.376031 13862 raft_consensus.cc:2393] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 1: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:05:30.377015 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:05:30.384910 13992 log.cc:927] Time spent T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:05:30.404992 13829 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:30.412137 13907 tablet_bootstrap.cc:492] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:30.449606 13905 tablet_bootstrap.cc:492] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:30.385429 13961 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:05:30.416584 13680 leader_election.cc:343] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:30.386734 13967 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:30.481451 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 76547.7us
W20260709 13:05:30.486197 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 69674.2us
I20260709 13:05:30.495715 13905 ts_tablet_manager.cc:1403] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.368s	user 0.027s	sys 0.068s
I20260709 13:05:30.487320 13987 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:30.493530 13757 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:30.504639 13716 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.504956 13961 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:30.508622 13905 raft_consensus.cc:359] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.508944 13931 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.509330 13905 raft_consensus.cc:385] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:30.509613 13905 raft_consensus.cc:740] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:30.510272 13905 consensus_queue.cc:260] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.512396 13905 ts_tablet_manager.cc:1434] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.004s
I20260709 13:05:30.513101 13905 tablet_bootstrap.cc:492] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:30.518168 13612 catalog_manager.cc:5697] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:30.500491 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 156245us
I20260709 13:05:30.513958 13987 raft_consensus.cc:697] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:05:30.524967 13998 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:05:30.534194 13912 leader_election.cc:290] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:30.542689 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:30.543078 13682 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:05:30.524194 13967 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:05:30.573637 14008 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.574155 14008 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.591329 13967 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.594717 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:30.551590 13912 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:05:30.608229 14013 consensus_queue.cc:1048] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.050s
I20260709 13:05:30.613976 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:30.614842 13862 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
W20260709 13:05:30.618929 13756 consensus_peers.cc:597] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.579773 13987 consensus_queue.cc:237] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.625895 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:30.629179 13757 leader_election.cc:304] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:30.631201 13996 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.114s
I20260709 13:05:30.633034 13996 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:30.633522 13996 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.633924 13996 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:30.635507 13682 leader_election.cc:343] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:30.636014 13682 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:05:30.637030 14002 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:30.649015 13614 catalog_manager.cc:5697] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.652523 13907 tablet_bootstrap.cc:654] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:30.653298 13680 leader_election.cc:343] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:30.671751 14008 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:30.671823 14006 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:30.679231 13905 tablet_bootstrap.cc:654] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:30.684638 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:30.670228 13910 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.688719 13910 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.691300 13910 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:30.745000 13906 tablet_bootstrap.cc:492] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:30.745404 13906 ts_tablet_manager.cc:1403] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.578s	user 0.037s	sys 0.062s
I20260709 13:05:30.743180 13931 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:30.738562 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 109499us
I20260709 13:05:30.748898 14006 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.749415 14006 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.707681 13961 consensus_queue.cc:1048] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
W20260709 13:05:30.736346 13682 leader_election.cc:343] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:30.757025 13682 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:05:30.754897 14006 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:30.757789 13910 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.065s
W20260709 13:05:30.831795 14021 log.cc:927] Time spent T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.062s	user 0.001s	sys 0.001s
W20260709 13:05:30.831620 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 67832us
I20260709 13:05:30.820488 13959 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:30.822672 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:30.844692 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:30.839922 13987 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:05:30.846866 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:30.849478 13862 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:30.832677 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:30.857342 13786 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 0.
I20260709 13:05:30.858788 13829 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:30.859611 13910 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:30.859967 13910 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.860316 13910 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.838434 13996 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.863613 13907 tablet_bootstrap.cc:492] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:30.864145 13907 ts_tablet_manager.cc:1403] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.452s	user 0.038s	sys 0.026s
I20260709 13:05:30.864637 13785 raft_consensus.cc:2393] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 1: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:05:30.855582 13757 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:05:30.877583 13830 leader_election.cc:343] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:30.882972 14016 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:30.888199 13906 raft_consensus.cc:359] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.888803 13906 raft_consensus.cc:385] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:30.889061 13906 raft_consensus.cc:740] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:30.889595 13906 consensus_queue.cc:260] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.893606 13906 ts_tablet_manager.cc:1434] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.148s	user 0.005s	sys 0.001s
I20260709 13:05:30.899497 13996 leader_election.cc:290] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:30.900947 13906 tablet_bootstrap.cc:492] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:30.908646 13907 raft_consensus.cc:359] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.909193 13907 raft_consensus.cc:385] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:30.907697 14008 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.909461 13907 raft_consensus.cc:740] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:30.909910 13959 consensus_queue.cc:1048] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:30.916611 13756 leader_election.cc:343] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:30.920768 13905 tablet_bootstrap.cc:492] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:30.921334 13905 ts_tablet_manager.cc:1403] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.408s	user 0.026s	sys 0.015s
I20260709 13:05:30.936367 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:30.937083 13861 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:30.938776 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:30.939394 13711 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.943727 13907 consensus_queue.cc:260] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:30.962034 13907 ts_tablet_manager.cc:1434] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.098s	user 0.009s	sys 0.002s
I20260709 13:05:30.963207 13907 tablet_bootstrap.cc:492] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:30.942762 14007 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:30.966558 14007 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.966944 14007 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:30.975744 14029 log.cc:927] Time spent T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:05:30.977075 14023 log.cc:927] Time spent T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:05:31.035830 13961 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:31.004068 13682 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:05:31.053005 13614 catalog_manager.cc:5697] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:31.081840 13905 raft_consensus.cc:359] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.082800 13905 raft_consensus.cc:385] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:31.083144 13905 raft_consensus.cc:740] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:31.084010 13905 consensus_queue.cc:260] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.075124 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:31.094871 13905 ts_tablet_manager.cc:1434] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.173s	user 0.008s	sys 0.002s
I20260709 13:05:31.096083 13905 tablet_bootstrap.cc:492] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
W20260709 13:05:31.079795 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 84400.9us
I20260709 13:05:31.100201 13863 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:31.127794 13907 tablet_bootstrap.cc:654] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:31.092394 13910 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.192408 13910 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:31.204855 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:31.218880 13906 tablet_bootstrap.cc:654] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:31.220849 14035 log.cc:927] Time spent T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:05:31.226980 13905 tablet_bootstrap.cc:654] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:31.232182 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:31.233764 13910 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:05:31.253644 13830 leader_election.cc:343] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:31.243295 13711 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:31.267267 14006 raft_consensus.cc:2764] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:05:31.296720 14016 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.297240 14016 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:05:31.276142 13830 consensus_peers.cc:597] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:31.305225 14016 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:31.311036 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:05:31.312723 13757 leader_election.cc:343] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:31.298911 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 148593us
I20260709 13:05:31.295261 13756 leader_election.cc:304] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:31.326424 13863 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
W20260709 13:05:31.330366 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 44853.1us
I20260709 13:05:31.332245 13996 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:31.342118 13996 raft_consensus.cc:697] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:31.342398 13907 tablet_bootstrap.cc:492] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:31.342896 13907 ts_tablet_manager.cc:1403] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.380s	user 0.019s	sys 0.070s
I20260709 13:05:31.343009 13996 consensus_queue.cc:237] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.318838 14007 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.356573 14041 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.370559 14041 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.375909 14002 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:31.377388 14041 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:05:31.377560 13662 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:31.378732 13791 raft_consensus.cc:2393] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 1: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:05:31.379093 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:31.364107 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:31.380239 13715 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:31.382328 14007 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:05:31.383983 13680 leader_election.cc:343] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:31.384953 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:31.395972 13756 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:31.405031 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:31.405727 13861 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:31.406505 13967 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.406922 13967 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.408856 13967 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:31.409005 13829 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:31.395993 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:31.411731 13682 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:05:31.412503 14041 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:31.413580 13907 raft_consensus.cc:359] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.414297 13907 raft_consensus.cc:385] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:31.414626 13907 raft_consensus.cc:740] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:31.412866 14041 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.415325 13907 consensus_queue.cc:260] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.415839 14041 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:31.418147 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:31.411016 13967 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:31.411288 13931 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:31.437628 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:31.425701 13931 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.445276 13931 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:31.436386 13907 ts_tablet_manager.cc:1434] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.093s	user 0.007s	sys 0.002s
I20260709 13:05:31.452258 13907 tablet_bootstrap.cc:492] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
W20260709 13:05:31.422855 13756 leader_election.cc:343] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:31.435257 13829 leader_election.cc:343] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:31.456480 13863 raft_consensus.cc:2393] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 1: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:05:31.457880 13905 tablet_bootstrap.cc:492] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:31.458300 13905 ts_tablet_manager.cc:1403] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.362s	user 0.018s	sys 0.025s
I20260709 13:05:31.463781 13905 raft_consensus.cc:359] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.464512 13905 raft_consensus.cc:385] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:31.464814 13905 raft_consensus.cc:740] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:31.465947 13757 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:31.474435 14016 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:31.476866 13905 consensus_queue.cc:260] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.477005 14041 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.478425 13711 raft_consensus.cc:2393] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 1: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:05:31.479012 13905 ts_tablet_manager.cc:1434] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:05:31.471374 13931 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.480602 13906 tablet_bootstrap.cc:492] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:31.480454 13830 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:31.481071 13906 ts_tablet_manager.cc:1403] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.587s	user 0.015s	sys 0.037s
I20260709 13:05:31.481834 13967 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:31.484107 13906 raft_consensus.cc:359] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.484767 13906 raft_consensus.cc:385] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:31.485046 13906 raft_consensus.cc:740] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:31.486193 13905 tablet_bootstrap.cc:492] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:31.486338 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:31.486979 13711 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:31.489310 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:05:31.490530 13680 leader_election.cc:343] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:31.493433 13907 tablet_bootstrap.cc:654] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:31.497007 13967 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:31.494376 14041 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:31.499725 13906 consensus_queue.cc:260] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.501784 13906 ts_tablet_manager.cc:1434] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.003s
I20260709 13:05:31.501819 13905 tablet_bootstrap.cc:654] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:31.502792 13906 tablet_bootstrap.cc:492] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:31.505070 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:31.508688 13711 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:31.509747 13756 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:31.510572 14016 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:31.511307 14006 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.511375 14016 raft_consensus.cc:697] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:31.511978 14006 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.512492 14016 consensus_queue.cc:237] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.514207 14006 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:31.509979 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:31.516471 13862 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:31.511566 13931 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:31.519906 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:31.521865 13863 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:31.522650 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:31.524108 13682 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:05:31.524582 13862 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:31.525091 14006 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:31.525604 14006 raft_consensus.cc:697] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:05:31.525760 13682 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:05:31.526898 14002 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:31.526726 14006 consensus_queue.cc:237] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.529902 13906 tablet_bootstrap.cc:654] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:31.533977 13907 tablet_bootstrap.cc:492] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:31.534320 13905 tablet_bootstrap.cc:492] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:31.534534 13907 ts_tablet_manager.cc:1403] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.083s	user 0.007s	sys 0.005s
I20260709 13:05:31.534775 13905 ts_tablet_manager.cc:1403] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.049s	user 0.006s	sys 0.006s
I20260709 13:05:31.536375 13612 catalog_manager.cc:5697] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:31.543121 13907 raft_consensus.cc:359] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.544270 13907 raft_consensus.cc:385] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:31.544523 13907 raft_consensus.cc:740] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:31.538501 13905 raft_consensus.cc:359] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.545019 13905 raft_consensus.cc:385] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:31.544759 13614 catalog_manager.cc:5697] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:31.545331 13905 raft_consensus.cc:740] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:31.545239 13907 consensus_queue.cc:260] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.546303 13905 consensus_queue.cc:260] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.547477 13907 ts_tablet_manager.cc:1434] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 13:05:31.548354 13907 tablet_bootstrap.cc:492] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:31.549966 13905 ts_tablet_manager.cc:1434] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:05:31.553086 13905 tablet_bootstrap.cc:492] T ac7aedfecb9c482a9cf59234dff1e9f8 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:31.557281 13906 tablet_bootstrap.cc:492] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:31.557731 13906 ts_tablet_manager.cc:1403] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.055s	user 0.006s	sys 0.006s
I20260709 13:05:31.559252 13614 catalog_manager.cc:5697] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:31.560146 13906 raft_consensus.cc:359] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.560802 13906 raft_consensus.cc:385] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:31.561079 13906 raft_consensus.cc:740] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:31.561748 13907 tablet_bootstrap.cc:654] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:31.565202 13905 tablet_bootstrap.cc:654] T ac7aedfecb9c482a9cf59234dff1e9f8 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:31.568810 13906 consensus_queue.cc:260] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.570956 13906 ts_tablet_manager.cc:1434] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:05:31.570986 13907 tablet_bootstrap.cc:492] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:31.571573 13907 ts_tablet_manager.cc:1403] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.005s
I20260709 13:05:31.572594 13906 tablet_bootstrap.cc:492] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:31.574185 13907 raft_consensus.cc:359] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.574827 13907 raft_consensus.cc:385] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:31.575105 13907 raft_consensus.cc:740] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:31.575788 13905 tablet_bootstrap.cc:492] T ac7aedfecb9c482a9cf59234dff1e9f8 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:31.576239 13905 ts_tablet_manager.cc:1403] T ac7aedfecb9c482a9cf59234dff1e9f8 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.006s
I20260709 13:05:31.575911 13907 consensus_queue.cc:260] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.577993 13907 ts_tablet_manager.cc:1434] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:31.578127 13906 tablet_bootstrap.cc:654] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:31.579082 13907 tablet_bootstrap.cc:492] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:31.586122 14016 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.586826 14016 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.591084 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:31.592012 13862 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:31.593372 13931 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.593968 13757 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:31.594007 13931 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.595304 14007 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:31.595955 14007 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.596385 14007 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:31.602140 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:31.603024 13711 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:31.604280 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:31.605065 13715 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:31.612692 13756 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:31.613926 13996 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:31.614392 13996 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.614825 13996 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:31.620980 14016 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:31.646447 13931 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:31.647784 13905 raft_consensus.cc:359] T ac7aedfecb9c482a9cf59234dff1e9f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.648499 13905 raft_consensus.cc:385] T ac7aedfecb9c482a9cf59234dff1e9f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:31.648669 13905 raft_consensus.cc:740] T ac7aedfecb9c482a9cf59234dff1e9f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:31.649205 13905 consensus_queue.cc:260] T ac7aedfecb9c482a9cf59234dff1e9f8 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.651297 13905 ts_tablet_manager.cc:1434] T ac7aedfecb9c482a9cf59234dff1e9f8 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.075s	user 0.029s	sys 0.033s
I20260709 13:05:31.652189 13905 tablet_bootstrap.cc:492] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:31.655082 13715 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:31.657599 13905 tablet_bootstrap.cc:654] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:31.668543 13905 tablet_bootstrap.cc:492] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:31.669003 13905 ts_tablet_manager.cc:1403] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.017s	user 0.003s	sys 0.012s
I20260709 13:05:31.670992 13905 raft_consensus.cc:359] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.671527 13905 raft_consensus.cc:385] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:31.671782 13905 raft_consensus.cc:740] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:31.672442 13905 consensus_queue.cc:260] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.673739 13907 tablet_bootstrap.cc:654] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:31.673923 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:31.674654 13996 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:05:31.675771 13757 leader_election.cc:343] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:31.676704 13996 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:31.642745 14007 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.678586 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:31.679343 13711 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:31.680629 14007 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:31.682327 13905 ts_tablet_manager.cc:1434] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:31.683187 13905 tablet_bootstrap.cc:492] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:31.685036 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:31.685714 13712 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:31.689635 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:31.691151 13711 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:31.692245 13756 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:31.692409 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:31.693135 14007 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:31.693415 13862 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:31.694008 14007 raft_consensus.cc:697] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:05:31.692988 13757 leader_election.cc:343] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:31.692993 13905 tablet_bootstrap.cc:654] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:31.698863 14007 consensus_queue.cc:237] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.700156 13862 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:31.701329 13757 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:31.702198 13996 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:31.702666 13996 raft_consensus.cc:697] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:31.703477 13996 consensus_queue.cc:237] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.709365 13906 tablet_bootstrap.cc:492] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:31.710043 13906 ts_tablet_manager.cc:1403] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.138s	user 0.055s	sys 0.037s
I20260709 13:05:31.723469 13905 tablet_bootstrap.cc:492] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:31.724179 13905 ts_tablet_manager.cc:1403] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.041s	user 0.022s	sys 0.006s
I20260709 13:05:31.726333 13712 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:31.727125 13905 raft_consensus.cc:359] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.727891 13905 raft_consensus.cc:385] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:31.728183 13905 raft_consensus.cc:740] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:31.717733 13906 raft_consensus.cc:359] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.729399 13906 raft_consensus.cc:385] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:31.728940 13905 consensus_queue.cc:260] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.729702 13906 raft_consensus.cc:740] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:31.730674 13906 consensus_queue.cc:260] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.731235 13907 tablet_bootstrap.cc:492] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:31.731652 13905 ts_tablet_manager.cc:1434] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:31.731806 13907 ts_tablet_manager.cc:1403] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.153s	user 0.008s	sys 0.005s
I20260709 13:05:31.732651 13905 tablet_bootstrap.cc:492] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:31.732867 13906 ts_tablet_manager.cc:1434] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:05:31.734396 13907 raft_consensus.cc:359] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.735217 13907 raft_consensus.cc:385] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:31.735494 13907 raft_consensus.cc:740] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:31.737833 13907 consensus_queue.cc:260] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.740180 13907 ts_tablet_manager.cc:1434] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:05:31.741313 13907 tablet_bootstrap.cc:492] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:31.742147 13905 tablet_bootstrap.cc:654] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:31.741683 13996 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.747761 13996 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.750523 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:31.751156 13712 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:31.752486 13756 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:31.753253 13906 tablet_bootstrap.cc:492] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:31.753259 13931 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:31.753798 13931 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.754118 13931 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:31.759691 13906 tablet_bootstrap.cc:654] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:31.761376 13931 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.762643 13996 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:31.764343 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:31.765189 13862 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:31.768069 13931 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:31.769428 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:31.770144 13862 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:31.769455 13907 tablet_bootstrap.cc:654] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:31.775869 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:31.776490 13711 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:31.778110 13611 catalog_manager.cc:5697] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:31.781082 13905 tablet_bootstrap.cc:492] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:31.781145 13907 tablet_bootstrap.cc:492] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:31.781700 13905 ts_tablet_manager.cc:1403] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.014s
I20260709 13:05:31.781878 13907 ts_tablet_manager.cc:1403] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.003s
I20260709 13:05:31.784981 13711 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:31.785312 13905 raft_consensus.cc:359] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.786039 13905 raft_consensus.cc:385] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:31.786298 13905 raft_consensus.cc:740] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:31.786358 13756 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:31.786979 13905 consensus_queue.cc:260] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.787668 14007 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:31.788441 14007 raft_consensus.cc:697] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:31.788865 13906 tablet_bootstrap.cc:492] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:31.789039 13905 ts_tablet_manager.cc:1434] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:05:31.789330 13906 ts_tablet_manager.cc:1403] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.036s	user 0.005s	sys 0.005s
I20260709 13:05:31.789449 14007 consensus_queue.cc:237] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.790537 13905 tablet_bootstrap.cc:492] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:31.791994 13906 raft_consensus.cc:359] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.792650 13906 raft_consensus.cc:385] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:31.792963 13906 raft_consensus.cc:740] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:31.794211 13907 raft_consensus.cc:359] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.795107 13907 raft_consensus.cc:385] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:31.795464 13907 raft_consensus.cc:740] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:31.796888 13905 tablet_bootstrap.cc:654] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:31.796449 13907 consensus_queue.cc:260] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.778080 13862 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:31.805848 13907 ts_tablet_manager.cc:1434] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.004s
I20260709 13:05:31.807137 13907 tablet_bootstrap.cc:492] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:31.807890 13906 consensus_queue.cc:260] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.811620 13931 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.812276 13931 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.816457 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:31.817106 13862 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:31.817627 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:31.818487 13711 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:31.820457 13757 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:31.821607 14016 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:31.822073 14016 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.822444 14016 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:31.826865 13931 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:31.828922 13906 ts_tablet_manager.cc:1434] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.004s
I20260709 13:05:31.827297 14016 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.830307 13906 tablet_bootstrap.cc:492] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:31.832971 13611 catalog_manager.cc:5697] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:31.835733 13611 catalog_manager.cc:5697] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:31.839108 13905 tablet_bootstrap.cc:492] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:31.839583 13905 ts_tablet_manager.cc:1403] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.024s
I20260709 13:05:31.838853 13907 tablet_bootstrap.cc:654] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:31.842484 13905 raft_consensus.cc:359] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.843214 13905 raft_consensus.cc:385] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:31.843539 13905 raft_consensus.cc:740] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:31.844566 13906 tablet_bootstrap.cc:654] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:31.844905 13905 consensus_queue.cc:260] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.847141 13905 ts_tablet_manager.cc:1434] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:31.849107 13905 tablet_bootstrap.cc:492] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:31.850570 13931 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:31.857209 13907 tablet_bootstrap.cc:492] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:31.857715 13907 ts_tablet_manager.cc:1403] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.004s
I20260709 13:05:31.859130 13905 tablet_bootstrap.cc:654] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:31.860390 13907 raft_consensus.cc:359] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.861088 13907 raft_consensus.cc:385] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:31.861342 13907 raft_consensus.cc:740] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:31.862192 13907 consensus_queue.cc:260] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.864910 13907 ts_tablet_manager.cc:1434] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:31.866600 13907 tablet_bootstrap.cc:492] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:31.872891 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:31.873188 13905 tablet_bootstrap.cc:492] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:31.873582 13862 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:31.874089 13905 ts_tablet_manager.cc:1403] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.009s
I20260709 13:05:31.876595 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:31.877246 13712 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:31.880611 13907 tablet_bootstrap.cc:654] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:31.879837 13905 raft_consensus.cc:359] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.882517 13905 raft_consensus.cc:385] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:31.883647 13905 raft_consensus.cc:740] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:31.884938 13905 consensus_queue.cc:260] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.888348 13905 ts_tablet_manager.cc:1434] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:05:31.890066 13905 tablet_bootstrap.cc:492] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:31.891582 14007 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:31.895223 13905 tablet_bootstrap.cc:654] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:31.901753 14006 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.902453 14006 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.904657 14006 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:31.905956 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:31.907608 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:05:31.908214 13680 leader_election.cc:343] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:31.908998 13682 leader_election.cc:343] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:31.909440 13682 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:05:31.913983 14002 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:31.914817 14002 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:31.920409 13931 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:31.940534 13996 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:31.940973 14016 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:05:31.953892 13680 consensus_peers.cc:597] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:31.957166 14006 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.957706 14006 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.961066 14006 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:31.961501 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:31.961877 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:31.962605 13864 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
W20260709 13:05:31.963397 13680 leader_election.cc:343] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:31.964251 13682 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:05:31.965794 14006 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:31.966281 14006 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.966740 14006 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:31.984392 13862 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:31.984823 14002 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.985612 14002 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.986514 13757 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:31.988796 14007 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:31.989452 14007 raft_consensus.cc:697] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:31.907086 13712 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:31.994311 14002 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:31.990581 14007 consensus_queue.cc:237] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:31.999567 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:32.000406 13790 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:32.001803 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:32.008486 14042 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:32.008980 14042 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.009399 14042 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.023064 13906 tablet_bootstrap.cc:492] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:32.023264 13907 tablet_bootstrap.cc:492] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:32.023761 13906 ts_tablet_manager.cc:1403] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.194s	user 0.025s	sys 0.032s
I20260709 13:05:32.025466 13905 tablet_bootstrap.cc:492] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:32.023777 13907 ts_tablet_manager.cc:1403] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.157s	user 0.044s	sys 0.068s
I20260709 13:05:32.025913 13905 ts_tablet_manager.cc:1403] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.136s	user 0.056s	sys 0.046s
I20260709 13:05:32.028779 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:32.028620 13907 raft_consensus.cc:359] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.029937 13907 raft_consensus.cc:385] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:32.030229 13682 leader_election.cc:343] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.030261 13907 raft_consensus.cc:740] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.031380 13907 consensus_queue.cc:260] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.032603 14042 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.032379 13906 raft_consensus.cc:359] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.033515 13906 raft_consensus.cc:385] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.033845 13906 raft_consensus.cc:740] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.035532 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:32.036135 13791 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.028596 13905 raft_consensus.cc:359] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.036166 13906 consensus_queue.cc:260] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.036895 13905 raft_consensus.cc:385] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.037199 13905 raft_consensus.cc:740] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.036706 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:32.037989 13905 consensus_queue.cc:260] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.038805 13906 ts_tablet_manager.cc:1434] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 13:05:32.039824 13906 tablet_bootstrap.cc:492] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:32.040320 13905 ts_tablet_manager.cc:1434] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
W20260709 13:05:32.040704 13682 leader_election.cc:343] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.041215 13905 tablet_bootstrap.cc:492] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:32.045312 13791 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:32.045872 13906 tablet_bootstrap.cc:654] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.046823 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:32.047811 14083 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:32.048206 13905 tablet_bootstrap.cc:654] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.034667 14042 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:32.060546 13905 tablet_bootstrap.cc:492] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:32.035367 13907 ts_tablet_manager.cc:1434] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:05:32.061520 13907 tablet_bootstrap.cc:492] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:32.067340 13907 tablet_bootstrap.cc:654] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.066633 13611 catalog_manager.cc:5697] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:32.069783 13905 ts_tablet_manager.cc:1403] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.003s
I20260709 13:05:32.070463 14007 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.071138 14007 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.071468 14006 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.072463 13905 raft_consensus.cc:359] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.073117 13905 raft_consensus.cc:385] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.073427 13905 raft_consensus.cc:740] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.074113 13905 consensus_queue.cc:260] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.076560 13905 ts_tablet_manager.cc:1434] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 13:05:32.078095 13905 tablet_bootstrap.cc:492] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:32.083083 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:32.083767 13905 tablet_bootstrap.cc:654] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.083758 13864 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.085620 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:32.089854 14006 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:32.088407 14083 raft_consensus.cc:697] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:05:32.093873 14016 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.094571 14083 consensus_queue.cc:237] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.100569 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:32.101006 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:32.094599 14016 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.109627 13757 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:32.110730 13996 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:32.111671 13864 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:32.113377 13682 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:32.098251 14007 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:32.116174 14016 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:32.117229 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:32.117800 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:05:32.118875 13757 leader_election.cc:343] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.119633 14002 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:32.119992 13756 leader_election.cc:343] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.114722 14084 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:32.120519 13756 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:32.120920 14084 raft_consensus.cc:697] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:05:32.120693 14002 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.122056 14084 consensus_queue.cc:237] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:05:32.117895 13680 leader_election.cc:343] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.127288 13906 tablet_bootstrap.cc:492] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:32.127825 13906 ts_tablet_manager.cc:1403] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.088s	user 0.014s	sys 0.031s
I20260709 13:05:32.129276 14002 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:32.128536 14016 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:32.131449 13906 raft_consensus.cc:359] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.132145 13906 raft_consensus.cc:385] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.132432 13906 raft_consensus.cc:740] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.133153 13906 consensus_queue.cc:260] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.133579 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:32.135560 13906 ts_tablet_manager.cc:1434] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:32.136507 13906 tablet_bootstrap.cc:492] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:32.136855 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:32.142313 13682 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:05:32.143915 13907 tablet_bootstrap.cc:492] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:32.144420 13907 ts_tablet_manager.cc:1403] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.083s	user 0.017s	sys 0.022s
I20260709 13:05:32.147830 14084 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:32.150178 13905 tablet_bootstrap.cc:492] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:32.150640 13905 ts_tablet_manager.cc:1403] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.073s	user 0.007s	sys 0.007s
I20260709 13:05:32.153059 13906 tablet_bootstrap.cc:654] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.154759 13907 raft_consensus.cc:359] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.155503 13907 raft_consensus.cc:385] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.155772 13907 raft_consensus.cc:740] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.156411 13907 consensus_queue.cc:260] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.157630 13905 raft_consensus.cc:359] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.158291 13905 raft_consensus.cc:385] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.158560 13905 raft_consensus.cc:740] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.159282 13905 consensus_queue.cc:260] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.161263 13906 tablet_bootstrap.cc:492] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:32.161361 13905 ts_tablet_manager.cc:1434] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:05:32.161755 13906 ts_tablet_manager.cc:1403] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.000s
I20260709 13:05:32.162107 13905 tablet_bootstrap.cc:492] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:32.163371 14007 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:32.164111 13907 ts_tablet_manager.cc:1434] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:05:32.164188 14016 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:32.165061 13907 tablet_bootstrap.cc:492] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:32.165165 13611 catalog_manager.cc:5697] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:32.166136 13906 raft_consensus.cc:359] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.166917 13906 raft_consensus.cc:385] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.167737 13906 raft_consensus.cc:740] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.168438 13906 consensus_queue.cc:260] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.170673 13906 ts_tablet_manager.cc:1434] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:05:32.171659 13906 tablet_bootstrap.cc:492] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:32.177392 13907 tablet_bootstrap.cc:654] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.177827 13906 tablet_bootstrap.cc:654] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.179803 13905 tablet_bootstrap.cc:654] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.197392 13905 tablet_bootstrap.cc:492] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:32.197845 13905 ts_tablet_manager.cc:1403] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 13:05:32.200595 13905 raft_consensus.cc:359] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.201267 13905 raft_consensus.cc:385] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.201550 13905 raft_consensus.cc:740] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.202162 13905 consensus_queue.cc:260] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.206280 13905 ts_tablet_manager.cc:1434] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:05:32.207122 13905 tablet_bootstrap.cc:492] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:32.213886 13612 catalog_manager.cc:5697] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:32.215530 13861 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.217218 14016 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:32.236433 13906 tablet_bootstrap.cc:492] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:32.237010 13906 ts_tablet_manager.cc:1403] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.066s	user 0.041s	sys 0.022s
I20260709 13:05:32.239645 13967 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.239913 13906 raft_consensus.cc:359] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.240154 13967 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.240869 13906 raft_consensus.cc:385] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.241410 13906 raft_consensus.cc:740] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.242435 13906 consensus_queue.cc:260] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.245016 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:32.245301 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:32.246683 13829 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:32.247557 13967 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:32.250010 13712 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.251690 13967 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:32.218964 13905 tablet_bootstrap.cc:654] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.221616 14007 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:32.258749 14100 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.259352 14100 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.262162 13906 ts_tablet_manager.cc:1434] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.009s
I20260709 13:05:32.265125 13906 tablet_bootstrap.cc:492] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:32.272401 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:32.273470 13714 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 0.
I20260709 13:05:32.280085 13907 tablet_bootstrap.cc:492] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:32.281486 13907 ts_tablet_manager.cc:1403] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.117s	user 0.017s	sys 0.007s
I20260709 13:05:32.300936 13967 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.301498 13967 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.290202 14083 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.302241 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:32.280581 13830 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:32.308598 13907 raft_consensus.cc:359] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.299042 14100 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:32.309620 13907 raft_consensus.cc:385] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.310420 13907 raft_consensus.cc:740] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
W20260709 13:05:32.311097 13829 leader_election.cc:343] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.314049 13907 consensus_queue.cc:260] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.307634 14083 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.316015 13907 ts_tablet_manager.cc:1434] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:05:32.317070 13907 tablet_bootstrap.cc:492] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:32.317147 14083 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:32.302759 14007 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:05:32.322275 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:32.322454 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:32.323145 13791 raft_consensus.cc:2393] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 1: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:05:32.323268 13861 raft_consensus.cc:2393] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 1: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:05:32.326823 13682 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:05:32.327402 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:32.327618 14083 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.320387 14100 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:32.341158 14100 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.341624 14100 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.355967 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:32.356987 13791 raft_consensus.cc:2393] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 1: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:05:32.356426 13906 tablet_bootstrap.cc:654] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.358459 13829 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:32.359664 14098 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.361066 13905 tablet_bootstrap.cc:492] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:32.361573 13905 ts_tablet_manager.cc:1403] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.155s	user 0.013s	sys 0.009s
I20260709 13:05:32.365657 14100 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.367175 14098 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:32.363899 13967 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:32.381749 13905 raft_consensus.cc:359] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.382432 13905 raft_consensus.cc:385] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.382676 13905 raft_consensus.cc:740] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.386153 13905 consensus_queue.cc:260] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.383225 14083 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:32.384613 13967 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.388547 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:32.391944 13905 ts_tablet_manager.cc:1434] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.004s
I20260709 13:05:32.392923 13905 tablet_bootstrap.cc:492] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:32.392409 13712 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.391569 13967 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.408041 14083 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.409873 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:32.409960 14083 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.410983 13967 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:32.406304 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:05:32.411288 13829 leader_election.cc:343] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.409168 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:05:32.412213 13830 leader_election.cc:343] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.412634 13830 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:05:32.412739 13829 leader_election.cc:343] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.416406 14099 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:32.416792 13931 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:32.419155 13907 tablet_bootstrap.cc:654] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.420217 14100 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:32.455087 13790 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.437601 13712 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:05:32.449007 14100 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.484148 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:32.431854 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:32.488324 13791 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:32.430202 14083 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:32.490020 13680 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:32.491600 14002 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:32.492061 14002 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:32.492432 13682 leader_election.cc:343] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.492455 14002 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.503108 13905 tablet_bootstrap.cc:654] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.504207 13906 tablet_bootstrap.cc:492] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:32.504633 13906 ts_tablet_manager.cc:1403] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.240s	user 0.015s	sys 0.037s
I20260709 13:05:32.506331 13931 consensus_queue.cc:1048] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:32.509447 13906 raft_consensus.cc:359] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.510138 13906 raft_consensus.cc:385] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.509996 14002 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.510407 13906 raft_consensus.cc:740] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.511502 14084 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.511946 14084 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.513948 14084 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:32.491186 14100 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.516422 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:32.511161 13906 consensus_queue.cc:260] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.518468 14100 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:32.518347 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:05:32.519750 13680 leader_election.cc:343] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:32.519881 13829 leader_election.cc:343] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.511523 14083 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
W20260709 13:05:32.520632 13662 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:32.522079 13906 ts_tablet_manager.cc:1434] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:05:32.522917 13830 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:05:32.523339 13906 tablet_bootstrap.cc:492] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:32.523685 13967 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:32.524492 13967 raft_consensus.cc:697] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:05:32.526448 13907 tablet_bootstrap.cc:492] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:32.526882 13907 ts_tablet_manager.cc:1403] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.210s	user 0.011s	sys 0.009s
I20260709 13:05:32.526825 13967 consensus_queue.cc:237] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.529779 13907 raft_consensus.cc:359] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.530443 13907 raft_consensus.cc:385] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.530763 13907 raft_consensus.cc:740] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.531610 13907 consensus_queue.cc:260] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.535066 13931 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.535532 13931 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.537546 13931 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:32.538573 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:32.539086 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:32.539450 13715 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:32.539772 13864 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:32.538573 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:05:32.541744 13757 leader_election.cc:343] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.542378 13756 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:32.542690 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:32.543206 13791 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.543118 13682 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:05:32.544077 14016 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:32.544230 14083 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:32.544308 13907 ts_tablet_manager.cc:1434] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 13:05:32.546087 13907 tablet_bootstrap.cc:492] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:32.542400 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:32.549830 14002 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:32.544471 14016 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.545225 14083 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.554082 14016 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.553879 13931 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.561604 13996 consensus_queue.cc:1048] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:32.562295 13906 tablet_bootstrap.cc:654] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.556432 14083 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.558781 13931 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.569044 13996 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.569584 13996 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.570703 13931 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:32.581683 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:32.582401 13862 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:32.577029 13996 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:32.578787 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:32.587255 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:32.588177 13714 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:32.588726 13791 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:32.589520 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:32.589707 13756 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:32.590668 13996 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:32.591015 13996 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.591406 13996 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.591061 13680 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:05:32.596199 13756 leader_election.cc:343] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.597193 14084 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:32.597868 14084 raft_consensus.cc:697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:05:32.599517 14083 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.598966 14084 consensus_queue.cc:237] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.600693 13712 raft_consensus.cc:2393] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 1: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:05:32.593874 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:05:32.602836 13757 leader_election.cc:343] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.603605 13757 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:32.604445 13905 tablet_bootstrap.cc:492] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:32.604574 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:32.604991 13905 ts_tablet_manager.cc:1403] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.212s	user 0.015s	sys 0.024s
I20260709 13:05:32.605500 13931 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:32.606696 13680 leader_election.cc:343] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.607779 14083 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:05:32.608539 13682 leader_election.cc:343] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.608310 14083 consensus_queue.cc:1048] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:32.609829 13830 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:32.610563 14099 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.611999 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:32.602783 14016 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.615624 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:32.616380 13712 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.618729 14099 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:32.619248 14002 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:32.628917 13905 raft_consensus.cc:359] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.629783 13905 raft_consensus.cc:385] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.630105 13905 raft_consensus.cc:740] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.636968 13864 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:32.625123 13996 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.640851 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:05:32.642225 13757 leader_election.cc:343] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.642346 13996 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:32.643711 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:32.643710 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:32.644536 13862 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.644593 13711 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.643785 14016 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:32.648963 13905 consensus_queue.cc:260] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.651084 13862 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:32.652302 13757 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:32.653023 13931 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:32.653676 13931 raft_consensus.cc:697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:32.654488 13931 consensus_queue.cc:237] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.660966 13711 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:32.663694 13613 catalog_manager.cc:5697] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:32.678511 13682 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:05:32.679741 14002 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:32.680267 14002 raft_consensus.cc:697] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:05:32.681079 14002 consensus_queue.cc:237] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.688511 13612 catalog_manager.cc:5697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:32.694581 14083 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.695098 14083 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.697206 13905 ts_tablet_manager.cc:1434] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.092s	user 0.005s	sys 0.015s
I20260709 13:05:32.698010 13905 tablet_bootstrap.cc:492] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:32.686058 13712 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:32.702267 13756 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:32.702526 14083 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:32.703089 14016 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:32.703646 14016 raft_consensus.cc:697] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:32.704443 14016 consensus_queue.cc:237] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.713140 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:32.712973 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:05:32.715724 13680 leader_election.cc:343] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:32.717357 13682 leader_election.cc:343] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.717916 13682 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:05:32.718824 13680 consensus_peers.cc:597] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:32.729436 13907 tablet_bootstrap.cc:654] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:32.725000 14110 log.cc:927] Time spent T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:05:32.740127 13907 tablet_bootstrap.cc:492] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:32.740582 13907 ts_tablet_manager.cc:1403] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.195s	user 0.006s	sys 0.009s
I20260709 13:05:32.741637 13906 tablet_bootstrap.cc:492] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:32.742297 13906 ts_tablet_manager.cc:1403] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.219s	user 0.019s	sys 0.006s
I20260709 13:05:32.745262 13907 raft_consensus.cc:359] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.745819 13907 raft_consensus.cc:385] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.745163 13611 catalog_manager.cc:5697] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:32.746066 13907 raft_consensus.cc:740] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.746778 13907 consensus_queue.cc:260] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.748711 13907 ts_tablet_manager.cc:1434] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:05:32.749557 13907 tablet_bootstrap.cc:492] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:32.750141 13906 raft_consensus.cc:359] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.750767 13906 raft_consensus.cc:385] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.751041 13906 raft_consensus.cc:740] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.737953 14002 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:32.751714 13906 consensus_queue.cc:260] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.756050 13906 ts_tablet_manager.cc:1434] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:05:32.783406 13906 tablet_bootstrap.cc:492] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:32.779134 13612 catalog_manager.cc:5697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:32.783790 14007 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.786007 14007 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.790824 14007 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:32.794304 13905 tablet_bootstrap.cc:654] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.795804 13907 tablet_bootstrap.cc:654] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.810422 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:32.811708 13907 tablet_bootstrap.cc:492] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:32.811587 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:32.812170 13907 ts_tablet_manager.cc:1403] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.005s
I20260709 13:05:32.813058 13757 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:32.814790 13907 raft_consensus.cc:359] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.815371 13907 raft_consensus.cc:385] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.815644 13907 raft_consensus.cc:740] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.815930 13996 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:32.816226 13907 consensus_queue.cc:260] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.818214 13907 ts_tablet_manager.cc:1434] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:05:32.818892 13907 tablet_bootstrap.cc:492] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:32.824417 13905 tablet_bootstrap.cc:492] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:32.825117 13612 catalog_manager.cc:5697] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:32.826120 13906 tablet_bootstrap.cc:654] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.829210 13907 tablet_bootstrap.cc:654] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.826597 13905 ts_tablet_manager.cc:1403] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.129s	user 0.008s	sys 0.004s
I20260709 13:05:32.834118 13905 raft_consensus.cc:359] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.834743 13905 raft_consensus.cc:385] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.835011 13905 raft_consensus.cc:740] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.835626 13905 consensus_queue.cc:260] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.837598 13905 ts_tablet_manager.cc:1434] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:32.838315 13905 tablet_bootstrap.cc:492] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:32.838873 13906 tablet_bootstrap.cc:492] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:32.839543 13906 ts_tablet_manager.cc:1403] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.056s	user 0.004s	sys 0.009s
I20260709 13:05:32.843250 13906 raft_consensus.cc:359] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.843928 13905 tablet_bootstrap.cc:654] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.844282 13906 raft_consensus.cc:385] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.844702 13906 raft_consensus.cc:740] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.845620 13906 consensus_queue.cc:260] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.849624 13906 ts_tablet_manager.cc:1434] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:05:32.850011 13907 tablet_bootstrap.cc:492] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:32.850533 13907 ts_tablet_manager.cc:1403] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.015s
I20260709 13:05:32.850581 13906 tablet_bootstrap.cc:492] T 397ec99b74c24481a69c1f4a7c294a73 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:32.855756 13905 tablet_bootstrap.cc:492] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:32.856210 13905 ts_tablet_manager.cc:1403] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 13:05:32.858145 13907 raft_consensus.cc:359] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.858907 13907 raft_consensus.cc:385] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.859226 13907 raft_consensus.cc:740] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.859057 13905 raft_consensus.cc:359] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.859761 13905 raft_consensus.cc:385] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.860040 13905 raft_consensus.cc:740] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.860141 13907 consensus_queue.cc:260] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.860651 13905 consensus_queue.cc:260] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.862380 13906 tablet_bootstrap.cc:654] T 397ec99b74c24481a69c1f4a7c294a73 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.862622 13907 ts_tablet_manager.cc:1434] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:05:32.862847 13905 ts_tablet_manager.cc:1434] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:32.863577 13907 tablet_bootstrap.cc:492] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:32.866866 13905 tablet_bootstrap.cc:492] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:32.871994 13907 tablet_bootstrap.cc:654] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.886289 13907 tablet_bootstrap.cc:492] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:32.886952 13907 ts_tablet_manager.cc:1403] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.005s
I20260709 13:05:32.890552 13907 raft_consensus.cc:359] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.891577 13907 raft_consensus.cc:385] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.891939 13907 raft_consensus.cc:740] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.892993 13907 consensus_queue.cc:260] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.895277 13907 ts_tablet_manager.cc:1434] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:05:32.897063 13907 tablet_bootstrap.cc:492] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:32.899154 14016 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.899691 14016 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.900821 13905 tablet_bootstrap.cc:654] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.901736 14016 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:32.904696 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:32.908316 13905 tablet_bootstrap.cc:492] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:32.908744 13905 ts_tablet_manager.cc:1403] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.000s
W20260709 13:05:32.909292 13757 leader_election.cc:343] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.910473 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:32.910990 13905 raft_consensus.cc:359] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.911120 13712 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:32.911535 13905 raft_consensus.cc:385] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.911739 13905 raft_consensus.cc:740] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.912477 13756 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:32.912786 13905 consensus_queue.cc:260] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.913232 14016 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:32.905259 13907 tablet_bootstrap.cc:654] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.906315 13906 tablet_bootstrap.cc:492] T 397ec99b74c24481a69c1f4a7c294a73 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:32.916282 13906 ts_tablet_manager.cc:1403] T 397ec99b74c24481a69c1f4a7c294a73 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.066s	user 0.029s	sys 0.016s
I20260709 13:05:32.914162 14016 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.917965 14016 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.920360 13906 raft_consensus.cc:359] T 397ec99b74c24481a69c1f4a7c294a73 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.921391 13906 raft_consensus.cc:385] T 397ec99b74c24481a69c1f4a7c294a73 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.921780 13906 raft_consensus.cc:740] T 397ec99b74c24481a69c1f4a7c294a73 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.922621 13906 consensus_queue.cc:260] T 397ec99b74c24481a69c1f4a7c294a73 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.924140 14016 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.925033 13907 tablet_bootstrap.cc:492] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:32.925477 13907 ts_tablet_manager.cc:1403] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.009s
I20260709 13:05:32.928099 13907 raft_consensus.cc:359] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.928857 13907 raft_consensus.cc:385] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.929152 13907 raft_consensus.cc:740] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.929808 13907 consensus_queue.cc:260] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.914942 13905 ts_tablet_manager.cc:1434] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:32.932030 13907 ts_tablet_manager.cc:1434] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:05:32.931551 13905 tablet_bootstrap.cc:492] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:32.932343 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:32.933049 13907 tablet_bootstrap.cc:492] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:32.933107 13711 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.939003 13905 tablet_bootstrap.cc:654] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.939731 13907 tablet_bootstrap.cc:654] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.940932 13906 ts_tablet_manager.cc:1434] T 397ec99b74c24481a69c1f4a7c294a73 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:05:32.941936 13906 tablet_bootstrap.cc:492] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:32.942711 13996 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.943158 13996 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.945077 13996 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:32.946441 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:32.946477 13711 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:32.947270 13862 raft_consensus.cc:2393] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 1: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:05:32.952690 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:32.954454 13756 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:32.954989 13906 tablet_bootstrap.cc:654] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.955798 13931 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.956313 13931 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.958376 13931 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:32.958770 13996 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:32.963724 13996 raft_consensus.cc:697] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:32.964607 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:32.964994 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:32.964789 13996 consensus_queue.cc:237] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:05:32.967386 13757 leader_election.cc:343] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.959579 14016 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:32.973148 13905 tablet_bootstrap.cc:492] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:32.973645 13905 ts_tablet_manager.cc:1403] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.002s
I20260709 13:05:32.974911 13907 tablet_bootstrap.cc:492] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:32.975404 13907 ts_tablet_manager.cc:1403] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.010s
I20260709 13:05:32.975646 13756 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:32.977444 13906 tablet_bootstrap.cc:492] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:32.977851 13906 ts_tablet_manager.cc:1403] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.010s
I20260709 13:05:32.978037 13907 raft_consensus.cc:359] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.978685 13907 raft_consensus.cc:385] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.978627 14016 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.979135 13907 raft_consensus.cc:740] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.979908 13907 consensus_queue.cc:260] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.980458 13906 raft_consensus.cc:359] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.981074 13906 raft_consensus.cc:385] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.981326 13906 raft_consensus.cc:740] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.982133 13907 ts_tablet_manager.cc:1434] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:32.982004 13906 consensus_queue.cc:260] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.983016 13907 tablet_bootstrap.cc:492] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:32.983897 13906 ts_tablet_manager.cc:1434] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:05:32.985782 13906 tablet_bootstrap.cc:492] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:32.986881 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:32.987703 13711 raft_consensus.cc:2393] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 1: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:05:32.989667 14007 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.990109 14007 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:32.991176 13790 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.991519 13906 tablet_bootstrap.cc:654] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.992441 14007 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:32.995695 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:32.996271 13711 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:32.996659 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:32.997704 13756 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:05:32.998749 13757 leader_election.cc:343] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:33.002595 14016 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:33.005456 14007 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:33.006096 13756 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:33.006903 13996 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:33.007296 13996 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.009263 14099 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:33.011196 13612 catalog_manager.cc:5697] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:33.012910 13905 raft_consensus.cc:359] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.007710 13996 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.013622 13905 raft_consensus.cc:385] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.013993 13905 raft_consensus.cc:740] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.015172 13905 consensus_queue.cc:260] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.017635 13907 tablet_bootstrap.cc:654] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.017845 13905 ts_tablet_manager.cc:1434] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.000s
I20260709 13:05:33.019248 13905 tablet_bootstrap.cc:492] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:33.025063 13905 tablet_bootstrap.cc:654] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.026234 14084 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.026889 14084 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.030182 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:33.030854 13785 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:33.031298 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:33.032032 13862 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:33.032691 13680 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:33.033645 14119 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:33.035140 14119 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:33.035526 14119 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.035897 14119 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.036510 13906 tablet_bootstrap.cc:492] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:33.037067 13906 ts_tablet_manager.cc:1403] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.006s
I20260709 13:05:33.040006 13906 raft_consensus.cc:359] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.045192 13906 raft_consensus.cc:385] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.045604 13906 raft_consensus.cc:740] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.043604 14100 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:33.046474 13906 consensus_queue.cc:260] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.048898 13906 ts_tablet_manager.cc:1434] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 13:05:33.044452 14084 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:33.044274 13996 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.056542 13996 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:33.056501 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:33.057075 13907 tablet_bootstrap.cc:492] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:33.057235 13712 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.057700 13907 ts_tablet_manager.cc:1403] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.075s	user 0.033s	sys 0.004s
I20260709 13:05:33.058049 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:05:33.059515 13757 leader_election.cc:343] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:33.059685 13906 tablet_bootstrap.cc:492] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:33.060463 14016 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.060956 14016 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.062953 14016 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:33.065174 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:33.065877 13711 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:33.066148 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:33.066766 13862 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:33.067066 13756 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:33.068104 14016 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:33.068460 14016 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.068792 14016 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.070660 13712 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:33.070726 13907 raft_consensus.cc:359] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.071807 13907 raft_consensus.cc:385] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.072288 13907 raft_consensus.cc:740] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.075641 13907 consensus_queue.cc:260] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.079614 14083 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.079015 13906 tablet_bootstrap.cc:654] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.079658 13864 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.080178 14083 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.082998 13756 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:33.083954 14119 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.084983 13996 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:33.085661 13996 raft_consensus.cc:697] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:33.086464 13996 consensus_queue.cc:237] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.089761 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:33.090428 13790 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.094255 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:33.094805 13862 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.097609 14084 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:33.098137 14119 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:33.102046 13907 ts_tablet_manager.cc:1434] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:05:33.103096 13907 tablet_bootstrap.cc:492] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:33.106158 13905 tablet_bootstrap.cc:492] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:33.106616 13905 ts_tablet_manager.cc:1403] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.088s	user 0.008s	sys 0.002s
I20260709 13:05:33.107262 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:33.108033 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:05:33.109841 13680 leader_election.cc:343] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:33.113108 13682 leader_election.cc:343] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:33.103478 14016 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.118489 14099 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.123924 14099 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.125206 14016 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:33.127082 13862 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:33.128679 13996 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.128914 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:33.129117 13996 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.129707 13862 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.131944 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:33.132602 13785 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:05:33.133134 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:33.131979 14099 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:33.133854 13861 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:33.134473 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:33.134928 13906 tablet_bootstrap.cc:492] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:33.135063 13711 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:33.135370 13906 ts_tablet_manager.cc:1403] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.006s
I20260709 13:05:33.136286 13756 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:33.137171 14135 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:33.137545 14135 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.137903 14135 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:33.138212 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:33.138756 13712 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.139016 13829 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:33.143607 14099 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:33.143978 13931 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:33.144959 13712 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:33.146593 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:33.106734 14083 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:33.119638 13790 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:33.147192 13712 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:05:33.148284 13680 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:33.148732 13756 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:33.150065 13931 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:33.151324 13931 raft_consensus.cc:697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:33.151584 14083 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:33.152130 14083 raft_consensus.cc:697] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:05:33.152396 13931 consensus_queue.cc:237] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.153026 14083 consensus_queue.cc:237] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.137904 13906 raft_consensus.cc:359] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.163626 13906 raft_consensus.cc:385] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.129792 13613 catalog_manager.cc:5697] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:33.121975 13907 tablet_bootstrap.cc:654] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.163925 13906 raft_consensus.cc:740] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.118745 13682 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:05:33.167704 13906 consensus_queue.cc:260] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:05:33.168927 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 55869.7us
I20260709 13:05:33.170987 13906 ts_tablet_manager.cc:1434] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.001s
I20260709 13:05:33.131173 13996 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:33.173857 14002 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:33.176115 14002 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:33.171901 13906 tablet_bootstrap.cc:492] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:33.193429 14086 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.194079 14086 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.196632 14086 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:33.198252 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:33.198974 13790 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:33.200367 13680 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:33.202283 14086 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:33.202615 14086 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.202940 14086 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.202121 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:33.203951 13864 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:33.206084 14100 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.206732 14100 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.211444 14100 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:33.211648 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:33.212643 13712 raft_consensus.cc:2393] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 1: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:05:33.212790 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:33.211601 13790 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.214789 14100 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.215405 14100 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.216943 13830 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:33.217859 13967 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.219067 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:33.219823 13712 raft_consensus.cc:2393] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 1: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:05:33.220647 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:33.157148 14135 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.144009 14099 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.120465 13905 raft_consensus.cc:359] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.224429 13829 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:33.247462 13905 raft_consensus.cc:385] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.247896 13905 raft_consensus.cc:740] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
W20260709 13:05:33.251065 14155 log.cc:927] Time spent T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:05:33.227133 13862 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:33.231045 14100 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:33.259662 14098 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.261170 13905 consensus_queue.cc:260] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.250555 14099 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:33.266665 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 102602us
I20260709 13:05:33.265846 13967 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:33.292611 13612 catalog_manager.cc:5697] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:33.295662 13905 ts_tablet_manager.cc:1434] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.189s	user 0.008s	sys 0.001s
I20260709 13:05:33.296890 13905 tablet_bootstrap.cc:492] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:33.303128 13907 tablet_bootstrap.cc:492] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:33.303576 13907 ts_tablet_manager.cc:1403] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.201s	user 0.011s	sys 0.013s
I20260709 13:05:33.309967 14100 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.310685 14100 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.317875 14100 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:33.323642 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:33.304401 14083 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 13:05:33.356717 14135 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:33.363561 13907 raft_consensus.cc:359] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.364332 13907 raft_consensus.cc:385] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.364673 13907 raft_consensus.cc:740] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.365415 13907 consensus_queue.cc:260] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.356577 14086 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.362931 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:33.374648 14086 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:33.368530 14099 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.379750 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:33.380142 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:33.380314 13785 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.380471 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:33.380684 13714 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:33.381263 13787 raft_consensus.cc:2393] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 2: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:05:33.382503 13712 raft_consensus.cc:2393] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 1: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:05:33.379421 14099 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:33.389650 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:33.390514 13864 raft_consensus.cc:2393] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 2: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:05:33.393059 13907 ts_tablet_manager.cc:1434] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.089s	user 0.010s	sys 0.010s
I20260709 13:05:33.393929 13907 tablet_bootstrap.cc:492] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:33.399663 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:33.406589 13830 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:33.405364 13785 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:33.408818 14099 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.409572 13861 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.415069 14098 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:33.423018 13905 tablet_bootstrap.cc:654] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.429359 13906 tablet_bootstrap.cc:654] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.443492 13861 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:33.450634 13907 tablet_bootstrap.cc:654] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.452008 14099 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:33.490190 13680 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:33.494495 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:33.514649 13714 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:05:33.519562 13996 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.520583 13996 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.524082 13996 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:33.527968 13830 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:05:33.529953 14007 consensus_queue.cc:1048] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:33.531119 13756 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:33.527923 13996 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:33.553733 13906 tablet_bootstrap.cc:492] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:33.554840 13906 ts_tablet_manager.cc:1403] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.383s	user 0.012s	sys 0.003s
I20260709 13:05:33.558358 13905 tablet_bootstrap.cc:492] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:33.559114 13905 ts_tablet_manager.cc:1403] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.262s	user 0.014s	sys 0.000s
I20260709 13:05:33.563553 13907 tablet_bootstrap.cc:492] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:33.563683 14157 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:33.564514 13907 ts_tablet_manager.cc:1403] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.171s	user 0.007s	sys 0.005s
I20260709 13:05:33.564563 14157 raft_consensus.cc:697] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:05:33.566632 14100 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:33.567454 14100 raft_consensus.cc:697] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:05:33.566911 14157 consensus_queue.cc:237] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.583346 13931 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:33.597321 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:33.575750 14100 consensus_queue.cc:237] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.611733 13907 raft_consensus.cc:359] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.613045 13907 raft_consensus.cc:385] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.613406 13907 raft_consensus.cc:740] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.616648 13906 raft_consensus.cc:359] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.617378 13906 raft_consensus.cc:385] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.617690 13906 raft_consensus.cc:740] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.618395 13906 consensus_queue.cc:260] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.619055 14002 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.595005 13905 raft_consensus.cc:359] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.619709 13905 raft_consensus.cc:385] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.620050 13905 raft_consensus.cc:740] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.619656 14002 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.620725 13905 consensus_queue.cc:260] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.622344 13905 ts_tablet_manager.cc:1434] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.000s
I20260709 13:05:33.623648 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:33.623715 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:33.624485 13714 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
W20260709 13:05:33.625313 13682 leader_election.cc:343] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:33.625427 13757 leader_election.cc:343] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:33.614035 13907 consensus_queue.cc:260] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.626181 14153 consensus_queue.cc:1048] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:33.627525 13996 consensus_queue.cc:1048] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:33.631714 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:33.627090 14002 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:33.632323 13907 ts_tablet_manager.cc:1434] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.002s
W20260709 13:05:33.634028 13680 leader_election.cc:343] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:33.634446 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:05:33.637514 14002 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:33.639436 13906 ts_tablet_manager.cc:1434] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.084s	user 0.012s	sys 0.000s
I20260709 13:05:33.642086 13905 tablet_bootstrap.cc:492] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:33.649425 13906 tablet_bootstrap.cc:492] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:33.646080 14153 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:33.660452 13756 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:33.661614 14153 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:33.661943 14153 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.662253 14153 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.669518 13907 tablet_bootstrap.cc:492] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:33.670928 14002 consensus_queue.cc:1048] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:33.687599 14083 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.688462 14083 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.691111 14083 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:33.692054 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:33.692200 13613 catalog_manager.cc:5697] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 0 to 2, leader changed from <none> to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 2 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:33.694242 13682 leader_election.cc:343] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:33.696175 13612 catalog_manager.cc:5697] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:33.698493 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:05:33.700045 13680 leader_election.cc:343] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:33.700464 13680 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:05:33.704139 14083 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:33.711738 13931 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.718899 13931 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.727053 13931 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:33.729053 13905 tablet_bootstrap.cc:654] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.752810 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:33.756693 13612 catalog_manager.cc:5697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:33.761126 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:33.770236 14007 consensus_queue.cc:1048] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:33.774585 13906 tablet_bootstrap.cc:654] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.777050 14157 consensus_queue.cc:1048] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:33.784008 14156 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:33.792546 13907 tablet_bootstrap.cc:654] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.810135 14007 consensus_queue.cc:1048] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:05:33.792207 13757 leader_election.cc:343] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:33.819492 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 47490us
I20260709 13:05:33.820966 14007 consensus_queue.cc:1048] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:33.825114 13905 tablet_bootstrap.cc:492] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:33.825570 13905 ts_tablet_manager.cc:1403] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.202s	user 0.020s	sys 0.019s
W20260709 13:05:33.826131 13756 leader_election.cc:343] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:33.826581 13756 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:33.827847 13931 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:33.844219 14153 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.850545 14153 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:33.850636 13905 raft_consensus.cc:359] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.851379 13905 raft_consensus.cc:385] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.851691 13905 raft_consensus.cc:740] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.852231 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:33.853302 13715 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.852319 13905 consensus_queue.cc:260] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.859649 13905 ts_tablet_manager.cc:1434] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 13:05:33.861162 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:33.861829 13861 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.862360 13905 tablet_bootstrap.cc:492] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:33.877861 13906 tablet_bootstrap.cc:492] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:33.878329 13906 ts_tablet_manager.cc:1403] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.237s	user 0.008s	sys 0.008s
I20260709 13:05:33.906759 13715 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:33.907691 13905 tablet_bootstrap.cc:654] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.910140 13907 tablet_bootstrap.cc:492] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:33.911482 13907 ts_tablet_manager.cc:1403] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.243s	user 0.018s	sys 0.014s
I20260709 13:05:33.913539 13906 raft_consensus.cc:359] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.914203 13906 raft_consensus.cc:385] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.914443 13906 raft_consensus.cc:740] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.915509 13861 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:33.915126 13906 consensus_queue.cc:260] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.917279 13757 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:33.922375 13906 ts_tablet_manager.cc:1434] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 13:05:33.923446 13906 tablet_bootstrap.cc:492] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:33.927646 14151 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:33.927671 13907 raft_consensus.cc:359] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.928568 13907 raft_consensus.cc:385] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.928856 13907 raft_consensus.cc:740] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.929493 13907 consensus_queue.cc:260] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.928225 14151 raft_consensus.cc:697] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:33.931766 13907 ts_tablet_manager.cc:1434] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:05:33.932782 13907 tablet_bootstrap.cc:492] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:33.932433 14151 consensus_queue.cc:237] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.957504 13906 tablet_bootstrap.cc:654] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.961863 13907 tablet_bootstrap.cc:654] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:33.961799 13662 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:33.967000 13905 tablet_bootstrap.cc:492] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:33.967520 13905 ts_tablet_manager.cc:1403] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.107s	user 0.025s	sys 0.000s
I20260709 13:05:33.970706 13905 raft_consensus.cc:359] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.971356 13905 raft_consensus.cc:385] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.971670 13905 raft_consensus.cc:740] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.972255 13905 consensus_queue.cc:260] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.974321 13905 ts_tablet_manager.cc:1434] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:05:33.975328 13905 tablet_bootstrap.cc:492] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:33.982184 13905 tablet_bootstrap.cc:654] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.984910 13907 tablet_bootstrap.cc:492] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:33.985428 13907 ts_tablet_manager.cc:1403] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.009s
I20260709 13:05:33.987644 13906 tablet_bootstrap.cc:492] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:33.987582 14083 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.988189 13906 ts_tablet_manager.cc:1403] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.065s	user 0.008s	sys 0.003s
I20260709 13:05:33.988157 14083 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.988435 13907 raft_consensus.cc:359] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.989085 13907 raft_consensus.cc:385] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.989346 13907 raft_consensus.cc:740] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.990295 14083 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:33.990056 13907 consensus_queue.cc:260] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.990808 13906 raft_consensus.cc:359] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.991451 13906 raft_consensus.cc:385] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.991703 13906 raft_consensus.cc:740] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.992555 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:33.992415 13906 consensus_queue.cc:260] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.993333 13905 tablet_bootstrap.cc:492] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:33.993216 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:33.993932 13905 ts_tablet_manager.cc:1403] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.000s
W20260709 13:05:33.994086 13680 leader_election.cc:343] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:33.994745 13682 leader_election.cc:343] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:33.994966 13907 ts_tablet_manager.cc:1434] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:05:33.995164 13682 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:05:33.995944 13907 tablet_bootstrap.cc:492] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:33.995383 13611 catalog_manager.cc:5697] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:33.996325 14083 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:33.998193 13905 raft_consensus.cc:359] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:33.998888 13905 raft_consensus.cc:385] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.999298 13905 raft_consensus.cc:740] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.000022 13905 consensus_queue.cc:260] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.002096 13905 ts_tablet_manager.cc:1434] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:05:34.002441 13907 tablet_bootstrap.cc:654] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.003546 13905 tablet_bootstrap.cc:492] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:34.011385 13905 tablet_bootstrap.cc:654] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.014554 13907 tablet_bootstrap.cc:492] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:34.015115 13907 ts_tablet_manager.cc:1403] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 13:05:34.018566 13907 raft_consensus.cc:359] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.021356 13907 raft_consensus.cc:385] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.021649 13907 raft_consensus.cc:740] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.022213 13907 consensus_queue.cc:260] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.024236 13907 ts_tablet_manager.cc:1434] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:34.025261 13907 tablet_bootstrap.cc:492] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:34.026557 13713 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:05:34.027959 14166 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:34.021390 13906 ts_tablet_manager.cc:1434] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:05:34.032389 13906 tablet_bootstrap.cc:492] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:34.038268 13906 tablet_bootstrap.cc:654] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.043632 13905 tablet_bootstrap.cc:492] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:34.044205 13905 ts_tablet_manager.cc:1403] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.011s
I20260709 13:05:34.047024 13905 raft_consensus.cc:359] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.047811 13907 tablet_bootstrap.cc:654] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.047950 13905 raft_consensus.cc:385] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.048405 13905 raft_consensus.cc:740] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.049115 13905 consensus_queue.cc:260] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.050668 13905 ts_tablet_manager.cc:1434] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:34.052671 13905 tablet_bootstrap.cc:492] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:34.060688 13905 tablet_bootstrap.cc:654] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.066773 13906 tablet_bootstrap.cc:492] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:34.067298 13906 ts_tablet_manager.cc:1403] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.003s
I20260709 13:05:34.070864 13906 raft_consensus.cc:359] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.071753 13906 raft_consensus.cc:385] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.072093 13906 raft_consensus.cc:740] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.072880 13906 consensus_queue.cc:260] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.075798 13791 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:05:34.076470 13907 tablet_bootstrap.cc:492] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:34.077044 13907 ts_tablet_manager.cc:1403] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.000s
I20260709 13:05:34.080417 13907 raft_consensus.cc:359] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.081234 13907 raft_consensus.cc:385] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.081573 13907 raft_consensus.cc:740] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.084676 13906 ts_tablet_manager.cc:1434] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:05:34.083082 13967 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:34.087934 13907 consensus_queue.cc:260] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.090106 13907 ts_tablet_manager.cc:1434] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:05:34.090499 13906 tablet_bootstrap.cc:492] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:34.102119 13907 tablet_bootstrap.cc:492] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:34.108753 13907 tablet_bootstrap.cc:654] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.113641 13906 tablet_bootstrap.cc:654] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.116914 13905 tablet_bootstrap.cc:492] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:34.117595 13905 ts_tablet_manager.cc:1403] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.065s	user 0.016s	sys 0.024s
I20260709 13:05:34.120568 13907 tablet_bootstrap.cc:492] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:34.121032 13907 ts_tablet_manager.cc:1403] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.002s
I20260709 13:05:34.121429 13906 tablet_bootstrap.cc:492] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:34.121860 13906 ts_tablet_manager.cc:1403] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.000s
I20260709 13:05:34.123548 13907 raft_consensus.cc:359] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.124322 13907 raft_consensus.cc:385] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.124606 13907 raft_consensus.cc:740] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.124698 13906 raft_consensus.cc:359] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.125417 13906 raft_consensus.cc:385] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.125267 13907 consensus_queue.cc:260] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.125713 13906 raft_consensus.cc:740] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.125857 13905 raft_consensus.cc:359] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.126590 13905 raft_consensus.cc:385] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.126873 13905 raft_consensus.cc:740] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.126902 13906 consensus_queue.cc:260] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.128306 13905 consensus_queue.cc:260] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.129051 13906 ts_tablet_manager.cc:1434] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:34.130438 13906 tablet_bootstrap.cc:492] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:34.135555 14083 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.136116 14083 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.137292 13906 tablet_bootstrap.cc:654] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.140146 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:34.140803 13791 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:34.141330 13907 ts_tablet_manager.cc:1434] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:05:34.141911 14083 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:34.142112 13680 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:34.142742 13907 tablet_bootstrap.cc:492] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:34.143848 13905 ts_tablet_manager.cc:1434] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:05:34.145094 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:34.145675 13865 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:34.152709 14083 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:34.152962 13907 tablet_bootstrap.cc:654] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.153316 14083 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.153759 14083 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.159052 13905 tablet_bootstrap.cc:492] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:34.159936 13906 tablet_bootstrap.cc:492] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:34.160537 13906 ts_tablet_manager.cc:1403] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.006s
I20260709 13:05:34.163476 13906 raft_consensus.cc:359] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.164119 13906 raft_consensus.cc:385] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.164377 13906 raft_consensus.cc:740] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.164997 13906 consensus_queue.cc:260] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.165598 13905 tablet_bootstrap.cc:654] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.167037 13906 ts_tablet_manager.cc:1434] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:34.168233 13907 tablet_bootstrap.cc:492] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:34.168467 13906 tablet_bootstrap.cc:492] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:34.168686 13907 ts_tablet_manager.cc:1403] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.010s
I20260709 13:05:34.171164 13907 raft_consensus.cc:359] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.171913 13907 raft_consensus.cc:385] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.172163 13907 raft_consensus.cc:740] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.172871 13907 consensus_queue.cc:260] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.174018 13906 tablet_bootstrap.cc:654] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.175310 13907 ts_tablet_manager.cc:1434] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:34.184105 14157 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:34.176321 13907 tablet_bootstrap.cc:492] T 3e4bec6398d84f67ad839268ec8d2a12 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:34.190498 14002 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.193249 14083 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.195801 14083 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:34.195701 14119 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:34.191004 14002 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.196125 13907 tablet_bootstrap.cc:654] T 3e4bec6398d84f67ad839268ec8d2a12 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.199013 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:34.212790 13861 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.214394 14002 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:34.205417 14157 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.215842 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:34.217164 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:05:34.217340 13682 leader_election.cc:343] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.218205 13907 tablet_bootstrap.cc:492] T 3e4bec6398d84f67ad839268ec8d2a12 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:34.210800 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:34.218685 13907 ts_tablet_manager.cc:1403] T 3e4bec6398d84f67ad839268ec8d2a12 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.000s
I20260709 13:05:34.218901 13791 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.221823 13906 tablet_bootstrap.cc:492] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:34.222272 13906 ts_tablet_manager.cc:1403] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.017s
I20260709 13:05:34.215651 14157 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:05:34.223734 13680 leader_election.cc:343] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.224181 13680 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:05:34.224776 13906 raft_consensus.cc:359] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.225435 13906 raft_consensus.cc:385] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.225529 14002 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:34.220387 13861 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:34.226141 13907 raft_consensus.cc:359] T 3e4bec6398d84f67ad839268ec8d2a12 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.226799 13907 raft_consensus.cc:385] T 3e4bec6398d84f67ad839268ec8d2a12 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.226712 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:34.227144 13907 raft_consensus.cc:740] T 3e4bec6398d84f67ad839268ec8d2a12 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.227105 13682 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:34.227368 13785 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:34.227541 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:34.227715 14157 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:34.228287 13907 consensus_queue.cc:260] T 3e4bec6398d84f67ad839268ec8d2a12 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.228363 14002 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:34.228890 13680 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:05:34.229552 13682 leader_election.cc:343] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.230458 13907 ts_tablet_manager.cc:1434] T 3e4bec6398d84f67ad839268ec8d2a12 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:05:34.231352 13907 tablet_bootstrap.cc:492] T 68418f30a686438bba0d6ab02efa0986 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:34.229621 14002 raft_consensus.cc:697] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:05:34.232292 14119 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:34.232744 14119 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.232398 14002 consensus_queue.cc:237] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.233074 14119 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.236904 13907 tablet_bootstrap.cc:654] T 68418f30a686438bba0d6ab02efa0986 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.225711 13906 raft_consensus.cc:740] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.244354 13907 tablet_bootstrap.cc:492] T 68418f30a686438bba0d6ab02efa0986 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:34.244854 13907 ts_tablet_manager.cc:1403] T 68418f30a686438bba0d6ab02efa0986 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.001s
I20260709 13:05:34.241055 13906 consensus_queue.cc:260] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.247328 13907 raft_consensus.cc:359] T 68418f30a686438bba0d6ab02efa0986 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.248039 13907 raft_consensus.cc:385] T 68418f30a686438bba0d6ab02efa0986 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.248325 13907 raft_consensus.cc:740] T 68418f30a686438bba0d6ab02efa0986 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.249179 13907 consensus_queue.cc:260] T 68418f30a686438bba0d6ab02efa0986 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.249864 13612 catalog_manager.cc:5697] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.255199 13907 ts_tablet_manager.cc:1434] T 68418f30a686438bba0d6ab02efa0986 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:05:34.231374 13791 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:34.256791 13906 ts_tablet_manager.cc:1434] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 13:05:34.257781 13906 tablet_bootstrap.cc:492] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:34.257928 14119 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.262264 14119 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:34.262923 14002 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.263355 14002 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.264612 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:34.265359 14002 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:34.266812 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:05:34.267809 13682 leader_election.cc:343] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.268517 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:34.269209 13907 tablet_bootstrap.cc:492] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:34.269207 13785 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:34.270952 13905 tablet_bootstrap.cc:492] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:34.271386 13905 ts_tablet_manager.cc:1403] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.113s	user 0.008s	sys 0.007s
W20260709 13:05:34.268515 13682 leader_election.cc:343] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.273958 13680 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:34.275386 14119 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:34.275583 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:34.275790 14119 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.276796 14119 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.276851 13791 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.273974 13905 raft_consensus.cc:359] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.280237 13905 raft_consensus.cc:385] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.280526 13905 raft_consensus.cc:740] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.285516 13791 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:34.286823 13680 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:34.292555 14156 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.293215 14156 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.302194 14153 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.302850 14153 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.304957 14119 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.336346 14166 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.336925 14166 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.339525 14156 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:34.339787 13905 consensus_queue.cc:260] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.340553 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:34.341104 14119 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:34.341207 13791 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 0.
I20260709 13:05:34.342465 13906 tablet_bootstrap.cc:654] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.342959 13829 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:34.343936 13967 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:34.344385 13907 tablet_bootstrap.cc:654] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.339073 14166 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:34.344329 13967 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.345055 13967 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.343261 14153 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:34.348951 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:34.352397 13967 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.355546 13907 tablet_bootstrap.cc:492] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:34.355978 13907 ts_tablet_manager.cc:1403] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.087s	user 0.010s	sys 0.003s
I20260709 13:05:34.357226 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:34.358026 13791 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.358724 13907 raft_consensus.cc:359] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.359615 13907 raft_consensus.cc:385] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.359879 13907 raft_consensus.cc:740] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.360669 13907 consensus_queue.cc:260] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.363730 13907 ts_tablet_manager.cc:1434] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:34.364660 13907 tablet_bootstrap.cc:492] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:34.370236 13907 tablet_bootstrap.cc:654] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.370601 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:34.375797 14098 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.376412 14098 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.378336 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:34.378819 14098 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:34.378979 13860 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:34.380817 13907 tablet_bootstrap.cc:492] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:34.380643 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:34.381278 13907 ts_tablet_manager.cc:1403] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.007s
I20260709 13:05:34.381371 13785 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 0.
I20260709 13:05:34.382869 13829 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:34.384006 14166 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:34.384183 13907 raft_consensus.cc:359] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.384514 14166 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.384930 13907 raft_consensus.cc:385] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.385012 14166 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.385252 13907 raft_consensus.cc:740] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.386083 13907 consensus_queue.cc:260] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.388126 13907 ts_tablet_manager.cc:1434] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
W20260709 13:05:34.388622 13757 leader_election.cc:343] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.392454 13757 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:34.393579 13907 tablet_bootstrap.cc:492] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:34.393934 13791 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:05:34.395537 13829 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:34.396360 14153 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:34.396764 14153 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.396693 14098 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:34.397262 14153 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.399554 14098 raft_consensus.cc:697] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:05:34.400750 14098 consensus_queue.cc:237] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.403980 14153 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.405946 14153 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:05:34.411737 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 125008us
I20260709 13:05:34.413132 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:34.413583 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:34.414156 13860 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.414038 13713 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 0.
I20260709 13:05:34.415522 14165 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.415658 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:34.416039 14165 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.417797 14157 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:34.418272 14157 raft_consensus.cc:697] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:05:34.418362 14165 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:34.419176 14157 consensus_queue.cc:237] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.416448 13715 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.422111 13907 tablet_bootstrap.cc:654] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:34.424628 13682 leader_election.cc:343] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.428826 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:34.429471 13785 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.431321 14151 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:34.433279 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:34.434032 13790 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 0.
I20260709 13:05:34.435537 13829 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:34.436357 14165 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:34.436745 14165 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.437076 14165 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.447237 14165 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.449924 14165 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:34.451484 13907 tablet_bootstrap.cc:492] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:34.452232 13907 ts_tablet_manager.cc:1403] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.059s	user 0.007s	sys 0.010s
I20260709 13:05:34.453392 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:34.456218 13907 raft_consensus.cc:359] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.457367 13907 raft_consensus.cc:385] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.457790 13907 raft_consensus.cc:740] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.458413 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:34.458542 13907 consensus_queue.cc:260] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.459277 13790 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.461036 13860 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:34.462494 13757 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:34.470463 14151 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:34.470978 14151 raft_consensus.cc:697] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:34.471958 14151 consensus_queue.cc:237] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.473397 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:34.475935 13715 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:05:34.477191 13785 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:34.479512 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:34.480300 13713 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 0.
I20260709 13:05:34.461665 13907 ts_tablet_manager.cc:1434] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:34.488842 13907 tablet_bootstrap.cc:492] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:34.489192 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:34.491001 13713 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:34.498536 13680 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:34.504988 13907 tablet_bootstrap.cc:654] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.506733 14151 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.509133 14151 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.511516 13613 catalog_manager.cc:5697] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.514545 14151 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:34.513494 14157 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:34.515075 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:05:34.518923 13757 leader_election.cc:343] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.516834 13905 ts_tablet_manager.cc:1434] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.245s	user 0.009s	sys 0.019s
I20260709 13:05:34.522212 13905 tablet_bootstrap.cc:492] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:34.525475 14157 raft_consensus.cc:697] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:05:34.526242 14157 consensus_queue.cc:237] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.526976 13907 tablet_bootstrap.cc:492] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:34.527431 13907 ts_tablet_manager.cc:1403] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.039s	user 0.006s	sys 0.010s
I20260709 13:05:34.528370 14100 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.528829 14100 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.529281 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:34.529826 13713 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.530051 13907 raft_consensus.cc:359] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.530673 14100 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:34.537117 13905 tablet_bootstrap.cc:654] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.539921 13713 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:05:34.495553 13967 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:34.542021 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:34.542766 13787 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 0.
I20260709 13:05:34.544402 13829 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:34.545424 14100 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:34.549280 14100 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.549690 14100 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:34.552095 13830 leader_election.cc:343] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.556582 13830 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:34.556998 13612 catalog_manager.cc:5697] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.470861 13790 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:05:34.559590 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:34.560166 13711 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.555816 13613 catalog_manager.cc:5697] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.530673 13907 raft_consensus.cc:385] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.563000 13907 raft_consensus.cc:740] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.566684 13907 consensus_queue.cc:260] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.570989 14167 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:34.571761 14167 raft_consensus.cc:697] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:05:34.572835 14167 consensus_queue.cc:237] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.578222 13611 catalog_manager.cc:5697] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:34.570452 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:34.563779 14100 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.604581 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:05:34.610679 13756 leader_election.cc:343] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.613215 13756 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:34.613353 13713 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:34.615563 14153 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:34.616753 14100 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:34.617331 14153 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:34.620251 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:34.620998 13787 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.562263 14166 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.622859 13907 ts_tablet_manager.cc:1434] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.000s
I20260709 13:05:34.625792 13905 tablet_bootstrap.cc:492] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:34.626253 13905 ts_tablet_manager.cc:1403] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.104s	user 0.030s	sys 0.035s
W20260709 13:05:34.628750 13830 leader_election.cc:343] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.630764 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:34.631014 13711 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:34.634368 13907 tablet_bootstrap.cc:492] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:34.640528 13787 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:05:34.640945 14157 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:34.641724 13829 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:34.642721 14100 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:34.643050 13906 tablet_bootstrap.cc:492] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:34.643503 13906 ts_tablet_manager.cc:1403] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.386s	user 0.097s	sys 0.146s
I20260709 13:05:34.643308 14100 raft_consensus.cc:697] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:05:34.644652 13830 leader_election.cc:343] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.645645 14100 consensus_queue.cc:237] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.649268 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:34.649827 13791 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.649950 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:34.651108 13905 raft_consensus.cc:359] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:05:34.651554 13830 leader_election.cc:343] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.651809 13905 raft_consensus.cc:385] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.652117 13905 raft_consensus.cc:740] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.653848 13756 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:34.654776 13905 consensus_queue.cc:260] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.660600 13905 ts_tablet_manager.cc:1434] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.002s
I20260709 13:05:34.653950 14166 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:34.658703 14151 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:34.665355 13906 raft_consensus.cc:359] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.665895 14151 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.666024 13906 raft_consensus.cc:385] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.666291 13906 raft_consensus.cc:740] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.666994 13906 consensus_queue.cc:260] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.684433 13906 ts_tablet_manager.cc:1434] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.041s	user 0.014s	sys 0.007s
I20260709 13:05:34.666281 14151 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.697088 13791 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:05:34.698982 13829 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:34.700150 13967 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:34.701375 13967 raft_consensus.cc:697] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:05:34.701548 13905 tablet_bootstrap.cc:492] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:34.701706 13906 tablet_bootstrap.cc:492] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:34.703505 13967 consensus_queue.cc:237] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.704834 13612 catalog_manager.cc:5697] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:34.707535 13612 catalog_manager.cc:5697] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:34.727365 13906 tablet_bootstrap.cc:654] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.727193 14083 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:34.731451 13907 tablet_bootstrap.cc:654] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.735842 14007 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.736284 14007 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.780259 14151 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.782111 14151 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:34.786693 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:34.787325 13865 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:34.788288 13905 tablet_bootstrap.cc:654] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.788542 13757 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:34.789289 13907 tablet_bootstrap.cc:492] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:34.789674 13907 ts_tablet_manager.cc:1403] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.159s	user 0.016s	sys 0.004s
I20260709 13:05:34.788610 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:34.773540 14007 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:34.793748 13710 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:34.794095 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:34.800271 13907 raft_consensus.cc:359] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.800981 13907 raft_consensus.cc:385] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.801270 13907 raft_consensus.cc:740] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.793037 13931 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:34.802770 13907 consensus_queue.cc:260] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.804105 13907 ts_tablet_manager.cc:1434] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:05:34.802340 13931 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.804818 13931 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.806444 14167 consensus_queue.cc:1048] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:34.802076 13757 leader_election.cc:343] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.819458 13907 tablet_bootstrap.cc:492] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:34.822511 13906 tablet_bootstrap.cc:492] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:34.823144 13906 ts_tablet_manager.cc:1403] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.124s	user 0.004s	sys 0.014s
I20260709 13:05:34.826176 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:34.826784 13711 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.832785 13906 raft_consensus.cc:359] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.833562 13906 raft_consensus.cc:385] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.833822 13906 raft_consensus.cc:740] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.834554 13906 consensus_queue.cc:260] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.836697 13711 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:34.838227 13906 ts_tablet_manager.cc:1434] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.001s
I20260709 13:05:34.839726 13756 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:34.839588 13613 catalog_manager.cc:5697] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:34.841982 14153 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:34.842494 14153 raft_consensus.cc:697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:34.843286 14153 consensus_queue.cc:237] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.843868 13931 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.845965 13931 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:34.852217 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:34.852850 13860 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.857954 13907 tablet_bootstrap.cc:654] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.862386 13905 tablet_bootstrap.cc:492] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:34.862852 13905 ts_tablet_manager.cc:1403] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.174s	user 0.018s	sys 0.009s
I20260709 13:05:34.863960 14100 consensus_queue.cc:1048] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:34.865868 13905 raft_consensus.cc:359] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.867120 13905 raft_consensus.cc:385] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.867770 13906 tablet_bootstrap.cc:492] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:34.867483 13905 raft_consensus.cc:740] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.876006 13905 consensus_queue.cc:260] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.881053 13905 ts_tablet_manager.cc:1434] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.007s
I20260709 13:05:34.886101 14007 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.886593 14007 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.887298 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:34.888557 13712 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.889192 13931 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.899513 14211 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:34.900779 13931 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.904484 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:34.903644 14007 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:34.909397 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:05:34.909770 13757 leader_election.cc:343] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.910449 13712 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
W20260709 13:05:34.911211 13756 leader_election.cc:343] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.912055 13756 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:34.912971 13996 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:34.914954 13860 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:34.916427 13931 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:34.892254 14153 consensus_queue.cc:1048] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:05:34.916837 13905 tablet_bootstrap.cc:492] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:34.917845 13757 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:34.919469 13611 catalog_manager.cc:5697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.924743 13996 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:34.940264 14083 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.943647 14083 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.945987 14083 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:34.947705 13996 raft_consensus.cc:697] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:34.950335 13996 consensus_queue.cc:237] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.953413 13906 tablet_bootstrap.cc:654] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.959901 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:34.959919 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:34.957456 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:05:34.961735 13682 leader_election.cc:343] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.969111 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:05:34.972546 13680 leader_election.cc:343] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.973001 13680 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:05:34.973994 14083 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:34.974434 13905 tablet_bootstrap.cc:654] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:34.975003 13757 leader_election.cc:343] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:34.977667 13756 leader_election.cc:343] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.978062 13756 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:34.979475 14156 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:34.980059 14156 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.980444 14156 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:34.986564 14156 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:05:34.987377 13682 consensus_peers.cc:597] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 -> Peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Couldn't send request to peer b5029654a4384e43a68eb67b794949b7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:34.987617 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:05:34.993443 13757 leader_election.cc:343] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.997684 14211 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:35.000926 13613 catalog_manager.cc:5697] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:35.014199 13906 tablet_bootstrap.cc:492] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:35.014631 13906 ts_tablet_manager.cc:1403] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.154s	user 0.013s	sys 0.003s
I20260709 13:05:35.025676 13861 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.029970 14153 consensus_queue.cc:1048] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:35.031477 13906 raft_consensus.cc:359] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.033372 13906 raft_consensus.cc:385] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.033728 13906 raft_consensus.cc:740] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.036156 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:35.034551 13906 consensus_queue.cc:260] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.037269 13907 tablet_bootstrap.cc:492] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:35.037669 13907 ts_tablet_manager.cc:1403] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.218s	user 0.027s	sys 0.005s
W20260709 13:05:35.039230 13756 leader_election.cc:343] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.041352 13756 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:35.043658 14156 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:35.046190 13906 ts_tablet_manager.cc:1434] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.004s
I20260709 13:05:35.050115 14167 consensus_queue.cc:1048] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:35.051272 13907 raft_consensus.cc:359] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.052206 13907 raft_consensus.cc:385] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.052510 13907 raft_consensus.cc:740] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.054020 13907 consensus_queue.cc:260] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.068100 13906 tablet_bootstrap.cc:492] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:35.071058 13907 ts_tablet_manager.cc:1434] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:05:35.072230 13907 tablet_bootstrap.cc:492] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:35.073581 13905 tablet_bootstrap.cc:492] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:35.074525 13905 ts_tablet_manager.cc:1403] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.182s	user 0.027s	sys 0.026s
I20260709 13:05:35.077028 13905 raft_consensus.cc:359] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.078111 14211 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:35.081032 13905 raft_consensus.cc:385] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.081367 13905 raft_consensus.cc:740] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.082091 13905 consensus_queue.cc:260] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.083089 13906 tablet_bootstrap.cc:654] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.084566 13905 ts_tablet_manager.cc:1434] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:05:35.085479 13905 tablet_bootstrap.cc:492] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:35.088297 13907 tablet_bootstrap.cc:654] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.091149 13905 tablet_bootstrap.cc:654] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.102644 13967 consensus_queue.cc:1048] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:35.104560 13906 tablet_bootstrap.cc:492] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:35.105022 13906 ts_tablet_manager.cc:1403] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.003s
I20260709 13:05:35.108197 13906 raft_consensus.cc:359] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.108837 13906 raft_consensus.cc:385] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.109093 13906 raft_consensus.cc:740] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.109694 13906 consensus_queue.cc:260] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.113484 13906 ts_tablet_manager.cc:1434] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:35.114300 13906 tablet_bootstrap.cc:492] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:35.115372 13907 tablet_bootstrap.cc:492] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:35.115904 13907 ts_tablet_manager.cc:1403] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.044s	user 0.004s	sys 0.011s
I20260709 13:05:35.118803 13905 tablet_bootstrap.cc:492] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:35.119288 13905 ts_tablet_manager.cc:1403] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.005s
I20260709 13:05:35.120419 13907 raft_consensus.cc:359] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.136754 13907 raft_consensus.cc:385] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.137066 13907 raft_consensus.cc:740] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.137712 13907 consensus_queue.cc:260] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.139290 13907 ts_tablet_manager.cc:1434] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:05:35.140301 13907 tablet_bootstrap.cc:492] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:35.120653 14167 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:35.132514 13905 raft_consensus.cc:359] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.142612 13905 raft_consensus.cc:385] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.142921 13905 raft_consensus.cc:740] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.143546 13905 consensus_queue.cc:260] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.145502 13905 ts_tablet_manager.cc:1434] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 13:05:35.134673 13906 tablet_bootstrap.cc:654] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.148708 13905 tablet_bootstrap.cc:492] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:35.156100 14211 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.156625 14211 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.161407 14211 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:35.161831 13907 tablet_bootstrap.cc:654] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.165012 13905 tablet_bootstrap.cc:654] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.167810 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:05:35.173418 13682 leader_election.cc:343] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.176795 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:35.177470 13791 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:35.177729 13906 tablet_bootstrap.cc:492] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:35.178215 13906 ts_tablet_manager.cc:1403] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.008s
I20260709 13:05:35.178562 13680 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:35.179816 14212 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:35.180186 14212 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.180560 14212 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.180622 13906 raft_consensus.cc:359] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.181330 13906 raft_consensus.cc:385] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.181579 13906 raft_consensus.cc:740] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.182185 13906 consensus_queue.cc:260] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.189878 14083 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.190349 14083 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.191326 13906 ts_tablet_manager.cc:1434] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:05:35.192329 13906 tablet_bootstrap.cc:492] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:35.193401 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:35.192353 14083 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:35.197467 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:35.197854 13906 tablet_bootstrap.cc:654] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.198256 13787 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 1: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:05:35.195632 14212 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.201128 13905 tablet_bootstrap.cc:492] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:35.202481 13905 ts_tablet_manager.cc:1403] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.054s	user 0.005s	sys 0.012s
I20260709 13:05:35.201046 13967 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.203034 13967 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.203856 14212 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:05:35.201917 13830 consensus_peers.cc:597] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:35.205029 13967 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:35.205071 13905 raft_consensus.cc:359] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.205840 13905 raft_consensus.cc:385] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.206107 13905 raft_consensus.cc:740] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.206538 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:35.206671 13905 consensus_queue.cc:260] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.207147 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:35.208057 13710 raft_consensus.cc:2393] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 1: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:05:35.208681 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:05:35.209827 13682 leader_election.cc:343] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.209985 13830 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:35.210673 13967 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.211199 13905 ts_tablet_manager.cc:1434] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:05:35.211037 13680 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:05:35.212163 13905 tablet_bootstrap.cc:492] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:35.212515 14083 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.213821 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:35.214635 13791 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.224125 14083 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:35.225333 13967 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:35.225843 13905 tablet_bootstrap.cc:654] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.230844 13907 tablet_bootstrap.cc:492] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:35.226438 13791 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:35.237486 13907 ts_tablet_manager.cc:1403] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.097s	user 0.014s	sys 0.010s
I20260709 13:05:35.237604 14100 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:35.238260 13680 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:35.240070 14212 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:35.240533 14212 raft_consensus.cc:697] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:05:35.240820 13907 raft_consensus.cc:359] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.241503 13907 raft_consensus.cc:385] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.241284 14212 consensus_queue.cc:237] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.241806 13907 raft_consensus.cc:740] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.242444 13907 consensus_queue.cc:260] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.245173 14135 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.245615 13907 ts_tablet_manager.cc:1434] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:35.246599 13907 tablet_bootstrap.cc:492] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:35.245640 14135 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.247696 13906 tablet_bootstrap.cc:492] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:35.248605 13906 ts_tablet_manager.cc:1403] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.003s
I20260709 13:05:35.251397 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:35.251789 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:35.252355 13710 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
W20260709 13:05:35.252780 13757 leader_election.cc:343] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.253554 13756 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:35.254823 14151 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:35.255167 14151 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.255501 14151 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.251077 13906 raft_consensus.cc:359] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.256016 14135 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:35.256366 13906 raft_consensus.cc:385] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.257499 13906 raft_consensus.cc:740] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.258141 13906 consensus_queue.cc:260] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.259573 14135 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:35.260327 13905 tablet_bootstrap.cc:492] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:35.270529 13905 ts_tablet_manager.cc:1403] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.000s
I20260709 13:05:35.271377 13907 tablet_bootstrap.cc:654] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.273787 13905 raft_consensus.cc:359] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.274542 13905 raft_consensus.cc:385] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.274807 13905 raft_consensus.cc:740] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.279153 14100 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:35.265404 13906 ts_tablet_manager.cc:1434] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:05:35.266168 14151 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.280450 13905 consensus_queue.cc:260] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.281560 14151 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:35.266970 13611 catalog_manager.cc:5697] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:35.282605 13905 ts_tablet_manager.cc:1434] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:05:35.284364 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:35.284898 13716 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.288220 13906 tablet_bootstrap.cc:492] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:35.289381 14151 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:35.259356 13662 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:35.299822 13906 tablet_bootstrap.cc:654] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.304586 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:05:35.306376 13757 leader_election.cc:343] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.315330 13716 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:35.317436 13756 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:35.318460 14151 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:35.318931 14151 raft_consensus.cc:697] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:35.319777 14151 consensus_queue.cc:237] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.325160 13905 tablet_bootstrap.cc:492] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:35.331108 13905 tablet_bootstrap.cc:654] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.346714 13906 tablet_bootstrap.cc:492] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:35.347115 13906 ts_tablet_manager.cc:1403] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.007s
I20260709 13:05:35.355533 13905 tablet_bootstrap.cc:492] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:35.356057 13905 ts_tablet_manager.cc:1403] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.003s
I20260709 13:05:35.358616 13905 raft_consensus.cc:359] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.359272 13905 raft_consensus.cc:385] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.359549 13905 raft_consensus.cc:740] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.360175 13905 consensus_queue.cc:260] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.362150 13905 ts_tablet_manager.cc:1434] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:35.363125 13905 tablet_bootstrap.cc:492] T fa2169d517e24498a35dae28da79c931 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:35.363533 13906 raft_consensus.cc:359] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.364310 13906 raft_consensus.cc:385] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.364629 13906 raft_consensus.cc:740] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.365353 13906 consensus_queue.cc:260] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.366055 13907 tablet_bootstrap.cc:492] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:35.365593 13612 catalog_manager.cc:5697] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:35.366479 13907 ts_tablet_manager.cc:1403] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.120s	user 0.020s	sys 0.024s
I20260709 13:05:35.369436 13907 raft_consensus.cc:359] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.370087 13907 raft_consensus.cc:385] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.370349 13907 raft_consensus.cc:740] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.371040 13907 consensus_queue.cc:260] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.373023 13906 ts_tablet_manager.cc:1434] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:05:35.374035 13906 tablet_bootstrap.cc:492] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:35.377317 13907 ts_tablet_manager.cc:1434] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:05:35.377900 13861 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.378328 13907 tablet_bootstrap.cc:492] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:35.381042 13906 tablet_bootstrap.cc:654] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.384816 13905 tablet_bootstrap.cc:654] T fa2169d517e24498a35dae28da79c931 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.389344 13907 tablet_bootstrap.cc:654] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.396409 13906 tablet_bootstrap.cc:492] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:35.396939 13906 ts_tablet_manager.cc:1403] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.005s
I20260709 13:05:35.400537 13906 raft_consensus.cc:359] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.402359 13906 raft_consensus.cc:385] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.402678 13906 raft_consensus.cc:740] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.403378 13906 consensus_queue.cc:260] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.405632 13906 ts_tablet_manager.cc:1434] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:05:35.406575 13906 tablet_bootstrap.cc:492] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:35.414327 13907 tablet_bootstrap.cc:492] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:35.414826 13907 ts_tablet_manager.cc:1403] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.001s
I20260709 13:05:35.419900 13907 raft_consensus.cc:359] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.420472 13907 raft_consensus.cc:385] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.420635 13907 raft_consensus.cc:740] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.423075 13905 tablet_bootstrap.cc:492] T fa2169d517e24498a35dae28da79c931 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:35.423545 13905 ts_tablet_manager.cc:1403] T fa2169d517e24498a35dae28da79c931 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.061s	user 0.007s	sys 0.014s
I20260709 13:05:35.426076 13905 raft_consensus.cc:359] T fa2169d517e24498a35dae28da79c931 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.426704 13905 raft_consensus.cc:385] T fa2169d517e24498a35dae28da79c931 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.426517 13907 consensus_queue.cc:260] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.426986 13905 raft_consensus.cc:740] T fa2169d517e24498a35dae28da79c931 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.428575 13907 ts_tablet_manager.cc:1434] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:35.428287 13905 consensus_queue.cc:260] T fa2169d517e24498a35dae28da79c931 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.429608 13907 tablet_bootstrap.cc:492] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:35.430456 13905 ts_tablet_manager.cc:1434] T fa2169d517e24498a35dae28da79c931 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:05:35.436192 14083 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.436625 14083 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.438566 14083 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:35.440021 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:35.443136 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:35.444923 13682 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:05:35.447798 14083 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:35.452767 13905 tablet_bootstrap.cc:492] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:35.454628 13907 tablet_bootstrap.cc:654] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.456259 14166 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.456766 14166 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.458675 13906 tablet_bootstrap.cc:654] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.460976 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:35.458806 13905 tablet_bootstrap.cc:654] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.458807 14166 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:35.459892 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:35.462410 13710 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 0.
I20260709 13:05:35.461588 13791 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 0.
I20260709 13:05:35.463920 13830 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:35.465096 14100 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:35.465440 14100 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.465778 14100 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.472856 14100 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.475813 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:35.476478 13791 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.477648 13905 tablet_bootstrap.cc:492] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:35.479701 13905 ts_tablet_manager.cc:1403] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.048s	user 0.008s	sys 0.005s
I20260709 13:05:35.480037 14151 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.480499 14151 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.481696 13791 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:05:35.482522 14151 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:35.482826 14135 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.482640 13905 raft_consensus.cc:359] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.483294 14135 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.484225 13905 raft_consensus.cc:385] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.484546 13905 raft_consensus.cc:740] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.484491 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:35.485275 14135 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:35.485489 13905 consensus_queue.cc:260] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.486409 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:35.487020 13712 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:35.487465 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:35.487969 13905 ts_tablet_manager.cc:1434] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
W20260709 13:05:35.488701 13757 leader_election.cc:343] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.489583 13905 tablet_bootstrap.cc:492] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:35.490468 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:35.475787 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:35.491485 13710 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.498473 13756 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:35.499248 13905 tablet_bootstrap.cc:654] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:35.499558 13756 leader_election.cc:343] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.500274 14153 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:35.500694 14153 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.501034 14153 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.502768 13907 tablet_bootstrap.cc:492] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:35.503216 13907 ts_tablet_manager.cc:1403] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.074s	user 0.013s	sys 0.020s
I20260709 13:05:35.486411 13829 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:35.505270 14166 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:35.505888 14166 raft_consensus.cc:697] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:05:35.506449 13907 raft_consensus.cc:359] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.507169 13907 raft_consensus.cc:385] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.509898 13906 tablet_bootstrap.cc:492] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:35.510363 13906 ts_tablet_manager.cc:1403] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.104s	user 0.008s	sys 0.005s
I20260709 13:05:35.507514 13907 raft_consensus.cc:740] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.513411 13906 raft_consensus.cc:359] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.506881 14166 consensus_queue.cc:237] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:05:35.513521 13757 leader_election.cc:343] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.515084 13757 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:35.513383 13907 consensus_queue.cc:260] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.515920 14151 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:35.517572 13907 ts_tablet_manager.cc:1434] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:05:35.519281 13907 tablet_bootstrap.cc:492] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:35.522622 13905 tablet_bootstrap.cc:492] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:35.523129 13905 ts_tablet_manager.cc:1403] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.013s
I20260709 13:05:35.525512 13907 tablet_bootstrap.cc:654] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.525686 14151 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:35.525904 13905 raft_consensus.cc:359] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.526685 13905 raft_consensus.cc:385] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.527004 13905 raft_consensus.cc:740] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.527782 13905 consensus_queue.cc:260] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.535388 13905 ts_tablet_manager.cc:1434] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:05:35.536424 13905 tablet_bootstrap.cc:492] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:35.514242 13906 raft_consensus.cc:385] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.547634 13906 raft_consensus.cc:740] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.548635 13906 consensus_queue.cc:260] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.551206 13906 ts_tablet_manager.cc:1434] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.001s
I20260709 13:05:35.552354 13906 tablet_bootstrap.cc:492] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:35.552670 14083 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.553360 14100 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:35.553289 14083 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.582674 14100 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.583447 14100 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.586856 13905 tablet_bootstrap.cc:654] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.588320 14100 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:35.598544 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:35.599334 13861 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:35.601845 13682 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:35.603068 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:35.603928 13791 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:35.610109 14211 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:35.610597 14211 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.610981 14211 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.611707 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:35.612416 13716 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 0.
I20260709 13:05:35.606247 13710 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:05:35.614372 14153 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.588325 14083 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:35.618074 13830 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:35.610110 13613 catalog_manager.cc:5697] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:35.626400 14166 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:35.626807 14166 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.627137 14166 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.629462 13996 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:35.667531 13906 tablet_bootstrap.cc:654] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.676855 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:35.677569 13791 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 0.
I20260709 13:05:35.679306 14153 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:35.682228 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:35.682842 13712 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.683840 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:05:35.686877 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 85128.6us
W20260709 13:05:35.687685 13757 leader_election.cc:343] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.691757 13712 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:35.696715 14166 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.701210 13907 tablet_bootstrap.cc:492] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:35.701714 13907 ts_tablet_manager.cc:1403] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.183s	user 0.028s	sys 0.014s
I20260709 13:05:35.701243 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:35.702769 13791 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.705295 13907 raft_consensus.cc:359] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.705622 14211 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.705973 13907 raft_consensus.cc:385] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.706319 13907 raft_consensus.cc:740] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.706946 13907 consensus_queue.cc:260] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.707944 13756 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:35.709573 14156 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:35.709995 14156 raft_consensus.cc:697] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:35.710251 13907 ts_tablet_manager.cc:1434] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:05:35.706938 14167 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.710748 14167 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.711265 13907 tablet_bootstrap.cc:492] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:35.711331 14083 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:35.710785 14156 consensus_queue.cc:237] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.713596 13791 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:05:35.715085 14167 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:35.715009 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:35.715318 13829 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:35.719981 13905 tablet_bootstrap.cc:492] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:35.720513 13905 ts_tablet_manager.cc:1403] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.184s	user 0.040s	sys 0.050s
I20260709 13:05:35.721792 14167 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:35.722705 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:35.723332 13716 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.723490 14167 raft_consensus.cc:697] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:05:35.724866 13905 raft_consensus.cc:359] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.725490 13905 raft_consensus.cc:385] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.725777 13905 raft_consensus.cc:740] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.726426 13905 consensus_queue.cc:260] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.729496 13905 ts_tablet_manager.cc:1434] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 13:05:35.715786 14166 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:35.724371 14167 consensus_queue.cc:237] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.734861 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:35.736599 13712 raft_consensus.cc:2393] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 1: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:05:35.736663 13710 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.743937 14273 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.744486 14273 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.748724 13830 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:35.752827 13905 tablet_bootstrap.cc:492] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:35.757422 14273 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:35.759485 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:05:35.761497 13682 leader_election.cc:343] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.752399 13716 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:05:35.769302 14153 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.753731 14166 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.770972 14153 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.773870 14153 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:35.788228 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:35.788885 13713 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:35.790364 14211 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:35.797940 13756 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:35.801018 13996 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:35.806545 13996 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.843502 13612 catalog_manager.cc:5697] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:35.806954 13996 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.854264 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:35.855260 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:35.844806 14135 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.856024 13785 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.856463 14135 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.861621 13613 catalog_manager.cc:5697] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:35.849448 14165 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.891356 14165 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.941303 14211 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.964749 14211 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:35.971275 13906 tablet_bootstrap.cc:492] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:35.971809 13906 ts_tablet_manager.cc:1403] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.420s	user 0.020s	sys 0.051s
I20260709 13:05:35.975528 14211 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:05:35.977653 13817 tablet.cc:2406] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260709 13:05:35.977620 13680 leader_election.cc:343] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.983953 13680 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:05:35.985070 14273 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:35.985736 13905 tablet_bootstrap.cc:654] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.991585 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:35.992209 13860 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.995764 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:35.996380 13789 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:35.997488 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:36.004674 13680 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:36.005973 14211 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:36.006429 14211 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.006845 14211 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.006688 13906 raft_consensus.cc:359] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.015867 13906 raft_consensus.cc:385] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:36.018467 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 174031us
I20260709 13:05:36.022888 13906 raft_consensus.cc:740] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.024354 13906 consensus_queue.cc:260] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:05:36.026356 13757 leader_election.cc:343] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:36.007048 13907 tablet_bootstrap.cc:654] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.009146 14166 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:36.055642 13906 ts_tablet_manager.cc:1434] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.002s
I20260709 13:05:36.070250 13906 tablet_bootstrap.cc:492] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:36.025840 14156 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.071292 14135 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:36.071220 14156 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.071808 14135 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.072242 14135 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:05:36.072513 14278 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:05:36.073329 14156 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:36.074095 14135 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:36.027758 14211 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.116997 13863 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:36.127978 14275 log.cc:927] Time spent T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:05:36.128414 14211 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:05:36.129577 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 77904.9us
I20260709 13:05:36.135053 13996 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.136961 13996 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:05:36.158794 14279 log.cc:927] Time spent T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
I20260709 13:05:36.160228 13905 tablet_bootstrap.cc:492] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:36.160647 13905 ts_tablet_manager.cc:1403] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.426s	user 0.024s	sys 0.027s
I20260709 13:05:36.169972 13860 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:36.164228 13785 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:36.191779 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:36.192649 14135 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.057s
I20260709 13:05:36.253607 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:36.212169 14285 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.269827 13682 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:36.268301 13905 raft_consensus.cc:359] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.270771 13905 raft_consensus.cc:385] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.271057 13905 raft_consensus.cc:740] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.271482 14083 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:36.271982 14083 raft_consensus.cc:697] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:05:36.272567 13905 consensus_queue.cc:260] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.272701 14083 consensus_queue.cc:237] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.268023 13789 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.274410 14285 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.274679 14100 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:36.289376 13905 ts_tablet_manager.cc:1434] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.128s	user 0.005s	sys 0.003s
I20260709 13:05:36.288836 13967 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:36.273859 14165 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:36.311151 13905 tablet_bootstrap.cc:492] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:36.299743 14273 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:05:36.329118 14285 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:36.331823 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:36.342300 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:36.343184 13709 raft_consensus.cc:2393] T fa2169d517e24498a35dae28da79c931 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 1: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:05:36.346969 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:36.356186 13789 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:36.357108 13907 tablet_bootstrap.cc:492] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:36.357343 13680 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:36.357877 13907 ts_tablet_manager.cc:1403] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.647s	user 0.002s	sys 0.041s
I20260709 13:05:36.359531 14292 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:36.360050 14292 raft_consensus.cc:697] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:05:36.361126 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:36.361486 14292 consensus_queue.cc:237] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.362692 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:36.364266 13905 tablet_bootstrap.cc:654] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.370178 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:36.370837 13709 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:36.377296 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:36.377858 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:36.393623 14285 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:05:36.401696 13906 tablet_bootstrap.cc:654] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.402845 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:05:36.416472 13757 leader_election.cc:343] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:36.434749 13662 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:05:36.431865 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 48736.9us
I20260709 13:05:36.445438 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:36.449090 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:36.446705 13907 raft_consensus.cc:359] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.451475 13907 raft_consensus.cc:385] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.451751 13907 raft_consensus.cc:740] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.452342 13907 consensus_queue.cc:260] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:05:36.455120 13757 leader_election.cc:343] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:36.456655 13907 ts_tablet_manager.cc:1434] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.098s	user 0.004s	sys 0.003s
I20260709 13:05:36.457144 13861 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:36.464577 13682 leader_election.cc:343] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:36.464785 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:36.458204 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:05:36.465425 13682 leader_election.cc:343] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:36.455852 13713 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.473153 13829 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:36.476171 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:36.462541 13611 catalog_manager.cc:5697] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:36.484355 14284 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 13:05:36.487717 13757 leader_election.cc:343] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:36.488520 13757 leader_election.cc:343] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:36.493371 14286 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:36.485612 14285 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:36.502516 13905 tablet_bootstrap.cc:492] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:36.503289 13905 ts_tablet_manager.cc:1403] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.198s	user 0.015s	sys 0.006s
I20260709 13:05:36.520143 13713 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:36.527736 14156 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:36.521981 13906 tablet_bootstrap.cc:492] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:36.530891 13906 ts_tablet_manager.cc:1403] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.461s	user 0.012s	sys 0.020s
I20260709 13:05:36.526393 13756 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:05:36.531970 13756 leader_election.cc:343] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:36.532896 13756 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:36.535876 13756 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:36.537528 13907 tablet_bootstrap.cc:492] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:36.539014 14282 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:36.540664 14135 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:36.545912 14281 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:36.546387 14281 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.546723 14281 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.568013 13906 raft_consensus.cc:359] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.569036 13906 raft_consensus.cc:385] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.569377 13906 raft_consensus.cc:740] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.571578 13906 consensus_queue.cc:260] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.607968 13906 ts_tablet_manager.cc:1434] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.006s
I20260709 13:05:36.615202 13905 raft_consensus.cc:359] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.616190 13905 raft_consensus.cc:385] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.616061 14298 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.616554 13905 raft_consensus.cc:740] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.616780 14298 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.617225 13905 consensus_queue.cc:260] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.619127 13905 ts_tablet_manager.cc:1434] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.109s	user 0.007s	sys 0.000s
I20260709 13:05:36.620946 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:36.622676 14298 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:36.622612 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:36.623582 13787 raft_consensus.cc:2393] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 1: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:05:36.627733 13906 tablet_bootstrap.cc:492] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:36.626117 13829 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:36.628810 14285 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:36.633060 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 65403.3us
I20260709 13:05:36.633980 13756 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:36.631026 13613 catalog_manager.cc:5697] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:36.636518 13905 tablet_bootstrap.cc:492] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:36.647840 14283 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:36.648377 14283 raft_consensus.cc:697] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:36.649200 14283 consensus_queue.cc:237] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.650413 14166 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:36.655010 14135 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260709 13:05:36.667580 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 105336us
I20260709 13:05:36.700948 13907 tablet_bootstrap.cc:654] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.704546 14281 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.708019 14281 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:36.712128 14285 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:36.723117 13906 tablet_bootstrap.cc:654] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.728734 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:36.734112 13710 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.742316 13710 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:36.747974 13756 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:36.749254 14283 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:36.749981 14283 raft_consensus.cc:697] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:36.749528 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:36.751808 14283 consensus_queue.cc:237] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:05:36.752640 13757 leader_election.cc:343] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:36.732435 13905 tablet_bootstrap.cc:654] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.772847 13906 tablet_bootstrap.cc:492] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:36.773365 13906 ts_tablet_manager.cc:1403] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.160s	user 0.013s	sys 0.003s
I20260709 13:05:36.774399 14282 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.774735 13905 tablet_bootstrap.cc:492] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:36.775342 13905 ts_tablet_manager.cc:1403] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.150s	user 0.016s	sys 0.000s
I20260709 13:05:36.774927 14282 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.776026 13906 raft_consensus.cc:359] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.776736 13906 raft_consensus.cc:385] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.776999 13906 raft_consensus.cc:740] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.777256 14282 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:36.777733 13906 consensus_queue.cc:260] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.778324 13905 raft_consensus.cc:359] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.779541 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:36.780661 13905 raft_consensus.cc:385] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.779889 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:36.781263 13905 raft_consensus.cc:740] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
W20260709 13:05:36.781487 13757 leader_election.cc:343] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:36.782610 13756 leader_election.cc:343] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:36.782851 13906 ts_tablet_manager.cc:1434] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:36.783020 13756 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:36.783798 13907 tablet_bootstrap.cc:492] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:36.783839 13906 tablet_bootstrap.cc:492] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:36.784094 14151 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:36.784498 13907 ts_tablet_manager.cc:1403] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.251s	user 0.020s	sys 0.008s
I20260709 13:05:36.787259 13905 consensus_queue.cc:260] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.788708 13907 raft_consensus.cc:359] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.790957 13907 raft_consensus.cc:385] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.791265 13907 raft_consensus.cc:740] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.790768 13613 catalog_manager.cc:5697] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:36.791940 13907 consensus_queue.cc:260] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.793779 13906 tablet_bootstrap.cc:654] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.800045 13907 ts_tablet_manager.cc:1434] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:05:36.801795 13907 tablet_bootstrap.cc:492] T cff75d4a417e4aeab081acad01b03c36 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:36.790802 13905 ts_tablet_manager.cc:1434] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:05:36.808202 13905 tablet_bootstrap.cc:492] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:36.819376 13905 tablet_bootstrap.cc:654] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.824271 13907 tablet_bootstrap.cc:654] T cff75d4a417e4aeab081acad01b03c36 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.823792 13613 catalog_manager.cc:5697] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:36.834112 13906 tablet_bootstrap.cc:492] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:36.834549 13906 ts_tablet_manager.cc:1403] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.051s	user 0.028s	sys 0.017s
I20260709 13:05:36.834872 13905 tablet_bootstrap.cc:492] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:36.835366 13905 ts_tablet_manager.cc:1403] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.000s
I20260709 13:05:36.836539 13907 tablet_bootstrap.cc:492] T cff75d4a417e4aeab081acad01b03c36 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:36.837036 13907 ts_tablet_manager.cc:1403] T cff75d4a417e4aeab081acad01b03c36 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.000s
I20260709 13:05:36.837138 13906 raft_consensus.cc:359] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.837822 13906 raft_consensus.cc:385] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.838176 13906 raft_consensus.cc:740] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.838829 13906 consensus_queue.cc:260] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.837836 13905 raft_consensus.cc:359] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.839824 13905 raft_consensus.cc:385] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.840088 13905 raft_consensus.cc:740] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.840457 13907 raft_consensus.cc:359] T cff75d4a417e4aeab081acad01b03c36 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.841060 13906 ts_tablet_manager.cc:1434] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:05:36.840716 13905 consensus_queue.cc:260] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.841209 13907 raft_consensus.cc:385] T cff75d4a417e4aeab081acad01b03c36 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.841497 14211 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.841679 13907 raft_consensus.cc:740] T cff75d4a417e4aeab081acad01b03c36 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.842214 13906 tablet_bootstrap.cc:492] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:36.841971 14211 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.842921 13905 ts_tablet_manager.cc:1434] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:36.842725 13907 consensus_queue.cc:260] T cff75d4a417e4aeab081acad01b03c36 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.844113 13905 tablet_bootstrap.cc:492] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:36.844408 14211 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:36.845643 13907 ts_tablet_manager.cc:1434] T cff75d4a417e4aeab081acad01b03c36 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.006s
I20260709 13:05:36.845914 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:36.846814 13789 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:36.847244 13907 tablet_bootstrap.cc:492] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03: Bootstrap starting.
I20260709 13:05:36.848049 13680 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:36.848366 13906 tablet_bootstrap.cc:654] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.846127 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:05:36.849690 13682 leader_election.cc:343] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:36.850487 14211 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:36.850869 14211 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.851267 14211 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.853634 13907 tablet_bootstrap.cc:654] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.859589 13906 tablet_bootstrap.cc:492] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:36.860059 13906 ts_tablet_manager.cc:1403] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:05:36.862552 13906 raft_consensus.cc:359] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.863214 13906 raft_consensus.cc:385] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.863729 13906 raft_consensus.cc:740] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.864459 13906 consensus_queue.cc:260] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.866498 13906 ts_tablet_manager.cc:1434] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:36.867373 13906 tablet_bootstrap.cc:492] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:36.868312 13905 tablet_bootstrap.cc:654] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.873265 13906 tablet_bootstrap.cc:654] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.871256 14211 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.876607 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:36.877228 13907 tablet_bootstrap.cc:492] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03: No bootstrap required, opened a new log
I20260709 13:05:36.877667 13907 ts_tablet_manager.cc:1403] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.005s
I20260709 13:05:36.880132 13907 raft_consensus.cc:359] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.880771 13907 raft_consensus.cc:385] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.881007 13907 raft_consensus.cc:740] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.881768 13907 consensus_queue.cc:260] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:05:36.882197 13682 leader_election.cc:343] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:36.884847 13906 tablet_bootstrap.cc:492] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:36.885296 13906 ts_tablet_manager.cc:1403] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.005s
I20260709 13:05:36.885353 13907 ts_tablet_manager.cc:1434] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:05:36.886047 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:36.886586 13790 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.888015 13906 raft_consensus.cc:359] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.888756 13906 raft_consensus.cc:385] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.889050 13906 raft_consensus.cc:740] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.889665 13906 consensus_queue.cc:260] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.892709 13906 ts_tablet_manager.cc:1434] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:05:36.894456 13906 tablet_bootstrap.cc:492] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:36.907794 14151 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.908425 14151 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.910444 14151 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:36.911094 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:36.911733 13713 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:36.913081 13756 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:36.913689 13905 tablet_bootstrap.cc:492] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:36.914175 13905 ts_tablet_manager.cc:1403] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.002s
I20260709 13:05:36.914662 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:36.915714 14282 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:36.916087 14282 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.916232 14292 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:36.916468 14282 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.917375 13905 raft_consensus.cc:359] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.918074 13905 raft_consensus.cc:385] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:36.918049 13757 leader_election.cc:343] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:36.918810 13905 raft_consensus.cc:740] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.919595 13905 consensus_queue.cc:260] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.921013 13905 ts_tablet_manager.cc:1434] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:36.923250 14282 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.923511 14292 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:36.927084 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:36.927644 13905 tablet_bootstrap.cc:492] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02: Bootstrap starting.
I20260709 13:05:36.927652 13713 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.929354 14002 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:36.930519 14083 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.930955 14083 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.932704 14083 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:36.933224 14083 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:36.936051 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:05:36.937860 13757 leader_election.cc:343] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:36.942203 13905 tablet_bootstrap.cc:654] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.942283 13713 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:36.943440 13756 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:36.944178 14283 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:36.944620 14283 raft_consensus.cc:697] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:36.945384 14283 consensus_queue.cc:237] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.948289 13905 tablet_bootstrap.cc:492] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02: No bootstrap required, opened a new log
I20260709 13:05:36.948607 14282 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:36.948801 13905 ts_tablet_manager.cc:1403] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.000s
I20260709 13:05:36.951308 13906 tablet_bootstrap.cc:654] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.951611 13905 raft_consensus.cc:359] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.952334 13905 raft_consensus.cc:385] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.952564 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:36.952759 13905 raft_consensus.cc:740] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.953168 13861 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:36.953955 13905 consensus_queue.cc:260] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.955498 13905 ts_tablet_manager.cc:1434] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:36.956849 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:36.957465 13787 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:36.958405 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:36.959115 14083 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:36.959439 14083 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.959744 14083 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.964741 13790 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:36.965695 14151 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.965961 14083 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.966180 14151 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.969237 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:36.969769 13861 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.976051 13680 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:36.977065 14212 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:36.977531 14212 raft_consensus.cc:697] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:05:36.978317 14212 consensus_queue.cc:237] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:36.979673 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:36.980037 14151 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:05:36.981171 13757 leader_election.cc:343] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:36.981784 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:36.982597 13710 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 0.
I20260709 13:05:36.984628 13756 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:36.983785 14211 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:36.986032 14083 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:36.991611 14151 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:37.001179 14151 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.001586 14151 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:37.003050 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:37.008641 13861 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:37.011646 13682 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:37.013994 14292 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:37.014508 14292 raft_consensus.cc:697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:05:37.015383 14292 consensus_queue.cc:237] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:37.011780 13790 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:37.075471 14151 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:37.077652 13862 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:37.079717 13611 catalog_manager.cc:5697] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.084098 14083 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.084640 14083 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:37.085901 14283 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:37.086472 14151 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:37.087555 14083 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:37.092571 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:05:37.096083 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:37.096697 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:37.096859 13785 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 0.
I20260709 13:05:37.097288 13710 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:37.100073 13906 tablet_bootstrap.cc:492] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:37.100484 13906 ts_tablet_manager.cc:1403] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.206s	user 0.033s	sys 0.006s
I20260709 13:05:37.096083 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:05:37.102553 13757 leader_election.cc:343] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:37.103361 13682 leader_election.cc:343] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:37.104760 13612 catalog_manager.cc:5697] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.106581 13612 catalog_manager.cc:5697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.082017 13790 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:37.115969 13680 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:37.120824 13906 raft_consensus.cc:359] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:37.121526 13906 raft_consensus.cc:385] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:37.121769 13906 raft_consensus.cc:740] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:37.123214 14292 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:37.123631 14292 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.123958 14292 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:37.124879 14151 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:37.126986 13906 consensus_queue.cc:260] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:37.130980 13906 ts_tablet_manager.cc:1434] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:05:37.131891 13906 tablet_bootstrap.cc:492] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:37.138975 14285 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.140740 14285 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:37.142722 14285 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:37.145149 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:37.148097 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:37.148854 13713 raft_consensus.cc:2393] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 1: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:05:37.154693 13829 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:37.155786 14285 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:37.139088 13710 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:05:37.171196 13906 tablet_bootstrap.cc:654] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:37.173834 14285 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:37.174921 13756 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:05:37.175025 14292 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:37.176417 14310 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:37.176877 14310 raft_consensus.cc:697] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:37.177033 14288 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:37.177716 14310 consensus_queue.cc:237] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:37.178154 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:37.178748 13789 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:37.188712 13789 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:05:37.189767 14292 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:37.191123 13680 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:37.191995 14292 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:37.191133 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:37.193137 14292 raft_consensus.cc:697] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:05:37.194067 13682 leader_election.cc:343] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:37.194265 14292 consensus_queue.cc:237] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:37.197871 13906 tablet_bootstrap.cc:492] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:37.198325 13906 ts_tablet_manager.cc:1403] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.001s
I20260709 13:05:37.201181 14285 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.201633 14285 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:37.202077 14167 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.202562 14167 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:37.203306 14282 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:37.204089 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:37.204493 14167 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:37.204664 13711 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 0.
I20260709 13:05:37.205374 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:37.205914 13791 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 0.
I20260709 13:05:37.207253 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:37.207533 13830 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:37.208292 14165 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:37.208657 14165 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.206719 14285 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:37.208981 14165 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:37.216970 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:37.224213 14165 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:37.226065 14165 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:37.227332 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:37.227941 13713 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:37.226689 13789 raft_consensus.cc:2393] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 1: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:05:37.231886 13906 raft_consensus.cc:359] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:37.233214 13906 raft_consensus.cc:385] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:37.233650 13906 raft_consensus.cc:740] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:37.234361 13906 consensus_queue.cc:260] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:37.242226 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:37.242760 13791 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P 35ecb005831740438d7537dd4b840e03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:37.244720 13906 ts_tablet_manager.cc:1434] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.002s
I20260709 13:05:37.246071 13829 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:37.254503 13611 catalog_manager.cc:5697] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.251741 14298 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:37.262100 13906 tablet_bootstrap.cc:492] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:37.265542 13713 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:05:37.266562 13830 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:37.267323 14167 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:37.267812 14167 raft_consensus.cc:697] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:05:37.268664 14167 consensus_queue.cc:237] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:37.272433 13791 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:05:37.288854 13906 tablet_bootstrap.cc:654] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:37.288550 13612 catalog_manager.cc:5697] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.271301 14298 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:37.312587 13612 catalog_manager.cc:5697] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:37.329823 13906 tablet_bootstrap.cc:492] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:37.330366 13906 ts_tablet_manager.cc:1403] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.022s
I20260709 13:05:37.332326 13906 raft_consensus.cc:359] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:37.332914 13906 raft_consensus.cc:385] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:37.333163 13906 raft_consensus.cc:740] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:37.333941 14298 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.333710 13906 consensus_queue.cc:260] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:37.334380 14298 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:37.335760 13906 ts_tablet_manager.cc:1434] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:05:37.336627 14298 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:37.337258 13906 tablet_bootstrap.cc:492] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7: Bootstrap starting.
I20260709 13:05:37.337219 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:37.337935 13713 raft_consensus.cc:2393] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 1: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:05:37.339514 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:37.340894 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:37.341949 14298 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:37.343532 13906 tablet_bootstrap.cc:654] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:37.348723 14298 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:37.348850 13906 tablet_bootstrap.cc:492] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7: No bootstrap required, opened a new log
I20260709 13:05:37.349500 13906 ts_tablet_manager.cc:1403] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7: Time spent bootstrapping tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 13:05:37.351883 13906 raft_consensus.cc:359] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:37.352535 13906 raft_consensus.cc:385] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:37.352772 13906 raft_consensus.cc:740] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Initialized, Role: FOLLOWER
I20260709 13:05:37.353432 13906 consensus_queue.cc:260] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:37.355439 13906 ts_tablet_manager.cc:1434] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:37.480798 14292 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:37.497697 14002 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:37.514051 14002 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:37.524031 14002 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:37.539117 14151 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:37.557629 14151 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:37.583647 14290 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:37.641970 14298 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.642482 14298 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:37.644488 14298 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:37.649416 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:37.652910 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:37.654349 13830 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:37.655262 14298 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:37.676249 13856 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:37.691840 14290 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:37.750022 14212 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:37.758184 13856 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:37.766987 14298 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.767469 14298 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:37.768617 14273 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:37.770193 14298 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:37.770699 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:05:37.772011 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:05:37.772653 14298 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:37.778203 13829 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:05:37.779838 14167 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.795836 14167 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:37.965819 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:38.001802 14356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:38.001943 14359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:38.003846 14357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:38.006376 12594 server_base.cc:1061] running on GCE node
I20260709 13:05:38.009013 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:38.009243 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:38.009514 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602338009491 us; error 0 us; skew 500 ppm
I20260709 13:05:38.010252 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:38.013618 12594 webserver.cc:533] Webserver started at http://127.12.76.132:39877/ using document root <none> and password file <none>
I20260709 13:05:38.014345 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:38.014627 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:38.015079 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:38.018404 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-3-root/instance:
uuid: "ceb06175847b428ea8bd77055fcddf58"
format_stamp: "Formatted at 2026-07-09 13:05:38 on dist-test-slave-th5x"
I20260709 13:05:38.024370 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 13:05:38.028476 14364 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:38.029696 12594 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:05:38.029973 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-3-root
uuid: "ceb06175847b428ea8bd77055fcddf58"
format_stamp: "Formatted at 2026-07-09 13:05:38 on dist-test-slave-th5x"
I20260709 13:05:38.030279 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:38.063716 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:38.065675 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:38.067773 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:38.070582 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:38.070839 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:38.071133 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:38.071352 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:38.166028 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.132:43039
I20260709 13:05:38.166147 14426 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.132:43039 every 8 connection(s)
I20260709 13:05:38.173733 12594 auto_leader_rebalancer-test.cc:384] add a tserver: ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:38.192576 14427 heartbeater.cc:344] Connected to a master server at 127.12.76.190:43389
I20260709 13:05:38.193440 14427 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:38.194437 14427 heartbeater.cc:507] Master 127.12.76.190:43389 requested a full tablet report, sending...
I20260709 13:05:38.196919 13613 ts_manager.cc:194] Registered new tserver with Master: ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:05:38.198987 13613 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57116
I20260709 13:05:38.569947 13865 consensus_queue.cc:237] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:38.577901 13716 raft_consensus.cc:1275] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:38.579926 14285 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.581966 13791 raft_consensus.cc:1275] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:38.586201 14298 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:38.592136 14167 raft_consensus.cc:2955] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
W20260709 13:05:38.603169 13829 consensus_peers.cc:597] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8446dab661a64f9b8075d7586f1197f4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.603401 13716 raft_consensus.cc:2955] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:38.615804 13791 raft_consensus.cc:2955] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:38.625837 13613 catalog_manager.cc:5697] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:38.669363 13710 consensus_queue.cc:237] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:38.677225 13865 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:38.679204 13789 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:38.679020 14002 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.680895 14212 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:38.689267 13680 consensus_peers.cc:597] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e7c254367a594ceb8d4a3db25a715ae1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.692420 14212 raft_consensus.cc:2955] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:38.694110 13865 raft_consensus.cc:2955] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:38.701692 13789 raft_consensus.cc:2955] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:38.712803 13612 catalog_manager.cc:5697] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:38.745838 13789 consensus_queue.cc:237] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:38.755259 13865 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:38.757639 13710 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:38.758980 14310 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.760246 14290 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.771720 14151 raft_consensus.cc:2955] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
W20260709 13:05:38.775133 13755 consensus_peers.cc:597] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0ff0635cc3464389804f1758fde23012. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.777693 13865 raft_consensus.cc:2955] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:38.787534 13716 consensus_queue.cc:237] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:38.788385 13710 raft_consensus.cc:2955] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:38.794726 13865 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:38.795516 13680 consensus_peers.cc:597] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3cfef71353344f180965689d6ec9166. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.797327 14273 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:38.799861 13789 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:38.799103 13612 catalog_manager.cc:5697] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:38.801944 14212 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.818186 14273 raft_consensus.cc:2955] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:38.821564 13789 raft_consensus.cc:2955] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:38.826560 13865 raft_consensus.cc:2955] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:38.838806 13612 catalog_manager.cc:5697] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:39.116339 14456 ts_tablet_manager.cc:933] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533)
I20260709 13:05:39.118206 14456 tablet_copy_client.cc:323] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.129:37533
I20260709 13:05:39.134305 13726 tablet_copy_service.cc:140] P b9d194f45e044e0988d5de1a99e5cd02: Received BeginTabletCopySession request for tablet e7c254367a594ceb8d4a3db25a715ae1 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:58552)
I20260709 13:05:39.134907 13726 tablet_copy_service.cc:161] P b9d194f45e044e0988d5de1a99e5cd02: Beginning new tablet copy session on tablet e7c254367a594ceb8d4a3db25a715ae1 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:58552: session id = ceb06175847b428ea8bd77055fcddf58-e7c254367a594ceb8d4a3db25a715ae1
I20260709 13:05:39.143648 14459 ts_tablet_manager.cc:933] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:39.146378 13726 tablet_copy_source_session.cc:215] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:39.150337 14456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7c254367a594ceb8d4a3db25a715ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.153560 14459 tablet_copy_client.cc:323] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.131:46015
I20260709 13:05:39.168282 14456 tablet_copy_client.cc:806] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:39.168999 14456 tablet_copy_client.cc:670] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:39.175952 14456 tablet_copy_client.cc:538] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:39.182753 13875 tablet_copy_service.cc:140] P b5029654a4384e43a68eb67b794949b7: Received BeginTabletCopySession request for tablet 8446dab661a64f9b8075d7586f1197f4 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:42104)
I20260709 13:05:39.183602 13875 tablet_copy_service.cc:161] P b5029654a4384e43a68eb67b794949b7: Beginning new tablet copy session on tablet 8446dab661a64f9b8075d7586f1197f4 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:42104: session id = ceb06175847b428ea8bd77055fcddf58-8446dab661a64f9b8075d7586f1197f4
I20260709 13:05:39.185266 14456 tablet_bootstrap.cc:492] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:39.191331 13875 tablet_copy_source_session.cc:215] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:39.202504 14427 heartbeater.cc:499] Master 127.12.76.190:43389 was elected leader, sending a full tablet report...
I20260709 13:05:39.203347 14459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8446dab661a64f9b8075d7586f1197f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.219276 14456 tablet_bootstrap.cc:492] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:39.220377 14456 tablet_bootstrap.cc:492] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:39.221102 14456 ts_tablet_manager.cc:1403] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.036s	user 0.024s	sys 0.007s
I20260709 13:05:39.224103 14456 raft_consensus.cc:359] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:39.225006 14456 raft_consensus.cc:740] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:39.226079 14459 tablet_copy_client.cc:806] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:39.226806 14459 tablet_copy_client.cc:670] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:39.225698 14456 consensus_queue.cc:260] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:39.234817 14456 ts_tablet_manager.cc:1434] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 13:05:39.236644 13726 tablet_copy_service.cc:342] P b9d194f45e044e0988d5de1a99e5cd02: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-e7c254367a594ceb8d4a3db25a715ae1 received from {username='slave'} at 127.0.0.1:58552
I20260709 13:05:39.236785 14459 tablet_copy_client.cc:538] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:39.237111 13726 tablet_copy_service.cc:434] P b9d194f45e044e0988d5de1a99e5cd02: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-e7c254367a594ceb8d4a3db25a715ae1 on tablet e7c254367a594ceb8d4a3db25a715ae1 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:39.246663 14459 tablet_bootstrap.cc:492] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:39.261157 14456 ts_tablet_manager.cc:933] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533)
I20260709 13:05:39.277755 14459 tablet_bootstrap.cc:492] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:39.278854 14459 tablet_bootstrap.cc:492] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:39.279680 14459 ts_tablet_manager.cc:1403] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.011s
I20260709 13:05:39.282496 14459 raft_consensus.cc:359] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:39.283566 14459 raft_consensus.cc:740] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:39.284266 14459 consensus_queue.cc:260] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:39.289316 14459 ts_tablet_manager.cc:1434] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 13:05:39.293795 13875 tablet_copy_service.cc:342] P b5029654a4384e43a68eb67b794949b7: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-8446dab661a64f9b8075d7586f1197f4 received from {username='slave'} at 127.0.0.1:42104
I20260709 13:05:39.294291 13875 tablet_copy_service.cc:434] P b5029654a4384e43a68eb67b794949b7: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-8446dab661a64f9b8075d7586f1197f4 on tablet 8446dab661a64f9b8075d7586f1197f4 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:39.298923 14459 ts_tablet_manager.cc:933] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:39.333043 14456 tablet_copy_client.cc:323] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.129:37533
I20260709 13:05:39.335537 14459 tablet_copy_client.cc:323] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.130:36047
I20260709 13:05:39.336858 13726 tablet_copy_service.cc:140] P b9d194f45e044e0988d5de1a99e5cd02: Received BeginTabletCopySession request for tablet f3cfef71353344f180965689d6ec9166 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:58552)
I20260709 13:05:39.341248 13726 tablet_copy_service.cc:161] P b9d194f45e044e0988d5de1a99e5cd02: Beginning new tablet copy session on tablet f3cfef71353344f180965689d6ec9166 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:58552: session id = ceb06175847b428ea8bd77055fcddf58-f3cfef71353344f180965689d6ec9166
I20260709 13:05:39.357841 13726 tablet_copy_source_session.cc:215] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:39.360970 14456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3cfef71353344f180965689d6ec9166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.381943 14456 tablet_copy_client.cc:806] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:39.382563 14456 tablet_copy_client.cc:670] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:39.387403 13801 tablet_copy_service.cc:140] P 35ecb005831740438d7537dd4b840e03: Received BeginTabletCopySession request for tablet 0ff0635cc3464389804f1758fde23012 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:45134)
I20260709 13:05:39.388129 13801 tablet_copy_service.cc:161] P 35ecb005831740438d7537dd4b840e03: Beginning new tablet copy session on tablet 0ff0635cc3464389804f1758fde23012 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:45134: session id = ceb06175847b428ea8bd77055fcddf58-0ff0635cc3464389804f1758fde23012
I20260709 13:05:39.395350 13801 tablet_copy_source_session.cc:215] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:39.396940 14456 tablet_copy_client.cc:538] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:39.404651 14459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff0635cc3464389804f1758fde23012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.406947 14456 tablet_bootstrap.cc:492] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:39.432710 14459 tablet_copy_client.cc:806] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:39.434653 14459 tablet_copy_client.cc:670] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:39.438282 14459 tablet_copy_client.cc:538] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:39.442131 14456 tablet_bootstrap.cc:492] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:39.443113 14456 tablet_bootstrap.cc:492] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:39.444268 14456 ts_tablet_manager.cc:1403] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.009s
I20260709 13:05:39.447468 14456 raft_consensus.cc:359] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:39.448365 14456 raft_consensus.cc:740] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:39.449038 14456 consensus_queue.cc:260] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:39.451098 14459 tablet_bootstrap.cc:492] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:39.451485 14456 ts_tablet_manager.cc:1434] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:39.453655 13726 tablet_copy_service.cc:342] P b9d194f45e044e0988d5de1a99e5cd02: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-f3cfef71353344f180965689d6ec9166 received from {username='slave'} at 127.0.0.1:58552
I20260709 13:05:39.454100 13726 tablet_copy_service.cc:434] P b9d194f45e044e0988d5de1a99e5cd02: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-f3cfef71353344f180965689d6ec9166 on tablet f3cfef71353344f180965689d6ec9166 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:39.481592 14459 tablet_bootstrap.cc:492] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:39.482332 14459 tablet_bootstrap.cc:492] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:39.482883 14459 ts_tablet_manager.cc:1403] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.032s	user 0.022s	sys 0.000s
I20260709 13:05:39.497450 14459 raft_consensus.cc:359] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:39.498041 14459 raft_consensus.cc:740] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:39.498646 14459 consensus_queue.cc:260] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:39.500913 14459 ts_tablet_manager.cc:1434] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:05:39.503064 13801 tablet_copy_service.cc:342] P 35ecb005831740438d7537dd4b840e03: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-0ff0635cc3464389804f1758fde23012 received from {username='slave'} at 127.0.0.1:45134
I20260709 13:05:39.503703 13801 tablet_copy_service.cc:434] P 35ecb005831740438d7537dd4b840e03: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-0ff0635cc3464389804f1758fde23012 on tablet 0ff0635cc3464389804f1758fde23012 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:39.512889 14402 raft_consensus.cc:1217] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:39.743336 14402 raft_consensus.cc:1217] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:39.855763 14402 raft_consensus.cc:1217] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:39.891665 14002 raft_consensus.cc:1064] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:05:39.894200 14002 consensus_queue.cc:237] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:39.899442 14402 raft_consensus.cc:1217] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:39.918239 13856 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:39.918239 14402 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:39.919461 13789 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:39.919742 14273 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:05:39.922372 14212 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:39.924115 14212 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:39.942950 14273 raft_consensus.cc:2955] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:39.946105 13789 raft_consensus.cc:2955] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:39.954609 14402 raft_consensus.cc:2955] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:39.959498 13856 raft_consensus.cc:2955] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:39.972378 13613 catalog_manager.cc:5697] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:39.995153 13710 consensus_queue.cc:237] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:40.001158 14402 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:40.002229 13789 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:40.003357 14474 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:40.004263 14273 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:40.012440 14273 raft_consensus.cc:2955] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.016976 13789 raft_consensus.cc:2955] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.025331 13600 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e7c254367a594ceb8d4a3db25a715ae1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:40.026139 14402 raft_consensus.cc:2955] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.039623 13614 catalog_manager.cc:5697] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.061300 13848 tablet_service.cc:1558] Processing DeleteTablet for tablet e7c254367a594ceb8d4a3db25a715ae1 with delete_type TABLET_DATA_TOMBSTONED (TS b5029654a4384e43a68eb67b794949b7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59764
I20260709 13:05:40.063190 14482 tablet_replica.cc:333] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:05:40.063959 14482 raft_consensus.cc:2243] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.064574 14482 raft_consensus.cc:2272] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.067116 14482 ts_tablet_manager.cc:1916] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:40.081866 14482 ts_tablet_manager.cc:1929] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:40.082396 14482 log.cc:1199] T e7c254367a594ceb8d4a3db25a715ae1 P b5029654a4384e43a68eb67b794949b7: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-2-root/wals/e7c254367a594ceb8d4a3db25a715ae1
I20260709 13:05:40.083983 13601 catalog_manager.cc:5028] TS b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): tablet e7c254367a594ceb8d4a3db25a715ae1 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:05:40.265702 14285 raft_consensus.cc:1064] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:05:40.268302 14285 consensus_queue.cc:237] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:40.274951 14402 raft_consensus.cc:1275] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.278504 13791 raft_consensus.cc:1275] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.276948 14471 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:05:40.277714 13716 raft_consensus.cc:1275] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.283805 14484 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:40.285617 14285 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:40.318730 14484 raft_consensus.cc:2955] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.321969 14402 raft_consensus.cc:2955] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.337618 13611 catalog_manager.cc:5697] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.346233 13790 raft_consensus.cc:2955] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.381318 13716 raft_consensus.cc:2955] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.389873 14474 raft_consensus.cc:1064] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:05:40.392390 14474 consensus_queue.cc:237] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:40.417819 13865 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.419351 14402 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.423894 14002 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:40.425913 14273 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:40.430326 13790 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.437211 14002 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:40.436924 13865 consensus_queue.cc:237] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:40.450281 14401 raft_consensus.cc:1275] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:40.451833 14290 raft_consensus.cc:1064] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:05:40.452896 14273 raft_consensus.cc:2955] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.454077 14290 consensus_queue.cc:237] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:40.456027 14484 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:40.461580 14401 raft_consensus.cc:2955] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.463649 14285 raft_consensus.cc:2955] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.465181 14402 raft_consensus.cc:2955] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.475389 13716 raft_consensus.cc:1275] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:40.477120 14487 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:40.481679 13716 raft_consensus.cc:2955] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.487061 13612 catalog_manager.cc:5697] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.490032 13601 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8446dab661a64f9b8075d7586f1197f4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:40.501099 13865 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.502720 14151 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:40.503496 14402 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.506222 14495 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:40.508047 13710 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:40.508430 13611 catalog_manager.cc:5697] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.509148 13865 raft_consensus.cc:2955] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.525924 13790 raft_consensus.cc:2955] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.537166 13777 tablet_service.cc:1558] Processing DeleteTablet for tablet 8446dab661a64f9b8075d7586f1197f4 with delete_type TABLET_DATA_TOMBSTONED (TS 35ecb005831740438d7537dd4b840e03 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48902
I20260709 13:05:40.513411 14290 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:05:40.544302 14495 raft_consensus.cc:2955] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.561645 14401 raft_consensus.cc:2955] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.572036 13856 raft_consensus.cc:2955] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.581568 13710 consensus_queue.cc:237] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:40.595726 13790 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:40.600894 14273 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:40.582044 13716 raft_consensus.cc:2955] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.608143 14402 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:40.611562 14491 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:40.610401 14273 raft_consensus.cc:2955] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.621208 13612 catalog_manager.cc:5697] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.624073 14499 tablet_replica.cc:333] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:05:40.623515 13790 raft_consensus.cc:2955] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.627588 14402 raft_consensus.cc:2955] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.647128 13600 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f3cfef71353344f180965689d6ec9166 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:40.625178 14499 raft_consensus.cc:2243] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.656664 14499 raft_consensus.cc:2272] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.658771 13612 catalog_manager.cc:5697] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.667614 14499 ts_tablet_manager.cc:1916] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:40.670626 13848 tablet_service.cc:1558] Processing DeleteTablet for tablet f3cfef71353344f180965689d6ec9166 with delete_type TABLET_DATA_TOMBSTONED (TS b5029654a4384e43a68eb67b794949b7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59764
I20260709 13:05:40.690994 14502 tablet_replica.cc:333] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:05:40.691706 13790 consensus_queue.cc:237] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:40.692157 14502 raft_consensus.cc:2243] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.743058 14502 raft_consensus.cc:2272] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.761575 14499 ts_tablet_manager.cc:1929] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:40.762087 14499 log.cc:1199] T 8446dab661a64f9b8075d7586f1197f4 P 35ecb005831740438d7537dd4b840e03: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-1-root/wals/8446dab661a64f9b8075d7586f1197f4
I20260709 13:05:40.765736 14502 ts_tablet_manager.cc:1916] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:40.772145 13599 catalog_manager.cc:5028] TS 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): tablet 8446dab661a64f9b8075d7586f1197f4 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:05:40.777750 14402 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:40.781011 14151 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:40.783497 13856 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:40.791517 14505 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:40.794833 14290 raft_consensus.cc:2955] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.796376 14402 raft_consensus.cc:2955] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.803683 14502 ts_tablet_manager.cc:1929] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:40.804225 14502 log.cc:1199] T f3cfef71353344f180965689d6ec9166 P b5029654a4384e43a68eb67b794949b7: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-2-root/wals/f3cfef71353344f180965689d6ec9166
I20260709 13:05:40.806082 13601 catalog_manager.cc:5028] TS b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): tablet f3cfef71353344f180965689d6ec9166 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:05:40.810534 13614 catalog_manager.cc:5697] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.812323 13856 raft_consensus.cc:2955] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:40.823177 13703 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ff0635cc3464389804f1758fde23012 with delete_type TABLET_DATA_TOMBSTONED (TS b9d194f45e044e0988d5de1a99e5cd02 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49478
I20260709 13:05:40.829769 13599 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0ff0635cc3464389804f1758fde23012 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:40.833033 14506 tablet_replica.cc:333] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:05:40.834362 14506 raft_consensus.cc:2243] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.835041 14506 raft_consensus.cc:2272] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.838337 14506 ts_tablet_manager.cc:1916] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:40.850829 14506 ts_tablet_manager.cc:1929] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:40.851239 14506 log.cc:1199] T 0ff0635cc3464389804f1758fde23012 P b9d194f45e044e0988d5de1a99e5cd02: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-0-root/wals/0ff0635cc3464389804f1758fde23012
I20260709 13:05:40.853045 13600 catalog_manager.cc:5028] TS b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): tablet 0ff0635cc3464389804f1758fde23012 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:05:41.885893 13716 consensus_queue.cc:237] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:41.891700 13856 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:41.891800 13680 consensus_peers.cc:597] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff2185b760234a0280587d4ea3f18b8a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:41.892541 13791 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:41.893239 14273 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.894059 14212 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.901412 14273 raft_consensus.cc:2955] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:41.905633 13791 raft_consensus.cc:2955] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:41.909368 13856 raft_consensus.cc:2955] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:41.923924 13791 consensus_queue.cc:237] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:41.923717 13614 catalog_manager.cc:5697] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:41.930653 13865 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:41.931567 13716 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:41.932035 13755 consensus_peers.cc:597] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 14765cc3066247a49b29adae5e893ab8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:41.932305 14151 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.933238 14507 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.949643 14151 raft_consensus.cc:2955] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:41.962064 13863 raft_consensus.cc:2955] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:41.974418 13716 raft_consensus.cc:2955] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:41.996840 13863 consensus_queue.cc:237] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:42.045104 13791 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:42.046816 13829 consensus_peers.cc:597] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3e4bec6398d84f67ad839268ec8d2a12. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:42.047222 14487 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:42.050406 13614 catalog_manager.cc:5697] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:42.051515 13716 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:42.057080 14484 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:42.070307 14521 log.cc:927] Time spent T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.031s
I20260709 13:05:42.088510 14487 raft_consensus.cc:2955] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:42.095434 13713 raft_consensus.cc:2955] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:42.101449 13791 raft_consensus.cc:2955] T 3e4bec6398d84f67ad839268ec8d2a12 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:42.114759 13790 consensus_queue.cc:237] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:42.129480 13611 catalog_manager.cc:5697] T 3e4bec6398d84f67ad839268ec8d2a12 P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
W20260709 13:05:42.135694 13755 consensus_peers.cc:597] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fa2169d517e24498a35dae28da79c931. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:42.138334 13863 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:42.139876 14507 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.140292 13710 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:42.143090 14507 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.158334 14505 raft_consensus.cc:2955] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:42.164440 13863 raft_consensus.cc:2955] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:42.168848 13713 raft_consensus.cc:2955] T fa2169d517e24498a35dae28da79c931 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:42.182101 13612 catalog_manager.cc:5697] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:42.287874 14529 ts_tablet_manager.cc:933] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533)
I20260709 13:05:42.290367 14529 tablet_copy_client.cc:323] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.129:37533
I20260709 13:05:42.292371 13726 tablet_copy_service.cc:140] P b9d194f45e044e0988d5de1a99e5cd02: Received BeginTabletCopySession request for tablet ff2185b760234a0280587d4ea3f18b8a from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:58552)
I20260709 13:05:42.293081 13726 tablet_copy_service.cc:161] P b9d194f45e044e0988d5de1a99e5cd02: Beginning new tablet copy session on tablet ff2185b760234a0280587d4ea3f18b8a from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:58552: session id = ceb06175847b428ea8bd77055fcddf58-ff2185b760234a0280587d4ea3f18b8a
I20260709 13:05:42.298856 13726 tablet_copy_source_session.cc:215] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:42.301728 14529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2185b760234a0280587d4ea3f18b8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.315263 14529 tablet_copy_client.cc:806] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:42.315858 14529 tablet_copy_client.cc:670] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:42.321408 14529 tablet_copy_client.cc:538] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:42.330322 14529 tablet_bootstrap.cc:492] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:42.394142 14529 tablet_bootstrap.cc:492] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:42.395105 14529 tablet_bootstrap.cc:492] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:42.396075 14529 ts_tablet_manager.cc:1403] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.066s	user 0.035s	sys 0.028s
I20260709 13:05:42.398967 14529 raft_consensus.cc:359] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:42.399904 14529 raft_consensus.cc:740] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:42.400529 14529 consensus_queue.cc:260] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:42.403676 14529 ts_tablet_manager.cc:1434] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:05:42.405345 13726 tablet_copy_service.cc:342] P b9d194f45e044e0988d5de1a99e5cd02: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-ff2185b760234a0280587d4ea3f18b8a received from {username='slave'} at 127.0.0.1:58552
I20260709 13:05:42.405735 13726 tablet_copy_service.cc:434] P b9d194f45e044e0988d5de1a99e5cd02: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-ff2185b760234a0280587d4ea3f18b8a on tablet ff2185b760234a0280587d4ea3f18b8a with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:42.416610 14529 ts_tablet_manager.cc:933] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:42.418363 14529 tablet_copy_client.cc:323] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.130:36047
I20260709 13:05:42.419906 13801 tablet_copy_service.cc:140] P 35ecb005831740438d7537dd4b840e03: Received BeginTabletCopySession request for tablet 14765cc3066247a49b29adae5e893ab8 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:45134)
I20260709 13:05:42.420435 13801 tablet_copy_service.cc:161] P 35ecb005831740438d7537dd4b840e03: Beginning new tablet copy session on tablet 14765cc3066247a49b29adae5e893ab8 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:45134: session id = ceb06175847b428ea8bd77055fcddf58-14765cc3066247a49b29adae5e893ab8
I20260709 13:05:42.428002 13801 tablet_copy_source_session.cc:215] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:42.430976 14529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14765cc3066247a49b29adae5e893ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.442862 14529 tablet_copy_client.cc:806] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:42.443454 14529 tablet_copy_client.cc:670] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:42.447335 14529 tablet_copy_client.cc:538] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:42.455470 14529 tablet_bootstrap.cc:492] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:42.473351 14529 tablet_bootstrap.cc:492] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:42.474062 14529 tablet_bootstrap.cc:492] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:42.475030 14529 ts_tablet_manager.cc:1403] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 13:05:42.477658 14529 raft_consensus.cc:359] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:42.478600 14529 raft_consensus.cc:740] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:42.479290 14529 consensus_queue.cc:260] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:42.481555 14529 ts_tablet_manager.cc:1434] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.003s
I20260709 13:05:42.483170 13801 tablet_copy_service.cc:342] P 35ecb005831740438d7537dd4b840e03: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-14765cc3066247a49b29adae5e893ab8 received from {username='slave'} at 127.0.0.1:45134
I20260709 13:05:42.483592 13801 tablet_copy_service.cc:434] P 35ecb005831740438d7537dd4b840e03: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-14765cc3066247a49b29adae5e893ab8 on tablet 14765cc3066247a49b29adae5e893ab8 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:42.598766 14529 ts_tablet_manager.cc:933] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:42.600517 14529 tablet_copy_client.cc:323] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.131:46015
I20260709 13:05:42.602073 13875 tablet_copy_service.cc:140] P b5029654a4384e43a68eb67b794949b7: Received BeginTabletCopySession request for tablet 3e4bec6398d84f67ad839268ec8d2a12 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:42104)
I20260709 13:05:42.602599 13875 tablet_copy_service.cc:161] P b5029654a4384e43a68eb67b794949b7: Beginning new tablet copy session on tablet 3e4bec6398d84f67ad839268ec8d2a12 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:42104: session id = ceb06175847b428ea8bd77055fcddf58-3e4bec6398d84f67ad839268ec8d2a12
I20260709 13:05:42.609772 13875 tablet_copy_source_session.cc:215] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:42.612563 14529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e4bec6398d84f67ad839268ec8d2a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.622592 14529 tablet_copy_client.cc:806] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:42.623119 14529 tablet_copy_client.cc:670] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:42.626672 14529 tablet_copy_client.cc:538] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:42.634321 14529 tablet_bootstrap.cc:492] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:42.667852 14529 tablet_bootstrap.cc:492] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:42.668687 14529 tablet_bootstrap.cc:492] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:42.669307 14529 ts_tablet_manager.cc:1403] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.000s
I20260709 13:05:42.671859 14529 raft_consensus.cc:359] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:42.672598 14529 raft_consensus.cc:740] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:42.673158 14529 consensus_queue.cc:260] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:42.675232 14529 ts_tablet_manager.cc:1434] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:42.677130 13875 tablet_copy_service.cc:342] P b5029654a4384e43a68eb67b794949b7: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-3e4bec6398d84f67ad839268ec8d2a12 received from {username='slave'} at 127.0.0.1:42104
I20260709 13:05:42.677541 13875 tablet_copy_service.cc:434] P b5029654a4384e43a68eb67b794949b7: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-3e4bec6398d84f67ad839268ec8d2a12 on tablet 3e4bec6398d84f67ad839268ec8d2a12 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:42.741394 14529 ts_tablet_manager.cc:933] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:42.742929 14529 tablet_copy_client.cc:323] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.130:36047
I20260709 13:05:42.744477 13801 tablet_copy_service.cc:140] P 35ecb005831740438d7537dd4b840e03: Received BeginTabletCopySession request for tablet fa2169d517e24498a35dae28da79c931 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:45134)
I20260709 13:05:42.744971 13801 tablet_copy_service.cc:161] P 35ecb005831740438d7537dd4b840e03: Beginning new tablet copy session on tablet fa2169d517e24498a35dae28da79c931 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:45134: session id = ceb06175847b428ea8bd77055fcddf58-fa2169d517e24498a35dae28da79c931
I20260709 13:05:42.751289 13801 tablet_copy_source_session.cc:215] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:42.754061 14529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa2169d517e24498a35dae28da79c931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.769549 14529 tablet_copy_client.cc:806] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:42.770125 14529 tablet_copy_client.cc:670] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:42.774293 14529 tablet_copy_client.cc:538] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:42.780234 14529 tablet_bootstrap.cc:492] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:42.803067 14529 tablet_bootstrap.cc:492] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:42.804031 14529 tablet_bootstrap.cc:492] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:42.804648 14529 ts_tablet_manager.cc:1403] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.003s
I20260709 13:05:42.807389 14529 raft_consensus.cc:359] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:42.808194 14529 raft_consensus.cc:740] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:42.808962 14529 consensus_queue.cc:260] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:42.812675 14529 ts_tablet_manager.cc:1434] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:05:42.814864 13801 tablet_copy_service.cc:342] P 35ecb005831740438d7537dd4b840e03: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-fa2169d517e24498a35dae28da79c931 received from {username='slave'} at 127.0.0.1:45134
I20260709 13:05:42.815321 13801 tablet_copy_service.cc:434] P 35ecb005831740438d7537dd4b840e03: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-fa2169d517e24498a35dae28da79c931 on tablet fa2169d517e24498a35dae28da79c931 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:42.858708 14402 raft_consensus.cc:1217] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:42.884101 14402 raft_consensus.cc:1217] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:43.009528 14402 raft_consensus.cc:1217] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:43.226402 14402 raft_consensus.cc:1217] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:43.378710 14151 raft_consensus.cc:1064] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:05:43.381310 14151 consensus_queue.cc:237] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:43.388378 14401 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:43.389883 14525 raft_consensus.cc:1064] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:05:43.391119 14541 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:43.391628 13856 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:43.392941 14505 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:43.392339 14525 consensus_queue.cc:237] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:43.395519 13713 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:43.400655 14541 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:43.413959 14151 raft_consensus.cc:2955] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:43.421111 14401 raft_consensus.cc:2955] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:43.419575 13862 raft_consensus.cc:2955] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:43.433600 14513 raft_consensus.cc:1064] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:05:43.442487 14402 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:43.443061 13791 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:43.444329 14537 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:43.448401 14513 consensus_queue.cc:237] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:43.456080 13713 raft_consensus.cc:2955] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:43.458983 14537 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:43.467108 13614 catalog_manager.cc:5697] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:43.490060 13716 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:43.490397 13856 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:43.492849 14538 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:43.494117 14513 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:43.511291 14401 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:43.511564 13791 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:43.516042 13791 consensus_queue.cc:237] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:43.516460 14549 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:43.526345 14402 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:43.528831 14525 raft_consensus.cc:2955] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:43.530090 14541 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:43.536721 14549 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:43.542663 13710 raft_consensus.cc:2955] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:43.545991 14541 raft_consensus.cc:2955] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:43.549319 14401 raft_consensus.cc:2955] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:43.559100 14402 raft_consensus.cc:2955] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:43.567355 13789 raft_consensus.cc:2955] T 3e4bec6398d84f67ad839268ec8d2a12 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:43.585963 13599 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 14765cc3066247a49b29adae5e893ab8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:43.593348 13611 catalog_manager.cc:5697] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:43.610267 13862 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:43.612272 13703 tablet_service.cc:1558] Processing DeleteTablet for tablet 14765cc3066247a49b29adae5e893ab8 with delete_type TABLET_DATA_TOMBSTONED (TS b9d194f45e044e0988d5de1a99e5cd02 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49478
I20260709 13:05:43.618469 13611 catalog_manager.cc:5697] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:43.621162 14151 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:43.645328 13862 raft_consensus.cc:2955] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:43.649969 14568 tablet_replica.cc:333] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
W20260709 13:05:43.650123 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 69618.6us
I20260709 13:05:43.651835 14554 raft_consensus.cc:2955] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:43.651585 14568 raft_consensus.cc:2243] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.655575 14568 raft_consensus.cc:2272] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.659236 14568 ts_tablet_manager.cc:1916] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:43.668334 13791 raft_consensus.cc:2955] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:05:43.671293 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 126218us
I20260709 13:05:43.682551 14402 raft_consensus.cc:2955] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:43.683399 14568 ts_tablet_manager.cc:1929] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:43.684012 14568 log.cc:1199] T 14765cc3066247a49b29adae5e893ab8 P b9d194f45e044e0988d5de1a99e5cd02: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-0-root/wals/14765cc3066247a49b29adae5e893ab8
I20260709 13:05:43.683733 13856 raft_consensus.cc:2955] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:43.692433 14151 raft_consensus.cc:1064] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:05:43.694700 14151 consensus_queue.cc:237] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:43.727653 13600 catalog_manager.cc:5028] TS b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): tablet 14765cc3066247a49b29adae5e893ab8 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:05:43.739511 13710 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:43.782298 13856 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:43.793494 14561 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:43.798254 13862 consensus_queue.cc:237] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:43.810559 14566 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:43.815760 13611 catalog_manager.cc:5697] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:05:43.837306 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 60282.5us
I20260709 13:05:43.877646 14402 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:43.881618 13716 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:43.885372 14537 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:43.886675 14563 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:43.900108 14402 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:43.913563 14572 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:43.897902 13716 consensus_queue.cc:237] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:43.930311 14400 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:43.932425 14513 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:43.940215 13856 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:43.938628 14563 raft_consensus.cc:2955] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:43.944491 14513 raft_consensus.cc:2955] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:43.947275 14549 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:43.967988 13716 raft_consensus.cc:2955] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:43.969219 14400 raft_consensus.cc:2955] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:43.993846 14402 raft_consensus.cc:2955] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:43.994473 13865 raft_consensus.cc:2955] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:44.028962 14505 raft_consensus.cc:2955] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:44.051890 13601 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3e4bec6398d84f67ad839268ec8d2a12 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:44.042266 13715 raft_consensus.cc:2955] T fa2169d517e24498a35dae28da79c931 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:44.052839 13600 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ff2185b760234a0280587d4ea3f18b8a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:44.064143 14400 raft_consensus.cc:2955] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:44.069726 13856 raft_consensus.cc:2955] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:44.073288 13612 catalog_manager.cc:5697] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:44.093554 13613 catalog_manager.cc:5697] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:44.094509 13614 catalog_manager.cc:5697] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:44.127746 13777 tablet_service.cc:1558] Processing DeleteTablet for tablet ff2185b760234a0280587d4ea3f18b8a with delete_type TABLET_DATA_TOMBSTONED (TS 35ecb005831740438d7537dd4b840e03 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48902
I20260709 13:05:44.131174 13790 consensus_queue.cc:237] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:44.141173 13780 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e4bec6398d84f67ad839268ec8d2a12 with delete_type TABLET_DATA_TOMBSTONED (TS 35ecb005831740438d7537dd4b840e03 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48902
I20260709 13:05:44.150034 14400 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:44.154717 14570 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:44.158403 14577 tablet_replica.cc:333] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:05:44.159960 14577 raft_consensus.cc:2243] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:44.160254 13865 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:44.161684 14505 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:44.161175 14577 raft_consensus.cc:2272] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:44.168613 14577 ts_tablet_manager.cc:1916] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:44.177464 14400 raft_consensus.cc:2955] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:44.172673 14505 raft_consensus.cc:2955] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:44.188854 13865 raft_consensus.cc:2955] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:44.192571 13614 catalog_manager.cc:5697] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:44.196059 13599 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fa2169d517e24498a35dae28da79c931 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:44.222379 13703 tablet_service.cc:1558] Processing DeleteTablet for tablet fa2169d517e24498a35dae28da79c931 with delete_type TABLET_DATA_TOMBSTONED (TS b9d194f45e044e0988d5de1a99e5cd02 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49478
I20260709 13:05:44.225298 14578 tablet_replica.cc:333] T fa2169d517e24498a35dae28da79c931 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:05:44.226451 14578 raft_consensus.cc:2243] T fa2169d517e24498a35dae28da79c931 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:44.227386 14578 raft_consensus.cc:2272] T fa2169d517e24498a35dae28da79c931 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:44.228403 14577 ts_tablet_manager.cc:1929] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:44.229079 14577 log.cc:1199] T ff2185b760234a0280587d4ea3f18b8a P 35ecb005831740438d7537dd4b840e03: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-1-root/wals/ff2185b760234a0280587d4ea3f18b8a
I20260709 13:05:44.230636 14578 ts_tablet_manager.cc:1916] T fa2169d517e24498a35dae28da79c931 P b9d194f45e044e0988d5de1a99e5cd02: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:44.233052 14577 tablet_replica.cc:333] T 3e4bec6398d84f67ad839268ec8d2a12 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:05:44.234247 14577 raft_consensus.cc:2243] T 3e4bec6398d84f67ad839268ec8d2a12 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:44.235050 14577 raft_consensus.cc:2272] T 3e4bec6398d84f67ad839268ec8d2a12 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:44.235699 13599 catalog_manager.cc:5028] TS 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): tablet ff2185b760234a0280587d4ea3f18b8a (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:05:44.238852 14577 ts_tablet_manager.cc:1916] T 3e4bec6398d84f67ad839268ec8d2a12 P 35ecb005831740438d7537dd4b840e03: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:44.245972 14578 ts_tablet_manager.cc:1929] T fa2169d517e24498a35dae28da79c931 P b9d194f45e044e0988d5de1a99e5cd02: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:44.246510 14578 log.cc:1199] T fa2169d517e24498a35dae28da79c931 P b9d194f45e044e0988d5de1a99e5cd02: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-0-root/wals/fa2169d517e24498a35dae28da79c931
I20260709 13:05:44.247987 13600 catalog_manager.cc:5028] TS b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): tablet fa2169d517e24498a35dae28da79c931 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:05:44.252194 14577 ts_tablet_manager.cc:1929] T 3e4bec6398d84f67ad839268ec8d2a12 P 35ecb005831740438d7537dd4b840e03: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:44.252592 14577 log.cc:1199] T 3e4bec6398d84f67ad839268ec8d2a12 P 35ecb005831740438d7537dd4b840e03: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-1-root/wals/3e4bec6398d84f67ad839268ec8d2a12
I20260709 13:05:44.253954 13599 catalog_manager.cc:5028] TS 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): tablet 3e4bec6398d84f67ad839268ec8d2a12 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:05:45.293673 13790 consensus_queue.cc:237] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:45.302820 13865 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:45.304193 13715 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:45.304473 13755 consensus_peers.cc:597] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bb9ba3c4f4a14a57b28d5cf2b9cf5afd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.306319 14579 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:45.307289 14564 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.315536 14572 raft_consensus.cc:2955] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:45.320320 13715 raft_consensus.cc:2955] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:45.321290 13863 raft_consensus.cc:2955] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:45.336061 13715 consensus_queue.cc:237] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:45.336735 13611 catalog_manager.cc:5697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.354705 13863 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:45.354696 13680 consensus_peers.cc:597] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 397ec99b74c24481a69c1f4a7c294a73. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.355770 13789 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:45.356235 14554 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:45.357439 14549 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.368155 14554 raft_consensus.cc:2955] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:45.372316 13789 raft_consensus.cc:2955] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:45.379602 13863 raft_consensus.cc:2955] T 397ec99b74c24481a69c1f4a7c294a73 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:45.392275 13865 consensus_queue.cc:237] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:45.397737 13614 catalog_manager.cc:5697] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:45.432346 13829 consensus_peers.cc:597] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 82e0eeb1582143a09acf311171812faa. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.434628 13789 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:45.437449 14563 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.437664 13715 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:45.442632 14563 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.450321 14591 raft_consensus.cc:2955] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:45.455106 13789 raft_consensus.cc:2955] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:45.457121 13715 raft_consensus.cc:2955] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:45.470575 13611 catalog_manager.cc:5697] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.473924 13789 consensus_queue.cc:237] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:45.481604 13865 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:45.481606 13715 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:45.482612 13755 consensus_peers.cc:597] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ac7aedfecb9c482a9cf59234dff1e9f8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.483121 14572 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.484048 14579 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.509160 14579 raft_consensus.cc:2955] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:45.513723 13865 raft_consensus.cc:2955] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:45.514423 13715 raft_consensus.cc:2955] T ac7aedfecb9c482a9cf59234dff1e9f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:45.530468 13611 catalog_manager.cc:5697] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:45.735860 14599 ts_tablet_manager.cc:933] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:45.740597 14599 tablet_copy_client.cc:323] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.130:36047
I20260709 13:05:45.742388 13801 tablet_copy_service.cc:140] P 35ecb005831740438d7537dd4b840e03: Received BeginTabletCopySession request for tablet bb9ba3c4f4a14a57b28d5cf2b9cf5afd from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:45134)
I20260709 13:05:45.742839 13801 tablet_copy_service.cc:161] P 35ecb005831740438d7537dd4b840e03: Beginning new tablet copy session on tablet bb9ba3c4f4a14a57b28d5cf2b9cf5afd from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:45134: session id = ceb06175847b428ea8bd77055fcddf58-bb9ba3c4f4a14a57b28d5cf2b9cf5afd
I20260709 13:05:45.749034 13801 tablet_copy_source_session.cc:215] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:45.751832 14599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb9ba3c4f4a14a57b28d5cf2b9cf5afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.768778 14599 tablet_copy_client.cc:806] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:45.769357 14599 tablet_copy_client.cc:670] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:45.772931 14599 tablet_copy_client.cc:538] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:45.781867 14599 tablet_bootstrap.cc:492] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:45.802668 14599 tablet_bootstrap.cc:492] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:45.803643 14599 tablet_bootstrap.cc:492] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:45.805231 14599 ts_tablet_manager.cc:1403] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.008s
I20260709 13:05:45.808511 14599 raft_consensus.cc:359] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:45.809433 14599 raft_consensus.cc:740] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:45.810142 14599 consensus_queue.cc:260] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:45.811743 14602 ts_tablet_manager.cc:933] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:45.814095 14599 ts_tablet_manager.cc:1434] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:05:45.816032 13801 tablet_copy_service.cc:342] P 35ecb005831740438d7537dd4b840e03: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-bb9ba3c4f4a14a57b28d5cf2b9cf5afd received from {username='slave'} at 127.0.0.1:45134
I20260709 13:05:45.816514 13801 tablet_copy_service.cc:434] P 35ecb005831740438d7537dd4b840e03: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-bb9ba3c4f4a14a57b28d5cf2b9cf5afd on tablet bb9ba3c4f4a14a57b28d5cf2b9cf5afd with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:45.816356 14602 tablet_copy_client.cc:323] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.131:46015
I20260709 13:05:45.821206 13875 tablet_copy_service.cc:140] P b5029654a4384e43a68eb67b794949b7: Received BeginTabletCopySession request for tablet 82e0eeb1582143a09acf311171812faa from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:42104)
I20260709 13:05:45.821745 13875 tablet_copy_service.cc:161] P b5029654a4384e43a68eb67b794949b7: Beginning new tablet copy session on tablet 82e0eeb1582143a09acf311171812faa from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:42104: session id = ceb06175847b428ea8bd77055fcddf58-82e0eeb1582143a09acf311171812faa
I20260709 13:05:45.829722 13875 tablet_copy_source_session.cc:215] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:45.833397 14602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e0eeb1582143a09acf311171812faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.840382 14599 ts_tablet_manager.cc:933] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533)
I20260709 13:05:45.849733 14602 tablet_copy_client.cc:806] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:45.850498 14602 tablet_copy_client.cc:670] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:45.850652 14599 tablet_copy_client.cc:323] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.129:37533
I20260709 13:05:45.852823 13726 tablet_copy_service.cc:140] P b9d194f45e044e0988d5de1a99e5cd02: Received BeginTabletCopySession request for tablet 397ec99b74c24481a69c1f4a7c294a73 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:58552)
I20260709 13:05:45.853471 13726 tablet_copy_service.cc:161] P b9d194f45e044e0988d5de1a99e5cd02: Beginning new tablet copy session on tablet 397ec99b74c24481a69c1f4a7c294a73 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:58552: session id = ceb06175847b428ea8bd77055fcddf58-397ec99b74c24481a69c1f4a7c294a73
I20260709 13:05:45.854871 14602 tablet_copy_client.cc:538] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:45.863341 13726 tablet_copy_source_session.cc:215] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:45.866601 14606 ts_tablet_manager.cc:933] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:45.878289 14599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 397ec99b74c24481a69c1f4a7c294a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.891744 14606 tablet_copy_client.cc:323] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.130:36047
I20260709 13:05:45.894337 13801 tablet_copy_service.cc:140] P 35ecb005831740438d7537dd4b840e03: Received BeginTabletCopySession request for tablet ac7aedfecb9c482a9cf59234dff1e9f8 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:45134)
I20260709 13:05:45.894868 13801 tablet_copy_service.cc:161] P 35ecb005831740438d7537dd4b840e03: Beginning new tablet copy session on tablet ac7aedfecb9c482a9cf59234dff1e9f8 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:45134: session id = ceb06175847b428ea8bd77055fcddf58-ac7aedfecb9c482a9cf59234dff1e9f8
I20260709 13:05:45.900174 14602 tablet_bootstrap.cc:492] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:45.903507 13801 tablet_copy_source_session.cc:215] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:45.906836 14606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac7aedfecb9c482a9cf59234dff1e9f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:45.910473 14599 tablet_copy_client.cc:806] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:45.911554 14599 tablet_copy_client.cc:670] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:45.915283 14599 tablet_copy_client.cc:538] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:45.925715 14599 tablet_bootstrap.cc:492] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:45.936684 14606 tablet_copy_client.cc:806] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:45.937363 14606 tablet_copy_client.cc:670] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:45.944698 14606 tablet_copy_client.cc:538] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:45.958688 14599 tablet_bootstrap.cc:492] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:45.959637 14599 tablet_bootstrap.cc:492] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:45.960311 14599 ts_tablet_manager.cc:1403] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.009s
I20260709 13:05:45.963153 14599 raft_consensus.cc:359] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:45.964854 14599 raft_consensus.cc:740] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:45.965474 14599 consensus_queue.cc:260] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:45.968359 14599 ts_tablet_manager.cc:1434] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:45.972038 13726 tablet_copy_service.cc:342] P b9d194f45e044e0988d5de1a99e5cd02: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-397ec99b74c24481a69c1f4a7c294a73 received from {username='slave'} at 127.0.0.1:58552
I20260709 13:05:45.972458 13726 tablet_copy_service.cc:434] P b9d194f45e044e0988d5de1a99e5cd02: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-397ec99b74c24481a69c1f4a7c294a73 on tablet 397ec99b74c24481a69c1f4a7c294a73 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:45.975195 14606 tablet_bootstrap.cc:492] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:45.985998 14602 tablet_bootstrap.cc:492] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:45.986955 14602 tablet_bootstrap.cc:492] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:45.987664 14602 ts_tablet_manager.cc:1403] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.088s	user 0.016s	sys 0.010s
I20260709 13:05:45.995307 14602 raft_consensus.cc:359] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:45.996158 14602 raft_consensus.cc:740] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:45.996843 14602 consensus_queue.cc:260] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:45.999401 14602 ts_tablet_manager.cc:1434] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 13:05:46.001168 13875 tablet_copy_service.cc:342] P b5029654a4384e43a68eb67b794949b7: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-82e0eeb1582143a09acf311171812faa received from {username='slave'} at 127.0.0.1:42104
I20260709 13:05:46.001626 13875 tablet_copy_service.cc:434] P b5029654a4384e43a68eb67b794949b7: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-82e0eeb1582143a09acf311171812faa on tablet 82e0eeb1582143a09acf311171812faa with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:46.014374 14606 tablet_bootstrap.cc:492] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:46.015180 14606 tablet_bootstrap.cc:492] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:46.015746 14606 ts_tablet_manager.cc:1403] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.004s
I20260709 13:05:46.018499 14606 raft_consensus.cc:359] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:46.019074 14606 raft_consensus.cc:740] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:46.019663 14606 consensus_queue.cc:260] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:46.021642 14606 ts_tablet_manager.cc:1434] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:46.023607 13801 tablet_copy_service.cc:342] P 35ecb005831740438d7537dd4b840e03: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-ac7aedfecb9c482a9cf59234dff1e9f8 received from {username='slave'} at 127.0.0.1:45134
I20260709 13:05:46.023976 13801 tablet_copy_service.cc:434] P 35ecb005831740438d7537dd4b840e03: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-ac7aedfecb9c482a9cf59234dff1e9f8 on tablet ac7aedfecb9c482a9cf59234dff1e9f8 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:46.185252 14400 raft_consensus.cc:1217] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:46.195811 14400 raft_consensus.cc:1217] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:46.274989 14400 raft_consensus.cc:1217] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:46.392761 14400 raft_consensus.cc:1217] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:46.715294 14525 raft_consensus.cc:1064] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:05:46.717247 14525 consensus_queue.cc:237] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:46.723482 14400 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:46.724073 13789 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:46.725906 13711 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:46.726390 14612 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.728155 14612 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.729058 14579 raft_consensus.cc:1064] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:05:46.729950 14612 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.739360 14579 consensus_queue.cc:237] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:46.776372 13865 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:46.779199 13715 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:46.778199 14549 raft_consensus.cc:1064] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:05:46.784788 14400 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:46.784693 14549 consensus_queue.cc:237] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:46.787504 14564 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.790220 14579 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.794054 14564 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.803885 14525 raft_consensus.cc:2955] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:46.813819 13711 raft_consensus.cc:2955] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:46.853763 14598 raft_consensus.cc:2955] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:46.866720 13789 raft_consensus.cc:2955] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:46.873903 13713 raft_consensus.cc:2955] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:46.877760 13611 catalog_manager.cc:5697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.885749 13863 raft_consensus.cc:2955] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:46.894264 13865 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:46.895856 14212 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:46.910914 14400 raft_consensus.cc:2955] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:46.882781 14402 raft_consensus.cc:2955] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:46.934762 14401 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:46.935268 13790 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:46.938572 14625 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.941817 14549 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.970834 13614 catalog_manager.cc:5697] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:46.980841 14554 raft_consensus.cc:2955] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:46.987442 14401 raft_consensus.cc:2955] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:46.993918 13865 consensus_queue.cc:237] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:46.996142 14564 raft_consensus.cc:1064] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:05:46.998345 14564 consensus_queue.cc:237] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:47.000651 13713 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:47.002151 14612 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:47.005388 14400 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:47.020153 13790 raft_consensus.cc:2955] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:47.037539 13612 catalog_manager.cc:5697] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:47.042586 14616 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:47.044633 14616 raft_consensus.cc:2955] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:47.051808 14401 raft_consensus.cc:2955] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:47.064668 13711 raft_consensus.cc:2955] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:47.064968 13862 raft_consensus.cc:2955] T 397ec99b74c24481a69c1f4a7c294a73 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:47.123253 14400 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:47.126560 13865 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:47.128021 14598 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:05:47.136755 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 128751us
I20260709 13:05:47.137403 14579 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:47.152256 13610 catalog_manager.cc:5697] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:47.172192 13777 tablet_service.cc:1558] Processing DeleteTablet for tablet 82e0eeb1582143a09acf311171812faa with delete_type TABLET_DATA_TOMBSTONED (TS 35ecb005831740438d7537dd4b840e03 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48902
I20260709 13:05:47.187733 13715 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:47.190026 13790 consensus_queue.cc:237] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:47.192210 14598 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:47.199447 13715 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:47.201440 14400 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:47.203393 14637 raft_consensus.cc:2955] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:47.206586 13601 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 82e0eeb1582143a09acf311171812faa with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:47.210460 14643 tablet_replica.cc:333] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:05:47.213973 13715 consensus_queue.cc:237] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:47.220666 14564 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:47.235487 14623 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:47.240088 14401 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:47.239697 14400 raft_consensus.cc:2955] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:47.241726 14549 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:47.249316 14549 raft_consensus.cc:2955] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:47.250411 13715 raft_consensus.cc:2955] T ac7aedfecb9c482a9cf59234dff1e9f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:47.259266 14401 raft_consensus.cc:2955] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:47.262135 14638 raft_consensus.cc:2955] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:47.272002 13711 raft_consensus.cc:2955] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:47.276441 14643 raft_consensus.cc:2243] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:47.277210 14643 raft_consensus.cc:2272] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:47.288321 13790 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:47.298139 14643 ts_tablet_manager.cc:1916] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:47.313608 13610 catalog_manager.cc:5697] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:47.299269 13600 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 397ec99b74c24481a69c1f4a7c294a73 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:47.299631 13865 raft_consensus.cc:2955] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:47.307720 14554 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:47.320858 13599 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bb9ba3c4f4a14a57b28d5cf2b9cf5afd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:47.341163 13610 catalog_manager.cc:5697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:47.343021 13610 catalog_manager.cc:5697] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:47.346182 13791 raft_consensus.cc:2955] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:47.348192 14400 raft_consensus.cc:2955] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:47.369104 14643 ts_tablet_manager.cc:1929] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:47.369831 14643 log.cc:1199] T 82e0eeb1582143a09acf311171812faa P 35ecb005831740438d7537dd4b840e03: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-1-root/wals/82e0eeb1582143a09acf311171812faa
I20260709 13:05:47.372876 13599 catalog_manager.cc:5028] TS 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): tablet 82e0eeb1582143a09acf311171812faa (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:05:47.375335 13790 consensus_queue.cc:237] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:47.385983 14400 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:47.387140 13848 tablet_service.cc:1558] Processing DeleteTablet for tablet bb9ba3c4f4a14a57b28d5cf2b9cf5afd with delete_type TABLET_DATA_TOMBSTONED (TS b5029654a4384e43a68eb67b794949b7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59764
I20260709 13:05:47.387221 14637 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:47.388468 13853 tablet_service.cc:1558] Processing DeleteTablet for tablet 397ec99b74c24481a69c1f4a7c294a73 with delete_type TABLET_DATA_TOMBSTONED (TS b5029654a4384e43a68eb67b794949b7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59764
I20260709 13:05:47.393314 13862 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:47.396939 14623 raft_consensus.cc:2955] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:47.398758 14579 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:47.402735 14400 raft_consensus.cc:2955] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:47.410846 13863 raft_consensus.cc:2955] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:47.401749 14645 tablet_replica.cc:333] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:05:47.418990 14645 raft_consensus.cc:2243] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:47.419312 13599 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ac7aedfecb9c482a9cf59234dff1e9f8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:47.419678 14645 raft_consensus.cc:2272] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:47.422370 13611 catalog_manager.cc:5697] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:47.424449 14645 ts_tablet_manager.cc:1916] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:47.434635 13703 tablet_service.cc:1558] Processing DeleteTablet for tablet ac7aedfecb9c482a9cf59234dff1e9f8 with delete_type TABLET_DATA_TOMBSTONED (TS b9d194f45e044e0988d5de1a99e5cd02 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49478
I20260709 13:05:47.440677 14646 tablet_replica.cc:333] T ac7aedfecb9c482a9cf59234dff1e9f8 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:05:47.447706 14645 ts_tablet_manager.cc:1929] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:47.448143 14645 log.cc:1199] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b5029654a4384e43a68eb67b794949b7: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-2-root/wals/bb9ba3c4f4a14a57b28d5cf2b9cf5afd
I20260709 13:05:47.449703 13601 catalog_manager.cc:5028] TS b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): tablet bb9ba3c4f4a14a57b28d5cf2b9cf5afd (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:05:47.450456 14645 tablet_replica.cc:333] T 397ec99b74c24481a69c1f4a7c294a73 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:05:47.452289 14645 raft_consensus.cc:2243] T 397ec99b74c24481a69c1f4a7c294a73 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:47.452893 14645 raft_consensus.cc:2272] T 397ec99b74c24481a69c1f4a7c294a73 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:47.453878 14646 raft_consensus.cc:2243] T ac7aedfecb9c482a9cf59234dff1e9f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:47.454561 14646 raft_consensus.cc:2272] T ac7aedfecb9c482a9cf59234dff1e9f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:47.455698 14645 ts_tablet_manager.cc:1916] T 397ec99b74c24481a69c1f4a7c294a73 P b5029654a4384e43a68eb67b794949b7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:47.457008 14646 ts_tablet_manager.cc:1916] T ac7aedfecb9c482a9cf59234dff1e9f8 P b9d194f45e044e0988d5de1a99e5cd02: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:47.469049 14645 ts_tablet_manager.cc:1929] T 397ec99b74c24481a69c1f4a7c294a73 P b5029654a4384e43a68eb67b794949b7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:47.469612 14645 log.cc:1199] T 397ec99b74c24481a69c1f4a7c294a73 P b5029654a4384e43a68eb67b794949b7: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-2-root/wals/397ec99b74c24481a69c1f4a7c294a73
I20260709 13:05:47.471256 14646 ts_tablet_manager.cc:1929] T ac7aedfecb9c482a9cf59234dff1e9f8 P b9d194f45e044e0988d5de1a99e5cd02: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:47.471738 14646 log.cc:1199] T ac7aedfecb9c482a9cf59234dff1e9f8 P b9d194f45e044e0988d5de1a99e5cd02: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-0-root/wals/ac7aedfecb9c482a9cf59234dff1e9f8
I20260709 13:05:47.471724 13601 catalog_manager.cc:5028] TS b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): tablet 397ec99b74c24481a69c1f4a7c294a73 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:05:47.473491 13600 catalog_manager.cc:5028] TS b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): tablet ac7aedfecb9c482a9cf59234dff1e9f8 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:05:48.507143 13790 consensus_queue.cc:237] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:48.512960 13862 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:48.513146 13755 consensus_peers.cc:597] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b1367b7b65234b7fbaacfcd765b3a6e5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:48.514225 13713 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:48.514163 14638 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:48.515697 14623 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:48.524061 13865 raft_consensus.cc:2955] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:48.525704 14564 raft_consensus.cc:2955] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:48.548750 13711 consensus_queue.cc:237] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:48.549072 13614 catalog_manager.cc:5697] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:48.561499 13790 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:48.560870 13713 raft_consensus.cc:2955] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:48.563236 14625 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:48.565601 13680 consensus_peers.cc:597] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5fbcfa22d8b54ed5997bc6453bdf0fd3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:48.577605 13862 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:48.579385 14549 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:48.591403 14549 raft_consensus.cc:2955] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:48.600898 13791 raft_consensus.cc:2955] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:48.609301 13865 consensus_queue.cc:237] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:48.620975 13862 raft_consensus.cc:2955] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
W20260709 13:05:48.623589 13829 consensus_peers.cc:597] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cff75d4a417e4aeab081acad01b03c36. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:48.624694 13611 catalog_manager.cc:5697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:48.625811 13711 raft_consensus.cc:1275] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:48.627591 14616 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:48.629930 13791 raft_consensus.cc:1275] T cff75d4a417e4aeab081acad01b03c36 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:48.631814 14647 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:48.639921 14616 raft_consensus.cc:2955] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:48.641119 13713 raft_consensus.cc:2955] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:48.655982 13790 consensus_queue.cc:237] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:48.660386 13610 catalog_manager.cc:5697] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
W20260709 13:05:48.668290 13755 consensus_peers.cc:597] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3618fd55609843fca70082d3565b459b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:48.668764 13862 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:48.666103 13791 raft_consensus.cc:2955] T cff75d4a417e4aeab081acad01b03c36 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:48.670135 14564 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:48.673906 13713 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:48.675189 14564 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:48.689363 14564 raft_consensus.cc:2955] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:48.692680 13865 raft_consensus.cc:2955] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:48.693485 13711 raft_consensus.cc:2955] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:48.716666 13610 catalog_manager.cc:5697] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:48.956497 14669 ts_tablet_manager.cc:933] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:48.958841 14669 tablet_copy_client.cc:323] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.130:36047
I20260709 13:05:48.960470 13801 tablet_copy_service.cc:140] P 35ecb005831740438d7537dd4b840e03: Received BeginTabletCopySession request for tablet b1367b7b65234b7fbaacfcd765b3a6e5 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:45134)
I20260709 13:05:48.960911 13801 tablet_copy_service.cc:161] P 35ecb005831740438d7537dd4b840e03: Beginning new tablet copy session on tablet b1367b7b65234b7fbaacfcd765b3a6e5 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:45134: session id = ceb06175847b428ea8bd77055fcddf58-b1367b7b65234b7fbaacfcd765b3a6e5
I20260709 13:05:48.966615 13801 tablet_copy_source_session.cc:215] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:48.969544 14669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1367b7b65234b7fbaacfcd765b3a6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.985172 14669 tablet_copy_client.cc:806] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:48.985810 14669 tablet_copy_client.cc:670] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:48.989406 14669 tablet_copy_client.cc:538] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:48.997259 14669 tablet_bootstrap.cc:492] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:49.016206 14669 tablet_bootstrap.cc:492] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:49.017259 14669 tablet_bootstrap.cc:492] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:49.017988 14669 ts_tablet_manager.cc:1403] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.004s
I20260709 13:05:49.020802 14669 raft_consensus.cc:359] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:49.021852 14669 raft_consensus.cc:740] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:49.023427 14669 consensus_queue.cc:260] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:49.026983 14669 ts_tablet_manager.cc:1434] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:49.029389 13801 tablet_copy_service.cc:342] P 35ecb005831740438d7537dd4b840e03: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-b1367b7b65234b7fbaacfcd765b3a6e5 received from {username='slave'} at 127.0.0.1:45134
I20260709 13:05:49.029778 13801 tablet_copy_service.cc:434] P 35ecb005831740438d7537dd4b840e03: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-b1367b7b65234b7fbaacfcd765b3a6e5 on tablet b1367b7b65234b7fbaacfcd765b3a6e5 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:49.107241 14669 ts_tablet_manager.cc:933] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533)
I20260709 13:05:49.108909 14669 tablet_copy_client.cc:323] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.129:37533
I20260709 13:05:49.110314 13726 tablet_copy_service.cc:140] P b9d194f45e044e0988d5de1a99e5cd02: Received BeginTabletCopySession request for tablet 5fbcfa22d8b54ed5997bc6453bdf0fd3 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:58552)
I20260709 13:05:49.110751 13726 tablet_copy_service.cc:161] P b9d194f45e044e0988d5de1a99e5cd02: Beginning new tablet copy session on tablet 5fbcfa22d8b54ed5997bc6453bdf0fd3 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:58552: session id = ceb06175847b428ea8bd77055fcddf58-5fbcfa22d8b54ed5997bc6453bdf0fd3
I20260709 13:05:49.115702 13726 tablet_copy_source_session.cc:215] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:49.118706 14669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fbcfa22d8b54ed5997bc6453bdf0fd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.129112 14669 tablet_copy_client.cc:806] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:49.129647 14669 tablet_copy_client.cc:670] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:49.132946 14669 tablet_copy_client.cc:538] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:49.142050 14669 tablet_bootstrap.cc:492] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:49.162392 14669 tablet_bootstrap.cc:492] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:49.163307 14669 tablet_bootstrap.cc:492] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:49.163986 14669 ts_tablet_manager.cc:1403] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.004s
I20260709 13:05:49.166764 14669 raft_consensus.cc:359] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:49.167649 14669 raft_consensus.cc:740] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:49.168268 14669 consensus_queue.cc:260] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:49.172978 14669 ts_tablet_manager.cc:1434] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:49.175714 14675 ts_tablet_manager.cc:933] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:49.175314 13726 tablet_copy_service.cc:342] P b9d194f45e044e0988d5de1a99e5cd02: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-5fbcfa22d8b54ed5997bc6453bdf0fd3 received from {username='slave'} at 127.0.0.1:58552
I20260709 13:05:49.177532 13726 tablet_copy_service.cc:434] P b9d194f45e044e0988d5de1a99e5cd02: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-5fbcfa22d8b54ed5997bc6453bdf0fd3 on tablet 5fbcfa22d8b54ed5997bc6453bdf0fd3 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:49.180411 14675 tablet_copy_client.cc:323] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.130:36047
I20260709 13:05:49.182129 13801 tablet_copy_service.cc:140] P 35ecb005831740438d7537dd4b840e03: Received BeginTabletCopySession request for tablet 3618fd55609843fca70082d3565b459b from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:45134)
I20260709 13:05:49.182653 13801 tablet_copy_service.cc:161] P 35ecb005831740438d7537dd4b840e03: Beginning new tablet copy session on tablet 3618fd55609843fca70082d3565b459b from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:45134: session id = ceb06175847b428ea8bd77055fcddf58-3618fd55609843fca70082d3565b459b
I20260709 13:05:49.190289 14669 ts_tablet_manager.cc:933] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:49.191107 13801 tablet_copy_source_session.cc:215] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:49.193823 14669 tablet_copy_client.cc:323] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.131:46015
I20260709 13:05:49.194123 14675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3618fd55609843fca70082d3565b459b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.195914 13875 tablet_copy_service.cc:140] P b5029654a4384e43a68eb67b794949b7: Received BeginTabletCopySession request for tablet cff75d4a417e4aeab081acad01b03c36 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:42104)
I20260709 13:05:49.196448 13875 tablet_copy_service.cc:161] P b5029654a4384e43a68eb67b794949b7: Beginning new tablet copy session on tablet cff75d4a417e4aeab081acad01b03c36 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:42104: session id = ceb06175847b428ea8bd77055fcddf58-cff75d4a417e4aeab081acad01b03c36
I20260709 13:05:49.212975 14675 tablet_copy_client.cc:806] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:49.213656 14675 tablet_copy_client.cc:670] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:49.218312 14675 tablet_copy_client.cc:538] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:49.220809 13875 tablet_copy_source_session.cc:215] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:49.224138 14669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff75d4a417e4aeab081acad01b03c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.228988 14675 tablet_bootstrap.cc:492] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:49.247001 14675 tablet_bootstrap.cc:492] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:49.247905 14669 tablet_copy_client.cc:806] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:49.247900 14675 tablet_bootstrap.cc:492] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:49.248499 14669 tablet_copy_client.cc:670] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:49.249001 14675 ts_tablet_manager.cc:1403] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 13:05:49.252539 14669 tablet_copy_client.cc:538] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:49.252632 14675 raft_consensus.cc:359] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:49.253432 14675 raft_consensus.cc:740] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:49.253940 14675 consensus_queue.cc:260] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:49.256158 14675 ts_tablet_manager.cc:1434] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 13:05:49.258149 13801 tablet_copy_service.cc:342] P 35ecb005831740438d7537dd4b840e03: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-3618fd55609843fca70082d3565b459b received from {username='slave'} at 127.0.0.1:45134
I20260709 13:05:49.258543 13801 tablet_copy_service.cc:434] P 35ecb005831740438d7537dd4b840e03: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-3618fd55609843fca70082d3565b459b on tablet 3618fd55609843fca70082d3565b459b with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:49.262790 14669 tablet_bootstrap.cc:492] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:49.287276 14669 tablet_bootstrap.cc:492] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:49.288144 14669 tablet_bootstrap.cc:492] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:49.288772 14669 ts_tablet_manager.cc:1403] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.014s
I20260709 13:05:49.291298 14669 raft_consensus.cc:359] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:49.292125 14669 raft_consensus.cc:740] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:49.292719 14669 consensus_queue.cc:260] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:49.296818 14669 ts_tablet_manager.cc:1434] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:05:49.298573 13875 tablet_copy_service.cc:342] P b5029654a4384e43a68eb67b794949b7: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-cff75d4a417e4aeab081acad01b03c36 received from {username='slave'} at 127.0.0.1:42104
I20260709 13:05:49.299026 13875 tablet_copy_service.cc:434] P b5029654a4384e43a68eb67b794949b7: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-cff75d4a417e4aeab081acad01b03c36 on tablet cff75d4a417e4aeab081acad01b03c36 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:49.480202 14400 raft_consensus.cc:1217] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:49.607838 14400 raft_consensus.cc:1217] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:49.650759 14400 raft_consensus.cc:1217] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:49.760675 14400 raft_consensus.cc:1217] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:50.070565 14564 raft_consensus.cc:1064] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:05:50.073316 14564 consensus_queue.cc:237] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:50.090091 14400 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.091267 13711 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.092594 14638 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.096530 13865 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.097833 14564 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:50.099138 14638 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.115805 14564 raft_consensus.cc:2955] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.119021 13865 raft_consensus.cc:2955] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.117493 14400 raft_consensus.cc:2955] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.142483 13614 catalog_manager.cc:5697] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.153813 13711 raft_consensus.cc:2955] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.170009 14623 raft_consensus.cc:1064] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:05:50.173020 14623 consensus_queue.cc:237] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:50.187340 13862 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.187877 14400 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.188958 13711 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.190794 14623 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.191677 14638 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.192312 14564 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.206372 14682 raft_consensus.cc:1064] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:05:50.208925 14682 consensus_queue.cc:237] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:50.226308 14623 raft_consensus.cc:2955] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.230144 13862 raft_consensus.cc:2955] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.232574 13791 consensus_queue.cc:237] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:50.233840 13713 raft_consensus.cc:2955] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.245116 14401 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:50.248251 13865 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:50.250103 14564 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:50.252635 14564 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:50.253540 14401 raft_consensus.cc:2955] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.255759 14402 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.255546 13612 catalog_manager.cc:5697] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.258147 14625 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.261754 14681 raft_consensus.cc:2955] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.267041 14402 raft_consensus.cc:2955] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.271857 13862 raft_consensus.cc:2955] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.276410 13863 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.278959 13791 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.284840 14653 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.287129 14653 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:50.290980 13599 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b1367b7b65234b7fbaacfcd765b3a6e5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:50.301234 13791 consensus_queue.cc:237] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:50.311833 13611 catalog_manager.cc:5697] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.313862 14700 raft_consensus.cc:1064] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:05:50.321425 14700 consensus_queue.cc:237] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:50.342911 13703 tablet_service.cc:1558] Processing DeleteTablet for tablet b1367b7b65234b7fbaacfcd765b3a6e5 with delete_type TABLET_DATA_TOMBSTONED (TS b9d194f45e044e0988d5de1a99e5cd02 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49478
I20260709 13:05:50.345399 13711 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:50.348667 14401 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:50.350389 14680 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:50.361554 14681 raft_consensus.cc:2955] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.370194 13713 raft_consensus.cc:2955] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.381099 14564 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:50.382793 13599 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3618fd55609843fca70082d3565b459b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:50.387888 14704 tablet_replica.cc:333] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:05:50.391192 13611 catalog_manager.cc:5697] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.415506 13848 tablet_service.cc:1558] Processing DeleteTablet for tablet 3618fd55609843fca70082d3565b459b with delete_type TABLET_DATA_TOMBSTONED (TS b5029654a4384e43a68eb67b794949b7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59764
I20260709 13:05:50.432799 14698 raft_consensus.cc:2955] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.435768 14402 raft_consensus.cc:2955] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.447121 13863 raft_consensus.cc:2955] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.449486 13791 raft_consensus.cc:2955] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.453073 14399 raft_consensus.cc:2955] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.461354 14705 tablet_replica.cc:333] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:05:50.463372 14705 raft_consensus.cc:2243] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.464193 14705 raft_consensus.cc:2272] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.471086 14704 raft_consensus.cc:2243] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.471918 14704 raft_consensus.cc:2272] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.472057 14401 raft_consensus.cc:1275] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.473376 13713 raft_consensus.cc:1275] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.474264 13791 raft_consensus.cc:1275] T cff75d4a417e4aeab081acad01b03c36 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.473579 13611 catalog_manager.cc:5697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.474740 14701 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.475234 14704 ts_tablet_manager.cc:1916] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:50.476649 14701 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.481050 14616 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.496693 14704 ts_tablet_manager.cc:1929] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:50.511616 14704 log.cc:1199] T b1367b7b65234b7fbaacfcd765b3a6e5 P b9d194f45e044e0988d5de1a99e5cd02: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-0-root/wals/b1367b7b65234b7fbaacfcd765b3a6e5
I20260709 13:05:50.513168 14705 ts_tablet_manager.cc:1916] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:50.514263 13600 catalog_manager.cc:5028] TS b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): tablet b1367b7b65234b7fbaacfcd765b3a6e5 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:05:50.520767 13711 consensus_queue.cc:237] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:50.521469 14616 raft_consensus.cc:2955] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.526846 14401 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:50.529078 14653 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:50.529512 13791 raft_consensus.cc:2955] T cff75d4a417e4aeab081acad01b03c36 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.536348 14402 raft_consensus.cc:2955] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.542647 14399 raft_consensus.cc:2955] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.538662 14698 raft_consensus.cc:2955] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.552011 13715 raft_consensus.cc:2955] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.565733 14705 ts_tablet_manager.cc:1929] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:50.566320 14705 log.cc:1199] T 3618fd55609843fca70082d3565b459b P b5029654a4384e43a68eb67b794949b7: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-2-root/wals/3618fd55609843fca70082d3565b459b
I20260709 13:05:50.569061 13600 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5fbcfa22d8b54ed5997bc6453bdf0fd3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:50.570626 13601 catalog_manager.cc:5028] TS b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): tablet 3618fd55609843fca70082d3565b459b (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:05:50.571224 13790 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:50.574736 14698 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:50.577957 13611 catalog_manager.cc:5697] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.580757 13790 raft_consensus.cc:2955] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.590968 13610 catalog_manager.cc:5697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.605929 13848 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fbcfa22d8b54ed5997bc6453bdf0fd3 with delete_type TABLET_DATA_TOMBSTONED (TS b5029654a4384e43a68eb67b794949b7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59764
I20260709 13:05:50.607043 14705 tablet_replica.cc:333] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:05:50.608345 14705 raft_consensus.cc:2243] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.609360 14705 raft_consensus.cc:2272] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.612528 14705 ts_tablet_manager.cc:1916] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b5029654a4384e43a68eb67b794949b7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:50.622995 13865 consensus_queue.cc:237] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:50.637169 14399 raft_consensus.cc:1275] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:50.638636 14705 ts_tablet_manager.cc:1929] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b5029654a4384e43a68eb67b794949b7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:50.638703 14701 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:50.639236 14705 log.cc:1199] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b5029654a4384e43a68eb67b794949b7: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-2-root/wals/5fbcfa22d8b54ed5997bc6453bdf0fd3
I20260709 13:05:50.641309 13601 catalog_manager.cc:5028] TS b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): tablet 5fbcfa22d8b54ed5997bc6453bdf0fd3 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:05:50.648727 14616 raft_consensus.cc:2955] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.650520 13715 raft_consensus.cc:1275] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:50.650095 14399 raft_consensus.cc:2955] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.651892 14700 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:50.658576 13711 raft_consensus.cc:2955] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.663062 13601 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cff75d4a417e4aeab081acad01b03c36 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:50.667366 13614 catalog_manager.cc:5697] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:50.677253 13777 tablet_service.cc:1558] Processing DeleteTablet for tablet cff75d4a417e4aeab081acad01b03c36 with delete_type TABLET_DATA_TOMBSTONED (TS 35ecb005831740438d7537dd4b840e03 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48902
I20260709 13:05:50.680270 14710 tablet_replica.cc:333] T cff75d4a417e4aeab081acad01b03c36 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:05:50.681351 14710 raft_consensus.cc:2243] T cff75d4a417e4aeab081acad01b03c36 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.682044 14710 raft_consensus.cc:2272] T cff75d4a417e4aeab081acad01b03c36 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.685247 14710 ts_tablet_manager.cc:1916] T cff75d4a417e4aeab081acad01b03c36 P 35ecb005831740438d7537dd4b840e03: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:50.697340 14710 ts_tablet_manager.cc:1929] T cff75d4a417e4aeab081acad01b03c36 P 35ecb005831740438d7537dd4b840e03: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:50.697701 14710 log.cc:1199] T cff75d4a417e4aeab081acad01b03c36 P 35ecb005831740438d7537dd4b840e03: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-1-root/wals/cff75d4a417e4aeab081acad01b03c36
I20260709 13:05:50.699208 13599 catalog_manager.cc:5028] TS 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): tablet cff75d4a417e4aeab081acad01b03c36 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:05:51.741246 13715 consensus_queue.cc:237] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
W20260709 13:05:51.749455 13680 consensus_peers.cc:597] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 68418f30a686438bba0d6ab02efa0986. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:51.752012 13862 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:51.753334 13791 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:51.754009 14698 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:51.755175 14653 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:51.763621 14713 raft_consensus.cc:2955] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:51.765681 13862 raft_consensus.cc:2955] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:51.766297 13791 raft_consensus.cc:2955] T 68418f30a686438bba0d6ab02efa0986 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:51.782166 13790 consensus_queue.cc:237] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:51.782644 13610 catalog_manager.cc:5697] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:51.794672 13862 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:51.795814 13755 consensus_peers.cc:597] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9c37f25da53241cd98c09e4525d9e23c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:51.796108 13715 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:51.797688 14711 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:51.799890 14681 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:51.811431 14711 raft_consensus.cc:2955] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:51.814178 13715 raft_consensus.cc:2955] T 9c37f25da53241cd98c09e4525d9e23c P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:51.830214 13790 consensus_queue.cc:237] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:51.830029 13862 raft_consensus.cc:2955] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:51.832283 13611 catalog_manager.cc:5697] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:51.843648 13755 consensus_peers.cc:597] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e2aec8e942e44d9b699829a1e6de4b3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:51.844031 13865 raft_consensus.cc:1275] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:51.845201 13711 raft_consensus.cc:1275] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:51.845850 14711 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:51.848450 14680 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:51.878099 14711 raft_consensus.cc:2955] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:51.884156 13862 raft_consensus.cc:2955] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:51.888054 13713 raft_consensus.cc:2955] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:51.906805 13611 catalog_manager.cc:5697] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:51.907794 13713 consensus_queue.cc:237] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
W20260709 13:05:51.924924 13680 consensus_peers.cc:597] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a3fcea1abf04503bc26d451a56ed222. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:51.928190 13865 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:51.928290 13791 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:51.929489 14698 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:51.930296 14713 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:51.937754 14713 raft_consensus.cc:2955] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:51.939445 13865 raft_consensus.cc:2955] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:51.940052 13791 raft_consensus.cc:2955] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:51.952960 13611 catalog_manager.cc:5697] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:52.191208 14733 ts_tablet_manager.cc:933] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:52.193426 14733 tablet_copy_client.cc:323] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.130:36047
I20260709 13:05:52.194967 13801 tablet_copy_service.cc:140] P 35ecb005831740438d7537dd4b840e03: Received BeginTabletCopySession request for tablet 9c37f25da53241cd98c09e4525d9e23c from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:45134)
I20260709 13:05:52.195552 13801 tablet_copy_service.cc:161] P 35ecb005831740438d7537dd4b840e03: Beginning new tablet copy session on tablet 9c37f25da53241cd98c09e4525d9e23c from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:45134: session id = ceb06175847b428ea8bd77055fcddf58-9c37f25da53241cd98c09e4525d9e23c
I20260709 13:05:52.203104 13801 tablet_copy_source_session.cc:215] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:52.206033 14733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c37f25da53241cd98c09e4525d9e23c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.218266 14733 tablet_copy_client.cc:806] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:52.218776 14733 tablet_copy_client.cc:670] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:52.223240 14733 tablet_copy_client.cc:538] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:52.230861 14733 tablet_bootstrap.cc:492] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:52.248243 14733 tablet_bootstrap.cc:492] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:52.249112 14733 tablet_bootstrap.cc:492] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:52.249742 14733 ts_tablet_manager.cc:1403] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.004s
I20260709 13:05:52.252722 14733 raft_consensus.cc:359] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:52.253557 14733 raft_consensus.cc:740] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:52.254166 14733 consensus_queue.cc:260] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:52.259296 14733 ts_tablet_manager.cc:1434] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 13:05:52.261194 13801 tablet_copy_service.cc:342] P 35ecb005831740438d7537dd4b840e03: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-9c37f25da53241cd98c09e4525d9e23c received from {username='slave'} at 127.0.0.1:45134
I20260709 13:05:52.261622 13801 tablet_copy_service.cc:434] P 35ecb005831740438d7537dd4b840e03: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-9c37f25da53241cd98c09e4525d9e23c on tablet 9c37f25da53241cd98c09e4525d9e23c with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:52.305320 14733 ts_tablet_manager.cc:933] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533)
I20260709 13:05:52.306890 14733 tablet_copy_client.cc:323] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.129:37533
I20260709 13:05:52.308531 13726 tablet_copy_service.cc:140] P b9d194f45e044e0988d5de1a99e5cd02: Received BeginTabletCopySession request for tablet 9a3fcea1abf04503bc26d451a56ed222 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:58552)
I20260709 13:05:52.308969 13726 tablet_copy_service.cc:161] P b9d194f45e044e0988d5de1a99e5cd02: Beginning new tablet copy session on tablet 9a3fcea1abf04503bc26d451a56ed222 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:58552: session id = ceb06175847b428ea8bd77055fcddf58-9a3fcea1abf04503bc26d451a56ed222
I20260709 13:05:52.316339 13726 tablet_copy_source_session.cc:215] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:52.318986 14733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a3fcea1abf04503bc26d451a56ed222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.334237 14733 tablet_copy_client.cc:806] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:52.334794 14733 tablet_copy_client.cc:670] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:52.338665 14733 tablet_copy_client.cc:538] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:52.348431 14733 tablet_bootstrap.cc:492] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:52.372442 14739 ts_tablet_manager.cc:933] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533)
I20260709 13:05:52.377332 14733 tablet_bootstrap.cc:492] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:52.378111 14739 tablet_copy_client.cc:323] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.129:37533
I20260709 13:05:52.378368 14733 tablet_bootstrap.cc:492] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:52.379122 14733 ts_tablet_manager.cc:1403] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.031s	user 0.023s	sys 0.006s
I20260709 13:05:52.379726 13726 tablet_copy_service.cc:140] P b9d194f45e044e0988d5de1a99e5cd02: Received BeginTabletCopySession request for tablet 68418f30a686438bba0d6ab02efa0986 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:58552)
I20260709 13:05:52.380184 13726 tablet_copy_service.cc:161] P b9d194f45e044e0988d5de1a99e5cd02: Beginning new tablet copy session on tablet 68418f30a686438bba0d6ab02efa0986 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:58552: session id = ceb06175847b428ea8bd77055fcddf58-68418f30a686438bba0d6ab02efa0986
I20260709 13:05:52.381969 14733 raft_consensus.cc:359] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:52.382915 14733 raft_consensus.cc:740] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:52.383606 14733 consensus_queue.cc:260] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:52.388712 13726 tablet_copy_source_session.cc:215] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:52.392586 14739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68418f30a686438bba0d6ab02efa0986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.396981 14733 ts_tablet_manager.cc:1434] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:05:52.405102 13726 tablet_copy_service.cc:342] P b9d194f45e044e0988d5de1a99e5cd02: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-9a3fcea1abf04503bc26d451a56ed222 received from {username='slave'} at 127.0.0.1:58552
I20260709 13:05:52.405616 13726 tablet_copy_service.cc:434] P b9d194f45e044e0988d5de1a99e5cd02: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-9a3fcea1abf04503bc26d451a56ed222 on tablet 9a3fcea1abf04503bc26d451a56ed222 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:52.410367 14739 tablet_copy_client.cc:806] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:52.410948 14733 ts_tablet_manager.cc:933] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:52.411424 14739 tablet_copy_client.cc:670] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:52.413810 14733 tablet_copy_client.cc:323] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.130:36047
I20260709 13:05:52.416868 13801 tablet_copy_service.cc:140] P 35ecb005831740438d7537dd4b840e03: Received BeginTabletCopySession request for tablet 2e2aec8e942e44d9b699829a1e6de4b3 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:45134)
I20260709 13:05:52.417357 13801 tablet_copy_service.cc:161] P 35ecb005831740438d7537dd4b840e03: Beginning new tablet copy session on tablet 2e2aec8e942e44d9b699829a1e6de4b3 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:45134: session id = ceb06175847b428ea8bd77055fcddf58-2e2aec8e942e44d9b699829a1e6de4b3
I20260709 13:05:52.437701 13801 tablet_copy_source_session.cc:215] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:52.441661 14733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e2aec8e942e44d9b699829a1e6de4b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.442163 14739 tablet_copy_client.cc:538] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:52.457047 14739 tablet_bootstrap.cc:492] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:52.458015 14733 tablet_copy_client.cc:806] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:52.458583 14733 tablet_copy_client.cc:670] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:52.463210 14733 tablet_copy_client.cc:538] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:52.469400 14733 tablet_bootstrap.cc:492] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:52.482043 14739 tablet_bootstrap.cc:492] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:52.482996 14739 tablet_bootstrap.cc:492] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:52.483716 14739 ts_tablet_manager.cc:1403] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.009s
I20260709 13:05:52.487506 14739 raft_consensus.cc:359] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:52.493436 14739 raft_consensus.cc:740] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:52.494197 14739 consensus_queue.cc:260] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:52.498262 14739 ts_tablet_manager.cc:1434] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.005s
I20260709 13:05:52.500047 13726 tablet_copy_service.cc:342] P b9d194f45e044e0988d5de1a99e5cd02: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-68418f30a686438bba0d6ab02efa0986 received from {username='slave'} at 127.0.0.1:58552
I20260709 13:05:52.500412 13726 tablet_copy_service.cc:434] P b9d194f45e044e0988d5de1a99e5cd02: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-68418f30a686438bba0d6ab02efa0986 on tablet 68418f30a686438bba0d6ab02efa0986 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:52.506138 14733 tablet_bootstrap.cc:492] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:52.507133 14733 tablet_bootstrap.cc:492] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:52.507802 14733 ts_tablet_manager.cc:1403] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.012s
I20260709 13:05:52.510396 14733 raft_consensus.cc:359] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:52.510946 14733 raft_consensus.cc:740] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:52.511478 14733 consensus_queue.cc:260] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:52.518231 14733 ts_tablet_manager.cc:1434] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:05:52.519858 13801 tablet_copy_service.cc:342] P 35ecb005831740438d7537dd4b840e03: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-2e2aec8e942e44d9b699829a1e6de4b3 received from {username='slave'} at 127.0.0.1:45134
I20260709 13:05:52.520251 13801 tablet_copy_service.cc:434] P 35ecb005831740438d7537dd4b840e03: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-2e2aec8e942e44d9b699829a1e6de4b3 on tablet 2e2aec8e942e44d9b699829a1e6de4b3 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:52.657160 14399 raft_consensus.cc:1217] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:52.833674 14399 raft_consensus.cc:1217] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:52.930053 14399 raft_consensus.cc:1217] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:53.004168 14399 raft_consensus.cc:1217] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:53.166690 14727 raft_consensus.cc:1064] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:05:53.170081 14727 consensus_queue.cc:237] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:53.181202 14399 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:53.182154 13713 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:53.182971 13865 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:53.183100 14727 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:53.184410 14746 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:53.185269 14711 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:53.206285 14746 raft_consensus.cc:2955] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.215683 13713 raft_consensus.cc:2955] T 9c37f25da53241cd98c09e4525d9e23c P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.218771 13865 raft_consensus.cc:2955] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.218695 14399 raft_consensus.cc:2955] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.225697 13611 catalog_manager.cc:5697] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:53.235603 14732 raft_consensus.cc:1064] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:05:53.238312 14732 consensus_queue.cc:237] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:53.281694 13862 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:53.282084 14399 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:53.283593 14698 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:53.285197 14713 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:53.289983 13790 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:53.295296 14713 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:53.345386 14399 raft_consensus.cc:2955] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.346343 13865 raft_consensus.cc:2955] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.344249 14698 raft_consensus.cc:2955] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.367504 13790 consensus_queue.cc:237] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:53.375219 14399 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:53.378458 14746 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:53.385696 13614 catalog_manager.cc:5697] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.388424 13865 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:53.398954 14681 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:53.394692 14727 raft_consensus.cc:2955] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.389218 13790 raft_consensus.cc:2955] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.405411 14402 raft_consensus.cc:2955] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.408192 13862 raft_consensus.cc:2955] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.409682 13713 consensus_queue.cc:237] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:53.418489 14401 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:53.420063 14698 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:53.421398 14681 raft_consensus.cc:1064] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:05:53.427165 13865 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:53.428802 14755 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:53.430593 13611 catalog_manager.cc:5697] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.432480 14681 consensus_queue.cc:237] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:53.440436 14755 raft_consensus.cc:2955] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.449285 13599 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9c37f25da53241cd98c09e4525d9e23c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:53.450384 13865 raft_consensus.cc:2955] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.451804 13703 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c37f25da53241cd98c09e4525d9e23c with delete_type TABLET_DATA_TOMBSTONED (TS b9d194f45e044e0988d5de1a99e5cd02 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49478
I20260709 13:05:53.455722 14763 tablet_replica.cc:333] T 9c37f25da53241cd98c09e4525d9e23c P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:05:53.466564 13713 raft_consensus.cc:1275] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:53.468240 14681 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:53.471004 13862 raft_consensus.cc:1275] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:53.470410 14402 raft_consensus.cc:2955] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.472699 14746 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:53.473903 14763 raft_consensus.cc:2243] T 9c37f25da53241cd98c09e4525d9e23c P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.474741 14763 raft_consensus.cc:2272] T 9c37f25da53241cd98c09e4525d9e23c P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.478173 14401 raft_consensus.cc:1275] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:53.481457 14763 ts_tablet_manager.cc:1916] T 9c37f25da53241cd98c09e4525d9e23c P b9d194f45e044e0988d5de1a99e5cd02: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:53.484272 14698 raft_consensus.cc:1064] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:05:53.486922 14698 consensus_queue.cc:237] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:53.488217 14746 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:53.491438 13600 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9a3fcea1abf04503bc26d451a56ed222 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:53.499581 14401 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:53.499583 13865 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:53.501349 14755 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:53.504530 14698 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:53.516630 13614 catalog_manager.cc:5697] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.519516 13790 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:53.522224 14755 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:53.528410 13777 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a3fcea1abf04503bc26d451a56ed222 with delete_type TABLET_DATA_TOMBSTONED (TS 35ecb005831740438d7537dd4b840e03 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48902
I20260709 13:05:53.546061 14771 tablet_replica.cc:333] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:05:53.573809 13791 raft_consensus.cc:2955] T 68418f30a686438bba0d6ab02efa0986 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.575943 14732 raft_consensus.cc:2955] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.580063 13863 raft_consensus.cc:2955] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.580931 14771 raft_consensus.cc:2243] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.581686 14771 raft_consensus.cc:2272] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.604507 14763 ts_tablet_manager.cc:1929] T 9c37f25da53241cd98c09e4525d9e23c P b9d194f45e044e0988d5de1a99e5cd02: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:53.605271 14763 log.cc:1199] T 9c37f25da53241cd98c09e4525d9e23c P b9d194f45e044e0988d5de1a99e5cd02: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-0-root/wals/9c37f25da53241cd98c09e4525d9e23c
I20260709 13:05:53.608455 13600 catalog_manager.cc:5028] TS b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): tablet 9c37f25da53241cd98c09e4525d9e23c (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:05:53.609370 14401 raft_consensus.cc:2955] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.615844 13611 catalog_manager.cc:5697] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.629298 14771 ts_tablet_manager.cc:1916] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:53.631245 14727 raft_consensus.cc:2955] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.644194 13713 consensus_queue.cc:237] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:05:53.649863 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 61341.1us
I20260709 13:05:53.656548 13715 raft_consensus.cc:2955] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.656889 14401 raft_consensus.cc:2955] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.659582 13862 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:53.660893 14758 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:53.662717 13863 raft_consensus.cc:2955] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.664526 14399 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:53.666400 14758 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:53.668329 14755 raft_consensus.cc:2955] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.678113 13865 raft_consensus.cc:2955] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.681227 13600 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 68418f30a686438bba0d6ab02efa0986 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:53.690080 14401 raft_consensus.cc:2955] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.693770 13611 catalog_manager.cc:5697] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.700088 14771 ts_tablet_manager.cc:1929] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:53.701663 14771 log.cc:1199] T 9a3fcea1abf04503bc26d451a56ed222 P 35ecb005831740438d7537dd4b840e03: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-1-root/wals/9a3fcea1abf04503bc26d451a56ed222
I20260709 13:05:53.703164 13599 catalog_manager.cc:5028] TS 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): tablet 9a3fcea1abf04503bc26d451a56ed222 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:05:53.709177 13791 consensus_queue.cc:237] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:53.710798 13610 catalog_manager.cc:5697] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.716192 14401 raft_consensus.cc:1275] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:53.717427 13865 raft_consensus.cc:1275] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:53.718819 14746 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:53.722748 14746 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:53.727667 13777 tablet_service.cc:1558] Processing DeleteTablet for tablet 68418f30a686438bba0d6ab02efa0986 with delete_type TABLET_DATA_TOMBSTONED (TS 35ecb005831740438d7537dd4b840e03 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48902
I20260709 13:05:53.728555 14771 tablet_replica.cc:333] T 68418f30a686438bba0d6ab02efa0986 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:05:53.729560 14771 raft_consensus.cc:2243] T 68418f30a686438bba0d6ab02efa0986 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.730693 14771 raft_consensus.cc:2272] T 68418f30a686438bba0d6ab02efa0986 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.733963 14771 ts_tablet_manager.cc:1916] T 68418f30a686438bba0d6ab02efa0986 P 35ecb005831740438d7537dd4b840e03: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:53.735247 14772 raft_consensus.cc:2955] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.736912 13865 raft_consensus.cc:2955] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.744853 13599 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2e2aec8e942e44d9b699829a1e6de4b3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:53.752501 14771 ts_tablet_manager.cc:1929] T 68418f30a686438bba0d6ab02efa0986 P 35ecb005831740438d7537dd4b840e03: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:53.753120 14771 log.cc:1199] T 68418f30a686438bba0d6ab02efa0986 P 35ecb005831740438d7537dd4b840e03: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-1-root/wals/68418f30a686438bba0d6ab02efa0986
I20260709 13:05:53.752852 14401 raft_consensus.cc:2955] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:53.756624 13610 catalog_manager.cc:5697] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.762056 13599 catalog_manager.cc:5028] TS 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): tablet 68418f30a686438bba0d6ab02efa0986 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:05:53.770287 13703 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e2aec8e942e44d9b699829a1e6de4b3 with delete_type TABLET_DATA_TOMBSTONED (TS b9d194f45e044e0988d5de1a99e5cd02 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49478
I20260709 13:05:53.771281 14763 tablet_replica.cc:333] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:05:53.772203 14763 raft_consensus.cc:2243] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.772975 14763 raft_consensus.cc:2272] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.776142 14763 ts_tablet_manager.cc:1916] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:53.793759 14763 ts_tablet_manager.cc:1929] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:53.794157 14763 log.cc:1199] T 2e2aec8e942e44d9b699829a1e6de4b3 P b9d194f45e044e0988d5de1a99e5cd02: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-0-root/wals/2e2aec8e942e44d9b699829a1e6de4b3
I20260709 13:05:53.795548 13600 catalog_manager.cc:5028] TS b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): tablet 2e2aec8e942e44d9b699829a1e6de4b3 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:05:54.840723 13791 consensus_queue.cc:237] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
W20260709 13:05:54.848043 13755 consensus_peers.cc:597] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe5150c5d9c445549ec6d199f2cd70e0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:54.848065 13865 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:54.849696 14711 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:54.850126 13715 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:54.851465 14777 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:54.857741 14711 raft_consensus.cc:2955] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:54.859289 13865 raft_consensus.cc:2955] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:54.860936 13715 raft_consensus.cc:2955] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:54.876983 13614 catalog_manager.cc:5697] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.879081 13791 consensus_queue.cc:237] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
W20260709 13:05:54.904630 13755 consensus_peers.cc:597] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eb0e4fb02d3a45d4a6cc322c544fbf80. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:54.904835 13863 raft_consensus.cc:1275] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:54.906095 13715 raft_consensus.cc:1275] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:54.906134 14777 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:54.907371 14781 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:54.916867 14781 raft_consensus.cc:2955] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:54.919845 13865 raft_consensus.cc:2955] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:54.933702 13715 raft_consensus.cc:2955] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:54.943185 13791 consensus_queue.cc:237] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:54.951210 13610 catalog_manager.cc:5697] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:54.956516 13863 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:54.959127 14780 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:05:54.960045 13755 consensus_peers.cc:597] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d67d303d4784301a07a1fa014f50b98. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:54.962471 13713 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:54.964636 14777 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:54.970335 14777 raft_consensus.cc:2955] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:54.972323 13863 raft_consensus.cc:2955] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:54.988891 13862 consensus_queue.cc:237] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:54.998006 13610 catalog_manager.cc:5697] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.017144 13715 raft_consensus.cc:2955] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
W20260709 13:05:55.018929 13829 consensus_peers.cc:597] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 49638a262b1d4ba9b26cde1d408bf7ac. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:55.021556 13713 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:55.024422 14775 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:55.027699 13791 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:55.033452 14751 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:55.043009 14793 raft_consensus.cc:2955] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:55.045420 13715 raft_consensus.cc:2955] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:55.051883 13791 raft_consensus.cc:2955] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:55.060495 13610 catalog_manager.cc:5697] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:55.372550 14797 ts_tablet_manager.cc:933] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:55.374650 14797 tablet_copy_client.cc:323] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.130:36047
I20260709 13:05:55.376479 13801 tablet_copy_service.cc:140] P 35ecb005831740438d7537dd4b840e03: Received BeginTabletCopySession request for tablet fe5150c5d9c445549ec6d199f2cd70e0 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:45134)
I20260709 13:05:55.377020 13801 tablet_copy_service.cc:161] P 35ecb005831740438d7537dd4b840e03: Beginning new tablet copy session on tablet fe5150c5d9c445549ec6d199f2cd70e0 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:45134: session id = ceb06175847b428ea8bd77055fcddf58-fe5150c5d9c445549ec6d199f2cd70e0
I20260709 13:05:55.383740 13801 tablet_copy_source_session.cc:215] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:55.387184 14797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe5150c5d9c445549ec6d199f2cd70e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:55.403607 14797 tablet_copy_client.cc:806] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:55.404234 14797 tablet_copy_client.cc:670] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:55.408172 14797 tablet_copy_client.cc:538] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:55.417999 14797 tablet_bootstrap.cc:492] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:55.441192 14797 tablet_bootstrap.cc:492] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:55.442128 14797 tablet_bootstrap.cc:492] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:55.442762 14797 ts_tablet_manager.cc:1403] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.003s
I20260709 13:05:55.445806 14797 raft_consensus.cc:359] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:55.446674 14797 raft_consensus.cc:740] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:55.447291 14797 consensus_queue.cc:260] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:55.450647 14797 ts_tablet_manager.cc:1434] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.005s
I20260709 13:05:55.453456 13801 tablet_copy_service.cc:342] P 35ecb005831740438d7537dd4b840e03: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-fe5150c5d9c445549ec6d199f2cd70e0 received from {username='slave'} at 127.0.0.1:45134
I20260709 13:05:55.453912 13801 tablet_copy_service.cc:434] P 35ecb005831740438d7537dd4b840e03: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-fe5150c5d9c445549ec6d199f2cd70e0 on tablet fe5150c5d9c445549ec6d199f2cd70e0 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:55.499253 14797 ts_tablet_manager.cc:933] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:55.513172 14802 ts_tablet_manager.cc:933] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:55.557683 14803 ts_tablet_manager.cc:933] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:55.564713 14797 tablet_copy_client.cc:323] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.130:36047
I20260709 13:05:55.567278 14803 tablet_copy_client.cc:323] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.131:46015
I20260709 13:05:55.567770 13801 tablet_copy_service.cc:140] P 35ecb005831740438d7537dd4b840e03: Received BeginTabletCopySession request for tablet 2d67d303d4784301a07a1fa014f50b98 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:45134)
I20260709 13:05:55.568334 13801 tablet_copy_service.cc:161] P 35ecb005831740438d7537dd4b840e03: Beginning new tablet copy session on tablet 2d67d303d4784301a07a1fa014f50b98 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:45134: session id = ceb06175847b428ea8bd77055fcddf58-2d67d303d4784301a07a1fa014f50b98
I20260709 13:05:55.569268 13875 tablet_copy_service.cc:140] P b5029654a4384e43a68eb67b794949b7: Received BeginTabletCopySession request for tablet 49638a262b1d4ba9b26cde1d408bf7ac from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:42104)
I20260709 13:05:55.569814 13875 tablet_copy_service.cc:161] P b5029654a4384e43a68eb67b794949b7: Beginning new tablet copy session on tablet 49638a262b1d4ba9b26cde1d408bf7ac from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:42104: session id = ceb06175847b428ea8bd77055fcddf58-49638a262b1d4ba9b26cde1d408bf7ac
I20260709 13:05:55.570188 14802 tablet_copy_client.cc:323] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.130:36047
I20260709 13:05:55.571969 13800 tablet_copy_service.cc:140] P 35ecb005831740438d7537dd4b840e03: Received BeginTabletCopySession request for tablet eb0e4fb02d3a45d4a6cc322c544fbf80 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:45134)
I20260709 13:05:55.572510 13800 tablet_copy_service.cc:161] P 35ecb005831740438d7537dd4b840e03: Beginning new tablet copy session on tablet eb0e4fb02d3a45d4a6cc322c544fbf80 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:45134: session id = ceb06175847b428ea8bd77055fcddf58-eb0e4fb02d3a45d4a6cc322c544fbf80
I20260709 13:05:55.578212 13875 tablet_copy_source_session.cc:215] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:55.581229 13800 tablet_copy_source_session.cc:215] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:55.582700 14803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49638a262b1d4ba9b26cde1d408bf7ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:55.583220 13801 tablet_copy_source_session.cc:215] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:55.585353 14802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb0e4fb02d3a45d4a6cc322c544fbf80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:55.598070 14797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d67d303d4784301a07a1fa014f50b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:55.602826 14802 tablet_copy_client.cc:806] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:55.603747 14802 tablet_copy_client.cc:670] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:55.608429 14803 tablet_copy_client.cc:806] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:55.608994 14803 tablet_copy_client.cc:670] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:55.612912 14803 tablet_copy_client.cc:538] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:55.618614 14797 tablet_copy_client.cc:806] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:55.619181 14797 tablet_copy_client.cc:670] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:55.623520 14802 tablet_copy_client.cc:538] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:55.623517 14797 tablet_copy_client.cc:538] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:55.628219 14803 tablet_bootstrap.cc:492] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:55.635831 14797 tablet_bootstrap.cc:492] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:55.639781 14802 tablet_bootstrap.cc:492] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:55.668401 14797 tablet_bootstrap.cc:492] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:55.669397 14797 tablet_bootstrap.cc:492] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:55.672295 14797 ts_tablet_manager.cc:1403] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.009s
I20260709 13:05:55.674739 14803 tablet_bootstrap.cc:492] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:55.675671 14803 tablet_bootstrap.cc:492] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:55.675382 14797 raft_consensus.cc:359] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:55.676365 14803 ts_tablet_manager.cc:1403] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.027s
I20260709 13:05:55.676419 14797 raft_consensus.cc:740] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:55.677326 14797 consensus_queue.cc:260] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:55.679603 14803 raft_consensus.cc:359] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:55.680361 14803 raft_consensus.cc:740] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:55.680940 14803 consensus_queue.cc:260] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:55.682685 14803 ts_tablet_manager.cc:1434] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:05:55.684782 13875 tablet_copy_service.cc:342] P b5029654a4384e43a68eb67b794949b7: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-49638a262b1d4ba9b26cde1d408bf7ac received from {username='slave'} at 127.0.0.1:42104
I20260709 13:05:55.685233 13875 tablet_copy_service.cc:434] P b5029654a4384e43a68eb67b794949b7: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-49638a262b1d4ba9b26cde1d408bf7ac on tablet 49638a262b1d4ba9b26cde1d408bf7ac with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:55.685751 14797 ts_tablet_manager.cc:1434] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:05:55.687537 13800 tablet_copy_service.cc:342] P 35ecb005831740438d7537dd4b840e03: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-2d67d303d4784301a07a1fa014f50b98 received from {username='slave'} at 127.0.0.1:45134
I20260709 13:05:55.687942 13800 tablet_copy_service.cc:434] P 35ecb005831740438d7537dd4b840e03: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-2d67d303d4784301a07a1fa014f50b98 on tablet 2d67d303d4784301a07a1fa014f50b98 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:55.689457 14802 tablet_bootstrap.cc:492] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:55.690339 14802 tablet_bootstrap.cc:492] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:55.691058 14802 ts_tablet_manager.cc:1403] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.010s
I20260709 13:05:55.693774 14802 raft_consensus.cc:359] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:55.694555 14802 raft_consensus.cc:740] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:55.695139 14802 consensus_queue.cc:260] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:55.697578 14802 ts_tablet_manager.cc:1434] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:55.699813 13800 tablet_copy_service.cc:342] P 35ecb005831740438d7537dd4b840e03: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-eb0e4fb02d3a45d4a6cc322c544fbf80 received from {username='slave'} at 127.0.0.1:45134
I20260709 13:05:55.700208 13800 tablet_copy_service.cc:434] P 35ecb005831740438d7537dd4b840e03: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-eb0e4fb02d3a45d4a6cc322c544fbf80 on tablet eb0e4fb02d3a45d4a6cc322c544fbf80 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:55.865233 14401 raft_consensus.cc:1217] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:55.976012 14401 raft_consensus.cc:1217] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:56.028438 14401 raft_consensus.cc:1217] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:56.104084 14401 raft_consensus.cc:1217] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:56.409821 14781 raft_consensus.cc:1064] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:05:56.412369 14781 consensus_queue.cc:237] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:56.419672 14401 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:56.421314 13862 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:56.422670 14805 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:56.423810 13713 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:56.425112 14805 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:56.427294 14806 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:56.444720 14806 raft_consensus.cc:2955] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.448625 13862 raft_consensus.cc:2955] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.447798 14401 raft_consensus.cc:2955] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.460291 13713 raft_consensus.cc:2955] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.465183 13614 catalog_manager.cc:5697] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:56.477849 14793 raft_consensus.cc:1064] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:05:56.480348 14793 consensus_queue.cc:237] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:56.486708 14805 raft_consensus.cc:1064] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:05:56.489059 14805 consensus_queue.cc:237] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:56.507530 14401 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:56.512940 13791 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:56.514256 13862 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:56.514671 14796 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:56.515359 14806 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:56.516007 13713 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:56.519723 14781 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:56.521929 13713 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:56.525755 14815 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:56.521966 14793 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:05:56.514964 14401 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:56.547384 14793 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:56.561380 14781 raft_consensus.cc:2955] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.565325 13715 raft_consensus.cc:2955] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.574129 14796 raft_consensus.cc:2955] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.575913 14401 raft_consensus.cc:2955] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.597283 13789 raft_consensus.cc:2955] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.597600 13610 catalog_manager.cc:5697] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.600783 13862 raft_consensus.cc:2955] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.599054 13791 consensus_queue.cc:237] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:56.606388 13711 raft_consensus.cc:2955] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.613472 13611 catalog_manager.cc:5697] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:05:56.656435 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 68737.6us
I20260709 13:05:56.658587 13713 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:56.675282 14833 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:56.675516 14401 raft_consensus.cc:2955] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.676800 14399 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:56.682297 14838 raft_consensus.cc:1064] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:05:56.684962 14838 consensus_queue.cc:237] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:56.685273 13713 raft_consensus.cc:2955] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.689682 14805 raft_consensus.cc:2955] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.690948 14831 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:56.695760 14399 raft_consensus.cc:2955] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.728262 13610 catalog_manager.cc:5697] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.739107 14399 raft_consensus.cc:1275] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:56.739225 13715 raft_consensus.cc:1275] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:56.740552 14805 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:56.741868 14832 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:56.745383 13599 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fe5150c5d9c445549ec6d199f2cd70e0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:56.747234 13865 raft_consensus.cc:1275] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:56.751368 13789 consensus_queue.cc:237] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:56.760308 13848 tablet_service.cc:1558] Processing DeleteTablet for tablet fe5150c5d9c445549ec6d199f2cd70e0 with delete_type TABLET_DATA_TOMBSTONED (TS b5029654a4384e43a68eb67b794949b7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59764
I20260709 13:05:56.757930 13862 consensus_queue.cc:237] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:56.764034 14399 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:56.767119 14838 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:56.777236 14837 raft_consensus.cc:2955] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.788265 14402 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:56.789166 14399 raft_consensus.cc:2955] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.790459 14796 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:56.801294 14796 raft_consensus.cc:2955] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.805617 14400 raft_consensus.cc:2955] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.812570 14806 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:56.877609 13713 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:56.879421 14793 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:56.884850 13711 raft_consensus.cc:2955] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.892932 13610 catalog_manager.cc:5697] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.918592 13601 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 49638a262b1d4ba9b26cde1d408bf7ac with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:56.926817 14842 tablet_replica.cc:333] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:05:56.930060 13865 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:56.932523 13612 catalog_manager.cc:5697] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.942408 13777 tablet_service.cc:1558] Processing DeleteTablet for tablet 49638a262b1d4ba9b26cde1d408bf7ac with delete_type TABLET_DATA_TOMBSTONED (TS 35ecb005831740438d7537dd4b840e03 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48902
I20260709 13:05:56.949740 14845 tablet_replica.cc:333] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:05:56.955138 14805 raft_consensus.cc:2955] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.960431 13703 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d67d303d4784301a07a1fa014f50b98 with delete_type TABLET_DATA_TOMBSTONED (TS b9d194f45e044e0988d5de1a99e5cd02 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49478
I20260709 13:05:56.966346 14401 raft_consensus.cc:2955] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.984907 14838 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:56.988392 14846 tablet_replica.cc:333] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:05:56.990612 13599 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2d67d303d4784301a07a1fa014f50b98 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:56.993022 14842 raft_consensus.cc:2243] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:56.994304 14842 raft_consensus.cc:2272] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:56.994982 13861 raft_consensus.cc:2955] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.994824 13713 raft_consensus.cc:2955] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:56.999316 14842 ts_tablet_manager.cc:1916] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:57.000734 13864 raft_consensus.cc:2955] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:57.009529 13610 catalog_manager.cc:5697] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:57.014719 14845 raft_consensus.cc:2243] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:57.022099 14845 raft_consensus.cc:2272] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:57.021377 14846 raft_consensus.cc:2243] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:57.023211 14846 raft_consensus.cc:2272] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:57.026132 14845 ts_tablet_manager.cc:1916] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:57.032128 14846 ts_tablet_manager.cc:1916] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:57.034085 14842 ts_tablet_manager.cc:1929] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:57.034541 14842 log.cc:1199] T fe5150c5d9c445549ec6d199f2cd70e0 P b5029654a4384e43a68eb67b794949b7: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-2-root/wals/fe5150c5d9c445549ec6d199f2cd70e0
I20260709 13:05:57.037081 13601 catalog_manager.cc:5028] TS b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): tablet fe5150c5d9c445549ec6d199f2cd70e0 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:05:57.039381 13789 consensus_queue.cc:237] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:57.045589 14401 raft_consensus.cc:1275] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:57.048401 13713 raft_consensus.cc:1275] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:57.050282 14838 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:57.052075 14838 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:57.060649 14846 ts_tablet_manager.cc:1929] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:57.061167 14846 log.cc:1199] T 2d67d303d4784301a07a1fa014f50b98 P b9d194f45e044e0988d5de1a99e5cd02: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-0-root/wals/2d67d303d4784301a07a1fa014f50b98
I20260709 13:05:57.067013 13600 catalog_manager.cc:5028] TS b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): tablet 2d67d303d4784301a07a1fa014f50b98 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:05:57.074762 14837 raft_consensus.cc:2955] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:57.075443 13713 raft_consensus.cc:2955] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:57.079223 14845 ts_tablet_manager.cc:1929] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:57.081154 14845 log.cc:1199] T 49638a262b1d4ba9b26cde1d408bf7ac P 35ecb005831740438d7537dd4b840e03: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-1-root/wals/49638a262b1d4ba9b26cde1d408bf7ac
I20260709 13:05:57.091082 14399 raft_consensus.cc:2955] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:57.095767 13599 catalog_manager.cc:5028] TS 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): tablet 49638a262b1d4ba9b26cde1d408bf7ac (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:05:57.096575 13599 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet eb0e4fb02d3a45d4a6cc322c544fbf80 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:57.096411 13610 catalog_manager.cc:5697] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:05:57.112957 13848 tablet_service.cc:1558] Processing DeleteTablet for tablet eb0e4fb02d3a45d4a6cc322c544fbf80 with delete_type TABLET_DATA_TOMBSTONED (TS b5029654a4384e43a68eb67b794949b7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59764
I20260709 13:05:57.113919 14842 tablet_replica.cc:333] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:05:57.114728 14842 raft_consensus.cc:2243] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:57.115322 14842 raft_consensus.cc:2272] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:57.118373 14842 ts_tablet_manager.cc:1916] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b5029654a4384e43a68eb67b794949b7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:57.131614 14842 ts_tablet_manager.cc:1929] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b5029654a4384e43a68eb67b794949b7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:57.132014 14842 log.cc:1199] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b5029654a4384e43a68eb67b794949b7: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-2-root/wals/eb0e4fb02d3a45d4a6cc322c544fbf80
I20260709 13:05:57.133456 13601 catalog_manager.cc:5028] TS b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): tablet eb0e4fb02d3a45d4a6cc322c544fbf80 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:05:58.175338 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:58.181864 13789 consensus_queue.cc:237] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
W20260709 13:05:58.188165 13755 consensus_peers.cc:597] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ab01257d4e56488eba41a0ce5c5e9954. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.188895 13861 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:58.189309 13713 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:58.189985 14805 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:58.190829 14837 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:58.198525 14837 raft_consensus.cc:2955] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:58.221189 13713 raft_consensus.cc:2955] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:58.233438 13865 consensus_queue.cc:237] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:58.233172 13857 raft_consensus.cc:2955] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:58.241758 13610 catalog_manager.cc:5697] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
W20260709 13:05:58.311138 13829 consensus_peers.cc:597] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7cc0929e3a64836993d9ee880b12800. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:58.314904 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 57964.8us
I20260709 13:05:58.322211 13713 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:58.324532 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 59703.5us
I20260709 13:05:58.329111 13789 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:58.340329 14860 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:58.349810 14860 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:58.358376 14796 raft_consensus.cc:2955] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:58.366506 13788 raft_consensus.cc:2955] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:58.383090 13711 consensus_queue.cc:237] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:58.384215 13789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:05:58.384914 13789 raft_consensus.cc:606] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Received request to transfer leadership to TS ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:58.390934 13791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3618fd55609843fca70082d3565b459b"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:05:58.391659 13791 raft_consensus.cc:606] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Received request to transfer leadership to TS ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:58.398746 13788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:05:58.399672 13788 raft_consensus.cc:606] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:05:58.402566 13713 raft_consensus.cc:2955] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:58.406427 13865 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:58.408237 14858 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:58.411441 13680 consensus_peers.cc:597] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: de09d01498e547e591ce4ebe62e59488. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.415220 13788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:05:58.416731 13788 raft_consensus.cc:606] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Received request to transfer leadership to TS ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:58.416600 13610 catalog_manager.cc:5697] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.418459 13791 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:58.422899 14758 raft_consensus.cc:2955] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:58.420744 13788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:05:58.424610 13788 raft_consensus.cc:606] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:05:58.424629 14812 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:58.434136 13865 raft_consensus.cc:2955] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:58.436385 13788 raft_consensus.cc:2955] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:58.453301 13791 consensus_queue.cc:237] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:58.458393 13614 catalog_manager.cc:5697] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:58.459443 13711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e689999f416446c9bf87d759da2844ae"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:05:58.460021 13711 raft_consensus.cc:606] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:05:58.461541 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:05:58.463132 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:58.482028 13715 raft_consensus.cc:1275] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:58.484077 13755 consensus_peers.cc:597] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44fb07fff88a4dcf97841a29f2641f66. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.486295 13865 raft_consensus.cc:1275] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:58.487744 14837 consensus_queue.cc:1048] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:58.488852 14850 consensus_queue.cc:1048] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:58.491010 14850 raft_consensus.cc:993] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03: : Instructing follower ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:05:58.491492 14850 raft_consensus.cc:1081] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Signalling peer ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:05:58.493682 14401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:56582
I20260709 13:05:58.494218 14401 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:58.494499 14401 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.499491 14401 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:58.504503 14401 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:58.506059 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:58.506227 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:58.507220 13857 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.506812 13791 raft_consensus.cc:3055] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:58.508306 13791 raft_consensus.cc:740] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:58.509038 13791 consensus_queue.cc:260] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:58.509797 13791 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.515542 13791 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:05:58.512632 14850 raft_consensus.cc:2955] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:58.518422 14366 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:05:58.519311 13865 raft_consensus.cc:2955] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:58.523057 13857 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:05:58.526816 14874 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:58.515962 13711 raft_consensus.cc:2955] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:58.530380 14874 raft_consensus.cc:697] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:05:58.531746 14874 consensus_queue.cc:237] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:58.538793 13614 catalog_manager.cc:5697] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:05:58.553066 13612 catalog_manager.cc:5697] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 1 to 2, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 2 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:58.619144 14852 raft_consensus.cc:993] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03: : Instructing follower b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:05:58.619673 14850 raft_consensus.cc:1081] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Signalling peer b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:05:58.621040 13857 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:59780
I20260709 13:05:58.621523 13857 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:58.621871 13857 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.629552 13857 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:58.632356 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:58.632913 13715 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.639299 13715 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:05:58.640398 13830 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:58.640427 13857 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:58.641162 14796 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:58.641355 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:58.641620 14796 raft_consensus.cc:697] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:05:58.641904 13791 raft_consensus.cc:3055] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:58.642223 13791 raft_consensus.cc:740] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:58.642388 14796 consensus_queue.cc:237] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:58.642884 13791 consensus_queue.cc:260] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:58.644037 13791 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.652999 13791 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:05:58.655946 14878 ts_tablet_manager.cc:933] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:58.664836 14878 tablet_copy_client.cc:323] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.130:36047
I20260709 13:05:58.665282 13610 catalog_manager.cc:5697] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 1 to 2, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 2 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:58.666540 13800 tablet_copy_service.cc:140] P 35ecb005831740438d7537dd4b840e03: Received BeginTabletCopySession request for tablet ab01257d4e56488eba41a0ce5c5e9954 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:45134)
I20260709 13:05:58.667099 13800 tablet_copy_service.cc:161] P 35ecb005831740438d7537dd4b840e03: Beginning new tablet copy session on tablet ab01257d4e56488eba41a0ce5c5e9954 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:45134: session id = ceb06175847b428ea8bd77055fcddf58-ab01257d4e56488eba41a0ce5c5e9954
I20260709 13:05:58.667214 14852 raft_consensus.cc:993] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03: : Instructing follower b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:05:58.667789 14852 raft_consensus.cc:1081] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Signalling peer b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:05:58.669636 13857 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:59780
I20260709 13:05:58.670154 13857 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:58.670527 13857 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.678567 13800 tablet_copy_source_session.cc:215] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:58.681531 14878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab01257d4e56488eba41a0ce5c5e9954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:58.681397 13857 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:58.684248 13857 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:58.684201 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:58.685034 13715 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.685276 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:58.685789 13791 raft_consensus.cc:3055] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:58.686050 13791 raft_consensus.cc:740] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:58.686697 13791 consensus_queue.cc:260] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:58.687814 13791 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.692416 13715 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:05:58.693811 13791 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:05:58.693750 13830 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:05:58.694819 14796 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:58.695289 14796 raft_consensus.cc:697] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:05:58.696099 14796 consensus_queue.cc:237] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:58.698978 14878 tablet_copy_client.cc:806] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:58.699640 14878 tablet_copy_client.cc:670] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:58.703950 14878 tablet_copy_client.cc:538] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:58.712406 14880 ts_tablet_manager.cc:933] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:58.714223 14878 tablet_bootstrap.cc:492] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:58.716475 13610 catalog_manager.cc:5697] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 1 to 2, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 2 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.719862 14880 tablet_copy_client.cc:323] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.131:46015
I20260709 13:05:58.721696 13875 tablet_copy_service.cc:140] P b5029654a4384e43a68eb67b794949b7: Received BeginTabletCopySession request for tablet c7cc0929e3a64836993d9ee880b12800 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:42104)
I20260709 13:05:58.722196 13875 tablet_copy_service.cc:161] P b5029654a4384e43a68eb67b794949b7: Beginning new tablet copy session on tablet c7cc0929e3a64836993d9ee880b12800 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:42104: session id = ceb06175847b428ea8bd77055fcddf58-c7cc0929e3a64836993d9ee880b12800
I20260709 13:05:58.728237 13865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59764
I20260709 13:05:58.728706 13865 raft_consensus.cc:606] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:05:58.729139 13875 tablet_copy_source_session.cc:215] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:58.731844 14880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7cc0929e3a64836993d9ee880b12800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:58.732663 13865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59764
I20260709 13:05:58.733112 13865 raft_consensus.cc:606] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Received request to transfer leadership
W20260709 13:05:58.734098 13601 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for ab01257d4e56488eba41a0ce5c5e9954 already in progress [suppressed 1 similar messages]
I20260709 13:05:58.740787 14878 tablet_bootstrap.cc:492] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:58.741515 13865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59764
I20260709 13:05:58.741999 14878 tablet_bootstrap.cc:492] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:58.742059 13865 raft_consensus.cc:606] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:05:58.742655 14878 ts_tablet_manager.cc:1403] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.012s
I20260709 13:05:58.745921 14880 tablet_copy_client.cc:806] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:58.745621 14878 raft_consensus.cc:359] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:58.746527 14880 tablet_copy_client.cc:670] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:58.746549 14878 raft_consensus.cc:740] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:58.747617 14878 consensus_queue.cc:260] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
W20260709 13:05:58.748394 13662 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:05:58.748850 13662 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for ab01257d4e56488eba41a0ce5c5e9954 already in progress
W20260709 13:05:58.749130 13662 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for ab01257d4e56488eba41a0ce5c5e9954 already in progress
I20260709 13:05:58.750051 14878 ts_tablet_manager.cc:1434] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:05:58.752700 13800 tablet_copy_service.cc:342] P 35ecb005831740438d7537dd4b840e03: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-ab01257d4e56488eba41a0ce5c5e9954 received from {username='slave'} at 127.0.0.1:45134
I20260709 13:05:58.753118 13800 tablet_copy_service.cc:434] P 35ecb005831740438d7537dd4b840e03: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-ab01257d4e56488eba41a0ce5c5e9954 on tablet ab01257d4e56488eba41a0ce5c5e9954 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:58.756986 14880 tablet_copy_client.cc:538] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:58.765808 14880 tablet_bootstrap.cc:492] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:58.785996 14880 tablet_bootstrap.cc:492] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:58.786883 14880 tablet_bootstrap.cc:492] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:58.787559 14880 ts_tablet_manager.cc:1403] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.022s	user 0.023s	sys 0.000s
I20260709 13:05:58.790400 14880 raft_consensus.cc:359] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:58.791440 14880 raft_consensus.cc:740] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:58.792181 14880 consensus_queue.cc:260] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:58.794914 14880 ts_tablet_manager.cc:1434] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:58.797017 13875 tablet_copy_service.cc:342] P b5029654a4384e43a68eb67b794949b7: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-c7cc0929e3a64836993d9ee880b12800 received from {username='slave'} at 127.0.0.1:42104
I20260709 13:05:58.797432 13875 tablet_copy_service.cc:434] P b5029654a4384e43a68eb67b794949b7: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-c7cc0929e3a64836993d9ee880b12800 on tablet c7cc0929e3a64836993d9ee880b12800 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:58.820708 14858 raft_consensus.cc:993] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02: : Instructing follower b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:05:58.821209 14858 raft_consensus.cc:1081] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Signalling peer b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:05:58.822630 13865 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e689999f416446c9bf87d759da2844ae"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:59792
I20260709 13:05:58.823072 13865 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:58.823498 13865 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.828687 13865 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:58.830304 14852 raft_consensus.cc:993] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03: : Instructing follower ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:05:58.830775 14852 raft_consensus.cc:1081] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Signalling peer ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:05:58.832846 13865 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:58.833369 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:58.833936 13791 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.834580 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:58.835129 13715 raft_consensus.cc:3055] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:58.835436 13715 raft_consensus.cc:740] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:05:58.838238 14401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:56582
I20260709 13:05:58.838763 14401 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:58.839110 14401 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.843842 13715 consensus_queue.cc:260] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:58.845014 13715 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.850081 13791 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:05:58.851279 13829 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:05:58.855952 13715 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:05:58.856528 14856 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:58.851162 14401 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:58.857049 14856 raft_consensus.cc:697] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:05:58.857903 14856 consensus_queue.cc:237] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:05:58.858973 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:58.864549 13791 raft_consensus.cc:3055] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:58.864858 13791 raft_consensus.cc:740] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:58.865582 13791 consensus_queue.cc:260] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:58.866585 13791 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.860816 14401 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:58.861936 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:58.876960 13857 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.885874 13857 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:05:58.887110 14368 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:05:58.888098 14874 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:58.888612 14874 raft_consensus.cc:697] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:05:58.889495 14874 consensus_queue.cc:237] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:58.897032 13612 catalog_manager.cc:5697] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 1 to 2, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 2 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:58.905560 13791 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:05:58.924479 14837 raft_consensus.cc:993] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03: : Instructing follower ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:05:58.925189 14852 raft_consensus.cc:1081] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Signalling peer ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:05:58.933501 14401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3618fd55609843fca70082d3565b459b"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:56582
I20260709 13:05:58.934067 14401 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:58.934818 14401 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.937248 14880 ts_tablet_manager.cc:933] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533)
I20260709 13:05:58.937685 13612 catalog_manager.cc:5697] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 1 to 2, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 2 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:58.939997 13857 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:58.941700 14874 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:58.952435 14401 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:58.956741 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:05:58.957373 13715 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.960194 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:05:58.960875 13788 raft_consensus.cc:3055] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:58.961230 13788 raft_consensus.cc:740] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:05:58.958206 14401 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:58.962077 13788 consensus_queue.cc:260] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:58.965380 13788 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.971864 14880 tablet_copy_client.cc:323] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.129:37533
I20260709 13:05:58.973281 13715 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:05:58.974601 14367 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:05:58.978073 13788 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:05:58.976328 14874 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:58.979779 14874 raft_consensus.cc:697] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:05:58.980782 14874 consensus_queue.cc:237] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:05:58.986657 13726 tablet_copy_service.cc:140] P b9d194f45e044e0988d5de1a99e5cd02: Received BeginTabletCopySession request for tablet de09d01498e547e591ce4ebe62e59488 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:58552)
I20260709 13:05:58.987236 13726 tablet_copy_service.cc:161] P b9d194f45e044e0988d5de1a99e5cd02: Beginning new tablet copy session on tablet de09d01498e547e591ce4ebe62e59488 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:58552: session id = ceb06175847b428ea8bd77055fcddf58-de09d01498e547e591ce4ebe62e59488
I20260709 13:05:58.995702 13726 tablet_copy_source_session.cc:215] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:59.007378 13610 catalog_manager.cc:5697] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 1 to 2, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 2 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:59.015865 14880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de09d01498e547e591ce4ebe62e59488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:59.022372 13791 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:59.024799 14875 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:59.038625 14878 ts_tablet_manager.cc:933] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:05:59.058843 14880 tablet_copy_client.cc:806] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:59.061369 14880 tablet_copy_client.cc:670] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:59.066066 14878 tablet_copy_client.cc:323] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.130:36047
I20260709 13:05:59.067656 13800 tablet_copy_service.cc:140] P 35ecb005831740438d7537dd4b840e03: Received BeginTabletCopySession request for tablet 44fb07fff88a4dcf97841a29f2641f66 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:45134)
I20260709 13:05:59.068151 13800 tablet_copy_service.cc:161] P 35ecb005831740438d7537dd4b840e03: Beginning new tablet copy session on tablet 44fb07fff88a4dcf97841a29f2641f66 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:45134: session id = ceb06175847b428ea8bd77055fcddf58-44fb07fff88a4dcf97841a29f2641f66
I20260709 13:05:59.065881 14880 tablet_copy_client.cc:538] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:59.072705 13788 raft_consensus.cc:1275] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.075515 14856 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:59.085186 13800 tablet_copy_source_session.cc:215] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:59.088282 14880 tablet_bootstrap.cc:492] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:59.088667 14878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44fb07fff88a4dcf97841a29f2641f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:59.098594 13715 raft_consensus.cc:1275] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.104959 14796 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:59.123672 13711 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:59.125140 14796 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:59.130954 14860 raft_consensus.cc:993] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7: : Instructing follower b9d194f45e044e0988d5de1a99e5cd02 to start an election
I20260709 13:05:59.131583 14863 raft_consensus.cc:1081] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Signalling peer b9d194f45e044e0988d5de1a99e5cd02 to start an election
I20260709 13:05:59.136669 13713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:49490
I20260709 13:05:59.138273 14401 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Advancing to term 2
I20260709 13:05:59.141659 13791 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:59.143604 14863 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:59.153086 14401 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEARNER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:59.156651 14880 tablet_bootstrap.cc:492] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:59.157642 14880 tablet_bootstrap.cc:492] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:05:59.158339 14880 ts_tablet_manager.cc:1403] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.070s	user 0.017s	sys 0.010s
I20260709 13:05:59.163132 14878 tablet_copy_client.cc:806] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:59.164462 14878 tablet_copy_client.cc:670] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:59.169133 14880 raft_consensus.cc:359] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:59.172200 14880 raft_consensus.cc:740] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:05:59.173998 14880 consensus_queue.cc:260] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:59.184902 14878 tablet_copy_client.cc:538] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:59.193800 14878 tablet_bootstrap.cc:492] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:05:59.196784 14880 ts_tablet_manager.cc:1434] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.004s
I20260709 13:05:59.217612 13726 tablet_copy_service.cc:342] P b9d194f45e044e0988d5de1a99e5cd02: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-de09d01498e547e591ce4ebe62e59488 received from {username='slave'} at 127.0.0.1:58552
I20260709 13:05:59.218303 13726 tablet_copy_service.cc:434] P b9d194f45e044e0988d5de1a99e5cd02: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-de09d01498e547e591ce4ebe62e59488 on tablet de09d01498e547e591ce4ebe62e59488 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:05:59.221678 14860 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:59.224021 14401 raft_consensus.cc:1217] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:59.283835 13865 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:59.284026 13716 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.285211 14875 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:59.302378 14796 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:05:59.324803 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 47590.8us
I20260709 13:05:59.340374 14399 raft_consensus.cc:1217] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:59.344609 13789 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.349646 14856 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:59.381559 13788 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:59.384771 14875 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:59.327785 13791 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:59.416150 14875 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:59.466404 13713 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:59.466938 13713 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.494043 13713 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:59.556717 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:59.568024 13713 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:05:59.667914 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:05:59.668519 13865 raft_consensus.cc:3055] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:59.668821 13865 raft_consensus.cc:740] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:05:59.704612 13865 consensus_queue.cc:260] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:05:59.705991 13865 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:59.836930 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 226713us
W20260709 13:05:59.850698 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.837733 13865 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:05:59.879446 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:05:59.881989 14901 log.cc:927] Time spent T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.454s	user 0.005s	sys 0.000s
W20260709 13:05:59.894030 14902 log.cc:927] Time spent T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:06:00.182802 14878 tablet_bootstrap.cc:492] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:00.183809 14878 tablet_bootstrap.cc:492] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:06:00.184844 14878 ts_tablet_manager.cc:1403] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.991s	user 0.040s	sys 0.015s
I20260709 13:06:00.188225 14878 raft_consensus.cc:359] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:00.189136 14878 raft_consensus.cc:740] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:06:00.189662 14878 consensus_queue.cc:260] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:00.192700 14878 ts_tablet_manager.cc:1434] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:00.303995 13682 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:00.304875 14758 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:00.305303 14758 raft_consensus.cc:697] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:00.306057 14758 consensus_queue.cc:237] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
W20260709 13:06:00.392920 13755 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.005s	sys 0.013s
W20260709 13:06:00.393285 13755 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.006s	sys 0.013s
I20260709 13:06:00.399824 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:00.400417 13791 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:00.410833 13679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.000s	sys 0.029s
W20260709 13:06:00.411190 13679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.000s	sys 0.029s
I20260709 13:06:00.411638 13791 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:00.415305 14919 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:00.415998 14919 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:00.420588 14919 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:00.425580 13715 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:00.434407 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:00.596357 14920 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:00.597118 14920 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:00.606295 14908 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:00.606842 14908 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:00.607234 14920 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:00.607904 14920 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:00.608891 14908 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:00.608596 14920 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:00.613112 14913 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:00.613288 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:00.613790 14913 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:00.615293 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:00.615994 13791 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:06:00.616755 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:00.614943 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:00.621290 14913 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:00.628855 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:00.652076 14903 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:00.652884 14903 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:00.663206 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:00.668228 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:00.671552 13680 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:00.672638 14915 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:00.673610 13680 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:00.704839 14796 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:00.705551 14796 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:00.708039 14796 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:00.708425 14796 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:00.708781 14796 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:00.710371 14796 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:00.710758 14796 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:00.711139 14796 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:00.714025 14796 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:00.722724 14903 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:00.743402 14908 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:00.744122 14908 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:00.747133 14908 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:00.751350 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:00.754817 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:00.765743 14915 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:00.766319 14915 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:00.766752 14915 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:00.775825 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 102293us
I20260709 13:06:00.776614 14921 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:00.777257 14921 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:00.779635 14796 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:00.780464 14921 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:00.781651 14903 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:00.783234 14903 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:00.785748 14903 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:00.780253 14796 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:00.796471 14796 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:00.802191 14919 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:00.802999 14919 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:00.804872 14915 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:00.807000 14915 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:00.807310 14919 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:00.814910 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:00.818271 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:00.819072 13791 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:06:00.821913 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:00.822590 13791 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.839794 14796 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:00.840566 14796 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:00.850091 14921 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:00.850703 14921 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:00.610972 14920 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:00.865011 14920 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:00.871667 14919 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:00.872368 14919 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:00.876190 14919 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:00.892226 14805 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:00.892887 14805 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:00.896703 14805 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:00.913932 14805 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:00.914535 14805 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:00.928776 14805 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:00.929606 14796 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:00.930471 14796 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:00.931214 14796 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:00.938118 13857 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.036s	user 0.037s	sys 0.047s
I20260709 13:06:00.938447 13791 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
W20260709 13:06:00.938596 13857 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.036s	user 0.037s	sys 0.047s
I20260709 13:06:00.938077 14927 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:00.939270 14927 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:00.912215 14915 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:00.942286 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 25) took 1043 ms. Trace:
I20260709 13:06:00.941973 14915 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:00.944377 14915 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:00.942749 13857 rpcz_store.cc:276] 0709 13:05:59.898631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.898817 (+   186us) service_pool.cc:224] Handling call
0709 13:05:59.901595 (+  2778us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.901817 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:00.939096 (+1037279us) log.cc:844] Serialized 14 byte log entry
0709 13:06:00.941935 (+  2839us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:00.941993 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:00.942050 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.942116 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:00.942233 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":278000,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"thread_start_us":1039398,"threads_started":2,"wal-append.queue_time_us":1669}
I20260709 13:06:00.944435 14860 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:00.941579 14927 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:00.945933 14927 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:00.946110 14796 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:00.945436 14860 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:00.946431 14927 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:00.946805 14903 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:00.947326 14903 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:00.948369 14927 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:00.949031 14927 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:00.949494 14903 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:00.949467 14927 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:00.950068 14903 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:00.950542 14903 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:00.951491 14927 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:00.953426 14903 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:00.953998 14928 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:00.954433 14928 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:00.957490 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:00.965679 14928 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:00.961563 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:00.966271 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:00.957317 14915 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:00.966962 14915 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:00.961660 14860 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:00.962353 14927 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:00.968282 14927 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:00.968901 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:00.970203 14927 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:00.971618 14915 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:00.970963 13611 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49436 (request call id 226) took 1108 ms. Trace:
I20260709 13:06:00.972829 13611 rpcz_store.cc:276] 0709 13:05:59.862766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.862903 (+   137us) service_pool.cc:224] Handling call
0709 13:06:00.970880 (+1107977us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:06:00.973167 14915 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:00.973502 13680 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:00.973735 14915 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:00.974699 13680 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:00.975744 14915 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:00.976207 14915 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:00.976493 14860 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:00.976653 14915 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:00.977113 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 48) took 1589 ms. Trace:
I20260709 13:06:00.977038 14860 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:00.978547 14915 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:00.977573 13788 rpcz_store.cc:276] 0709 13:05:59.387749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.388127 (+   378us) service_pool.cc:224] Handling call
0709 13:05:59.388507 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:59.389224 (+   717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.389411 (+   187us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:59.389973 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 13:05:59.821518 (+431545us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:59.828637 (+  7119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.836521 (+  7884us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:59.916435 (+ 79914us) raft_consensus.cc:1685] finished
0709 13:05:59.916463 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:00.977030 (+1060567us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":114,"thread_start_us":418522,"threads_started":1,"wal-append.queue_time_us":492910}
I20260709 13:06:00.986613 14930 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:00.980775 14915 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:00.979045 14920 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:00.987950 14920 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:00.987798 14930 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:00.988381 14920 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.989421 14915 raft_consensus.cc:697] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:00.990357 14915 consensus_queue.cc:237] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:00.983269 13754 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.526s	user 0.038s	sys 0.066s
W20260709 13:06:00.991950 13754 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.537s	user 0.040s	sys 0.066s
W20260709 13:06:00.984148 13681 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.277s	user 0.010s	sys 0.018s
W20260709 13:06:00.992439 13681 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.290s	user 0.011s	sys 0.018s
I20260709 13:06:00.993782 14927 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:00.994318 14927 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:00.984792 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:00.996260 13784 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:06:00.985807 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:00.997166 13791 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:06:00.997913 14927 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:01.001626 13791 raft_consensus.cc:1240] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:01.008405 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:00.979588 14860 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:01.010171 14920 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:01.015571 14920 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:01.016134 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 768) took 1710 ms. Trace:
I20260709 13:06:01.016371 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.016513 13716 rpcz_store.cc:276] 0709 13:05:59.305251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.305388 (+   137us) service_pool.cc:224] Handling call
0709 13:05:59.305744 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:59.569815 (+264071us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.569859 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:59.667346 (+ 97487us) log.cc:844] Serialized 26 byte log entry
0709 13:05:59.886078 (+218732us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:59.886131 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.886223 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:01.015884 (+1129661us) raft_consensus.cc:1685] finished
0709 13:06:01.015911 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:01.016059 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19822,"raft.queue_time_us":22059,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":72,"thread_start_us":382107,"threads_started":2,"wal-append.queue_time_us":279200,"wal-append.run_cpu_time_us":1686,"wal-append.run_wall_time_us":1006145}
I20260709 13:06:01.018208 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.022462 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.023717 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.024394 13783 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:06:01.023725 14917 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.027691 14805 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:01.027971 14917 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:01.028344 14805 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:01.030015 14917 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:01.031023 14928 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.031311 14805 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:01.031543 14928 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:01.031898 14860 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.032490 14860 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:01.033638 14928 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:01.034399 14860 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:01.035385 14927 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:01.036034 14927 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:01.038532 14927 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:01.039142 14927 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.040657 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:01.039880 14928 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:01.045420 14928 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:01.064966 13680 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:01.066499 14927 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:01.069990 14914 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.070526 14914 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:01.072633 14914 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:01.086083 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:01.087090 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:01.088296 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:01.093366 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:01.093976 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:01.093984 14921 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:01.094962 13861 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:01.096053 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:01.096585 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:01.099884 14401 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:06:01.100786 14860 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:01.101289 14860 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:01.108528 13789 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.177s	user 0.023s	sys 0.040s
W20260709 13:06:01.108992 13789 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.177s	user 0.023s	sys 0.040s
I20260709 13:06:01.110778 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:01.111204 14860 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:01.112128 13612 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49444 (request call id 230) took 1435 ms. Trace:
I20260709 13:06:01.112514 13612 rpcz_store.cc:276] 0709 13:05:59.677273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.711966 (+ 34693us) service_pool.cc:224] Handling call
0709 13:06:01.112069 (+1400103us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:06:01.124599 14758 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:01.126272 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:01.125113 14758 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:01.176704 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:01.177351 14890 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:01.207096 14930 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:01.125536 14928 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:01.176059 14933 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:01.067025 14917 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:01.213001 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:01.217110 14758 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:01.219893 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 155060us
I20260709 13:06:01.221400 13680 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:01.228222 14796 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.228864 14796 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:01.208001 14863 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.239395 14758 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.241518 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:01.240116 14915 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:01.242923 14796 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:01.246204 14758 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:01.211576 14903 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.247797 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:01.252959 13789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 51) took 1322 ms. Trace:
I20260709 13:06:01.238682 14856 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.253311 13789 rpcz_store.cc:276] 0709 13:05:59.930882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.931023 (+   141us) service_pool.cc:224] Handling call
0709 13:05:59.931330 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.931533 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:01.109369 (+1177836us) log.cc:844] Serialized 14 byte log entry
0709 13:06:01.252669 (+143300us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:01.252712 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:01.252748 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:01.252805 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:01.252908 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":98485,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"thread_start_us":1320514,"threads_started":2}
I20260709 13:06:01.254945 14758 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:01.255851 14940 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.241313 14928 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.236999 14917 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:01.327569 14922 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:01.327973 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.328896 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.329614 14938 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.330042 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:01.336683 14423 debug-util.cc:398] Leaking SignalData structure 0x7b08002deda0 after lost signal to thread 12597
I20260709 13:06:01.340181 14939 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:01.244704 14860 consensus_queue.cc:1059] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:06:01.316870 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.248411 14915 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:01.357048 13789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:06:01.362885 13789 raft_consensus.cc:606] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:06:01.357599 14927 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:01.365263 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:01.365947 14927 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:01.331089 14934 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.367278 14400 raft_consensus.cc:1217] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:01.371003 14911 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:01.251915 14903 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:01.374485 13716 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:01.347091 14930 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.382735 14930 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:01.384632 14860 raft_consensus.cc:3055] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:01.385172 14860 raft_consensus.cc:740] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:01.385277 14930 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:01.386291 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 256940us
I20260709 13:06:01.438328 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:01.438939 13863 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:06:01.357591 14928 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:01.444939 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 205780us
I20260709 13:06:01.367772 14913 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.370699 14915 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:01.305869 14856 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:01.356824 14938 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:01.461593 14938 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:01.351295 14922 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:01.464815 14922 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:01.466075 14922 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:01.435891 14940 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:01.466543 14922 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:01.438246 14911 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:06:01.446993 14423 debug-util.cc:398] Leaking SignalData structure 0x7b08002df4e0 after lost signal to thread 13648
I20260709 13:06:01.438923 14919 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:01.442390 14930 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.471894 13716 raft_consensus.cc:1240] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:01.248055 14863 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:01.473397 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:01.474225 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:01.474466 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:01.474264 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:01.472626 14913 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:01.476282 14940 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:01.476724 14856 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:01.476943 14917 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:01.250200 14933 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:01.471282 14911 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:01.485736 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:01.486059 14928 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:01.485772 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:01.250545 14890 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:01.489739 14922 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:01.444012 14934 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:01.498225 14948 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.456527 14860 consensus_queue.cc:260] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:01.479241 14919 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:01.386264 14939 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:01.505795 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:01.504212 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:01.470938 14932 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:01.483691 14930 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:01.514340 13682 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:01.515199 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:01.515834 13716 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 1.
I20260709 13:06:01.517840 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:01.520561 14953 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:01.520622 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:01.510118 14398 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:06:01.521799 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:01.531798 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:01.516130 14912 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:01.568418 14367 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:01.570014 14928 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:01.570478 14928 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.571120 14928 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:01.529119 14936 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:01.534011 14903 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:01.529398 14950 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
W20260709 13:06:01.602725 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 77783.1us
I20260709 13:06:01.603595 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:01.619251 13682 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:06:01.613797 14423 debug-util.cc:398] Leaking SignalData structure 0x7b0800337620 after lost signal to thread 13740
I20260709 13:06:01.624765 14951 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:01.613797 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.516407 14948 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:01.525841 14932 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:01.627202 14951 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:01.537187 14912 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:01.636947 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:01.637794 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:01.618988 13709 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 1.
I20260709 13:06:01.570441 14911 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
W20260709 13:06:01.640547 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 253006us
I20260709 13:06:01.648125 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:01.625622 14913 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:01.648039 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:01.649784 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:01.654471 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:01.655841 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:01.669001 13711 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:01.669144 13709 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8591822f3dc3430e935360afdb260fce"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:06:01.628705 14863 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:01.656810 14423 debug-util.cc:398] Leaking SignalData structure 0x7b080024ff60 after lost signal to thread 13815
I20260709 13:06:01.620409 14936 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:01.673491 13829 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:01.710441 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:01.705034 14423 debug-util.cc:398] Leaking SignalData structure 0x7b08002db800 after lost signal to thread 13816
I20260709 13:06:01.716485 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:01.669011 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.707949 13709 raft_consensus.cc:606] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:06:01.757923 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.707086 14919 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:01.761655 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:01.721750 14863 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:01.772643 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.780231 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.764608 13800 tablet_copy_service.cc:342] P 35ecb005831740438d7537dd4b840e03: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-44fb07fff88a4dcf97841a29f2641f66 received from {username='slave'} at 127.0.0.1:45134
I20260709 13:06:01.778689 14863 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:01.789258 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.782637 13829 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:01.797981 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.798545 13789 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 1.
I20260709 13:06:01.805382 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.807221 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:01.772342 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.787158 14930 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:01.809440 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:01.814953 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.813678 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:01.814416 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:01.820850 14957 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:01.756527 14890 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:01.797165 14423 debug-util.cc:398] Leaking SignalData structure 0x7b0800340760 after lost signal to thread 13889
I20260709 13:06:01.830403 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:01.814076 13800 tablet_copy_service.cc:434] P 35ecb005831740438d7537dd4b840e03: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-44fb07fff88a4dcf97841a29f2641f66 on tablet 44fb07fff88a4dcf97841a29f2641f66 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:01.807533 14863 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:01.836647 14955 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:01.838337 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:01.841766 14915 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:01.843918 14942 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:01.838861 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:01.844352 14942 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.844777 14942 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:01.838526 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:01.851006 13715 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:01.839649 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:01.853065 13713 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:06:01.839162 14368 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:01.838864 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:01.858291 14914 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:01.858747 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:01.859457 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.858302 14368 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:01.845958 14948 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:01.841302 14949 raft_consensus.cc:1064] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:06:01.856129 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:01.856258 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:01.835844 14916 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.853391 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.882220 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:01.883751 13713 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:01.882558 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:01.884593 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:01.842530 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:01.871699 14951 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:01.880733 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.837549 14912 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:01.881708 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:01.881058 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.870457 14368 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:01.886031 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.864316 14936 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:01.892417 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:01.841799 14955 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.883167 14927 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:01.910360 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.863858 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:01.904143 14890 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:01.915942 13708 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:01.916944 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:01.911170 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:01.887665 14911 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:01.919942 13680 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:01.921458 13680 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:01.926119 14758 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:01.931330 14758 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.914186 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.900803 14932 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:01.882161 14916 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:01.935492 14758 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:01.913264 14955 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:01.927757 14920 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:01.934736 14856 consensus_queue.cc:1059] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:01.941637 14954 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.942173 14954 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:01.929654 14957 consensus_queue.cc:1059] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:06:01.942327 14758 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:02.132629 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:02.136858 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 215474us
I20260709 13:06:02.147001 13864 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 1.
I20260709 13:06:02.138259 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:02.138389 14951 raft_consensus.cc:3055] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:02.142179 14932 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:02.158939 14951 raft_consensus.cc:740] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:02.159129 14932 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:02.158236 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:02.160027 14951 consensus_queue.cc:260] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:02.161361 14932 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:02.161490 14951 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.143539 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:02.081766 14928 consensus_meta.cc:287] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.000s
I20260709 13:06:02.144264 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:02.148207 13791 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:02.148501 13680 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:01.940063 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:01.974862 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:02.165469 13680 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:01.992695 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:01.951259 14933 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:02.240149 13680 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:02.168079 13716 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:06:02.183653 14758 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:02.184684 14958 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:01.952291 14856 consensus_queue.cc:1243] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Peer b9d194f45e044e0988d5de1a99e5cd02 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:06:02.182564 13829 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:02.166960 14932 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.167186 14928 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:02.242408 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 180822us
I20260709 13:06:02.244454 14366 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:02.246047 14366 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:02.107862 14942 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:02.247277 14366 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:02.249001 14366 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:06:02.240442 14423 debug-util.cc:398] Leaking SignalData structure 0x7b080034ce20 after lost signal to thread 14426
I20260709 13:06:02.249228 14927 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.249483 14903 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:02.251171 14423 debug-util.cc:398] Leaking SignalData structure 0x7b080034ce60 after lost signal to thread 14427
I20260709 13:06:02.262343 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:02.263806 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:02.264461 13788 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:02.266494 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:02.265043 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:02.268308 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:02.254247 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:06:02.248999 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 66510.7us
I20260709 13:06:02.275882 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:02.277315 14796 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:02.277776 14796 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:02.247134 14914 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.291501 13829 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:02.282555 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:02.249400 14957 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.250697 14890 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:02.302913 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:02.250756 14938 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.259989 14935 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:02.295665 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:02.309114 14796 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:02.316219 14796 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.310977 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:02.318408 14934 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:02.253340 14928 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:02.325461 14942 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:02.325687 14367 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:02.327090 14938 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:02.327474 14938 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:02.327837 14938 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.329587 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:02.304688 14890 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:02.308189 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:02.344079 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:02.313517 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:02.337749 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:02.347239 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:02.338853 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:02.353078 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:06:02.342193 14961 log.cc:927] Time spent T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:06:02.343518 14954 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:02.323519 14935 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:02.345475 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:02.346146 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:02.348495 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:02.349241 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:02.329751 14916 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:02.290679 14949 consensus_queue.cc:237] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:02.351649 13783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 1127) took 1285 ms. Trace:
I20260709 13:06:02.357722 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:02.345424 14890 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.251493 14958 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:02.353185 14955 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:02.373337 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:02.366802 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:02.383750 13713 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:02.396996 14805 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.397656 14805 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:02.362258 13783 rpcz_store.cc:276] 0709 13:06:01.065849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.067145 (+  1296us) service_pool.cc:224] Handling call
0709 13:06:01.852266 (+785121us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b580001c598. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9eee 0000000000375939 00007f523742d1e0 00007f52374f60c4 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:02.350689 (+498423us) spinlock_profiling.cc:243] Waited 5.73 ms on lock 0x7b580001c598. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9f8c 00007f522f3b9ef6 0000000000375939 00007f523742d1e0 00007f52374f60c4 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:02.350862 (+   173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:02.351083 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:02.351122 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:02.351281 (+   159us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:02.351335 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.351448 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:02.351584 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23305728}
I20260709 13:06:02.434504 14805 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:02.452478 14400 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEARNER]: Advancing to term 3
I20260709 13:06:02.452818 14935 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:02.437449 14916 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:02.460491 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 82812.7us
I20260709 13:06:02.461910 13680 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:02.467192 14958 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:02.467392 14903 raft_consensus.cc:1064] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:06:02.467428 14954 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.468606 14928 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:02.468753 13680 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:02.469435 14911 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.469122 14928 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:02.470489 13680 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:02.475383 13680 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:02.476081 13791 raft_consensus.cc:1275] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:02.470007 14903 consensus_queue.cc:237] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:02.474982 14940 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.477777 14916 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.489197 14938 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:02.501044 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 246) took 1155 ms. Trace:
I20260709 13:06:02.501688 14402 rpcz_store.cc:276] 0709 13:06:01.345971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.346689 (+   718us) service_pool.cc:224] Handling call
0709 13:06:01.979990 (+633301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:01.980145 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:01.980168 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:01.980204 (+    36us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:01.980232 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:01.980279 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:02.500778 (+520499us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b54005942d0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:02.500939 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1433963392}
I20260709 13:06:02.506116 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:02.507544 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:02.507597 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:02.519253 14368 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:02.520706 13790 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:02.520735 14934 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.509107 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:02.512331 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:02.524204 14368 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:02.525499 14934 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:02.525974 14934 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:02.526422 14934 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.546902 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:02.551642 14946 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:02.552013 14805 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:02.552397 14946 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:02.552706 14805 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:02.555023 14805 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:02.556003 14935 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:02.556653 14935 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:02.560742 14956 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:02.561407 14956 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:02.559175 14935 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:02.566216 13610 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57116 (request call id 134) took 2833 ms. Trace:
I20260709 13:06:02.566587 13610 rpcz_store.cc:276] 0709 13:05:59.798281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.802076 (+  3795us) service_pool.cc:224] Handling call
0709 13:06:02.566122 (+2764046us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49901,"reported_tablets":2}
W20260709 13:06:02.573993 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:02.575021 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.575950 14368 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:02.576217 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:02.577121 14968 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:02.578382 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 326775us
I20260709 13:06:02.579016 14366 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:02.518129 14915 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:02.519316 13711 raft_consensus.cc:2393] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 2: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:02.594347 14400 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEARNER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:02.481315 14928 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:02.599597 14399 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:02.607123 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.609966 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:02.611756 14368 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:06:02.611960 13830 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.026s	sys 0.033s
W20260709 13:06:02.612784 13830 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.026s	sys 0.033s
W20260709 13:06:02.614933 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 691991us
I20260709 13:06:02.623433 14796 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:06:02.624387 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 296403us
I20260709 13:06:02.624095 14796 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:02.603861 14968 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.581072 13612 catalog_manager.cc:5697] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 2 to 3, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 3 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.622682 13680 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:02.564106 14956 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:02.555128 14946 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:02.505347 14939 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:06:02.629678 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 338231us
I20260709 13:06:02.630342 13680 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:02.632570 13612 catalog_manager.cc:5697] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 1 to 2, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.619012 14928 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.615548 14914 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:02.635673 13756 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:02.637072 14955 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:02.640184 14796 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:02.638350 14914 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:02.629161 14908 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:02.647606 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:02.648793 13757 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:02.649176 14938 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:02.650099 14914 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:02.650861 14805 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:02.651347 14968 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:02.651880 14968 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:02.652436 14912 raft_consensus.cc:1064] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:06:02.653133 13756 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:02.653932 14968 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:02.654548 14974 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.648908 14908 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:02.651153 14860 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.657444 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:02.657686 14921 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:02.658136 14921 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:02.658510 14921 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:02.658680 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:02.659730 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:02.660969 13830 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:02.661705 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:02.662657 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:02.664446 13865 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:06:02.666097 14921 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:02.666647 14856 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.648572 13680 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:02.669543 14959 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.669807 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:02.669970 14908 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:02.670611 13680 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:02.671679 13830 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:02.671873 14921 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:02.672308 14959 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.674250 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:02.675041 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:02.676069 14922 raft_consensus.cc:993] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02: : Instructing follower 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:02.676026 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:02.676697 14916 consensus_queue.cc:1048] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:02.677100 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:02.677575 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.604175 14934 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:02.678309 13757 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:02.635707 14932 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:02.654148 13756 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:02.680815 14796 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.646535 14955 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:02.682106 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:02.708109 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 54023us
I20260709 13:06:02.708834 13756 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:02.682281 13830 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:02.689898 14367 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:02.691491 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:02.712642 13757 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:02.654546 14912 consensus_queue.cc:237] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:02.703970 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:02.707612 14974 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:02.714023 14796 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:02.714402 14796 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:06:02.701558 14863 consensus_meta.cc:287] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.849s	user 0.009s	sys 0.002s
I20260709 13:06:02.698846 13829 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:02.710457 14837 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:02.699976 14958 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.708161 14955 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:02.714744 14796 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.719960 13830 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:02.684333 14956 consensus_queue.cc:1059] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:06:02.724279 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:02.714679 14400 raft_consensus.cc:1240] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:02.725378 14805 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.739929 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:02.742367 13680 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:02.743355 14971 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:02.707919 13859 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:06:02.743798 14971 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:02.744062 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:02.744880 14402 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:02.745819 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:02.744210 14971 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.740774 14796 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:02.716966 14367 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:02.748795 14933 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.751469 14908 consensus_queue.cc:1059] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:02.724922 14837 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:02.731480 14946 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:02.736357 14955 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:02.753710 14837 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:02.753605 14957 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:02.754881 14856 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:02.747809 14398 raft_consensus.cc:1240] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:02.756479 14796 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:02.744691 14943 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:06:02.757498 14942 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.755712 14946 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:02.748030 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:02.748163 14940 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.755024 14944 raft_consensus.cc:1081] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Signalling peer 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:02.729565 14863 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:02.749972 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:02.752570 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:02.757539 14976 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.765672 14856 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:02.756157 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:02.756136 14921 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:06:02.767776 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 47908.4us
I20260709 13:06:02.764071 14916 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:06:02.771245 14367 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:02.768465 14858 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
W20260709 13:06:02.778096 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 69339.8us
I20260709 13:06:02.771708 14946 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.777124 14805 raft_consensus.cc:993] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03: : Instructing follower b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:02.780210 13861 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:02.781112 13830 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:02.781328 13756 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:02.781476 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:02.785127 14805 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:02.786867 14941 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.787981 13830 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:02.789204 13756 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:02.791008 14796 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.783254 14963 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:02.792543 14863 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:02.792969 14367 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:02.785944 14942 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.794869 13830 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:02.795509 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:02.785789 14968 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.785094 14956 raft_consensus.cc:1081] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Signalling peer b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:02.800135 13756 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:02.800817 14796 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.802026 13830 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:02.780588 14921 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:02.804878 14966 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.792543 14856 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:02.808058 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:02.810328 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:02.807444 13756 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:02.816555 14958 consensus_queue.cc:1059] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:02.818020 14796 raft_consensus.cc:3055] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:02.818427 14796 raft_consensus.cc:740] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:02.819262 14796 consensus_queue.cc:260] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:02.819929 14935 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.805374 14951 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:02.815742 13756 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:02.773263 14957 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:02.810928 14976 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:02.810680 14908 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:02.808089 14907 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:02.827561 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.805542 14890 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:02.831772 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:02.833349 14890 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:02.834336 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:02.820783 14935 consensus_queue.cc:1059] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:02.835273 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:02.827487 14850 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.834344 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:02.836336 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:02.844544 14837 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:02.839365 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:02.825771 14951 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:02.842981 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:02.860212 14398 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:06:02.864069 14399 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:02.849587 14951 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.849838 14908 raft_consensus.cc:3055] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:02.901232 14837 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:02.901805 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 1072) took 1140 ms. Trace:
I20260709 13:06:02.902210 13861 rpcz_store.cc:276] 0709 13:06:01.761012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.370873 (+609861us) service_pool.cc:224] Handling call
0709 13:06:02.371129 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:02.783381 (+412252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.901564 (+118183us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b5400120cd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:02.901745 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":940383488}
I20260709 13:06:02.907757 14973 raft_consensus.cc:3055] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:02.908206 14973 raft_consensus.cc:740] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:02.917641 13785 raft_consensus.cc:1240] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:02.916555 14973 consensus_queue.cc:260] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:02.920425 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:02.891469 14908 raft_consensus.cc:740] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:02.850919 14957 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:02.923787 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:02.927731 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:02.928258 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:02.928521 13711 raft_consensus.cc:2393] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 2: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:02.927805 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:02.928557 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:02.931380 14934 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:02.936230 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:02.924491 14973 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.939810 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:02.941181 14966 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.941250 14958 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:02.943455 14399 raft_consensus.cc:1275] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:02.947661 14805 consensus_queue.cc:1059] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:02.949601 14974 raft_consensus.cc:3055] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:02.949473 14837 consensus_queue.cc:1048] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:02.925158 13859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:06:02.965070 14796 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.950017 14974 raft_consensus.cc:740] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:02.969058 14980 raft_consensus.cc:3055] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:02.968016 13784 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8591822f3dc3430e935360afdb260fce"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:48928
I20260709 13:06:02.971204 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:02.969507 13859 raft_consensus.cc:606] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:06:02.945102 14966 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:02.946623 14921 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:02.973169 13859 raft_consensus.cc:614] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:02.950857 14958 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:02.980881 14958 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:02.981369 13859 raft_consensus.cc:1240] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:02.974974 14980 raft_consensus.cc:740] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:02.941984 14916 consensus_queue.cc:1059] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:06:02.971534 14974 consensus_queue.cc:260] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:02.975786 13784 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:02.986850 14974 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.987133 13784 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.994834 14980 consensus_queue.cc:260] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:02.988829 14976 consensus_queue.cc:1059] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:06:03.006982 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:03.007444 14934 raft_consensus.cc:3055] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:03.007844 14934 raft_consensus.cc:740] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:03.008633 14934 consensus_queue.cc:260] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:03.010919 14934 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.026386 14980 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.031512 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:03.035569 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:03.054960 13790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:06:03.055581 13790 raft_consensus.cc:606] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Received request to transfer leadership to TS ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:03.061527 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:03.040761 14963 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:03.065366 14963 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:02.951299 14908 consensus_queue.cc:260] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:03.079295 13829 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:03.082930 14942 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:03.082979 14850 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:03.083645 14942 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:03.084210 14942 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.084420 13788 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:03.079777 14860 consensus_queue.cc:1059] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:06:03.076184 14921 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:03.097957 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:03.096311 14966 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:06:03.128494 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 402362us
I20260709 13:06:03.111941 14908 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.135340 13757 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:03.137424 14951 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:03.113595 13788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:06:03.147652 13861 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:59780
I20260709 13:06:03.148443 13861 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:03.148896 13861 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.153918 13865 raft_consensus.cc:1275] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:03.156714 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:03.160533 14796 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:03.161173 14796 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:03.159934 14951 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:03.166584 14805 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:03.166951 14805 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:03.167243 14805 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.172892 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:03.173187 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:03.174012 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:03.174980 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:03.176281 14796 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:03.178756 14949 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:03.179593 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:03.180197 13859 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:06:03.183285 13861 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:03.172554 13788 raft_consensus.cc:606] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:06:03.186439 13861 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:03.173554 14805 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:03.186472 13858 raft_consensus.cc:1240] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:03.111152 14943 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
W20260709 13:06:03.211324 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.212787 14805 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:03.142236 14946 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:03.214912 14398 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:03.215010 14957 raft_consensus.cc:3055] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:03.225215 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:03.179370 14949 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:03.218963 14959 raft_consensus.cc:3055] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:03.217197 14946 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:03.216676 13784 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:03.231528 13783 raft_consensus.cc:1240] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:03.222703 14957 raft_consensus.cc:740] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:03.280098 14921 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:03.281283 13791 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:03.244268 14959 raft_consensus.cc:740] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:03.289633 13862 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:03.290359 14986 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:06:03.292713 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:03.252576 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:03.324486 14949 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:06:03.298589 14971 consensus_meta.cc:287] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.545s	user 0.013s	sys 0.000s
I20260709 13:06:03.355396 13863 raft_consensus.cc:1275] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:03.290225 14921 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
W20260709 13:06:03.346052 14955 consensus_meta.cc:287] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.003s
I20260709 13:06:03.389117 14949 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:03.343446 14971 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:03.436902 13864 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:03.438099 14971 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:03.439857 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:03.439450 14949 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:03.443149 14949 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:03.446547 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:06:03.447590 14988 log.cc:927] Time spent T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:06:03.328184 14957 consensus_queue.cc:260] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:03.450338 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:03.449604 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:03.404150 14955 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:03.429927 13784 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:03.465387 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:06:03.542395 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 87382.9us
I20260709 13:06:03.546911 13715 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:03.548605 13791 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:03.556574 13756 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:03.349153 14959 consensus_queue.cc:260] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:03.499074 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:03.588529 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:03.590862 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:03.592015 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:03.591051 14990 log.cc:927] Time spent T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:06:03.594472 14959 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.595882 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:03.597916 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:03.599010 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:03.600270 14921 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:03.602031 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:03.602622 13856 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.603922 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:06:03.604302 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 47812.7us
I20260709 13:06:03.604573 13785 raft_consensus.cc:3055] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:03.604996 13785 raft_consensus.cc:740] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:03.605764 13756 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:03.606472 13783 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:03.606842 13756 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:03.607760 14912 consensus_queue.cc:1048] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:03.608717 14805 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:03.609257 14993 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.609300 14805 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:03.614699 14963 consensus_meta.cc:287] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.549s	user 0.005s	sys 0.005s
W20260709 13:06:03.615233 14942 consensus_meta.cc:287] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.001s
I20260709 13:06:03.615664 14942 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:03.616791 14955 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:03.616917 13863 raft_consensus.cc:1240] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:03.617710 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 69485.6us
I20260709 13:06:03.620599 13789 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:03.608618 13756 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:03.635061 13788 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:03.640791 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:03.646993 13710 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:03.648944 14805 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:03.647953 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:03.650558 13856 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:03.652652 13757 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:03.652573 14366 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:03.653867 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:03.655918 13789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d07097a615d345468e43de064c67057d"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:06:03.656445 13789 raft_consensus.cc:606] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:06:03.657738 14366 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:03.657940 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:03.615145 14963 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:03.707958 13830 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:06:03.661248 14402 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.002s	sys 0.013s
I20260709 13:06:03.710251 13863 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:03.710692 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:03.728826 13710 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.711325 13864 raft_consensus.cc:1240] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:03.729257 13856 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:03.712169 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 54514.4us
W20260709 13:06:03.731323 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 78740.9us
W20260709 13:06:03.731635 14402 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.004s	sys 0.017s
I20260709 13:06:03.785593 13790 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:03.785647 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 77771.3us
I20260709 13:06:03.659518 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:03.797559 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:03.791929 13830 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:03.790685 13682 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:03.832152 13682 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:03.832700 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:03.833197 13682 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:03.796074 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:03.712198 14976 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:06:03.834911 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.730167 14934 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:03.836488 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 50356.7us
I20260709 13:06:03.837713 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:03.841004 13856 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.838912 13682 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:03.605803 13785 consensus_queue.cc:260] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:03.794123 14973 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:03.793102 14986 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:03.792435 14955 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:06:03.837391 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 45562.7us
I20260709 13:06:03.848114 14976 raft_consensus.cc:697] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:03.855578 13830 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:03.837368 14949 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:03.793938 14998 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.840473 14993 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:03.795310 14959 consensus_queue.cc:1059] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:06:03.846657 14921 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:03.845054 13858 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:03.846745 14973 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:03.866880 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:03.856678 14911 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:03.856926 13785 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.852532 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:03.867620 13711 raft_consensus.cc:2393] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 2: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:03.874135 13856 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
W20260709 13:06:03.866284 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 134979us
I20260709 13:06:03.902799 14366 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:03.877370 13830 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:03.842643 14966 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:06:03.860220 14933 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:03.877883 14971 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:03.877954 14974 consensus_queue.cc:1059] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:06:03.866323 14998 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:03.876528 14973 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.884408 14963 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:03.884735 14976 consensus_queue.cc:237] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:03.867583 14994 consensus_queue.cc:1059] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:06:03.858981 14955 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:03.864238 14949 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:03.893177 14942 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:03.866192 14946 consensus_queue.cc:1059] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:06:03.907864 14934 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:03.865590 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:06:03.919348 14999 log.cc:927] Time spent T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:06:03.930644 13785 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:03.901819 13710 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:03.878813 15002 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:03.937579 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 96563.4us
I20260709 13:06:03.926800 14997 raft_consensus.cc:993] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03: : Instructing follower ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:06:03.940094 13829 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:03.907357 13830 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:03.911640 15008 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:03.901660 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:03.916339 14955 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:03.916385 13711 raft_consensus.cc:1275] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:03.948472 13830 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:03.918406 14998 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:03.918318 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:03.949848 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:03.925006 14949 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:03.938346 14940 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:03.962734 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:03.963340 13788 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:03.964318 14971 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:03.964452 13787 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:03.952198 13712 raft_consensus.cc:3055] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:03.955699 15008 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:03.956213 14997 raft_consensus.cc:1081] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Signalling peer ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:06:03.948042 14966 raft_consensus.cc:2764] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:06:03.958379 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:03.967334 13712 raft_consensus.cc:740] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:03.961163 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:03.969022 13710 raft_consensus.cc:1240] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:03.974908 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 107535us
I20260709 13:06:03.977087 14995 raft_consensus.cc:3055] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:03.979187 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:03.979367 14955 consensus_queue.cc:1059] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:03.975966 13712 consensus_queue.cc:260] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:03.980430 13712 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:03.980769 14998 consensus_queue.cc:1175] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "35ecb005831740438d7537dd4b840e03" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:06:03.856595 14982 consensus_queue.cc:1175] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b5029654a4384e43a68eb67b794949b7" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:03.983378 14973 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:03.979429 14995 raft_consensus.cc:740] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:03.980468 14955 raft_consensus.cc:3055] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:03.988708 14955 raft_consensus.cc:740] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:03.975266 14911 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:03.988989 14995 consensus_queue.cc:260] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:03.989573 14955 consensus_queue.cc:260] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:03.989856 14911 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:03.990981 14955 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.991966 14911 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:03.990219 14995 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.995165 13680 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:03.996065 15012 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:03.984477 14946 raft_consensus.cc:993] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03: : Instructing follower b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:03.996827 15012 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.997219 15012 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.996850 14946 raft_consensus.cc:1081] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Signalling peer b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:04.001235 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:04.002091 14932 raft_consensus.cc:3055] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:03.987025 15010 raft_consensus.cc:3055] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:04.002549 14932 raft_consensus.cc:740] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:04.002789 15010 raft_consensus.cc:740] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:04.003557 14932 consensus_queue.cc:260] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:03.995281 14994 raft_consensus.cc:3055] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:04.004966 14994 raft_consensus.cc:740] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:04.005175 14932 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.005816 13788 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:04.005908 14994 consensus_queue.cc:260] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:04.013093 14959 raft_consensus.cc:1064] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:06:04.013284 13782 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:06:04.015251 14401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:56582
I20260709 13:06:04.015823 14401 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:04.016122 14401 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.017747 14366 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:03.993395 14973 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:04.019028 14366 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:04.020597 13712 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:04.023339 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:04.003703 15010 consensus_queue.cc:260] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:04.023928 13756 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:04.028585 15007 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:04.029069 13756 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:04.029234 15007 raft_consensus.cc:697] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:04.030285 14912 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:04.030143 15007 consensus_queue.cc:237] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:04.030905 14912 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:04.007313 14994 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:04.029098 14987 consensus_queue.cc:1175] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b9d194f45e044e0988d5de1a99e5cd02" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:06:04.026660 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:04.026721 14805 consensus_queue.cc:1048] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:04.027537 14963 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:04.034533 14963 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:04.022200 15005 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:04.036604 14963 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:04.030151 13756 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:04.039383 14963 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:04.039882 14963 raft_consensus.cc:697] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:04.040741 14963 consensus_queue.cc:237] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:04.028687 15010 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.042666 13788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:06:04.044178 13788 raft_consensus.cc:606] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Received request to transfer leadership to TS ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:04.033278 14401 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:04.047950 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 63096.8us
I20260709 13:06:04.049012 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:04.051985 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:04.024317 13712 raft_consensus.cc:2393] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 3: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:04.053954 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:04.060122 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:04.061201 13857 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:59780
I20260709 13:06:04.061738 13857 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:04.062080 14401 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:04.063969 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:04.065407 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:03.987663 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:04.067004 13864 raft_consensus.cc:2393] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 2: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:06:04.088505 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 249632us
I20260709 13:06:04.103048 13682 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:04.105221 13682 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:04.108614 13682 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:04.114923 13829 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:04.115972 14932 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:04.117022 15012 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:04.117808 15008 consensus_queue.cc:1059] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.118763 15008 raft_consensus.cc:3055] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:04.119020 15012 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:04.119083 15008 raft_consensus.cc:740] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:04.119942 15008 consensus_queue.cc:260] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:04.120718 15008 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.123692 14970 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:04.124200 14970 raft_consensus.cc:697] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:04.062121 13857 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.063975 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:04.128309 14970 consensus_queue.cc:237] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:04.112078 14916 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:04.110700 15005 raft_consensus.cc:697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:04.101670 15014 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.170804 15014 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:04.057286 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
W20260709 13:06:04.206813 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 181707us
I20260709 13:06:04.112025 13757 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:06:04.214428 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 102356us
I20260709 13:06:04.215726 13757 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:04.218348 13757 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:06:04.225387 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 276798us
I20260709 13:06:04.229928 13707 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:04.232728 15027 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:04.238634 15027 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:04.242357 15029 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:04.158838 14916 raft_consensus.cc:697] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:06:04.257392 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 104018us
I20260709 13:06:04.263743 15007 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:04.264143 13857 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:04.264875 15007 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:04.266705 13857 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:04.267218 14959 consensus_queue.cc:237] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:04.270087 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:04.270026 15005 consensus_queue.cc:237] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:04.272706 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 43989.8us
I20260709 13:06:04.273785 13830 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:04.157406 14986 consensus_queue.cc:1059] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:06:04.281492 15007 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:04.282070 14986 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:04.282305 14966 raft_consensus.cc:3055] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:04.282874 14966 raft_consensus.cc:740] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:06:04.287256 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 78611.9us
I20260709 13:06:04.288050 15018 consensus_queue.cc:1059] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:04.293840 14944 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:04.294135 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 185793us
I20260709 13:06:04.300143 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:04.302865 14368 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:04.304244 14934 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:04.307057 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:04.307902 13786 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:04.308305 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.310451 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:04.311256 13782 raft_consensus.cc:3055] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:04.311599 13782 raft_consensus.cc:740] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:04.310036 13791 raft_consensus.cc:2955] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:04.312849 13782 consensus_queue.cc:260] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:04.314462 13782 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.295724 13830 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:04.291275 14911 raft_consensus.cc:3055] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:04.317124 14911 raft_consensus.cc:740] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:04.254607 14916 consensus_queue.cc:237] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:04.323928 13857 raft_consensus.cc:1240] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:04.326342 14963 raft_consensus.cc:993] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03: : Instructing follower b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:04.327123 14963 raft_consensus.cc:1081] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Signalling peer b5029654a4384e43a68eb67b794949b7 to start an election
W20260709 13:06:04.327450 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.302153 14998 raft_consensus.cc:2955] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:04.330318 15014 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:04.296564 15007 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:04.331344 15007 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:04.318418 14911 consensus_queue.cc:260] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:04.334457 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:04.335589 13857 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d07097a615d345468e43de064c67057d"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:59780
I20260709 13:06:04.336640 13857 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:04.337090 13857 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.340456 15014 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:04.340574 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 65190.6us
I20260709 13:06:04.341455 14955 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:04.342214 14955 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:04.342665 13830 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:04.344816 14955 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:04.334594 14911 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.347118 15007 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:04.348819 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:04.350039 13784 raft_consensus.cc:1240] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:04.351995 14944 consensus_queue.cc:1048] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:04.353003 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:04.353951 13785 raft_consensus.cc:2393] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 3: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:04.355274 13682 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:04.343192 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:04.356448 15003 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:04.360491 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:04.360859 13786 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:04.362429 15014 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:04.363893 13830 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:04.364957 14970 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:04.365496 13830 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:04.372948 14957 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.373296 13830 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:04.376436 15002 consensus_queue.cc:1059] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:04.380010 13857 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:04.380993 13707 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.383226 13680 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:04.382221 14982 raft_consensus.cc:2955] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:04.384475 14933 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:04.387199 14955 raft_consensus.cc:3055] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:04.388018 14955 raft_consensus.cc:740] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:04.389019 14955 consensus_queue.cc:260] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:04.390462 14955 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.356606 14966 consensus_queue.cc:260] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:04.386401 14970 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:04.384977 14933 raft_consensus.cc:697] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:04.417263 14933 consensus_queue.cc:237] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:04.392231 13857 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:04.425115 15014 consensus_queue.cc:1059] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:04.426504 14401 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEARNER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:04.393177 13790 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:04.399165 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:06:04.408658 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.432150 13791 raft_consensus.cc:3055] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:04.432541 13791 raft_consensus.cc:740] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:04.433547 13791 consensus_queue.cc:260] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:04.434391 13791 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.441655 13791 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:04.442456 13829 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:04.445176 14970 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:04.447803 13786 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:04.449155 13612 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49428 (request call id 234) took 2266 ms. Trace:
I20260709 13:06:04.449328 14997 raft_consensus.cc:993] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03: : Instructing follower ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:06:04.449946 14997 raft_consensus.cc:1081] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Signalling peer ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:06:04.451905 14402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:56582
I20260709 13:06:04.452458 14402 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:04.452809 14402 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.465548 14971 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:04.466102 14971 raft_consensus.cc:697] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:04.445849 13707 raft_consensus.cc:1275] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:04.466858 14402 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:04.467085 14971 consensus_queue.cc:237] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:04.468072 13610 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49444 (request call id 231) took 1629 ms. Trace:
W20260709 13:06:04.474102 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.468456 13610 rpcz_store.cc:276] 0709 13:06:02.825945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.826073 (+   128us) service_pool.cc:224] Handling call
0709 13:06:03.219279 (+393206us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b54003edd54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232448090 00007f52324e6f3a 00007f523829d1cc 00007f523839b37e 00007f523685c2a4 00007f523685c232 00007f523685c161 00007f523685c0dc 00007f523685b392 00007f523081948c 00007f52308188c6
0709 13:06:04.455328 (+1236049us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73961,"reported_tablets":4,"spinlock_wait_cycles":723177216}
I20260709 13:06:04.480301 13611 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49436 (request call id 227) took 2232 ms. Trace:
I20260709 13:06:04.480737 13611 rpcz_store.cc:276] 0709 13:06:02.247723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.247831 (+   108us) service_pool.cc:224] Handling call
0709 13:06:04.480131 (+2232300us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":282121,"reported_tablets":3}
I20260709 13:06:04.480468 14399 raft_consensus.cc:2955] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:04.487216 14997 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:04.493744 14402 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:06:04.495010 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 121939us
I20260709 13:06:04.508036 15005 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:04.509986 14966 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.515246 13614 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57116 (request call id 135) took 1667 ms. Trace:
I20260709 13:06:04.515539 15009 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:04.515650 13614 rpcz_store.cc:276] 0709 13:06:02.836175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.836632 (+   457us) service_pool.cc:224] Handling call
0709 13:06:03.226891 (+390259us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54003edd54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232448090 00007f52324e6f3a 00007f523829d1cc 00007f523839b37e 00007f523685c2a4 00007f523685c232 00007f523685c161 00007f523685c0dc 00007f523685b392 00007f523081948c 00007f52308188c6
0709 13:06:04.501245 (+1274354us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":4,"spinlock_wait_cycles":678131584}
I20260709 13:06:04.516315 15009 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:04.517673 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:04.518361 13707 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.518713 15009 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:04.487876 14997 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:04.524641 14401 raft_consensus.cc:2955] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:04.526679 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:04.521668 15029 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:04.528878 15029 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:04.532778 14997 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:04.532925 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:04.533864 14393 raft_consensus.cc:2393] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 2: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:04.534608 15005 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:04.535173 15005 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:04.537506 15005 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:04.541167 13830 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:04.543431 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:04.544471 13864 raft_consensus.cc:2393] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 2: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:04.548648 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:04.551044 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:04.551932 13708 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 1.
I20260709 13:06:04.553718 13782 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:04.555172 13829 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:04.556211 13756 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:04.559819 14367 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:04.560782 15019 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:04.560912 15009 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:04.561245 15019 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:04.561986 15019 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.565768 15009 raft_consensus.cc:697] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:04.556298 14957 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:04.569492 15008 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:04.569577 14957 raft_consensus.cc:697] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:04.570281 15008 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.570582 13864 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.570801 15008 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:04.572150 15005 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.575335 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:04.577854 13782 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:04.577805 15005 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:04.579098 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:04.579900 14970 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:04.554432 13858 raft_consensus.cc:2955] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:04.531231 15029 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:04.575856 15008 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:04.580781 13707 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:04.582037 14367 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:04.576620 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:04.580286 14970 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.582891 15007 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:04.583225 14970 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.583369 15007 raft_consensus.cc:697] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:04.570598 14957 consensus_queue.cc:237] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:04.583258 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:04.586987 14934 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:04.590657 14934 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:04.592840 13860 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:04.593420 14934 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:04.593765 13682 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 2.052s (SENT)
I20260709 13:06:04.566847 15009 consensus_queue.cc:237] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:04.451077 13612 rpcz_store.cc:276] 0709 13:06:02.182962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.215122 (+ 32160us) service_pool.cc:224] Handling call
0709 13:06:04.448938 (+2233816us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:02.657915 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:02.696880 (+ 38965us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:02.700146 (+  3266us) write_op.cc:435] Acquired schema lock
0709 13:06:02.703129 (+  2983us) tablet.cc:662] Decoding operations
0709 13:06:02.751265 (+ 48136us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:02.751345 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:02.751376 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:06:02.751677 (+   301us) tablet.cc:701] Row locks acquired
0709 13:06:02.751695 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:06:02.751825 (+   130us) write_op.cc:270] Start()
0709 13:06:02.751932 (+   107us) write_op.cc:276] Timestamp: P: 1783602362751788 usec, L: 0
0709 13:06:02.751978 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 13:06:02.753604 (+  1626us) log.cc:844] Serialized 987 byte log entry
0709 13:06:03.840009 (+1086405us) op_driver.cc:464] REPLICATION: finished
0709 13:06:04.039140 (+199131us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f522f3d40ac 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f5235f14ef0
0709 13:06:04.105949 (+ 66809us) write_op.cc:301] APPLY: starting
0709 13:06:04.106046 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:04.112375 (+  6329us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:04.125568 (+ 13193us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:04.171805 (+ 46237us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:04.176034 (+  4229us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:06:04.176408 (+   374us) write_op.cc:312] APPLY: finished
0709 13:06:04.177222 (+   814us) log.cc:844] Serialized 29 byte log entry
0709 13:06:04.177375 (+   153us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:04.177451 (+    76us) write_op.cc:454] Released schema lock
0709 13:06:04.177493 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:04.177808 (+   315us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:04.177832 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":310966,"reported_tablets":6,"spinlock_wait_cycles":14848,"child_traces":[["op",{"apply.queue_time_us":265550,"apply.run_cpu_time_us":2248,"apply.run_wall_time_us":71858,"num_ops":2,"prepare.queue_time_us":5598,"prepare.run_cpu_time_us":39926,"prepare.run_wall_time_us":495779,"raft.queue_time_us":307713,"raft.run_cpu_time_us":22601,"raft.run_wall_time_us":440590,"replication_time_us":1037794,"spinlock_wait_cycles":44728704,"thread_start_us":794521,"threads_started":4,"wal-append.queue_time_us":489831}]]}
I20260709 13:06:04.595126 14368 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:06:04.596472 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 95040.9us
I20260709 13:06:04.586252 14955 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:06:04.586511 15005 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:04.598440 13864 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:04.600445 14934 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:04.616372 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 112830us
I20260709 13:06:04.598732 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:04.599792 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:04.622282 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:04.610307 14976 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:06:04.615836 14934 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.626009 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:04.599529 15007 consensus_queue.cc:237] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:04.630748 14970 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:04.595968 15019 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:04.631366 14940 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:06:04.647025 15019 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:04.652072 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:04.657811 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:04.662053 13713 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.634032 14934 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:04.664798 13791 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:04.680181 13857 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:04.680404 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:04.680975 13786 raft_consensus.cc:3055] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:04.681279 13786 raft_consensus.cc:740] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:04.681910 14971 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:04.684996 13713 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:04.690790 13707 raft_consensus.cc:2393] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 2: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:04.682459 14971 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:04.686033 14966 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:04.686344 13790 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:04.686803 15029 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:04.624174 13860 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:04.696151 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:04.697872 14367 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:04.699079 14971 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:04.700736 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:04.704319 13784 raft_consensus.cc:1275] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:04.682179 13786 consensus_queue.cc:260] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:04.706748 15019 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:04.713935 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:04.714617 14970 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:04.716475 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:04.720548 13791 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:04.720146 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:04.720714 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:04.721315 13782 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:04.721470 13785 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.722769 13786 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.720149 14934 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:04.724408 14903 raft_consensus.cc:2955] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:06:04.728297 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 134550us
I20260709 13:06:04.742246 14366 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:06:04.755404 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.755437 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:04.756378 13713 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:04.756846 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:04.760327 14976 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:04.760818 14976 raft_consensus.cc:697] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:04.761615 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:04.762224 13864 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:04.762961 15018 consensus_queue.cc:1059] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:04.764219 15018 raft_consensus.cc:3055] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:04.764623 15018 raft_consensus.cc:740] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:04.765657 15018 consensus_queue.cc:260] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:04.761650 14976 consensus_queue.cc:237] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:04.773365 13864 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:04.774523 14368 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:04.775658 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:04.775993 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:04.728235 13782 raft_consensus.cc:2955] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:04.778678 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:04.779314 14934 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:04.779466 13708 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.779598 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:04.780071 14934 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:04.780543 14934 raft_consensus.cc:697] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:04.787453 14399 raft_consensus.cc:1240] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:04.791318 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:04.792032 13712 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.795621 13713 raft_consensus.cc:1240] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:04.767308 15018 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.798346 14402 raft_consensus.cc:2955] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:04.801280 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:04.780997 13785 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:04.803462 14959 consensus_queue.cc:1059] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:04.801858 14934 consensus_queue.cc:237] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:04.788462 13786 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:04.830904 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:04.836313 15008 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:04.869133 15008 raft_consensus.cc:697] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:04.869204 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:06:04.892475 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 59618.7us
I20260709 13:06:04.874418 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:04.902102 15014 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.902685 15014 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:04.904484 14942 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:04.905031 14942 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:04.907027 14942 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:04.829420 14933 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:06:04.908648 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:04.909416 13786 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:04.910677 15014 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:04.911713 15008 consensus_queue.cc:237] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:04.914252 13829 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:04.914800 13712 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:04.916592 13756 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:04.917790 13756 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:04.919557 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:04.919978 14982 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:04.920342 14982 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:04.920460 14935 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:04.920727 14982 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.921214 13865 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:04.919337 13756 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:04.873971 13709 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.923589 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:04.923904 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:04.924248 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:04.920502 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:04.935138 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:04.935775 13790 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:04.936614 13861 raft_consensus.cc:2410] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:06:04.937078 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:04.937739 13863 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:04.938097 14912 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.911397 13864 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:04.951516 13713 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:04.930332 15014 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:04.954975 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:04.957756 15014 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.976480 15014 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:04.976867 13785 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:04.975761 14998 raft_consensus.cc:3055] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:04.991232 13682 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:04.994932 13830 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:04.999097 13713 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.006853 13682 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:04.990953 14998 raft_consensus.cc:740] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:05.015566 13790 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:05.021150 13830 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:04.999871 14959 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:05.026891 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:05.028688 14805 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:06:05.030359 13716 raft_consensus.cc:2955] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:05.035776 14921 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:05.023159 14942 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:05.054601 13830 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:05.048336 14970 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:05.025486 14957 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:06:05.075166 13830 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:05.049741 15019 raft_consensus.cc:697] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:05.085369 14958 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:05.087674 14912 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:05.091894 13782 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.082664 14942 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:05.114076 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 374467us
I20260709 13:06:05.076082 14998 consensus_queue.cc:260] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:05.102146 14921 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:05.104175 14911 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:05.123904 14366 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:05.122957 13708 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:05.128551 15007 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:05.139083 14998 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:05.147111 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 72033.4us
I20260709 13:06:05.149534 14858 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:05.148279 15019 consensus_queue.cc:237] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:05.152669 14942 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:05.167835 14942 consensus_queue.cc:1059] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:05.141301 15018 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:05.169039 15052 raft_consensus.cc:3055] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:05.168815 15018 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:05.169415 15052 raft_consensus.cc:740] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:05.170359 15052 consensus_queue.cc:260] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:05.173949 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:05.178277 13790 raft_consensus.cc:2393] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 3: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:05.150066 14858 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:05.197351 14858 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:05.197909 15041 log.cc:927] Time spent T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.156s	user 0.004s	sys 0.000s
I20260709 13:06:05.198865 13709 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:05.199586 14903 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.200042 14903 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:05.203789 14805 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:05.204237 14805 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:05.206034 14805 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:05.207705 14982 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:05.171376 15018 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:05.210315 14982 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:05.212800 15057 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:05.213310 15057 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:05.215209 14903 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:05.219515 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:05.220268 14399 raft_consensus.cc:2393] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 2: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:05.215402 15057 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:05.229017 13713 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.229491 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:05.230173 13708 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:05.174679 13830 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:06:05.232851 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 93003.1us
W20260709 13:06:05.234592 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 59968.6us
I20260709 13:06:05.231087 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:05.243816 14366 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:05.247007 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:05.261797 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 118198us
I20260709 13:06:05.272003 15008 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:05.272791 15008 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:05.273561 15059 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:05.275434 15008 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:05.277593 15008 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.278179 15008 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:05.282593 13756 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:05.285403 13864 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.287402 14805 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:05.286846 13857 raft_consensus.cc:2393] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 2: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:06:05.287328 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 44599.4us
I20260709 13:06:05.287918 14805 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:05.288245 14805 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.290830 13790 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:05.246562 15057 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:05.297963 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:05.300925 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:05.211352 15014 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:05.286978 15007 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:05.306636 13856 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.286898 15008 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:05.248064 14966 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
W20260709 13:06:05.316449 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 68007.4us
I20260709 13:06:05.252636 14944 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:06:05.322031 13682 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:05.280881 15046 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:06:05.323289 13682 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:05.288661 14982 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:06:05.323431 15018 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:05.311467 15007 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:05.334409 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:05.319332 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 54759.7us
I20260709 13:06:05.336727 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:05.336982 15063 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:06:05.337527 13789 raft_consensus.cc:2393] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 2: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:05.338847 14940 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:05.342056 15014 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:05.342976 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:05.343612 13709 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:05.344410 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:05.345799 13709 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.351830 14805 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:05.352344 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 50273.7us
I20260709 13:06:05.348627 13784 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:05.323740 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:05.357726 13682 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:05.364362 13856 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.349802 15007 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.367040 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:05.408036 14805 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:05.412096 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 109346us
W20260709 13:06:05.414002 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.363219 14955 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:05.417042 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 126339us
I20260709 13:06:05.429344 15068 consensus_queue.cc:1059] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:05.408401 13860 raft_consensus.cc:2376] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2. Re-sending same reply.
I20260709 13:06:05.416380 15052 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.424007 14959 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:05.408842 15046 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:06:05.425225 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:05.454514 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.424607 13861 raft_consensus.cc:2955] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:05.456837 15009 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.551174 15009 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:05.553305 15009 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:05.556661 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:05.454833 13709 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:05.454705 14933 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:05.575779 15062 raft_consensus.cc:3055] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:05.578238 15062 raft_consensus.cc:740] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:05.579447 15062 consensus_queue.cc:260] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:05.581194 15062 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:05.558422 13785 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:05.596026 14940 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:05.596588 14940 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:05.592010 14858 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:05.570441 14944 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:05.572467 14959 raft_consensus.cc:697] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:05.608361 14940 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:05.608666 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:05.616396 13788 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:05.622586 14943 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.202s
I20260709 13:06:05.605495 14903 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:06:05.638203 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.635572 15068 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:06:05.593806 14933 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:05.645748 14903 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:05.645454 13830 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:05.623709 14940 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:05.652026 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:05.652288 14903 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:05.652943 13791 raft_consensus.cc:2393] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 2: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:05.620086 14858 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:05.649930 14944 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:05.654667 14858 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:05.656278 14944 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:05.656710 15007 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:05.657619 13784 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:05.659828 14959 consensus_queue.cc:237] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:05.665395 13830 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:06:05.665748 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.648919 13788 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:06:05.650671 15071 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:05.684046 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:05.685093 13710 raft_consensus.cc:2393] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 2: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:05.687369 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:05.689759 13782 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:05.692276 13707 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:05.694590 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:05.676982 14940 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:05.681672 13860 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:05.681855 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:05.699559 14940 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:05.683578 14933 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:05.684357 14971 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:05.677121 13788 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:05.704296 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:05.704728 13756 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:05.714583 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:06:05.719717 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 68643.1us
I20260709 13:06:05.744359 15071 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:05.733457 15046 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:06:05.733678 15063 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:06:05.747255 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:05.747931 13782 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:05.748672 13708 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
W20260709 13:06:05.753961 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 49335.8us
I20260709 13:06:05.714473 14971 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:05.764750 13830 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:05.769452 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:05.770254 13716 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:05.770784 13756 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:05.772468 13682 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:05.772738 13756 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:06:05.767293 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 340948us
I20260709 13:06:05.757097 14982 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:05.760004 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:05.778249 15070 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:05.778434 13707 raft_consensus.cc:1275] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.778786 14912 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:05.779567 15069 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.780053 15069 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:05.782109 15069 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:05.786126 13716 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:06:05.773993 15008 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:05.788823 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:05.795472 14393 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:06:05.795958 14393 pending_rounds.cc:85] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 4
I20260709 13:06:05.796283 14393 pending_rounds.cc:107] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:06:05.796366 14970 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.796602 14393 raft_consensus.cc:2889] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:05.797178 14970 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:05.800302 14970 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:05.803126 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:05.762804 14971 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.813740 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:05.814761 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:05.767485 15007 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:05.819509 14402 raft_consensus.cc:1240] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:05.829325 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:05.961473 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:05.847957 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.972957 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:05.830159 13710 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
W20260709 13:06:05.854609 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 47250.8us
I20260709 13:06:05.974349 13756 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:05.810674 14970 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.815559 14933 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:05.980471 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:05.873183 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 100814us
I20260709 13:06:05.980868 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:05.979578 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:05.961699 14966 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.853077 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:05.989607 15067 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:05.994635 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:05.963258 13784 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:05.830286 15008 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.870110 15070 raft_consensus.cc:697] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:05.852811 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:05.830749 14982 raft_consensus.cc:697] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:05.990397 13829 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:06.002671 13861 raft_consensus.cc:2393] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 2: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:06.005453 13830 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:06.000492 15067 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.946040 15013 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 13:06:06.019394 14933 raft_consensus.cc:697] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:06.019893 15014 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:06.055984 15014 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:06.058145 15014 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:06.003443 14958 consensus_queue.cc:1048] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:06:06.056022 14933 consensus_queue.cc:237] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:06.052768 13680 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:06.066457 15057 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:06.067118 15057 raft_consensus.cc:697] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:06.070309 15081 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:06:06.071802 15070 consensus_queue.cc:237] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:06.039570 15067 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:06.078647 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 49199.3us
I20260709 13:06:06.034485 14966 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:06.009217 14970 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:06.081434 14982 consensus_queue.cc:237] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:06.036067 15082 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:06.098213 15082 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:06.098671 15082 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:06.043147 15008 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:06.101074 15008 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:06.102193 14911 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.102550 15067 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:06.102715 14911 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:06.106918 15057 consensus_queue.cc:237] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:06.107702 13858 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 2: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:06.105528 13860 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:06.106020 15013 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.063244 14971 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:06.102734 14966 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:06:06.123164 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 148616us
I20260709 13:06:06.097716 15055 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:06.125413 13856 raft_consensus.cc:2955] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:06:06.146211 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 148566us
I20260709 13:06:06.152803 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:06.153659 13710 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
W20260709 13:06:06.155925 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.159863 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:06.163745 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 173459us
I20260709 13:06:06.169720 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:06.170338 13864 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:06.169220 13830 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:06.118923 15013 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:06.182016 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:06.171968 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:06.173354 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:06.179329 14911 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:06.181635 15014 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:06:06.225045 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 55930.6us
I20260709 13:06:06.266731 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:06.228926 13785 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:06.238396 14994 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.188143 15070 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.234526 14942 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:06.218878 15051 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:06.233274 15091 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.235824 13784 raft_consensus.cc:1275] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:06.276291 15067 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:06.282835 15090 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:06.311491 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:06.312248 13790 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 3: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
W20260709 13:06:06.312500 15086 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:06:06.311709 15090 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:06.290162 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:06.313757 13709 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:06.308928 14971 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:06.302568 13860 raft_consensus.cc:2393] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 2: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:06.317610 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:06.283208 14970 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:06:06.319574 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 139723us
I20260709 13:06:06.326426 13829 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:06.288300 14942 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.328017 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:06.329341 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:06.282713 14994 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:06.279088 15014 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:06.332087 14942 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:06.340303 14994 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:06.296044 15070 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:06.302604 15091 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:06.358433 15007 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:06.359022 15007 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:06.361001 15007 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:06.361032 15014 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:06.362499 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:06.363641 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:06.363641 13860 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:06:06.364478 15090 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:06.367798 13757 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:06.364490 13711 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:06.371345 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:06.375957 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:06.379964 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:06.380746 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1121) took 1095 ms. Trace:
I20260709 13:06:06.381069 13863 rpcz_store.cc:276] 0709 13:06:05.285403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.286201 (+   798us) service_pool.cc:224] Handling call
0709 13:06:06.379817 (+1093616us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b5800021698. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:06:06.380675 (+   858us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8325888}
I20260709 13:06:06.382885 13680 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:06.384004 13680 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:06.384534 15007 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.385020 15007 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:06.385800 14933 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:06.386438 14933 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:06.386747 15091 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:06.387094 15007 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:06.387327 13789 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:06.341023 15103 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:06.390805 14367 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:06.370834 14912 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:06.549015 13860 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:06.549242 15101 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:06.367194 15057 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.172s
I20260709 13:06:06.549691 15091 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:06.550474 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:06.550977 15067 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.551443 14935 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:06:06.553941 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:06.519086 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 123741us
W20260709 13:06:06.442802 15096 log.cc:927] Time spent T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:06:06.442058 15061 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:06.570320 13856 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 2: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:06.545902 14912 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.565809 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:06.554124 15013 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:06.654541 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 85689.4us
I20260709 13:06:06.669603 14805 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.670307 14805 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:06.672411 15100 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.672940 15100 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:06.675523 14970 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:06.675920 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:06.676519 13859 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:06.570869 15101 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:06.679567 15101 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:06.583024 14935 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:06.683573 14935 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:06.687227 15111 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:06.687769 15111 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:06.703061 15111 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:06.575887 15061 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:06.705123 15061 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.585386 14912 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:06.703166 14970 consensus_queue.cc:1048] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:06.704013 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 47720.7us
I20260709 13:06:06.704121 13709 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:06.704380 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:06.558094 15082 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:06.730690 14805 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:06.576244 15067 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:06.571935 15091 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:06.745970 14368 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:06.748703 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:06.753686 15067 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:06.764649 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:06.724924 15070 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:06.800300 13857 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:06.800760 13865 raft_consensus.cc:1240] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:06.761566 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:06.747488 13708 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:06.777454 15082 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:06.777949 14942 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:06.789817 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 43961.2us
I20260709 13:06:06.789819 13712 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:06.803268 15110 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:06.805998 15091 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:06.807240 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 1118) took 1517 ms. Trace:
I20260709 13:06:06.811906 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:06:06.825515 13712 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 846) took 1558 ms (client timeout 1826 ms). Trace:
W20260709 13:06:06.800078 15113 log.cc:927] Time spent T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.056s	user 0.003s	sys 0.000s
I20260709 13:06:06.813561 13857 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:06.826896 13865 rpcz_store.cc:276] 0709 13:06:05.284392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.284521 (+   129us) service_pool.cc:224] Handling call
0709 13:06:06.797366 (+1512845us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b5800021698. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:06.797600 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.801260 (+  3660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.801484 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9090944}
I20260709 13:06:06.824560 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 208) took 1705 ms. Trace:
I20260709 13:06:06.827841 14367 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:06.821264 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:06.830163 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 1123) took 1544 ms. Trace:
W20260709 13:06:06.825980 13712 rpcz_store.cc:269] 0709 13:06:05.266761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.267126 (+   365us) service_pool.cc:224] Handling call
0709 13:06:06.748548 (+1481422us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b5800003398. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:06:06.825440 (+ 76892us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34123008}
I20260709 13:06:06.830085 14402 rpcz_store.cc:276] 0709 13:06:05.119045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.119206 (+   161us) service_pool.cc:224] Handling call
0709 13:06:05.139809 (+ 20603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:05.819989 (+680180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.824256 (+1004267us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54004c18d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:06.824466 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1562487040}
I20260709 13:06:06.831369 13857 rpcz_store.cc:276] 0709 13:06:05.286010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.292662 (+  6652us) service_pool.cc:224] Handling call
0709 13:06:06.795205 (+1502543us) spinlock_profiling.cc:243] Waited 5 ms on lock 0x7b5800021698. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:06.795401 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.829937 (+ 34536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.830111 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11492736}
I20260709 13:06:06.844491 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:06.845042 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:06.822732 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:06.845659 13715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 848) took 1530 ms. Trace:
I20260709 13:06:06.846269 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:06.846139 13715 rpcz_store.cc:276] 0709 13:06:05.268808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.268963 (+   155us) service_pool.cc:224] Handling call
0709 13:06:06.757877 (+1488914us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b5800003398. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:06.758019 (+   142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.788590 (+ 30571us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.788620 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:06.798747 (+ 10127us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:06.798790 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.798849 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:06.798961 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42539392}
I20260709 13:06:06.845049 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:06.848143 13715 raft_consensus.cc:1275] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:06.848489 14940 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:06.845844 13782 raft_consensus.cc:2393] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 2: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:06.845574 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:06.810475 13709 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:06.833242 15110 raft_consensus.cc:697] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:06.884393 15110 consensus_queue.cc:237] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:06.886489 15101 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.887005 15101 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:06.887555 15111 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:06.865768 13786 raft_consensus.cc:2368] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 2. Current term is 3.
W20260709 13:06:06.864966 15080 log.cc:927] Time spent T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.751s	user 0.004s	sys 0.009s
I20260709 13:06:06.866336 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:06.898159 13715 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:06.867679 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:06.870991 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 844) took 1606 ms. Trace:
I20260709 13:06:06.872699 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1131) took 1058 ms. Trace:
I20260709 13:06:06.873790 15091 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:06.849016 14940 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:06.876422 13612 catalog_manager.cc:5697] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 1 to 3, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 3 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.879140 15051 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:06.887710 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:06.849180 15059 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:06.849725 15005 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:06.833282 14942 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:06.915791 13713 rpcz_store.cc:276] 0709 13:06:05.264941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.265060 (+   119us) service_pool.cc:224] Handling call
0709 13:06:06.870341 (+1605281us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b5800003398. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:06.870529 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.870702 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.870725 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:06.870761 (+    36us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:06.870788 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.870835 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:06.870927 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53866368}
I20260709 13:06:06.930176 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:06.938028 13711 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:06:06.927731 13863 raft_consensus.cc:1275] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:06.931352 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:06.934353 13862 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 2: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:06.853876 14997 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:06.939013 13680 leader_election.cc:400] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 2. Current term is 3.
I20260709 13:06:06.947700 13680 leader_election.cc:403] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:06.942965 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.897387 15052 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:06.830132 14912 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:06.930328 13612 catalog_manager.cc:5697] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index 2 to 5, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.824846 15061 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:06.909125 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:06.958420 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 59144.6us
I20260709 13:06:06.950909 13612 catalog_manager.cc:5697] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 1 to 2, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 2 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:06:06.954026 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 104093us
I20260709 13:06:06.934233 15051 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:06.966166 13612 catalog_manager.cc:5697] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 1 to 2, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.963704 13712 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:06.934194 15059 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.909283 15046 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:06:06.972384 13791 raft_consensus.cc:2393] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 3: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:06.977607 14399 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:06.977891 14367 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:06.956915 15005 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:06.976667 15082 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 2. Current term is 3.
I20260709 13:06:06.981003 15072 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:06.981734 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:06.981536 15072 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:06.984289 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:06.984876 13782 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:06.985086 15072 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:06.968276 15059 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:06.985796 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:06.988147 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:06.990479 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:06.991262 13782 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 3: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:06.957427 14933 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:06.939826 15091 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:06.994095 13680 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:07.000481 13680 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:06.929313 13858 rpcz_store.cc:276] 0709 13:06:05.814601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.818324 (+  3723us) service_pool.cc:224] Handling call
0709 13:06:06.872481 (+1054157us) spinlock_profiling.cc:243] Waited 84.6 ms on lock 0x7b54002d9bd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:06.872637 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194613120}
I20260709 13:06:07.002616 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:06.955592 14997 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:06.959620 15052 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:07.006557 13829 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:06.992973 15046 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:06.970592 13612 catalog_manager.cc:5697] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:07.019515 13682 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:07.012857 14942 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.011858 15101 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:07.029511 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:07.012451 15046 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:07.029799 15005 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:07.022313 14955 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:07.001832 14933 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:07.034281 15052 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:07.024068 14940 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:07.025992 15010 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.043562 13786 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:07.054467 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:07.057627 13829 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:07.059597 14912 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:07.061093 15077 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:07.061304 14997 leader_election.cc:290] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:07.061676 15077 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:07.042735 13783 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.320s	user 0.012s	sys 0.019s
I20260709 13:06:07.055689 13786 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
W20260709 13:06:07.064335 13783 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.412s	user 0.014s	sys 0.020s
I20260709 13:06:07.040271 14955 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:07.065863 14955 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.066133 13783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 92) took 1606 ms. Trace:
I20260709 13:06:07.068272 15091 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:07.067684 13783 rpcz_store.cc:276] 0709 13:06:05.459599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.551633 (+ 92034us) service_pool.cc:224] Handling call
0709 13:06:05.552004 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:05.570188 (+ 18184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:05.573431 (+  3243us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:05.651666 (+ 78235us) spinlock_profiling.cc:243] Waited 6.25 ms on lock 0x7b2c000108d8. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5230dd7a11 00007f5230de7372 00007f5232519a01 00007f52324de43a 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2
0709 13:06:05.652086 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 13:06:06.882202 (+1230116us) spinlock_profiling.cc:243] Waited 7.56 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f522f3d40ac 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b
0709 13:06:07.064815 (+182613us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:07.064857 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.065879 (+  1022us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:07.065934 (+    55us) raft_consensus.cc:1685] finished
0709 13:06:07.065954 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.066062 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17951,"raft.queue_time_us":14688,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":100,"spinlock_wait_cycles":31753728,"thread_start_us":1412354,"threads_started":1,"wal-append.queue_time_us":1327934}
I20260709 13:06:07.068286 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:07.038363 15046 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:07.076162 15084 log.cc:927] Time spent T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 1.018s	user 0.013s	sys 0.004s
I20260709 13:06:07.071281 13786 raft_consensus.cc:606] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:06:07.078459 14858 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.062618 14940 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.079061 13783 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:07.121337 13783 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:06:07.121939 13783 raft_consensus.cc:606] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:06:07.122282 13783 raft_consensus.cc:614] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:07.062788 15010 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:07.080976 14943 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:07.127050 14943 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.127447 14943 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.130643 15008 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.066689 15052 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:07.131155 15008 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:07.131569 15052 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.131938 15052 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.133653 15008 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:07.134963 15008 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.108568 14955 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:07.109485 15068 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:07.135844 15068 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:07.136658 13862 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:07.136970 14955 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:07.138523 15068 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:07.115612 15105 log.cc:927] Time spent T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.564s	user 0.000s	sys 0.009s
I20260709 13:06:07.043506 15061 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:07.135386 15008 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:07.141821 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 59) took 1507 ms. Trace:
I20260709 13:06:07.141957 15077 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:07.143752 13784 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:06:07.145293 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:07.149400 13830 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:07.072182 14933 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:07.055320 15100 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:07.154464 15009 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:07.177089 13830 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:07.156141 13714 rpcz_store.cc:276] 0709 13:06:05.634215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.634379 (+   164us) service_pool.cc:224] Handling call
0709 13:06:05.634707 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:05.635070 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:05.635100 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:05.635593 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:06:05.827171 (+191578us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:05.829472 (+  2301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.853201 (+ 23729us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:07.072569 (+1219368us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:06:07.141535 (+ 68966us) raft_consensus.cc:1685] finished
0709 13:06:07.141564 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.141762 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3153,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":6447,"spinlock_wait_cycles":29235456,"thread_start_us":175866,"threads_started":1,"wal-append.queue_time_us":384260}
I20260709 13:06:07.160321 15072 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:07.160955 15010 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:07.167996 13863 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:06:07.180080 15072 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:07.162963 15059 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:07.182210 15072 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:07.182789 15059 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:07.183517 15009 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:07.184320 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:07.184396 15008 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:07.185519 15009 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:07.176868 14966 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.179437 13784 raft_consensus.cc:606] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:06:07.188598 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:06:07.193833 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 191264us
W20260709 13:06:07.180091 15092 log.cc:927] Time spent T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.959s	user 0.007s	sys 0.017s
I20260709 13:06:07.187949 13784 raft_consensus.cc:614] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:07.200767 13680 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:07.202595 13830 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:06:07.202723 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 308674us
W20260709 13:06:07.201108 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 207439us
I20260709 13:06:07.188005 15052 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:07.197001 15008 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:07.210130 14943 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:07.214010 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:07.213171 15008 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:07.178117 15046 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:07.216439 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:07.215284 15008 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.218647 15123 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.219594 13789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 743) took 1035 ms. Trace:
I20260709 13:06:07.219931 13789 rpcz_store.cc:276] 0709 13:06:06.184096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.206021 (+ 21925us) service_pool.cc:224] Handling call
0709 13:06:07.219398 (+1013377us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54003bd154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:07.219534 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255025536}
I20260709 13:06:07.222707 13788 raft_consensus.cc:1275] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:07.220772 15051 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:07.225978 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:07.226994 15051 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:07.228669 13829 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:07.232048 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:07.242830 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:07.240917 13862 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 1.
I20260709 13:06:07.252676 15061 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:07.253780 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 736) took 1113 ms. Trace:
I20260709 13:06:07.254155 13787 rpcz_store.cc:276] 0709 13:06:06.140486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.160471 (+ 19985us) service_pool.cc:224] Handling call
0709 13:06:06.366169 (+205698us) spinlock_profiling.cc:243] Waited 8.01 ms on lock 0x7b580001c598. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9eee 0000000000375939 00007f523742d1e0 00007f52374f60c4 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:07.252950 (+886781us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b580001c598. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9f8c 00007f522f3b9ef6 0000000000375939 00007f523742d1e0 00007f52374f60c4 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:07.253080 (+   130us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:07.253248 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:07.253281 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:07.253418 (+   137us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:07.253455 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.253518 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.253628 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24350976}
I20260709 13:06:07.255928 13863 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 2: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:07.257690 15100 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:07.258236 15100 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:07.253482 15061 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:07.261193 15061 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:07.264753 15100 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:07.265614 15077 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:07.266116 15077 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:07.268054 15077 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:07.268486 15077 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:07.269136 15077 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:07.278113 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:07.279292 14401 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:07.281625 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:07.283994 13757 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:07.285522 15077 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:07.286176 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 45117.7us
I20260709 13:06:07.286548 15046 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:07.290905 14933 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:07.294584 15082 consensus_queue.cc:1048] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:07.298453 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 56544.8us
I20260709 13:06:07.300529 13830 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:07.301461 14970 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:07.302081 14970 raft_consensus.cc:697] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:07.303175 14970 consensus_queue.cc:237] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:07.304733 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:07.309094 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 1423) took 1128 ms. Trace:
I20260709 13:06:07.310328 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:07.309491 13708 rpcz_store.cc:276] 0709 13:06:06.180308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.850675 (+670367us) service_pool.cc:224] Handling call
0709 13:06:06.864769 (+ 14094us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.864986 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:06.865290 (+   304us) log.cc:844] Serialized 14 byte log entry
0709 13:06:07.308741 (+443451us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:07.308799 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:07.308843 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.308917 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.309042 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37640,"prepare.queue_time_us":322,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":43967,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":4562,"thread_start_us":389260,"threads_started":1}
I20260709 13:06:07.311051 13863 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 2: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:07.313820 15046 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:07.314438 15046 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:07.316809 15046 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:07.326403 14368 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:07.329762 14921 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:07.330641 14921 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:07.332907 14966 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:07.334432 14921 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:07.335552 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:07.334317 14966 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:07.339830 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 57914.3us
I20260709 13:06:07.342341 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:07.229820 14958 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:07.344971 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:07.240612 15051 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:07.353387 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 69491.1us
I20260709 13:06:07.348059 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:07.358856 13707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 857) took 1568 ms. Trace:
I20260709 13:06:07.359292 13707 rpcz_store.cc:276] 0709 13:06:05.790986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.791240 (+   254us) service_pool.cc:224] Handling call
0709 13:06:05.791765 (+   525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:05.853120 (+ 61355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:05.853157 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:05.996216 (+143059us) log.cc:844] Serialized 26 byte log entry
0709 13:06:06.154353 (+158137us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:06.160837 (+  6484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.167340 (+  6503us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:07.176396 (+1009056us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:06:07.338288 (+161892us) raft_consensus.cc:1685] finished
0709 13:06:07.343081 (+  4793us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.358791 (+ 15710us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139495,"raft.queue_time_us":39460,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":2677248,"thread_start_us":149649,"threads_started":1,"wal-append.queue_time_us":222193}
I20260709 13:06:07.363492 14805 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:07.349455 14958 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.242761 15059 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
I20260709 13:06:07.344244 15010 consensus_queue.cc:1059] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:06:07.353442 15051 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.350442 15082 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:07.376178 13757 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:07.348613 14398 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:06:07.356410 15005 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:07.378612 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:07.390777 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:07.391199 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:07.391831 13861 raft_consensus.cc:2393] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 3: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:07.372419 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:07.367679 15100 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:07.398212 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:07.373059 14958 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.374848 13784 raft_consensus.cc:1275] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:07.423058 13715 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:07.425293 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:07.425414 13829 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:07.376492 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:07.376067 15102 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.379166 15051 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:07.428733 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 52953.2us
I20260709 13:06:07.424530 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:07.378149 15072 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.442384 13756 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:07.434360 13788 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:07.387672 15005 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:07.440258 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:07.443181 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:07.442349 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:07.447355 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:07.441915 13709 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:07.450204 14982 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.438799 14994 raft_consensus.cc:3055] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:07.451058 14994 raft_consensus.cc:740] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:07.450728 14982 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:07.451957 14994 consensus_queue.cc:260] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:07.452955 14982 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:07.453171 14994 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.453971 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 744) took 1126 ms. Trace:
I20260709 13:06:07.428972 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:07.468966 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:07.472148 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:07.472693 13857 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
W20260709 13:06:07.475584 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 453762us
I20260709 13:06:07.477452 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:07.448124 15005 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.479343 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:07.447992 15091 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:07.428253 15100 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:07.431325 15082 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:07.455996 15010 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:07.505971 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:07.475376 14942 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.520911 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:07.442412 15102 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:07.448285 15072 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:07.480171 14966 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:07.507957 15101 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:07.577425 13788 raft_consensus.cc:2410] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:07.530733 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:07.481452 14943 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:07.613040 15100 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:07.589758 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 856) took 1801 ms. Trace:
I20260709 13:06:07.454312 13785 rpcz_store.cc:276] 0709 13:06:06.327646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.333514 (+  5868us) service_pool.cc:224] Handling call
0709 13:06:07.225809 (+892295us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b580001c598. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9eee 0000000000375939 00007f523742d1e0 00007f52374f60c4 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:07.225940 (+   131us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:07.226132 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:07.353064 (+126932us) log.cc:844] Serialized 14 byte log entry
0709 13:06:07.453612 (+100548us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:07.453665 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:07.453709 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.453801 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.453914 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42720,"prepare.queue_time_us":124095,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":1750,"spinlock_wait_cycles":2426112,"thread_start_us":29920,"threads_started":1}
I20260709 13:06:07.662648 13856 raft_consensus.cc:2368] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 2. Current term is 3.
I20260709 13:06:07.609969 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:06:07.662853 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 237522us
I20260709 13:06:07.664549 13715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:06:07.666185 13682 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:07.678241 13715 raft_consensus.cc:606] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:06:07.678861 13715 raft_consensus.cc:614] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:07.679994 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:07.590349 15139 log.cc:927] Time spent T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:07.507691 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:07.506093 15091 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.521747 14935 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:07.674937 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:07.678210 13865 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:07.587293 15136 log.cc:927] Time spent T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:06:07.692914 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:07.578820 14982 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:06:07.578259 15135 log.cc:927] Time spent T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:07.681002 13861 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:07.713814 13682 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:07.608063 15082 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:07.689366 15091 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.735760 15005 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:07.718649 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:07.733965 15051 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:07.739310 15005 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:07.672711 13716 rpcz_store.cc:276] 0709 13:06:05.788825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.788967 (+   142us) service_pool.cc:224] Handling call
0709 13:06:05.789248 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:05.818944 (+ 29696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:05.818974 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:07.186671 (+1367697us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b2c00000f48. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5230dd7a11 00007f5230de7372 00007f5232519a01 00007f52324de43a 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2
0709 13:06:07.187187 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:06:07.377324 (+190137us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:07.420226 (+ 42902us) log.cc:844] Serialized 14 byte log entry
0709 13:06:07.420436 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.420519 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:07.530328 (+109809us) spinlock_profiling.cc:243] Waited 4.73 ms on lock 0x7b18002b0c00. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f13f3 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
0709 13:06:07.589445 (+ 59117us) raft_consensus.cc:1685] finished
0709 13:06:07.589477 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.589664 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129310,"prepare.queue_time_us":41871,"prepare.run_wall_time_us":37,"raft.queue_time_us":42400,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":10705,"spinlock_wait_cycles":45256832,"thread_start_us":188209,"threads_started":1,"wal-append.queue_time_us":337580}
I20260709 13:06:07.739768 13859 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:07.740082 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:06:07.742060 15008 consensus_meta.cc:287] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.500s	user 0.009s	sys 0.001s
I20260709 13:06:07.742745 15008 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:07.743542 14394 raft_consensus.cc:1240] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:07.743872 13862 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.744103 13682 leader_election.cc:400] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 2. Current term is 3.
I20260709 13:06:07.744450 13682 leader_election.cc:403] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:06:07.746631 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.746762 15082 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.747844 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:07.750665 15009 consensus_queue.cc:1059] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:07.752672 15072 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:07.606376 15145 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:07.764324 15145 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:07.664381 15101 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:07.524928 15010 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:07.767689 15101 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.769757 15010 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:07.771571 13785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
W20260709 13:06:07.690889 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 153201us
I20260709 13:06:07.530838 14942 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:07.772910 13757 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:07.773677 15008 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:07.773860 14942 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:07.720599 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 1238) took 1155 ms. Trace:
I20260709 13:06:07.702575 14959 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:06:07.721580 14966 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:06:07.724373 15117 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.715s	user 0.004s	sys 0.001s
I20260709 13:06:07.725963 14912 raft_consensus.cc:993] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03: : Instructing follower b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:07.728245 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:07.789407 13789 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.719280 14998 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:07.690697 15127 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.756716 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:07.756588 15102 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:07.754662 14958 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:07.716039 14982 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:07.763404 13860 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:07.756425 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:07.770979 13862 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:07.771291 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:07.689345 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:07.711030 14935 raft_consensus.cc:697] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:06:07.795150 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 83159.2us
I20260709 13:06:07.774226 15100 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:07.704595 14943 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 13:06:07.742038 15051 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:07.781932 13757 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:07.805114 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:07.805747 14399 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:07.793499 14998 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.808059 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:07.808421 13863 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:07.809167 13856 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:07.798882 14912 raft_consensus.cc:1081] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Signalling peer b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:07.820189 14935 consensus_queue.cc:237] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:07.810026 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:07.807456 13757 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:07.831895 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:07.831797 15101 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:08.041239 14912 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:08.235561 15127 consensus_queue.cc:1059] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:06:08.128475 15147 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.241003 14943 raft_consensus.cc:3055] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:08.241273 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:08.057179 15119 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:08.241411 15147 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:08.242379 13787 raft_consensus.cc:2368] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3.
I20260709 13:06:08.058595 14942 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:06:08.211791 15144 log.cc:927] Time spent T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:06:08.243220 14942 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:08.223049 15082 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 2. Current term is 3.
I20260709 13:06:08.244751 13858 raft_consensus.cc:1240] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:08.245462 14982 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:08.246083 14966 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:08.246570 14966 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:08.134878 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:08.247761 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 421759us
I20260709 13:06:08.248596 14966 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:07.810845 15067 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:08.249330 15067 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:08.249723 15067 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:08.234844 15145 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:08.136336 14398 raft_consensus.cc:1240] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:08.251271 13789 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:08.040993 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:06:07.837803 15133 log.cc:927] Time spent T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.476s	user 0.002s	sys 0.000s
I20260709 13:06:07.809979 14998 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:08.256740 13786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 750) took 1509 ms. Trace:
I20260709 13:06:08.257702 14858 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:08.257143 13786 rpcz_store.cc:276] 0709 13:06:06.747686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.116155 (+368469us) service_pool.cc:224] Handling call
0709 13:06:07.116567 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:07.116961 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:07.116990 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:07.117436 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:06:07.280373 (+162937us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:07.280417 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.280484 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:07.837140 (+556656us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:06:08.256466 (+419326us) raft_consensus.cc:1685] finished
0709 13:06:08.256492 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.256686 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":592,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":122,"spinlock_wait_cycles":40764160,"thread_start_us":162544,"threads_started":1,"wal-append.queue_time_us":232724}
I20260709 13:06:08.258476 14858 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:08.261018 14858 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:07.779922 13782 rpcz_store.cc:276] 0709 13:06:06.565083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.070366 (+505283us) service_pool.cc:224] Handling call
0709 13:06:07.070715 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:07.124559 (+ 53844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:07.124595 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:07.148478 (+ 23883us) log.cc:844] Serialized 26 byte log entry
0709 13:06:07.307532 (+159054us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:07.307574 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.308373 (+   799us) spinlock_profiling.cc:243] Waited 53.5 ms on lock 0x7b54000eced4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:07.308433 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:07.717196 (+408763us) raft_consensus.cc:1685] finished
0709 13:06:07.717233 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.720523 (+  3290us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":291,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":123080064,"thread_start_us":158652,"threads_started":1,"wal-append.queue_time_us":306795}
I20260709 13:06:08.264452 15101 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:07.961488 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 154097us
I20260709 13:06:08.265509 13757 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:06:08.238152 13865 consensus_meta.cc:287] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.000s
I20260709 13:06:08.267083 13865 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:08.252254 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:08.266206 15070 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:08.266157 14943 raft_consensus.cc:740] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:06:08.245710 15091 consensus_meta.cc:287] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.512s	user 0.006s	sys 0.003s
I20260709 13:06:07.848217 14958 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:06:08.267868 15061 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.036s	sys 0.018s
I20260709 13:06:08.267730 13757 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:08.267320 15147 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:08.271111 13829 leader_election.cc:400] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3.
I20260709 13:06:08.267773 15145 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:08.237000 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:08.276098 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:08.276407 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:08.279287 13829 leader_election.cc:403] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:08.277297 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:08.280882 13857 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:59780
I20260709 13:06:08.281066 13829 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:08.282353 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:08.243819 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:08.280678 14994 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:08.287815 14994 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:08.289989 14994 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:08.285107 15070 consensus_queue.cc:1059] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:06:08.284813 15102 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3.
I20260709 13:06:08.282644 15145 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:08.293289 13857 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:08.293496 13829 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:08.286943 15152 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:08.293661 13857 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:08.294174 15152 raft_consensus.cc:697] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:08.294417 15145 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:08.295059 15152 consensus_queue.cc:237] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:08.298128 15102 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:08.298466 15102 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.298769 15102 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:08.272670 15061 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.036s	sys 0.018s
I20260709 13:06:08.301054 13829 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:08.262981 14998 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:08.306259 13789 raft_consensus.cc:1275] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:08.304073 13757 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:08.242292 15119 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:08.309907 15145 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:08.310578 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:08.311578 15119 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:08.307291 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:08.312928 13789 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:08.307166 13857 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:08.314550 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:08.314980 15150 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:08.273226 15091 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:08.314674 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:08.312959 14958 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:08.316552 13860 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:08.332625 13785 raft_consensus.cc:606] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:06:08.333046 13785 raft_consensus.cc:614] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:08.333037 14366 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:08.336064 13682 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:08.337733 14944 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:08.344655 15166 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:08.345561 15166 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:08.312402 14943 consensus_queue.cc:260] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:08.338258 14944 raft_consensus.cc:697] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:08.338315 15005 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:08.338428 15059 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:08.329659 14935 consensus_queue.cc:1059] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:06:08.360837 13783 raft_consensus.cc:2393] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 3: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:08.340124 14940 consensus_queue.cc:1059] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
W20260709 13:06:08.385828 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 52867.6us
I20260709 13:06:08.362120 14943 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:08.395766 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:08.396697 14399 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:08.398437 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:08.386116 15082 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:08.346206 15166 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:08.362550 15005 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:08.409626 14399 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:08.410668 13829 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:08.395757 14858 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:08.381809 15059 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:08.418694 14998 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:08.419904 15154 log.cc:927] Time spent T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:06:08.412308 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:08.421555 14921 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:08.428050 14921 raft_consensus.cc:697] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:08.412505 15082 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:08.403386 14944 consensus_queue.cc:237] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:08.428069 15072 raft_consensus.cc:3055] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:08.443302 15072 raft_consensus.cc:740] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:08.443717 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:08.444165 15072 consensus_queue.cc:260] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:08.435052 15091 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:08.422653 14858 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:08.447297 14858 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:08.430164 15166 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:08.436718 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:08.437661 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:08.438388 15005 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:08.439518 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:08.440601 14994 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:08.442797 15070 raft_consensus.cc:3055] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:08.445341 15072 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:08.429013 13782 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:08.430207 14921 consensus_queue.cc:237] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:08.480115 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.467345 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.479269 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:08.495633 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 1428) took 1146 ms. Trace:
I20260709 13:06:08.481341 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:08.472836 13757 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:08.495998 13712 rpcz_store.cc:276] 0709 13:06:07.349102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.349206 (+   104us) service_pool.cc:224] Handling call
0709 13:06:08.479956 (+1130750us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b5800003398. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:06:08.495581 (+ 15625us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7674240}
I20260709 13:06:08.455814 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:08.463711 13681 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.428s	user 0.010s	sys 0.063s
I20260709 13:06:08.457517 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.499442 14368 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:08.501005 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.475086 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.502267 13710 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:08.459733 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:08.504190 13863 raft_consensus.cc:2393] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 3: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:08.456249 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:08.449747 15067 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:08.505836 15165 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:08.506289 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:08.505900 13708 raft_consensus.cc:2393] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 3: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:08.507680 15067 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:08.507720 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 70134.1us
I20260709 13:06:08.508112 15167 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:08.509234 13708 raft_consensus.cc:1275] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:08.509588 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.510149 13712 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:08.510311 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:08.511097 13859 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:08.520954 13681 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.486s	user 0.012s	sys 0.063s
I20260709 13:06:08.513118 14942 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:08.513790 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.524776 13711 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:08.470705 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:08.464921 15082 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:08.455559 15052 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:08.465968 15059 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:08.458222 13707 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:08.481105 15111 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:06:08.457123 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.456704 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.519814 13716 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:06:08.522361 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.534108 13857 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:08.534152 13715 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:08.442991 15102 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:08.494447 15070 raft_consensus.cc:740] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:08.520177 15009 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:08.593119 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 62315.3us
I20260709 13:06:08.597190 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:08.597817 13788 raft_consensus.cc:3055] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:08.598182 13788 raft_consensus.cc:740] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:08.584775 14858 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:08.598985 13788 consensus_queue.cc:260] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:08.602115 13788 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:08.586464 15059 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:08.608429 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.609604 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:08.610245 13715 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:08.595059 15082 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.614827 13856 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:08.593067 13714 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:06:08.598335 15013 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:08.590370 15166 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:06:08.602887 14858 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:08.602535 15009 raft_consensus.cc:697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:08.619259 15059 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:08.633554 15059 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:08.628546 15013 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:08.630524 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:08.637204 13858 raft_consensus.cc:2393] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 3: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:08.637939 14858 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:08.640816 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:08.641724 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:08.642068 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.642737 15102 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:08.603076 14935 consensus_queue.cc:1175] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b5029654a4384e43a68eb67b794949b7" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:08.643746 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:08.644824 15127 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:08.644989 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.645311 15127 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:08.646049 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:08.647253 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:08.623075 14944 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:08.647567 14942 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:08.647878 14398 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:08.647954 14944 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:08.642844 13709 raft_consensus.cc:2393] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 3: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:08.649405 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:08.648104 14942 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:08.670433 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.687685 13788 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:08.688871 13829 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:08.683475 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:08.689838 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:08.690300 13711 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:08.691390 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:08.694027 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 288367us
I20260709 13:06:08.704995 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.706034 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:08.706586 14399 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:08.707038 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:08.647248 15127 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:08.707769 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.709578 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:08.708431 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.710446 13716 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:08.710842 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.711213 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.711778 13716 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:08.683372 14921 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:08.688344 15167 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:08.625377 15082 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:08.790674 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.777338 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:08.807646 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:08.806952 14399 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
W20260709 13:06:08.800496 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 48976us
I20260709 13:06:08.802757 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:08.847393 13790 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:06:08.847513 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.782290 13788 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:08.849058 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:08.807643 13710 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:08.717751 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:08.852983 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:08.691597 15171 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:08.856734 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:08.744305 14998 raft_consensus.cc:3055] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:08.864245 14998 raft_consensus.cc:740] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:08.865806 14998 consensus_queue.cc:260] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:08.867075 14998 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:08.875610 13712 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:08.877072 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.878158 13715 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 1.
I20260709 13:06:08.717249 15008 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:08.887955 13710 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:06:08.896708 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 140246us
I20260709 13:06:08.746243 14942 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:08.688862 15070 consensus_queue.cc:260] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:08.789565 15013 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:08.705484 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:08.788194 14994 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:08.743547 15059 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:08.902545 14401 raft_consensus.cc:1240] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:08.902755 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 43923.4us
I20260709 13:06:08.855365 15101 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:08.743296 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:08.906005 13713 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
W20260709 13:06:08.906253 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:08.905691 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 104512us
I20260709 13:06:08.790697 14858 consensus_queue.cc:1059] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 13:06:08.910444 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.908180 15008 raft_consensus.cc:697] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:06:08.961875 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.961982 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.891891 14943 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:08.955055 14367 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:08.913311 15059 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:08.900151 15151 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:08.968394 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.968732 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:08.856758 15167 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:08.903143 15168 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.743391 15009 consensus_queue.cc:237] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:08.873198 14921 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:08.974967 13713 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:08.911540 15013 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:08.960081 14944 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:08.882076 15171 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:08.914192 15101 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:08.980866 14367 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:08.959504 15070 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:08.996001 15008 consensus_queue.cc:237] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:08.911821 15170 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.977187 13859 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:08.912976 13708 raft_consensus.cc:1275] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:06:08.976379 15175 log.cc:927] Time spent T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:06:08.988801 15181 log.cc:927] Time spent T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:06:08.982441 15166 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:08.998492 15177 log.cc:927] Time spent T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:06:08.989426 15159 log.cc:927] Time spent T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.645s	user 0.004s	sys 0.005s
I20260709 13:06:09.008764 13857 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:09.013855 13680 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:09.016274 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:09.019234 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 71) took 1264 ms. Trace:
I20260709 13:06:08.977478 15151 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:09.022687 13711 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:08.998598 15101 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:08.970623 14943 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:09.010869 15111 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.053287 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:09.047641 13861 rpcz_store.cc:276] 0709 13:06:07.754366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.763998 (+  9632us) service_pool.cc:224] Handling call
0709 13:06:07.764409 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:07.780420 (+ 16011us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:07.780453 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:07.793158 (+ 12705us) log.cc:844] Serialized 26 byte log entry
0709 13:06:08.515228 (+722070us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b180016fa80. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e0d1 00007f5232499a0f
0709 13:06:08.602619 (+ 87391us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:08.602656 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.602727 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:09.018871 (+416144us) raft_consensus.cc:1685] finished
0709 13:06:09.018899 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.019159 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18113,"raft.queue_time_us":19463,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":8017,"spinlock_wait_cycles":2932608,"thread_start_us":87217,"threads_started":1,"wal-append.queue_time_us":907379}
I20260709 13:06:09.024026 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:09.054358 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:09.003588 14398 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:09.047402 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:08.983104 15168 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:09.049870 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 128434us
I20260709 13:06:09.062661 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:09.010749 15148 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:09.075201 13713 raft_consensus.cc:2368] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3.
I20260709 13:06:09.081534 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:08.991706 15013 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:09.082719 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:09.088037 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:09.054325 14959 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.096859 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:09.097723 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:09.098142 13713 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.052525 14942 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:06:09.084715 15072 consensus_meta.cc:287] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.005s
I20260709 13:06:09.100440 13860 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:09.103919 15013 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:09.105340 14921 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:09.010123 15170 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:09.107661 15151 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:09.111516 13712 raft_consensus.cc:2410] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:09.080539 14940 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:09.115756 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 107048us
I20260709 13:06:09.127432 14367 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:06:09.128454 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 70757.3us
I20260709 13:06:09.091547 15082 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:09.116367 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:09.139288 13713 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:09.140491 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:09.140930 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 57717.5us
I20260709 13:06:09.092650 15148 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:09.142643 13708 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.149861 13830 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.152107 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:09.152911 13715 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.157178 14367 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:06:09.156263 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 71773.2us
I20260709 13:06:09.160008 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:09.160615 13713 raft_consensus.cc:2376] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3. Re-sending same reply.
I20260709 13:06:09.162822 15059 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:09.163828 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:09.164463 13860 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:09.165159 14367 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.167268 13830 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.168175 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:09.167472 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:09.166966 14367 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:09.171718 15082 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.171933 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:09.172919 13707 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 3: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:09.172811 15165 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:09.173386 15165 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:09.173849 15165 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.174175 15171 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:09.157918 15111 raft_consensus.cc:2764] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:06:09.156564 14970 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.177394 14943 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:09.164499 15191 consensus_queue.cc:1059] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:06:09.186338 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:09.125034 14942 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:09.235154 14942 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:09.192968 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:09.193720 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:09.179458 15191 raft_consensus.cc:3055] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:09.236694 15191 raft_consensus.cc:740] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:09.237794 15191 consensus_queue.cc:260] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:09.238358 13680 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:09.166723 15101 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:09.198343 15168 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:09.198841 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:09.206975 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 302420us
W20260709 13:06:09.211469 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 247303us
I20260709 13:06:09.172822 15059 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.195492 14970 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:06:09.187463 15147 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.214874 15170 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:09.215503 14940 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.196431 15169 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:09.250568 13680 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:09.217566 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:09.260699 13756 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:09.261516 15010 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.220914 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:09.262142 13712 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:09.174197 13707 raft_consensus.cc:1275] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:09.223981 15121 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:09.262732 13756 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:09.264642 15010 raft_consensus.cc:2764] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:06:09.226330 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.266135 13680 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:09.266464 15010 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.267748 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:09.268364 13782 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:09.268596 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:09.268718 13789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:06:09.269340 13789 raft_consensus.cc:606] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Received request to transfer leadership to TS ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:09.269647 13789 raft_consensus.cc:614] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:09.270889 14858 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.271337 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:09.271615 14858 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.272181 15010 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:09.272476 14401 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:09.274303 15010 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:09.249038 15193 consensus_queue.cc:1059] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:06:09.261245 14940 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:09.264683 14367 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.239370 15191 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.232385 13715 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:09.276876 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:09.239866 14943 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.280562 15169 raft_consensus.cc:697] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:09.317348 15169 consensus_queue.cc:237] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:09.225804 15165 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:09.280679 13680 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:09.320716 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:09.272552 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:09.216583 13830 leader_election.cc:400] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3.
I20260709 13:06:09.321892 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:06:09.322183 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 112634us
I20260709 13:06:09.322908 13830 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:09.282483 13757 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:09.282845 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:09.284421 13789 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:09.324774 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:09.325419 13788 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:06:09.285395 13791 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:09.230875 13708 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:09.291064 13756 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:09.295928 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:09.337018 13830 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.337402 14805 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:09.337633 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 46641.1us
I20260709 13:06:09.338061 13830 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:09.338630 13756 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.297751 14940 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:09.307313 14367 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.311287 15178 raft_consensus.cc:3055] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:09.309080 15059 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:09.327111 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 44707.4us
I20260709 13:06:09.324707 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:09.342113 15121 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.347815 15010 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.358690 15165 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:09.360345 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:09.351735 15170 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.365304 13782 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:09.344089 14970 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.344137 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:09.344847 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:09.335875 15070 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:09.395582 15070 raft_consensus.cc:697] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:09.406840 15070 consensus_queue.cc:237] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:09.346001 14942 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:09.340190 13830 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.409756 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:09.349305 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:09.350689 13756 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:09.345504 15147 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.345391 14943 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:09.348542 15178 raft_consensus.cc:740] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:09.386900 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:09.387924 15101 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:09.392374 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:09.398100 15167 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:09.404520 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:09.382407 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:09.440019 13789 raft_consensus.cc:2410] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:09.429728 15127 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:09.411577 13680 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:09.412273 14805 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:09.412534 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 72395.8us
I20260709 13:06:09.429957 15008 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.441025 14805 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:09.441428 14805 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.426894 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:09.429533 15193 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:09.425751 13829 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.424042 14942 raft_consensus.cc:697] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:09.441440 13830 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:06:09.411866 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 61272.2us
I20260709 13:06:09.445287 13756 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:09.447746 13830 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.447295 13756 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:09.451454 13680 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:09.442014 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:09.453914 14942 consensus_queue.cc:237] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:09.457742 15193 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:09.459714 13756 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.461483 14805 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:09.431443 14966 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:06:09.465171 14805 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:09.442510 15127 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:09.446589 15101 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.446918 15082 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.449519 15122 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:09.475785 13680 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:09.447260 13784 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:09.469841 14401 raft_consensus.cc:1240] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:09.465076 15010 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:09.463071 15147 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.487501 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:09.489871 14401 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:09.487478 13830 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:09.470414 13756 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:09.495077 14805 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.475175 14858 consensus_queue.cc:1059] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:06:09.496390 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:09.476857 15122 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:09.497211 15122 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.467209 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:09.472095 15149 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:06:09.493047 15170 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.499598 15170 raft_consensus.cc:3055] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:09.502151 13756 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:09.503703 13756 leader_election.cc:304] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.505096 13756 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:09.506494 13756 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.468039 15102 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.468775 15127 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.468801 15195 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.509956 13756 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:09.518580 14367 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.500968 15010 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:09.499948 15170 raft_consensus.cc:740] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:09.513186 15077 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:09.510912 14912 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.511291 15150 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:09.548141 14366 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:09.553634 13830 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.554090 14366 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:09.512298 15069 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.550997 14805 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.557435 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:09.522430 15190 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.562265 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:09.562458 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:09.563074 13710 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
W20260709 13:06:09.558847 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 71463.9us
I20260709 13:06:09.560494 13790 raft_consensus.cc:1240] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:09.564743 13756 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.561628 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:09.549885 15149 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:06:09.560348 14994 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:09.557823 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:09.566349 14994 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:09.552348 15009 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:09.567312 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:09.479854 15187 consensus_queue.cc:1059] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:06:09.571158 13713 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:09.500764 15160 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
W20260709 13:06:09.573392 15209 log.cc:927] Time spent T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:06:09.587491 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:09.513433 15167 consensus_queue.cc:1059] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
W20260709 13:06:09.559362 15210 log.cc:927] Time spent T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:06:09.573959 14994 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:09.574127 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:09.576182 13829 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:09.576936 14912 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:09.572727 13756 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:09.580760 14805 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.551915 15010 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.556299 15150 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:09.583998 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:09.594470 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:09.595175 13712 raft_consensus.cc:2376] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3. Re-sending same reply.
I20260709 13:06:09.584697 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:09.553141 15077 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:09.597306 15077 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.597565 13860 raft_consensus.cc:1240] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:09.585103 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:09.555879 15165 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:09.585255 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:09.569943 14942 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:09.555913 15166 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.586959 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:09.554267 15147 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:09.470677 15178 consensus_queue.cc:260] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:09.589924 13863 raft_consensus.cc:2393] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 3: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:09.592437 13789 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:09.592681 13756 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:09.599195 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:09.596041 15150 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.599292 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:09.606169 13857 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:09.601307 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:09.595652 14994 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:09.610478 14805 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.608378 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:09.615518 13859 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:09.624362 14994 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.623641 14366 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.625139 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:09.597983 15148 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:09.597335 14998 consensus_queue.cc:1059] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:06:09.660132 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:09.666891 15197 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.628014 14994 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:09.667928 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:09.668823 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:09.671047 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:09.671540 13682 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:09.671908 13711 raft_consensus.cc:2393] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 3: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:06:09.673557 15212 log.cc:927] Time spent T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:06:09.593871 15170 consensus_queue.cc:260] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:09.609305 15193 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:09.627090 15166 consensus_queue.cc:1059] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:06:09.676636 15184 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:06:09.677475 15166 raft_consensus.cc:3055] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:09.677990 15166 raft_consensus.cc:740] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:09.622643 15147 raft_consensus.cc:697] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:09.686372 13682 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:09.688376 13682 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:09.688905 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:09.679736 13830 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:09.692018 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:09.663936 14944 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:09.701745 14944 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.701700 15166 consensus_queue.cc:260] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:09.702448 14944 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:09.663476 13858 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:09.638149 14398 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:09.703446 15170 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:09.700614 15213 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.668251 15121 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:09.708607 15166 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.697198 14998 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.697000 15082 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.700173 15149 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.699182 13830 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:09.708830 15147 consensus_queue.cc:237] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:09.728425 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:09.736184 15077 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:09.737434 14966 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:09.735320 13830 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.747699 13830 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.753741 15150 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:09.754086 14994 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:09.750945 15197 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:09.758038 15205 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:06:09.759706 13830 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:09.761896 13830 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.764837 15197 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:09.766218 15207 log.cc:927] Time spent T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.227s	user 0.005s	sys 0.007s
I20260709 13:06:09.768600 15077 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:09.764984 15149 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.776038 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:09.746619 14966 raft_consensus.cc:697] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:09.759846 15145 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:09.779526 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 87614.2us
I20260709 13:06:09.744360 15127 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:09.790155 15214 consensus_queue.cc:1059] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:09.803444 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 55492.4us
I20260709 13:06:09.794711 13756 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.804145 13680 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:09.805142 13756 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.796424 15216 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:09.797955 15219 consensus_queue.cc:1059] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:09.799966 13682 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:09.800611 14858 raft_consensus.cc:3055] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:09.799242 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:09.817072 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:09.817687 13713 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:09.810909 14982 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.828459 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:09.809513 15168 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.811106 15077 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.813591 15150 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:09.760075 15122 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:09.813345 14858 raft_consensus.cc:740] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:09.829666 13714 raft_consensus.cc:1240] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:09.840835 15122 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:09.840665 14858 consensus_queue.cc:260] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:09.843302 14858 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:09.846427 13786 raft_consensus.cc:1240] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:09.817361 14944 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:09.847623 13612 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49428 (request call id 235) took 4527 ms. Trace:
I20260709 13:06:09.848963 13614 catalog_manager.cc:5697] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:09.841641 15010 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:09.851881 14921 raft_consensus.cc:3055] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:09.852254 14921 raft_consensus.cc:740] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:09.853021 14921 consensus_queue.cc:260] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:09.853807 15010 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:09.854364 14921 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.854954 13784 raft_consensus.cc:1240] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:09.858079 13757 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.858134 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:09.847988 13612 rpcz_store.cc:276] 0709 13:06:05.340716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.340904 (+   188us) service_pool.cc:224] Handling call
0709 13:06:09.847537 (+4506633us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:07.505149 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:07.524143 (+ 18994us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:07.524199 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:06:07.524215 (+    16us) tablet.cc:662] Decoding operations
0709 13:06:07.536338 (+ 12123us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:07.536462 (+   124us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:07.536511 (+    49us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:06:07.537224 (+   713us) tablet.cc:701] Row locks acquired
0709 13:06:07.537272 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:06:07.537513 (+   241us) write_op.cc:270] Start()
0709 13:06:07.537683 (+   170us) write_op.cc:276] Timestamp: P: 1783602367537424 usec, L: 0
0709 13:06:07.537731 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 13:06:07.689147 (+151416us) log.cc:844] Serialized 2201 byte log entry
0709 13:06:08.902489 (+1213342us) op_driver.cc:464] REPLICATION: finished
0709 13:06:09.121566 (+219077us) write_op.cc:301] APPLY: starting
0709 13:06:09.121666 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:09.121849 (+   183us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:09.145715 (+ 23866us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:09.154606 (+  8891us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:09.154868 (+   262us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:06:09.154928 (+    60us) write_op.cc:312] APPLY: finished
0709 13:06:09.161213 (+  6285us) log.cc:844] Serialized 47 byte log entry
0709 13:06:09.161423 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:09.161528 (+   105us) write_op.cc:454] Released schema lock
0709 13:06:09.161582 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:09.162071 (+   489us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:09.162113 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":533,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":212616,"apply.run_cpu_time_us":3487,"apply.run_wall_time_us":40398,"num_ops":5,"prepare.queue_time_us":377258,"prepare.run_cpu_time_us":21511,"prepare.run_wall_time_us":327730,"raft.queue_time_us":326358,"raft.run_cpu_time_us":45349,"raft.run_wall_time_us":287117,"replication_time_us":1314847,"thread_start_us":609973,"threads_started":4,"wal-append.queue_time_us":583498}]]}
I20260709 13:06:09.861030 14912 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.865798 13830 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.867579 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:09.850665 13614 catalog_manager.cc:5697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 1 to 2, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 2 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:09.871817 13756 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.873239 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:09.832397 14998 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:09.869643 13614 catalog_manager.cc:5697] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 1 to 2, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 2 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:09.877229 13614 catalog_manager.cc:5697] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 1 to 2, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 2 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:09.848286 14944 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:09.832582 15214 consensus_queue.cc:1243] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Peer b5029654a4384e43a68eb67b794949b7 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:09.885142 13710 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:06:09.890421 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 45775.1us
I20260709 13:06:09.894232 13713 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:09.880254 15194 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.879374 14998 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.896526 13756 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:09.886713 15150 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.900866 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:09.903548 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 91574.4us
I20260709 13:06:09.899331 15185 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:06:09.913022 15077 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.834713 14966 consensus_queue.cc:237] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:09.898231 14998 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:09.921028 13830 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:09.932103 13786 raft_consensus.cc:1240] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:09.935020 14994 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:09.905988 14982 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:09.941262 13790 raft_consensus.cc:1240] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:09.951592 13716 consensus_queue.cc:237] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:09.952786 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.949286 15194 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.927856 13859 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:09.956363 15127 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:09.968950 15067 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:06:09.961377 14982 raft_consensus.cc:697] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:10.000705 13859 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:10.004343 15091 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:10.006517 14982 consensus_queue.cc:237] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:10.012565 13863 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:10.021945 15151 consensus_queue.cc:1059] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:09.998442 15067 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.025738 15067 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:10.027868 15067 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:10.032903 13711 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:10.039364 13863 raft_consensus.cc:2955] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:10.041658 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:10.030387 14998 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:10.067348 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:10.071169 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:10.071822 13856 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:06:10.092398 13757 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:10.093425 14982 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:10.099380 13710 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:10.041021 15009 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:10.104344 15009 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.048300 15194 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:06:10.040035 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:10.110275 13713 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:10.088191 15122 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:06:10.123060 13787 raft_consensus.cc:1275] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:10.130275 14998 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:10.148340 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:10.106169 14982 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.040432 15174 consensus_queue.cc:1059] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:06:10.151327 15077 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:10.152693 14982 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.152982 14998 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.171315 15194 consensus_queue.cc:1048] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:06:10.175060 14998 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:10.181723 15226 log.cc:927] Time spent T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.086s	user 0.001s	sys 0.001s
W20260709 13:06:10.242498 15232 log.cc:927] Time spent T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:06:10.245239 14982 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:10.245926 15229 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:06:10.175383 15077 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:10.248193 14998 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:10.251041 14393 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:10.254307 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:10.256309 13861 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:10.258351 13682 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:10.235385 15184 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:10.269639 15082 raft_consensus.cc:3055] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:10.270143 15082 raft_consensus.cc:740] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:10.268033 15187 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:10.276778 15187 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.277377 15187 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:10.277554 15077 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:10.277837 14982 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:10.280011 15184 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:10.286842 13784 raft_consensus.cc:1240] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:10.288753 15184 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:10.297461 14858 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:10.298077 14858 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:10.299456 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:10.300385 14858 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:10.301296 14943 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:10.303315 13830 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:10.306201 13711 raft_consensus.cc:1275] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:10.306375 13682 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:06:10.309511 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.312007 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:10.312435 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:10.313247 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:10.313599 15122 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.314119 15122 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:10.316143 15122 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:10.316777 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:10.316866 15150 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:10.317055 15122 consensus_queue.cc:1059] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:10.317399 14402 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:10.318333 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:10.318928 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:10.319694 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:10.320266 14395 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.318464 13714 raft_consensus.cc:1275] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:10.321759 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:10.322921 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:10.331357 13791 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 3: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:10.325745 13755 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:10.271041 15082 consensus_queue.cc:260] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:10.333793 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:10.335111 13791 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
W20260709 13:06:10.338088 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.334542 14958 consensus_queue.cc:1059] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:06:10.344220 15111 consensus_queue.cc:1059] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:10.342976 13755 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:10.321626 15160 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:10.338878 15091 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:10.356256 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 49955.5us
W20260709 13:06:10.357266 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.361914 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:10.363669 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:10.364049 13709 raft_consensus.cc:2955] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:10.369395 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:10.372442 15160 consensus_queue.cc:1048] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:10.373277 13756 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:10.374104 14994 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:10.352705 15185 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:10.380232 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:10.380909 13784 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:10.381861 13680 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:10.383015 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:10.301846 14943 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:10.385054 15170 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:10.385099 14858 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:10.386484 14943 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:10.333052 15182 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:06:10.294629 15121 raft_consensus.cc:2955] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:10.336788 14970 consensus_queue.cc:1048] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:06:10.357545 15219 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:10.387167 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:10.417853 15145 raft_consensus.cc:3055] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:10.418450 15145 raft_consensus.cc:740] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:10.421154 15171 raft_consensus.cc:3055] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:10.413257 15191 raft_consensus.cc:3055] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:10.422719 13711 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
W20260709 13:06:10.431898 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.427145 15191 raft_consensus.cc:740] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:10.424633 15171 raft_consensus.cc:740] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:10.439146 15009 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:10.449512 14399 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:10.450503 15009 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:10.450686 13787 raft_consensus.cc:1240] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:10.462858 15171 consensus_queue.cc:260] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:10.463960 15171 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.476750 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:10.478528 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:10.480340 15252 consensus_queue.cc:1059] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:10.481253 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:10.482874 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:10.483614 13864 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.486688 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:10.500044 15111 raft_consensus.cc:3055] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:10.500696 15111 raft_consensus.cc:740] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:10.506263 15178 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:10.521843 15240 log.cc:927] Time spent T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:06:10.549490 13791 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:10.554466 13786 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:10.556170 13786 raft_consensus.cc:1240] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:10.558401 15239 log.cc:927] Time spent T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.319s	user 0.002s	sys 0.000s
I20260709 13:06:10.577036 13782 raft_consensus.cc:1275] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:06:10.577651 13782 pending_rounds.cc:85] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 1
I20260709 13:06:10.577951 13782 pending_rounds.cc:107] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:10.578253 13782 raft_consensus.cc:2889] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:10.580873 15237 log.cc:927] Time spent T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.341s	user 0.001s	sys 0.001s
I20260709 13:06:10.601656 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:10.611575 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.615443 15013 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:10.621706 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:10.610970 13712 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:10.634313 13756 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:10.638295 15067 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:10.501823 15111 consensus_queue.cc:260] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:10.641942 15111 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.642244 13756 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:10.644743 15067 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:10.645268 15067 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.645721 15067 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:10.646713 15165 consensus_queue.cc:1059] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:10.648119 15166 raft_consensus.cc:3055] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:10.648573 15166 raft_consensus.cc:740] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:10.649569 15166 consensus_queue.cc:260] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:10.655678 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:10.656101 13756 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:10.657132 15122 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:10.661001 13712 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:10.667735 15010 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:10.684144 13680 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:10.693301 13755 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:10.697175 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:10.700479 13864 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
W20260709 13:06:10.701570 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 149518us
W20260709 13:06:10.709726 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 362681us
I20260709 13:06:10.433561 15145 consensus_queue.cc:260] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:10.717115 13757 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:06:10.718241 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.703646 15013 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:10.724450 15185 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:10.724664 15248 log.cc:927] Time spent T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.279s	user 0.000s	sys 0.000s
I20260709 13:06:10.704375 15091 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:10.726471 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 261508us
I20260709 13:06:10.716980 13784 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:06:10.475297 15191 consensus_queue.cc:260] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:10.814652 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:10.843750 15250 log.cc:927] Time spent T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:06:10.849934 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
W20260709 13:06:10.852315 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.751982 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:10.756779 15197 consensus_queue.cc:1059] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.110s
I20260709 13:06:10.783955 14966 consensus_queue.cc:1048] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.102s
W20260709 13:06:10.858817 15187 consensus_meta.cc:287] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.003s
I20260709 13:06:10.849807 15013 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.788847 15067 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:10.903054 15224 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:10.867883 15168 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:10.950129 15246 log.cc:927] Time spent T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 13:06:10.958739 15249 log.cc:927] Time spent T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
W20260709 13:06:10.963760 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:10.980144 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.981986 15238 raft_consensus.cc:3055] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:10.982427 15238 raft_consensus.cc:740] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:10.983317 15238 consensus_queue.cc:260] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:10.984472 15238 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.986403 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:10.902042 15187 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:11.014695 15187 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:11.020771 15082 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:10.870689 15253 consensus_queue.cc:1059] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.163s
I20260709 13:06:11.029824 15067 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:11.031550 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:10.973644 15168 raft_consensus.cc:697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:10.905030 15013 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:11.057698 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 814) took 1117 ms. Trace:
W20260709 13:06:11.058665 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 328210us
I20260709 13:06:11.061141 13785 rpcz_store.cc:276] 0709 13:06:09.939862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.940331 (+   469us) service_pool.cc:224] Handling call
0709 13:06:09.940601 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:09.958660 (+ 18059us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.958694 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:10.299378 (+340684us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b4800240258. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5237407aa1 00007f52373feb37 00007f52373fe9ca 00007f52374f626f 00007f52374f5f37 00007f523750a55c 00007f523750a508 00007f523750a488 00007f523750a443 00007f52375096ec 00007f5236433a96
0709 13:06:10.609718 (+310340us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b2c000108d8. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5230dd7a11 00007f5230de7372 00007f5232519a01 00007f52324de43a 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2
0709 13:06:10.610395 (+   677us) log.cc:844] Serialized 26 byte log entry
0709 13:06:11.055656 (+445261us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:11.055696 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.055765 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:11.057451 (+  1686us) raft_consensus.cc:1685] finished
0709 13:06:11.057477 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.057628 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17701,"raft.queue_time_us":18110,"raft.run_cpu_time_us":5045,"raft.run_wall_time_us":338996,"spinlock_wait_cycles":8086144,"thread_start_us":444808,"threads_started":1,"wal-append.queue_time_us":445226}
W20260709 13:06:11.068092 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 86844.8us
I20260709 13:06:11.047533 14958 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.069725 14958 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:11.070878 13783 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:11.071583 13783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 1294) took 1262 ms. Trace:
I20260709 13:06:11.071930 13783 rpcz_store.cc:276] 0709 13:06:09.809646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.810997 (+  1351us) service_pool.cc:224] Handling call
0709 13:06:10.562964 (+751967us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b580001c598. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:10.563212 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.070713 (+507501us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400219920. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f5232455dc0 00007f52324e01c0 00007f52324e1231 00007f52324ddd8f 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c
0709 13:06:11.071289 (+   576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.071527 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":354119168}
I20260709 13:06:11.072969 14958 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:11.007032 13707 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:11.091889 13785 raft_consensus.cc:2955] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:11.053938 15166 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:10.903653 15224 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:11.098019 15217 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:11.123076 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 405051us
W20260709 13:06:11.132496 15121 consensus_meta.cc:287] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.661s	user 0.010s	sys 0.000s
I20260709 13:06:11.153956 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:06:11.161887 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 88068.9us
I20260709 13:06:11.125242 15217 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:11.180734 15013 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:11.176833 15185 raft_consensus.cc:697] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:11.183130 15185 consensus_queue.cc:237] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:11.130713 15168 consensus_queue.cc:237] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:11.203253 15224 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:11.214210 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:11.209182 14395 consensus_meta.cc:287] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.888s	user 0.011s	sys 0.002s
I20260709 13:06:11.223809 13757 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:11.228797 15260 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.221866 14395 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:11.244163 15190 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.244999 15269 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:11.264408 15268 log.cc:927] Time spent T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:06:11.263626 15190 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:11.245188 15260 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:11.271338 15260 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:11.272565 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:11.274434 14401 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:06:11.288130 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 64440.6us
W20260709 13:06:11.292515 15241 log.cc:927] Time spent T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.886s	user 0.000s	sys 0.006s
I20260709 13:06:11.297781 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:11.298970 13785 raft_consensus.cc:2393] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 4: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:11.300156 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 1190) took 1408 ms. Trace:
I20260709 13:06:11.300611 13860 rpcz_store.cc:276] 0709 13:06:09.891895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.893133 (+  1238us) service_pool.cc:224] Handling call
0709 13:06:09.909266 (+ 16133us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:09.909604 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.909634 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:10.273481 (+363847us) spinlock_profiling.cc:243] Waited 7.15 ms on lock 0x7b2c000cc698. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5230dd7a11 00007f5230de7372 00007f5232519a01 00007f52324de43a 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2
0709 13:06:10.274094 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 13:06:10.329662 (+ 55568us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:10.336765 (+  7103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.341452 (+  4687us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:11.292026 (+950574us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:06:11.299753 (+  7727us) raft_consensus.cc:1685] finished
0709 13:06:11.299780 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.300084 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":188,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":163,"spinlock_wait_cycles":54023168,"thread_start_us":28198,"threads_started":1,"wal-append.queue_time_us":116859}
I20260709 13:06:11.303026 14366 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:11.306876 15260 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.316028 15277 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.316628 15277 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:11.320065 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:11.320788 13715 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:11.322440 13756 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:11.323302 15278 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:11.323770 15260 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:11.324112 15280 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:11.324393 15121 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:11.324760 15280 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:11.325170 15121 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:11.315033 15072 raft_consensus.cc:3055] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:11.323773 15278 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.328400 15278 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:11.328850 15247 log.cc:927] Time spent T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.538s	user 0.000s	sys 0.013s
I20260709 13:06:11.331912 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:11.327893 15072 raft_consensus.cc:740] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:11.333607 15072 consensus_queue.cc:260] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:11.327369 15280 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:11.338773 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:11.339525 13862 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 1.
I20260709 13:06:11.341564 15277 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:11.343197 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:11.343654 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:11.343981 13862 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:11.341259 15278 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:11.342442 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:11.348698 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:11.348901 13757 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:11.349613 15067 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:11.350056 15121 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:11.351132 14366 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:11.352809 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:11.353399 13710 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:11.353555 15121 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:11.357558 13707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 911) took 1786 ms. Trace:
I20260709 13:06:11.358018 13707 rpcz_store.cc:276] 0709 13:06:09.571078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.576219 (+  5141us) service_pool.cc:224] Handling call
0709 13:06:10.179972 (+603753us) spinlock_profiling.cc:243] Waited 7.27 ms on lock 0x7b5800003398. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:10.180298 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.087425 (+907127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.357277 (+269852us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b54001540d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:11.357489 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1818620544}
I20260709 13:06:11.366848 15217 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:11.369030 15238 raft_consensus.cc:476] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 13:06:11.372059 14921 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:11.374682 13713 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:11.369051 13710 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:11.379174 13756 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:11.380194 15284 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:11.380676 15284 raft_consensus.cc:697] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:11.381494 15284 consensus_queue.cc:237] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:11.383483 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:11.384133 13714 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
W20260709 13:06:11.385119 14994 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.010s	sys 0.003s
W20260709 13:06:11.385558 14994 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.010s	sys 0.003s
I20260709 13:06:11.388427 13682 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:11.390062 15127 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:11.399456 15145 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:11.403935 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:11.404570 13858 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.426638 13709 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:11.428807 13858 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:06:11.436559 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:11.438612 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.440121 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:11.440815 13862 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
W20260709 13:06:11.449676 15091 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.004s	sys 0.008s
W20260709 13:06:11.450115 15091 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.004s	sys 0.008s
I20260709 13:06:11.450311 15244 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.450950 15244 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:11.453234 15244 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:11.442737 15278 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:11.454229 15008 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:11.457118 15277 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:11.457687 15277 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:11.458156 13830 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:11.459028 15008 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:11.459401 15008 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.460085 15008 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:11.460279 15277 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:11.462044 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:11.462637 13860 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:11.463625 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:11.464365 14398 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:11.473937 15008 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:11.475020 13860 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:11.476181 15008 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:11.485420 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:11.539999 13682 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:11.540913 13682 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:11.579983 15168 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:11.580605 15168 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:11.582715 15168 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:11.585557 15168 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:11.586047 15168 raft_consensus.cc:697] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:11.586908 15168 consensus_queue.cc:237] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:11.593067 15168 raft_consensus.cc:2764] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:11.594936 13614 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57116 (request call id 136) took 5809 ms. Trace:
I20260709 13:06:11.595273 13614 rpcz_store.cc:276] 0709 13:06:05.785608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.785768 (+   160us) service_pool.cc:224] Handling call
0709 13:06:11.594888 (+5809120us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:10.167381 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:10.243794 (+ 76413us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:10.243827 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:06:10.243846 (+    19us) tablet.cc:662] Decoding operations
0709 13:06:10.244480 (+   634us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:10.244546 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:10.244584 (+    38us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:06:10.244977 (+   393us) tablet.cc:701] Row locks acquired
0709 13:06:10.244991 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:06:10.245178 (+   187us) write_op.cc:270] Start()
0709 13:06:10.245287 (+   109us) write_op.cc:276] Timestamp: P: 1783602370245134 usec, L: 0
0709 13:06:10.245309 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:06:10.245990 (+   681us) log.cc:844] Serialized 1749 byte log entry
0709 13:06:10.453566 (+207576us) spinlock_profiling.cc:243] Waited 9.84 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f522f3d40ac 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b
0709 13:06:11.183920 (+730354us) op_driver.cc:464] REPLICATION: finished
0709 13:06:11.254520 (+ 70600us) write_op.cc:301] APPLY: starting
0709 13:06:11.254634 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:11.254848 (+   214us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:11.254901 (+    53us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:11.255678 (+   777us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:11.255985 (+   307us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:06:11.256061 (+    76us) write_op.cc:312] APPLY: finished
0709 13:06:11.256375 (+   314us) log.cc:844] Serialized 41 byte log entry
0709 13:06:11.257481 (+  1106us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:11.257629 (+   148us) write_op.cc:454] Released schema lock
0709 13:06:11.257689 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:11.258164 (+   475us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:11.258198 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":437285,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":70302,"apply.run_cpu_time_us":2711,"apply.run_wall_time_us":3620,"num_ops":4,"prepare.queue_time_us":219525,"prepare.run_cpu_time_us":23445,"prepare.run_wall_time_us":554522,"raft.queue_time_us":338640,"raft.run_cpu_time_us":53637,"raft.run_wall_time_us":65907,"replication_time_us":938439,"spinlock_wait_cycles":22652416,"thread_start_us":670837,"threads_started":4,"wal-append.queue_time_us":230638}]]}
I20260709 13:06:11.619234 15168 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.619948 15168 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:11.621860 15168 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:11.628309 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:11.654660 15213 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:11.657188 15213 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:11.657599 15213 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:11.664215 15213 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:11.666163 15213 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:11.669129 15213 raft_consensus.cc:2955] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:11.682121 15277 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.682786 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:11.682654 15277 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:11.684280 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:11.684661 15277 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:11.685021 13782 raft_consensus.cc:2393] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 3: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:11.685135 15277 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:11.685608 15277 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:11.687702 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:11.691468 15191 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:11.691385 15278 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:11.692128 15278 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:11.694065 15278 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:11.696120 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:11.696815 13784 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.704144 14401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 439) took 1017 ms. Trace:
I20260709 13:06:11.704541 14401 rpcz_store.cc:276] 0709 13:06:10.686699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.686926 (+   227us) service_pool.cc:224] Handling call
0709 13:06:10.687321 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.275002 (+587681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.703931 (+428929us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b54004a8b54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:11.704091 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1349303552}
I20260709 13:06:11.708693 13784 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:06:11.711108 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:11.714365 13788 raft_consensus.cc:2393] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 3: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:11.712914 15277 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:11.711747 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:11.715873 13782 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:11.721000 13680 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:11.722095 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:11.722718 13712 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:11.723687 15213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:49478 (request call id 74) took 1805 ms. Trace:
I20260709 13:06:11.724068 15213 rpcz_store.cc:276] 0709 13:06:09.918130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.937878 (+ 19748us) service_pool.cc:224] Handling call
0709 13:06:09.960185 (+ 22307us) log.cc:844] Serialized 501 byte log entry
0709 13:06:10.247703 (+287518us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b5400057e20. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f523245eb26 00007f523245849a 00007f5232457714 00007f5232437eaa 00007f523243ed53 00007f523243ecd9 00007f523243ec69 00007f523243ec31 00007f523243ddfd 000000000038f354
0709 13:06:11.723602 (+1475899us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14031,"raft.queue_time_us":14872,"raft.run_cpu_time_us":2982,"raft.run_wall_time_us":105614,"spinlock_wait_cycles":2493824,"thread_start_us":160922,"threads_started":1,"wal-append.queue_time_us":223869,"wal-append.run_cpu_time_us":1873,"wal-append.run_wall_time_us":1051084}
I20260709 13:06:11.725965 13600 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ab01257d4e56488eba41a0ce5c5e9954 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:11.728282 15213 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:11.728770 15213 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.729117 15213 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.730829 13782 raft_consensus.cc:2955] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:11.735985 15213 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:11.739795 15213 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:11.740626 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:11.741868 15284 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:06:11.742193 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.742385 15284 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:11.743134 15009 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:11.743675 15009 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:11.745802 15009 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:11.746594 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:11.747200 13784 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:11.748826 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:11.749378 13788 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.753793 15190 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:11.754925 15069 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:11.755465 15069 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:11.762713 13788 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:06:11.762029 13712 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:11.764272 15069 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:11.764537 15284 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:11.766309 13830 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:11.767781 14970 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:11.768906 14970 raft_consensus.cc:697] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:11.770421 13680 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:11.771601 15224 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:11.772080 15224 raft_consensus.cc:697] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:11.772951 15224 consensus_queue.cc:237] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:11.778338 15284 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.778976 15284 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:11.780687 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:11.785235 13787 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:11.781198 15284 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:11.787536 13680 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:11.779767 14970 consensus_queue.cc:237] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:11.789083 15223 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:11.789463 15223 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:11.789821 15223 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:11.797226 15223 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:11.800125 13714 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:11.805799 13787 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:11.806464 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:11.807037 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:11.807622 13789 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:11.810011 15224 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:11.810611 15224 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:11.811733 15213 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:11.816483 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:11.816550 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:11.817099 13861 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:11.817442 13787 raft_consensus.cc:2393] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 3: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:11.818434 15224 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:11.819013 15223 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:11.819389 13682 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:06:11.820088 15272 log.cc:927] Time spent T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.575s	user 0.002s	sys 0.000s
I20260709 13:06:11.820827 15223 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:11.821318 15223 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:11.821754 15223 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:11.828994 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:11.832378 15276 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:11.832922 15185 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:11.833426 15185 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:11.837242 15101 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:11.837836 15101 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:11.841862 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:11.845144 15168 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:11.845690 15168 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:11.848727 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.850152 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:11.851516 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:11.852594 13790 raft_consensus.cc:2393] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 2: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:11.854641 15051 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.855211 15051 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:11.856552 15091 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:11.857205 15091 consensus_queue.cc:1243] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer ceb06175847b428ea8bd77055fcddf58 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:11.857441 15051 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:11.857681 15166 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:11.858247 15166 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:11.858754 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:11.859862 15191 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:11.860417 15191 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:11.861804 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:11.862442 13861 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:11.863726 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:11.864401 13709 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:11.865219 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:11.866051 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:11.866256 15166 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:11.868448 13860 raft_consensus.cc:1275] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:11.832947 15276 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:11.862504 15191 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:11.885403 14401 pending_rounds.cc:85] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 4
I20260709 13:06:11.886160 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:11.889508 13711 raft_consensus.cc:1240] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:11.898754 14401 pending_rounds.cc:107] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:06:11.897605 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:11.899055 14401 raft_consensus.cc:2889] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:11.871197 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:11.903076 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:11.903651 13716 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:06:11.903573 14399 raft_consensus.cc:2955] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:11.904904 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:11.905448 13713 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:06:11.907691 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:11.907845 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:11.909531 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:11.908728 13857 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:11.912117 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:11.913424 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:11.914108 13864 raft_consensus.cc:2393] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 2: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:11.917181 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:11.917760 13712 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:11.918829 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:11.919355 13712 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:11.885887 13789 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:11.921031 13680 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:11.871299 15276 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:11.925969 13756 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:11.877451 14397 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:11.896622 15224 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.938154 13757 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:11.940968 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:11.911718 14966 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:06:11.942874 13680 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:11.911098 15166 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.956379 13757 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:11.922362 15217 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:11.958387 14368 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:11.953598 15013 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:11.970436 15091 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:11.971282 15091 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:11.972554 15185 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:11.973248 15121 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:11.973677 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:11.980278 15191 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:11.980787 15191 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.981227 15191 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.934492 15051 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:11.983734 15051 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:11.986133 15051 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:11.939833 15278 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:11.989228 15278 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.989665 15278 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.993062 15223 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:11.937100 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:11.948315 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:11.932677 15070 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
W20260709 13:06:12.022471 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 87449.8us
W20260709 13:06:12.025388 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 85072.5us
I20260709 13:06:12.026134 13756 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:12.005234 15168 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:12.028650 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 91064.2us
I20260709 13:06:12.004639 15244 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:12.009006 15217 raft_consensus.cc:697] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:11.954474 15224 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:12.042760 13756 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:12.043829 15264 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:12.044248 15264 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.044325 13756 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:12.044648 15264 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:12.045668 15010 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:12.046713 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.021255 15223 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:12.027034 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:12.050918 13783 raft_consensus.cc:2393] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 3: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:11.998534 15166 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:11.973742 15121 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:12.051600 15300 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:12.046314 15010 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:12.065605 13830 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:12.053475 15190 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.068711 15216 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:12.075858 15101 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:12.079537 15217 consensus_queue.cc:237] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.080426 14398 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:12.080914 14394 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:12.059381 15300 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.063805 15260 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:12.064754 15010 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:12.042037 15244 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:12.087359 15305 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:12.088558 15121 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:12.115543 15166 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:12.116020 15121 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.116443 15010 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:12.090690 15165 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:12.117278 15165 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:12.119124 15165 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:12.090819 15216 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.090969 15298 consensus_queue.cc:1059] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:06:12.122085 15298 raft_consensus.cc:3055] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:12.122393 15298 raft_consensus.cc:740] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:12.096457 15190 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:12.123900 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:12.125392 15190 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:12.127115 13755 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:12.129395 15182 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:12.129873 15127 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:12.129916 15182 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:12.130529 15127 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.101017 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:12.108991 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:12.101116 15301 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:12.132819 15244 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:12.110159 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:12.132896 15301 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.134325 15301 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:12.136947 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:12.113381 15300 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:12.114141 15260 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:12.141943 15260 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:12.142581 15224 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:12.130384 15069 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:12.097831 14367 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:12.111773 15308 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:12.143967 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 46257.1us
I20260709 13:06:12.148788 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:12.148553 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:12.150441 13713 raft_consensus.cc:2393] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 3: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:12.151342 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:12.154790 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:12.160385 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:12.088510 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 132226us
I20260709 13:06:12.144068 15308 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:12.132732 15072 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.115355 15305 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:12.164489 13757 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:12.193806 14994 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:12.195791 13757 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:12.195886 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:12.196718 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:12.198143 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:12.199438 15305 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:12.191196 13791 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:12.200670 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:12.200863 14994 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:12.201920 13757 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:12.202713 14994 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:12.160734 15260 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:12.205336 15216 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:12.165988 15308 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:12.166606 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:12.167032 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:12.209535 14393 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:12.210266 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:12.211000 13790 raft_consensus.cc:2393] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 3: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:12.211395 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:12.211723 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:12.212821 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:12.213423 13788 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:12.214213 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:12.167654 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:12.169983 15194 consensus_queue.cc:1059] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:12.146348 15278 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:12.171708 13783 raft_consensus.cc:1275] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:12.219563 15194 consensus_queue.cc:1243] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer b9d194f45e044e0988d5de1a99e5cd02 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:06:12.220134 15194 raft_consensus.cc:3055] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:12.220458 15194 raft_consensus.cc:740] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:12.221235 15194 consensus_queue.cc:260] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.222360 15194 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.173040 14366 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:12.178040 15301 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.223778 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:12.179836 15182 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:12.180073 15069 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.123111 15298 consensus_queue.cc:260] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.226613 15069 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:12.227254 15298 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:12.228638 15069 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:12.181227 15127 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:12.230760 13784 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:12.181869 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:12.182413 15261 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.248806 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:12.183895 15191 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:12.162575 15244 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:12.159825 15264 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.218195 15278 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:12.191039 13787 raft_consensus.cc:1240] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:12.225961 15301 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:12.116504 15121 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:12.199219 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:12.232957 13788 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:06:12.233094 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 60121.5us
I20260709 13:06:12.237411 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:12.271917 13712 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:12.239188 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:12.240386 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:12.182931 15150 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:12.257113 13829 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:12.258167 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:12.259433 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:12.232395 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:12.189744 15067 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:12.262377 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:12.262720 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:12.279728 13711 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:12.264899 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:12.285298 13861 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:12.248718 15308 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:12.287176 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:12.289999 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:12.291949 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:12.292342 13829 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:12.257227 15244 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.296532 14399 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:12.299229 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:12.302379 13712 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:12.302601 13863 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:12.203708 15260 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:12.303371 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:12.268551 15309 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.263676 15216 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:12.309868 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:12.314268 13682 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:12.286626 15008 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:12.287098 15213 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:12.311606 13786 raft_consensus.cc:2393] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 3: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:12.308282 14397 raft_consensus.cc:1240] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:12.340320 15216 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.344733 15260 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:12.318715 15101 consensus_queue.cc:1059] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:06:12.346283 15101 raft_consensus.cc:3055] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:12.346626 15101 raft_consensus.cc:740] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:12.346817 15191 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:12.347566 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:12.347424 15101 consensus_queue.cc:260] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.348498 15121 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:12.348713 15101 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.308156 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:12.356681 15213 raft_consensus.cc:697] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:12.357741 15213 consensus_queue.cc:237] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:12.320271 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:12.290515 15303 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.264698 15224 consensus_queue.cc:1048] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:06:12.321074 14368 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:12.307114 14982 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.261094 15261 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.343551 13715 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:12.342270 14959 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:12.335765 15309 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.332937 15264 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:12.318722 15185 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:06:12.282316 15013 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:06:12.306833 15244 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.365509 15303 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.362305 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:12.393054 13863 raft_consensus.cc:2393] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 3: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:12.288863 15150 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:12.365995 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 44993.2us
I20260709 13:06:12.394384 13830 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:12.394785 14368 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:12.316035 15301 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:12.287745 15067 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:12.372097 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 58608.2us
I20260709 13:06:12.397486 13790 raft_consensus.cc:2393] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 3: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:12.371955 14982 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:12.384011 15010 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.395318 13830 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:12.387101 14393 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:12.392339 15303 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:12.368337 15165 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:12.403647 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:12.346293 15216 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:12.401506 13864 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:12.414486 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:12.411252 15191 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:12.416813 15301 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:12.420635 15010 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:12.422096 15150 leader_election.cc:290] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:12.423552 15067 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:12.423921 15261 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:12.425757 13784 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:06:12.402482 15298 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:12.431604 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:12.432513 13789 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:12.448972 13785 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:12.397435 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:12.466477 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:12.467895 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:12.468259 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:12.470119 14367 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:12.472194 13756 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:12.453786 14959 raft_consensus.cc:697] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:12.476579 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:12.472321 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:12.481817 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:12.482402 13711 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:12.477608 15284 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:12.478780 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:12.471865 15301 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:12.471244 13784 raft_consensus.cc:606] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:06:12.473052 15191 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:12.485529 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:12.478893 15122 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:12.472955 15298 raft_consensus.cc:697] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:12.486956 14367 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:12.488024 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:12.498090 15298 consensus_queue.cc:237] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.498564 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:12.500038 14367 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:12.500311 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:12.501111 13713 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:12.494751 15309 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:12.502100 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:12.502852 15165 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:12.502986 13713 raft_consensus.cc:2393] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 3: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:12.503358 15165 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.503844 15165 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.484607 15284 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.486172 15301 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.489657 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:12.518137 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:12.511453 14367 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:12.518755 13711 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:12.484375 14959 consensus_queue.cc:237] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.521796 14366 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:12.522342 13859 raft_consensus.cc:1275] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:12.523026 15121 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:12.523382 15308 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:12.523649 15121 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:12.500303 15307 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:12.524163 15121 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.511353 13756 leader_election.cc:304] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:12.524792 15301 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:12.516302 15284 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.525645 15070 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:12.525818 13756 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:12.526965 13756 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:12.527101 14994 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:12.527560 14994 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.527928 14994 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.528599 15261 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:12.499167 13707 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:12.493141 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:06:12.532269 13645 debug-util.cc:398] Leaking SignalData structure 0x7b0800034ca0 after lost signal to thread 12597
I20260709 13:06:12.532717 15244 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:12.533397 13645 debug-util.cc:398] Leaking SignalData structure 0x7b0800035380 after lost signal to thread 13648
W20260709 13:06:12.534695 13645 debug-util.cc:398] Leaking SignalData structure 0x7b080031a6e0 after lost signal to thread 13740
I20260709 13:06:12.496129 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:12.535055 14400 raft_consensus.cc:2393] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 4: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:06:12.535871 13645 debug-util.cc:398] Leaking SignalData structure 0x7b080034c760 after lost signal to thread 13815
W20260709 13:06:12.536181 13645 debug-util.cc:398] Leaking SignalData structure 0x7b080034c700 after lost signal to thread 13816
W20260709 13:06:12.537235 13645 debug-util.cc:398] Leaking SignalData structure 0x7b0800290f80 after lost signal to thread 13889
W20260709 13:06:12.537539 13645 debug-util.cc:398] Leaking SignalData structure 0x7b080021afc0 after lost signal to thread 13890
W20260709 13:06:12.538605 15321 log.cc:927] Time spent T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 13:06:12.538684 13645 debug-util.cc:398] Leaking SignalData structure 0x7b0800356f60 after lost signal to thread 14426
I20260709 13:06:12.522976 14366 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:12.542773 13756 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:12.543499 15067 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:12.545624 14982 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:12.545835 15306 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:12.534715 15244 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:12.552042 14366 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:12.556130 15244 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:12.559482 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 48110.6us
I20260709 13:06:12.561218 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:12.561833 13710 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:12.562358 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:12.563967 13756 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:12.565830 14366 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:12.568306 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:12.563189 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:12.569553 13714 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:12.573809 13756 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:12.576849 14368 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:12.581200 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:12.583036 15067 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:12.593374 13710 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:06:12.594205 13710 raft_consensus.cc:606] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:06:12.532320 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:12.587271 15009 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:12.585382 15308 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:12.621049 14366 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:12.601475 13830 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:12.601382 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:12.602902 14994 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.624471 14399 raft_consensus.cc:1275] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:12.626719 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:12.627451 13709 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:12.603473 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:12.612591 15009 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.629128 15009 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.604022 15082 consensus_queue.cc:1048] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:12.604925 13715 raft_consensus.cc:1275] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:12.613478 15067 raft_consensus.cc:697] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:12.569690 15165 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:12.604825 15301 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.635967 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:12.636763 13715 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.637663 15301 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:12.638358 13863 raft_consensus.cc:2368] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 2. Current term is 3.
I20260709 13:06:12.606459 15284 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:12.598237 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:12.640878 13784 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 4: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:12.608714 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:12.641978 13787 raft_consensus.cc:2393] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 4: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:12.643615 13757 leader_election.cc:400] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 2. Current term is 3.
I20260709 13:06:12.644778 15165 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:12.648389 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:12.649053 15308 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:12.651018 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 49634.9us
I20260709 13:06:12.651976 14366 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:12.613646 13682 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:12.586066 15191 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:12.660733 13715 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:12.655499 15191 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.663468 15191 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.664618 13756 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:12.664846 15009 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:12.665529 15280 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:12.666004 15280 raft_consensus.cc:697] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:12.666867 15280 consensus_queue.cc:237] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.633909 15067 consensus_queue.cc:237] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.673331 13682 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:12.674762 15013 raft_consensus.cc:2764] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:12.678469 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:12.685571 14966 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:12.655764 15082 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:12.655692 15308 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:12.657833 15300 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:12.692787 15300 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.693192 15300 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.688364 13682 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:12.667687 13708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:06:12.698189 15127 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:12.689738 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:12.687599 15009 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:12.721490 14982 consensus_queue.cc:1059] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:12.721881 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:12.722872 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:12.708999 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:12.742972 13715 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.773852 13784 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 4: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:12.739786 13709 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.781190 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:12.781965 14399 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 4: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:12.783998 13715 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:12.723690 13708 raft_consensus.cc:606] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:06:12.797320 13708 raft_consensus.cc:614] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:12.785976 15284 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:12.801637 15121 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:12.803292 14394 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:12.775735 15101 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:06:12.786010 15150 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.806020 15150 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.808040 15150 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:12.809991 14994 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:12.812021 15127 raft_consensus.cc:993] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02: : Instructing follower b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:12.812516 15127 raft_consensus.cc:1081] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Signalling peer b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:12.812677 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:12.818025 13864 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:59792
I20260709 13:06:12.818635 13864 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:12.818898 13864 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:12.819932 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:12.820581 13859 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:12.823536 15121 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:12.827679 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:12.834450 13756 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:12.835884 15101 consensus_queue.cc:1059] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:12.838125 15191 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:12.843673 14402 raft_consensus.cc:2368] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 3. Current term is 4.
I20260709 13:06:12.833818 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:12.847329 14401 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 4: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:12.849473 13716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:06:12.857012 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:12.862046 13716 raft_consensus.cc:606] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:06:12.862279 13710 raft_consensus.cc:2393] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 4: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:12.855628 13757 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:12.830597 13864 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.858043 15299 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.872334 15301 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:12.872327 15299 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.872957 15301 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.873546 13756 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:12.874876 15101 raft_consensus.cc:3055] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:12.874948 13756 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:12.874378 15299 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:12.875471 15101 raft_consensus.cc:740] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:12.876545 15101 consensus_queue.cc:260] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:12.879802 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:12.877010 15072 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:12.879892 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:12.889873 13712 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:12.891201 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:12.854755 13787 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:12.896087 13857 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:06:12.896504 13857 pending_rounds.cc:85] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 2
I20260709 13:06:12.896715 13857 pending_rounds.cc:107] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:06:12.896960 13857 raft_consensus.cc:2889] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:12.847259 15261 raft_consensus.cc:3055] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:12.855358 13784 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:12.877240 15299 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:12.888339 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:12.909756 13790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:06:12.890993 13611 catalog_manager.cc:5697] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 1 to 2, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 2 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:06:12.904014 13756 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:12.856771 15191 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:12.877527 15069 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:12.916721 13611 catalog_manager.cc:5697] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 1 to 2, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 2 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:06:12.877764 15276 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:12.880200 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:12.913897 13790 raft_consensus.cc:606] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:06:12.928079 13790 raft_consensus.cc:614] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:12.928009 13611 catalog_manager.cc:5697] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 1 to 2, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 2 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:12.917757 14366 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:12.923946 15300 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.888338 13709 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:12.920773 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:12.934463 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:12.931185 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:12.935140 13712 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 4: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:12.906687 15261 raft_consensus.cc:740] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:12.940438 13864 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:12.932065 13611 catalog_manager.cc:5697] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 1 to 2, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 2 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:12.933674 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:12.941658 13713 raft_consensus.cc:3055] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:12.936219 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:12.942643 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:12.917507 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:12.942083 13713 raft_consensus.cc:740] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:12.911929 15072 raft_consensus.cc:697] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:12.942232 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:12.944029 13680 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:12.944164 13611 catalog_manager.cc:5697] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 1 to 2, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 2 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:06:12.924947 15276 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.925035 15010 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:12.969868 13790 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:12.911669 15217 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:06:12.938380 15191 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:12.972110 13863 raft_consensus.cc:2393] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 4: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:12.971680 13611 catalog_manager.cc:5697] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:12.941298 13707 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:12.925698 13859 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:12.939742 15301 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:12.940246 15101 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.951454 15013 raft_consensus.cc:2764] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:06:12.975843 13713 consensus_queue.cc:260] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:12.971376 15276 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.984500 13713 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:12.981607 15072 consensus_queue.cc:237] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:12.972687 15010 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.973421 15219 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:12.994791 13713 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:13.002348 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:13.003338 13712 raft_consensus.cc:2393] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 4: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:13.008291 14367 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:12.977777 13611 catalog_manager.cc:5697] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 1 to 2, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132), now has a pending config: VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129), VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130), VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131), VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 2 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:13.011283 13611 catalog_manager.cc:5697] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:13.014474 13611 catalog_manager.cc:5697] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 1 to 2, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 2 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:06:13.015784 13611 catalog_manager.cc:5697] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:06:13.016875 13611 catalog_manager.cc:5697] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 1 to 3, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 3 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:12.994915 15010 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:13.018090 13611 catalog_manager.cc:5697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 1 to 3, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 3 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.020259 13790 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:13.001582 15300 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:13.031572 13680 leader_election.cc:400] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 3. Current term is 4.
I20260709 13:06:13.031971 13680 leader_election.cc:403] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:13.013626 15305 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:13.039032 15217 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 3. Current term is 4.
I20260709 13:06:13.046707 15305 raft_consensus.cc:697] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:13.075066 15305 consensus_queue.cc:237] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:13.032995 15013 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:06:13.066612 13830 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:13.079276 15337 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:13.079766 15337 raft_consensus.cc:697] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:13.080027 13864 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:13.080593 15337 consensus_queue.cc:237] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:13.085500 15329 log.cc:927] Time spent T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260709 13:06:13.087994 15332 log.cc:927] Time spent T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:06:13.000643 15261 consensus_queue.cc:260] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:13.090910 15261 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:13.092828 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:13.101965 13830 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:13.067297 13707 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
W20260709 13:06:13.115612 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 80164.4us
I20260709 13:06:13.116626 13710 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:13.068087 15010 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:13.073940 15331 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.090s	user 0.003s	sys 0.000s
I20260709 13:06:13.030797 15213 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:06:13.118762 15309 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:13.125741 13789 raft_consensus.cc:2368] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 4. Current term is 5.
I20260709 13:06:13.127322 15069 consensus_queue.cc:1059] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:13.125669 15224 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:06:13.128943 15216 raft_consensus.cc:993] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02: : Instructing follower b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:13.136075 15077 raft_consensus.cc:993] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03: : Instructing follower b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:13.136610 15077 raft_consensus.cc:1081] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Signalling peer b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:13.139247 15069 raft_consensus.cc:3055] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:13.139518 13829 leader_election.cc:400] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 4. Current term is 5.
I20260709 13:06:13.139649 15069 raft_consensus.cc:740] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:13.139926 13829 leader_election.cc:403] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:13.140913 15301 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:13.140573 15069 consensus_queue.cc:260] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:13.141983 15069 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.148361 15276 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:13.149714 13785 raft_consensus.cc:1240] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:13.150739 15276 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:13.151865 13786 raft_consensus.cc:1275] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:13.152158 15216 raft_consensus.cc:1081] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 LEADER]: Signalling peer b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:13.153439 15336 consensus_queue.cc:1048] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:13.155799 15301 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 4. Current term is 5.
I20260709 13:06:13.164215 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:13.164887 13864 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:13.170043 13863 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:59780
I20260709 13:06:13.170881 13863 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:13.164091 15216 consensus_queue.cc:1059] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:13.172689 15216 raft_consensus.cc:3055] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:13.173079 15216 raft_consensus.cc:740] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:13.171357 13863 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:13.183636 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 57522.4us
I20260709 13:06:13.196748 14366 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:13.199486 15251 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:13.204885 13710 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:06:13.209811 13830 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:13.210798 13864 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:13.203568 15216 consensus_queue.cc:260] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:13.213433 13757 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:13.215091 15336 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:13.224027 15336 raft_consensus.cc:697] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:13.225193 15336 consensus_queue.cc:237] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:13.236099 13857 raft_consensus.cc:1240] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:13.235976 13856 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:59792
I20260709 13:06:13.237353 13856 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:13.237824 13856 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.240474 13863 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:13.217036 15276 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:13.215533 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:13.234094 15216 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:13.262198 13863 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:13.263810 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:13.264362 13789 raft_consensus.cc:3055] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:13.264698 13789 raft_consensus.cc:740] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:13.265360 13789 consensus_queue.cc:260] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:13.273661 13856 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:13.276134 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:13.279286 13710 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:13.246800 15077 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:06:13.259820 15276 raft_consensus.cc:697] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:13.289891 13789 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.266467 13858 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:06:13.281481 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:13.296903 13785 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.287158 13709 raft_consensus.cc:1275] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:13.299196 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:13.308974 13712 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.299485 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:13.311576 13715 raft_consensus.cc:3055] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:13.312000 13715 raft_consensus.cc:740] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:13.299896 15010 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:13.300581 15276 consensus_queue.cc:237] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:13.280784 14394 raft_consensus.cc:1240] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:13.313122 13715 consensus_queue.cc:260] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:13.334231 13715 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.332708 15213 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:13.339509 13789 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:13.347054 13856 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:13.352003 13710 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:13.357334 13785 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:13.359323 13829 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:13.358065 13712 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:13.370816 13715 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:13.372782 13830 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:13.375253 13756 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:13.381752 14970 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:13.382252 14970 raft_consensus.cc:697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:13.333849 15302 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:06:13.383072 14970 consensus_queue.cc:237] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:13.389211 15101 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:13.389988 15101 raft_consensus.cc:697] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:13.341801 15213 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:13.373986 13786 raft_consensus.cc:1240] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:13.397626 15213 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:13.357668 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:13.398092 15213 consensus_queue.cc:1059] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:13.398710 15013 raft_consensus.cc:3055] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:13.399048 15013 raft_consensus.cc:740] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:13.399844 15013 consensus_queue.cc:260] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:13.374375 15010 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.412266 15010 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:13.414251 15010 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:13.406080 15069 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:13.421967 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:13.422848 13864 raft_consensus.cc:2410] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:06:13.424356 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 50729us
I20260709 13:06:13.401051 15013 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:13.419574 15309 consensus_queue.cc:1048] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:06:13.437384 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:13.438068 13864 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
W20260709 13:06:13.448341 15350 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.057s	user 0.002s	sys 0.001s
I20260709 13:06:13.451833 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:13.452813 13709 raft_consensus.cc:2410] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:13.456722 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:13.457923 13786 raft_consensus.cc:2393] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 4: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:13.459656 13682 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:13.432766 15069 raft_consensus.cc:697] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:13.461030 15127 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:13.461408 15127 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:13.461920 15127 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:13.461436 15069 consensus_queue.cc:237] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:13.391187 15101 consensus_queue.cc:237] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:13.490813 13756 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:13.499563 15077 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:13.513605 13858 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:13.523029 13707 raft_consensus.cc:2410] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:06:13.553372 15353 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.174s	user 0.002s	sys 0.000s
I20260709 13:06:13.560894 15127 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:13.565178 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:13.563225 15127 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:13.573076 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:13.576413 13783 raft_consensus.cc:2393] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 4: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
W20260709 13:06:13.583401 15356 log.cc:927] Time spent T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:06:13.607354 13707 raft_consensus.cc:1275] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:13.609470 15101 consensus_queue.cc:1048] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:13.630015 13708 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:13.635020 13708 raft_consensus.cc:1275] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:13.638574 13791 raft_consensus.cc:1275] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:13.640105 15261 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:13.641763 14970 consensus_queue.cc:1048] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:13.645820 13856 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:06:13.647449 13682 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:13.648885 15013 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:13.649574 15013 raft_consensus.cc:697] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:13.650604 15013 consensus_queue.cc:237] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:13.667765 14394 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:13.639432 15308 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:06:13.679026 15261 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:06:13.718289 13791 raft_consensus.cc:1275] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:13.725063 15308 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:06:13.739647 13610 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49444 (request call id 232) took 4905 ms. Trace:
I20260709 13:06:13.740232 13610 rpcz_store.cc:276] 0709 13:06:08.834048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.852656 (+ 18608us) service_pool.cc:224] Handling call
0709 13:06:09.458503 (+605847us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54003edd54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232448090 00007f52324e6f3a 00007f523829d1cc 00007f523839b37e 00007f523685c2a4 00007f523685c232 00007f523685c161 00007f523685c0dc 00007f523685b392 00007f523081948c 00007f52308188c6
0709 13:06:13.739588 (+4281085us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":276079,"reported_tablets":14,"spinlock_wait_cycles":236974976}
I20260709 13:06:13.745213 13614 catalog_manager.cc:5697] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index 5 to 6, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New cstate: current_term: 3 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:13.749897 13614 catalog_manager.cc:5697] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 1 to 4, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 4 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.754052 13614 catalog_manager.cc:5697] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 3 to 4, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 4 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:06:13.755517 13614 catalog_manager.cc:5697] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 1 to 3, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 3 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:06:13.756852 13614 catalog_manager.cc:5697] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 1 to 2, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 2 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:13.758486 13614 catalog_manager.cc:5697] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.760131 13614 catalog_manager.cc:5697] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 2 to 3, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 3 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.761458 13614 catalog_manager.cc:5697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 2 to 4, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 4 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.762873 13614 catalog_manager.cc:5697] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 1 to 3, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 3 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:13.765550 13614 catalog_manager.cc:5697] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 1 to 2, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 2 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:13.768908 13614 catalog_manager.cc:5697] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 2 to 5, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 5 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:06:13.788911 13611 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49436 (request call id 228) took 4210 ms. Trace:
I20260709 13:06:13.789382 13611 rpcz_store.cc:276] 0709 13:06:09.578410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.578546 (+   136us) service_pool.cc:224] Handling call
0709 13:06:13.187573 (+3609027us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b54003edb00. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5235e48161 00007f5235f1cb89 00007f5235f127ad 00007f5235ed3e0b 00007f5235ed3be4 00007f52383d42d1 00007f52383d4b2f 00007f5238293d4b 00007f523839bc3e 00007f523685c2a4 00007f523685c232
0709 13:06:13.788838 (+601265us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:13.296053 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:13.306747 (+ 10694us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:13.306780 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:06:13.306797 (+    17us) tablet.cc:662] Decoding operations
0709 13:06:13.307877 (+  1080us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:13.307934 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:13.308025 (+    91us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:06:13.389315 (+ 81290us) tablet.cc:701] Row locks acquired
0709 13:06:13.389332 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:06:13.389482 (+   150us) write_op.cc:270] Start()
0709 13:06:13.389595 (+   113us) write_op.cc:276] Timestamp: P: 1783602373389440 usec, L: 0
0709 13:06:13.389614 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:06:13.390215 (+   601us) log.cc:844] Serialized 5109 byte log entry
0709 13:06:13.473219 (+ 83004us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f522f3d40ac 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b
0709 13:06:13.613783 (+140564us) op_driver.cc:464] REPLICATION: finished
0709 13:06:13.642434 (+ 28651us) write_op.cc:301] APPLY: starting
0709 13:06:13.642525 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:13.642835 (+   310us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:13.642858 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:13.655335 (+ 12477us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:13.659489 (+  4154us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:06:13.659553 (+    64us) write_op.cc:312] APPLY: finished
0709 13:06:13.659846 (+   293us) log.cc:844] Serialized 89 byte log entry
0709 13:06:13.660594 (+   748us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:13.660721 (+   127us) write_op.cc:454] Released schema lock
0709 13:06:13.660767 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:13.665367 (+  4600us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:13.666224 (+   857us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":73599,"reported_tablets":26,"spinlock_wait_cycles":25652096,"child_traces":[["op",{"apply.queue_time_us":26793,"apply.run_cpu_time_us":3395,"apply.run_wall_time_us":18671,"num_ops":12,"prepare.queue_time_us":78115,"prepare.run_cpu_time_us":31630,"prepare.run_wall_time_us":301682,"raft.queue_time_us":15450,"raft.run_cpu_time_us":976,"raft.run_wall_time_us":1240,"replication_time_us":224028,"spinlock_wait_cycles":36333952,"thread_start_us":259857,"threads_started":4,"wal-append.queue_time_us":202393}]]}
I20260709 13:06:13.780297 13614 catalog_manager.cc:5697] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129), VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130), VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131), VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 2 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:13.806378 13791 consensus_queue.cc:237] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:13.801997 13614 catalog_manager.cc:5697] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 1 to 3, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 3 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
W20260709 13:06:13.802229 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 72959us
I20260709 13:06:13.808291 13614 catalog_manager.cc:5697] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 1 to 2, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 2 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:06:13.815320 13614 catalog_manager.cc:5697] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:13.832621 13614 catalog_manager.cc:5697] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 1 to 4, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 4 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:13.837028 13786 raft_consensus.cc:1275] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:13.854648 13787 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:06:13.855206 13787 pending_rounds.cc:85] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 1
I20260709 13:06:13.855517 13787 pending_rounds.cc:107] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:13.855810 13787 raft_consensus.cc:2889] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:13.865761 14395 raft_consensus.cc:1275] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:13.867029 13707 raft_consensus.cc:1275] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:13.869627 15185 consensus_queue.cc:1048] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:13.874954 15276 consensus_queue.cc:1048] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:13.881211 13856 raft_consensus.cc:1275] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:13.883949 15072 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:06:13.898952 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 45860.1us
W20260709 13:06:13.899020 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 45202us
I20260709 13:06:13.935380 13708 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:13.938747 15299 raft_consensus.cc:2955] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:13.947530 13713 raft_consensus.cc:1275] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:13.962260 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:13.963725 13715 raft_consensus.cc:1275] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:06:13.964067 13715 pending_rounds.cc:85] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 2
I20260709 13:06:13.964618 13715 pending_rounds.cc:107] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:06:13.964880 13715 raft_consensus.cc:2889] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:13.970326 14394 raft_consensus.cc:2955] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:13.981945 15051 consensus_queue.cc:1048] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:06:13.992579 15101 consensus_queue.cc:1048] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:13.993664 14994 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:13.994315 14994 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:13.997665 15261 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:14.000391 13599 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 44fb07fff88a4dcf97841a29f2641f66 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:14.006348 14994 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:13.954803 15301 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:06:14.008066 15337 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:14.014519 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:14.017191 13864 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:14.020951 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:14.025559 14402 raft_consensus.cc:2393] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 4: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:14.028527 13612 catalog_manager.cc:5697] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:14.044247 13785 raft_consensus.cc:1275] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:14.048074 13612 catalog_manager.cc:5697] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.015319 13859 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:14.076692 15276 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.074308 15145 consensus_queue.cc:1048] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:14.087007 13861 raft_consensus.cc:1275] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:14.094929 15224 consensus_queue.cc:1048] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.111101 13712 raft_consensus.cc:1275] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:14.143906 13614 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49428 (request call id 236) took 1307 ms. Trace:
I20260709 13:06:14.129879 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:14.152765 13611 catalog_manager.cc:5697] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 2 to 3, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 3 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.144503 13614 rpcz_store.cc:276] 0709 13:06:12.836876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.842035 (+  5159us) service_pool.cc:224] Handling call
0709 13:06:14.143841 (+1301806us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:13.923001 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:13.924939 (+  1938us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:13.924983 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:06:13.925000 (+    17us) tablet.cc:662] Decoding operations
0709 13:06:13.926596 (+  1596us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:13.926663 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:13.926697 (+    34us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:06:13.928148 (+  1451us) tablet.cc:701] Row locks acquired
0709 13:06:13.928168 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:06:13.928334 (+   166us) write_op.cc:270] Start()
0709 13:06:13.928472 (+   138us) write_op.cc:276] Timestamp: P: 1783602373928285 usec, L: 0
0709 13:06:13.928493 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:06:13.929233 (+   740us) log.cc:844] Serialized 6381 byte log entry
0709 13:06:13.968724 (+ 39491us) op_driver.cc:464] REPLICATION: finished
0709 13:06:13.969109 (+   385us) write_op.cc:301] APPLY: starting
0709 13:06:13.969190 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:13.969497 (+   307us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:13.969602 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:13.971543 (+  1941us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:13.971834 (+   291us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:06:13.971885 (+    51us) write_op.cc:312] APPLY: finished
0709 13:06:13.972270 (+   385us) log.cc:844] Serialized 113 byte log entry
0709 13:06:13.973336 (+  1066us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:13.973498 (+   162us) write_op.cc:454] Released schema lock
0709 13:06:13.973555 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:13.986403 (+ 12848us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:13.987752 (+  1349us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31233,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":142,"apply.run_cpu_time_us":3920,"apply.run_wall_time_us":4790,"num_ops":16,"prepare.queue_time_us":2918,"prepare.run_cpu_time_us":5327,"prepare.run_wall_time_us":37274,"replication_time_us":40081}]]}
I20260709 13:06:14.160688 13611 catalog_manager.cc:5697] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 1 to 2, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 2 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:14.171277 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 108960us
I20260709 13:06:14.115162 15051 consensus_queue.cc:1048] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:06:14.174685 13757 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:14.158735 15336 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:14.184880 13611 catalog_manager.cc:5697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 1 to 2, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 2 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.193471 13611 catalog_manager.cc:5697] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.195827 13611 catalog_manager.cc:5697] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 1 to 3, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 3 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.199038 13611 catalog_manager.cc:5697] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:14.200338 13611 catalog_manager.cc:5697] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 2 to 4, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 4 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:06:14.196755 15299 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:14.220595 13716 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:14.230268 13848 tablet_service.cc:1558] Processing DeleteTablet for tablet ab01257d4e56488eba41a0ce5c5e9954 with delete_type TABLET_DATA_TOMBSTONED (TS b5029654a4384e43a68eb67b794949b7 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:59764
I20260709 13:06:14.221917 15299 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:14.239029 15299 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:14.201555 15336 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:14.256791 13712 consensus_queue.cc:237] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:14.257846 13715 raft_consensus.cc:2955] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:14.277987 15389 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:14.319182 15336 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:14.301527 15051 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:14.326891 15051 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:14.332901 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 67298.8us
W20260709 13:06:14.336925 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 88582.1us
I20260709 13:06:14.341310 13789 raft_consensus.cc:1275] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:06:14.342799 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 94467.8us
W20260709 13:06:14.341473 15359 log.cc:927] Time spent T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:06:14.354027 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:14.354979 14401 raft_consensus.cc:2393] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 4: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:06:14.368053 15379 log.cc:927] Time spent T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
W20260709 13:06:14.419974 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 65916.1us
I20260709 13:06:14.358461 15315 consensus_queue.cc:1048] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:06:14.410929 15391 tablet_replica.cc:333] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
W20260709 13:06:14.425115 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 74100.1us
I20260709 13:06:14.424353 15299 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:14.461575 15383 log.cc:927] Time spent T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.222s	user 0.002s	sys 0.000s
W20260709 13:06:14.459709 15385 log.cc:927] Time spent T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.217s	user 0.004s	sys 0.002s
W20260709 13:06:14.502866 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 124260us
I20260709 13:06:14.504199 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:14.514806 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 159370us
I20260709 13:06:14.524638 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:14.530736 14395 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:14.536051 15051 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:14.562427 15393 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.538406 15299 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:14.563678 15393 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:14.574550 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:14.597712 13791 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:06:14.607801 15393 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:14.672842 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:14.674471 15372 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.675384 15372 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:14.678277 15372 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:14.679256 13829 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:14.687850 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:14.688989 14395 raft_consensus.cc:2393] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 4: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:14.710170 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:06:14.726150 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 65599.4us
I20260709 13:06:14.728621 13829 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:14.730563 15300 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:14.730994 15300 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:14.731393 15300 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:14.744813 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 45728.4us
I20260709 13:06:14.744980 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:14.745875 13785 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:14.748888 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:14.749425 13861 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:14.750293 13786 raft_consensus.cc:2410] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:14.757764 15421 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:14.763638 15224 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:14.775852 13856 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:14.801959 15409 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:06:14.802117 14399 consensus_queue.cc:237] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 3, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:14.806854 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 50733.4us
I20260709 13:06:14.817695 14366 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:14.819514 15375 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:14.819922 15375 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.820308 15375 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:14.850261 15417 log.cc:927] Time spent T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.240s	user 0.002s	sys 0.000s
I20260709 13:06:14.912660 15375 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:14.923348 15300 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:14.964396 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:14.968243 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:14.969564 13864 raft_consensus.cc:2410] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:14.973418 13861 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:14.975997 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:14.977159 13713 raft_consensus.cc:2410] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:14.977084 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:14.977815 13716 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:14.956625 13757 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:14.988576 14368 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:14.990608 15305 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:14.994635 15300 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:14.965523 15375 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:15.000855 13787 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:06:15.002060 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:15.002493 13829 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:15.002827 14399 raft_consensus.cc:2393] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 4: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:06:15.004033 15427 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:06:15.006654 15336 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:15.007037 15429 log.cc:927] Time spent T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:06:15.007264 15336 raft_consensus.cc:697] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:15.019464 15372 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:15.022199 15386 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:15.022966 15386 raft_consensus.cc:697] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:15.024317 15386 consensus_queue.cc:237] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:15.025171 15336 consensus_queue.cc:237] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:15.022099 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 131066us
I20260709 13:06:15.033228 13612 catalog_manager.cc:5697] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 2 to 4, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 4 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:15.046514 13716 raft_consensus.cc:2410] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:15.059906 13611 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49444 (request call id 233) took 1136 ms. Trace:
I20260709 13:06:15.055114 13612 catalog_manager.cc:5697] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:15.060411 13611 rpcz_store.cc:276] 0709 13:06:13.923881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.924186 (+   305us) service_pool.cc:224] Handling call
0709 13:06:15.059709 (+1135523us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:14.236455 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:14.244598 (+  8143us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:14.244639 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:06:14.244658 (+    19us) tablet.cc:662] Decoding operations
0709 13:06:14.245417 (+   759us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:14.245470 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:14.245495 (+    25us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:06:14.246059 (+   564us) tablet.cc:701] Row locks acquired
0709 13:06:14.246077 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:06:14.246219 (+   142us) write_op.cc:270] Start()
0709 13:06:14.246319 (+   100us) write_op.cc:276] Timestamp: P: 1783602374246179 usec, L: 0
0709 13:06:14.246343 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:06:14.252736 (+  6393us) log.cc:844] Serialized 2865 byte log entry
0709 13:06:14.432624 (+179888us) op_driver.cc:464] REPLICATION: finished
0709 13:06:14.438202 (+  5578us) write_op.cc:301] APPLY: starting
0709 13:06:14.438314 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:14.438601 (+   287us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:14.453213 (+ 14612us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:14.464390 (+ 11177us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:14.464626 (+   236us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:06:14.464681 (+    55us) write_op.cc:312] APPLY: finished
0709 13:06:14.464957 (+   276us) log.cc:844] Serialized 59 byte log entry
0709 13:06:14.465856 (+   899us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:14.465975 (+   119us) write_op.cc:454] Released schema lock
0709 13:06:14.466034 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:14.466343 (+   309us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:14.466367 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":42620,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":4044,"apply.run_cpu_time_us":4299,"apply.run_wall_time_us":28161,"num_ops":7,"prepare.queue_time_us":2213,"prepare.run_cpu_time_us":3429,"prepare.run_wall_time_us":23746,"replication_time_us":178505}]]}
I20260709 13:06:15.051458 15300 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:15.074862 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:15.069355 15013 raft_consensus.cc:2955] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:15.075496 13791 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.088219 13789 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:15.088328 15300 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:15.093353 15372 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.096743 15375 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:15.084110 14401 raft_consensus.cc:2955] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:15.100107 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:15.095563 15372 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:15.103726 15372 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:15.104240 15409 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.104735 15409 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:15.105531 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:15.106295 13863 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:15.106943 15409 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:15.108201 14368 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:15.106691 15300 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:15.109539 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:15.110162 14399 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:15.110545 15393 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:15.110934 15393 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.111260 15393 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.120002 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:15.123325 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:15.142023 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:15.143062 15339 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:15.143456 15339 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.143815 15339 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:15.149036 13829 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:15.152693 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:15.160950 14970 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:15.179924 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:15.195012 13791 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:06:15.119256 15393 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:15.185125 15013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:49478 (request call id 75) took 1052 ms. Trace:
I20260709 13:06:15.211833 14366 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:15.219633 13857 raft_consensus.cc:2955] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:15.251699 15391 raft_consensus.cc:2243] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:15.232595 15375 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:15.277709 15375 raft_consensus.cc:697] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:15.301785 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:15.272830 15339 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:15.321087 15391 raft_consensus.cc:2272] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:15.328315 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:15.328958 13856 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.341612 13856 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:06:15.321444 15393 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:15.351339 14368 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:15.225896 15013 rpcz_store.cc:276] 0709 13:06:14.131441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.132519 (+  1078us) service_pool.cc:224] Handling call
0709 13:06:14.254074 (+121555us) spinlock_profiling.cc:243] Waited 44 ms on lock 0x7b5400058320. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f523245b520 00007f52324e4b42 00007f52324e3800 00007f52324dc9fa 00007f52374a44c9 00007f5230a20c54 00007f5230a20be2 00007f5230a20b11 00007f5230a20a8c 00007f5230a1fd42
0709 13:06:14.263220 (+  9146us) log.cc:844] Serialized 501 byte log entry
0709 13:06:14.673168 (+409948us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b18003a8220. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f13f3 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
0709 13:06:14.838034 (+164866us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b4c002eec00. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52307aaa20 00007f52307bba29 00007f52307bc13f 00007f52307802ab 00007f52307adf3c 00007f52307ae3fe 00007f5230a3b50b 00007f523243a381 00007f523243826b 00007f523243ed53 00007f523243ecd9
0709 13:06:15.183957 (+345923us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":283,"mutex_wait_us":125311,"raft.queue_time_us":6336,"raft.run_cpu_time_us":6261,"raft.run_wall_time_us":214915,"spinlock_wait_cycles":134113792,"thread_start_us":71146,"threads_started":1,"wal-append.queue_time_us":95001}
I20260709 13:06:15.362460 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:15.363004 13791 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:15.364087 15405 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:15.371639 15405 raft_consensus.cc:697] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:15.388063 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:15.360216 15375 consensus_queue.cc:237] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:15.384963 15339 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:15.383610 15405 consensus_queue.cc:237] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:15.410169 13791 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:06:15.411423 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:15.413192 13600 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet de09d01498e547e591ce4ebe62e59488 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:15.414353 15082 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:15.414927 15082 raft_consensus.cc:697] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:15.415072 15391 ts_tablet_manager.cc:1916] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:15.416134 15082 consensus_queue.cc:237] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:15.432454 15436 log.cc:927] Time spent T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:06:15.440124 15372 raft_consensus.cc:2955] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:15.443368 13863 raft_consensus.cc:2955] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:15.450767 13789 raft_consensus.cc:1275] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:15.452394 15298 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:06:15.457461 15438 log.cc:927] Time spent T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.142s	user 0.000s	sys 0.005s
I20260709 13:06:15.462432 13787 raft_consensus.cc:2955] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:15.467469 13612 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57116 (request call id 138) took 1136 ms. Trace:
I20260709 13:06:15.469373 13612 rpcz_store.cc:276] 0709 13:06:14.331479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.331814 (+   335us) service_pool.cc:224] Handling call
0709 13:06:15.467379 (+1135565us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:15.284879 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:15.285626 (+   747us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:15.285676 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:06:15.285693 (+    17us) tablet.cc:662] Decoding operations
0709 13:06:15.286174 (+   481us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:15.286268 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:15.286294 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:06:15.286761 (+   467us) tablet.cc:701] Row locks acquired
0709 13:06:15.286818 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:06:15.286971 (+   153us) write_op.cc:270] Start()
0709 13:06:15.287120 (+   149us) write_op.cc:276] Timestamp: P: 1783602375286912 usec, L: 0
0709 13:06:15.287154 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:06:15.305257 (+ 18103us) log.cc:844] Serialized 919 byte log entry
0709 13:06:15.399335 (+ 94078us) op_driver.cc:464] REPLICATION: finished
0709 13:06:15.448918 (+ 49583us) write_op.cc:301] APPLY: starting
0709 13:06:15.449021 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:15.449151 (+   130us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:15.449274 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:15.451637 (+  2363us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:15.451856 (+   219us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:06:15.451917 (+    61us) write_op.cc:312] APPLY: finished
0709 13:06:15.452186 (+   269us) log.cc:844] Serialized 29 byte log entry
0709 13:06:15.453014 (+   828us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:15.455657 (+  2643us) write_op.cc:454] Released schema lock
0709 13:06:15.455721 (+    64us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":229976,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":49297,"num_ops":2,"prepare.queue_time_us":183677,"prepare.run_cpu_time_us":4563,"prepare.run_wall_time_us":41270,"replication_time_us":112044,"thread_start_us":168412,"threads_started":2}]]}
I20260709 13:06:15.469874 13848 tablet_service.cc:1558] Processing DeleteTablet for tablet 44fb07fff88a4dcf97841a29f2641f66 with delete_type TABLET_DATA_TOMBSTONED (TS b5029654a4384e43a68eb67b794949b7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59764
I20260709 13:06:15.468191 13614 catalog_manager.cc:5697] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 3 to 4, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 4 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:15.492966 13614 catalog_manager.cc:5697] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 2 to 4, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 4 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:06:15.523958 13861 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:15.526075 15069 consensus_queue.cc:1059] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:15.526964 15276 raft_consensus.cc:3055] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:15.527400 15276 raft_consensus.cc:740] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:15.528270 15276 consensus_queue.cc:260] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:15.530241 15276 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.533223 14401 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:15.541661 14394 raft_consensus.cc:1275] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:15.544028 15145 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:15.548496 15069 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:15.549181 15069 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:15.552181 13599 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c7cc0929e3a64836993d9ee880b12800 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:15.552918 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:15.559144 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:15.569614 13757 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:15.571012 15387 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:15.579668 13861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "536b1fc131984687bf3b13417507e21d"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:06:15.580397 13861 raft_consensus.cc:606] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:06:15.587327 13857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82e0eeb1582143a09acf311171812faa"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:06:15.588822 13857 raft_consensus.cc:606] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Received request to transfer leadership to TS ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:15.565030 13610 catalog_manager.cc:5697] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:15.590018 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:15.592232 15069 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:15.598187 13787 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:06:15.598750 13787 raft_consensus.cc:606] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:15.604949 13857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d07097a615d345468e43de064c67057d"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:06:15.605571 13857 raft_consensus.cc:606] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:06:15.609512 13789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:06:15.610067 13789 raft_consensus.cc:606] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:15.611588 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:15.612123 15391 ts_tablet_manager.cc:1929] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:06:15.612664 15391 log.cc:1199] T ab01257d4e56488eba41a0ce5c5e9954 P b5029654a4384e43a68eb67b794949b7: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-2-root/wals/ab01257d4e56488eba41a0ce5c5e9954
I20260709 13:06:15.613438 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:15.643921 13611 catalog_manager.cc:5697] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 3 to 4, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 4 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:15.665364 13612 catalog_manager.cc:5697] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:15.667363 13612 catalog_manager.cc:5697] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:15.670469 13612 catalog_manager.cc:5697] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 3 to 5, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 5 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:15.614415 15391 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:59764 (request call id 75) took 1456 ms. Trace:
I20260709 13:06:15.710005 15391 rpcz_store.cc:276] 0709 13:06:14.179151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.202689 (+ 23538us) service_pool.cc:224] Handling call
0709 13:06:14.350805 (+148116us) ts_tablet_manager.cc:1151] Deleting tablet ab01257d4e56488eba41a0ce5c5e9954
0709 13:06:14.365256 (+ 14451us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:06:15.566760 (+1201504us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:15.606370 (+ 39610us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:15.614334 (+  7964us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":825866,"tablet-delete.queue_time_us":93857,"thread_start_us":64062,"threads_started":1}
I20260709 13:06:15.722338 15391 tablet_replica.cc:333] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:06:15.759354 15391 raft_consensus.cc:2243] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:15.760164 15391 raft_consensus.cc:2272] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:15.712656 13601 catalog_manager.cc:5028] TS b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): tablet ab01257d4e56488eba41a0ce5c5e9954 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
W20260709 13:06:15.770743 13601 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 58295.1us
I20260709 13:06:15.784582 13787 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:06:15.785040 13787 pending_rounds.cc:85] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 5
I20260709 13:06:15.785298 13787 pending_rounds.cc:107] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:06:15.785594 13787 raft_consensus.cc:2889] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:15.787036 15405 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:15.788568 13777 tablet_service.cc:1558] Processing DeleteTablet for tablet de09d01498e547e591ce4ebe62e59488 with delete_type TABLET_DATA_TOMBSTONED (TS 35ecb005831740438d7537dd4b840e03 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48902
I20260709 13:06:15.796590 15448 tablet_replica.cc:333] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:06:15.798568 15448 raft_consensus.cc:2243] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:15.816627 15386 raft_consensus.cc:993] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03: : Instructing follower b9d194f45e044e0988d5de1a99e5cd02 to start an election
I20260709 13:06:15.845742 15448 raft_consensus.cc:2272] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:15.845826 15069 raft_consensus.cc:1081] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Signalling peer b9d194f45e044e0988d5de1a99e5cd02 to start an election
I20260709 13:06:15.846371 14970 raft_consensus.cc:993] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7: : Instructing follower 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:15.847090 13857 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:15.850442 13713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:49488
I20260709 13:06:15.851099 13713 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:15.840401 13789 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:15.850505 15336 raft_consensus.cc:1081] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Signalling peer 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:15.851619 13713 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.848578 14401 raft_consensus.cc:3055] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:15.862881 14401 raft_consensus.cc:740] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:15.871006 13789 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "536b1fc131984687bf3b13417507e21d"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:48914
I20260709 13:06:15.874982 13789 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:15.875387 13789 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.876253 14401 consensus_queue.cc:260] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:15.887143 14401 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:15.852187 15372 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:06:15.893967 13611 catalog_manager.cc:5697] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index 3 to 5, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New cstate: current_term: 2 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:15.899299 15051 raft_consensus.cc:993] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7: : Instructing follower 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:15.899734 15448 ts_tablet_manager.cc:1916] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:15.899895 15051 raft_consensus.cc:1081] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Signalling peer 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:15.901808 13791 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d07097a615d345468e43de064c67057d"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:48914
I20260709 13:06:15.902328 13791 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:15.902647 13791 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.904182 15217 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:06:15.917941 13713 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:15.915529 13791 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:15.946542 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:15.947198 13785 raft_consensus.cc:3055] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:15.947537 13785 raft_consensus.cc:740] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:15.948675 14401 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:15.949401 13789 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:15.950568 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:15.950285 13785 consensus_queue.cc:260] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:15.951135 13857 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.951761 13785 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.949532 13713 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:15.955302 13789 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:15.956444 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:15.957095 13856 raft_consensus.cc:3055] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:15.957420 13856 raft_consensus.cc:740] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:15.958719 15217 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:15.959342 15217 consensus_queue.cc:1243] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer ceb06175847b428ea8bd77055fcddf58 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:06:15.961290 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:15.961794 13863 raft_consensus.cc:3055] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:15.962085 13863 raft_consensus.cc:740] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:15.962808 13856 consensus_queue.cc:260] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:15.963902 13856 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.968466 13791 leader_election.cc:290] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:15.968750 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:15.969310 13710 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.972250 15448 ts_tablet_manager.cc:1929] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:15.974574 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:15.974988 15448 log.cc:1199] T de09d01498e547e591ce4ebe62e59488 P 35ecb005831740438d7537dd4b840e03: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-1-root/wals/de09d01498e547e591ce4ebe62e59488
I20260709 13:06:15.975297 13708 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.962808 13863 consensus_queue.cc:260] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:15.985275 13863 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.956461 15391 ts_tablet_manager.cc:1916] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:15.971700 13857 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:15.996534 13682 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:15.979470 13599 catalog_manager.cc:5028] TS 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): tablet de09d01498e547e591ce4ebe62e59488 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:06:15.997812 15082 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:15.998440 15082 raft_consensus.cc:697] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:15.999630 15082 consensus_queue.cc:237] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:16.001248 13785 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:16.023892 15298 raft_consensus.cc:993] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7: : Instructing follower ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:06:16.084048 15298 raft_consensus.cc:1081] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Signalling peer ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:06:16.044453 13708 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:16.085846 14399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82e0eeb1582143a09acf311171812faa"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:56558
I20260709 13:06:16.086229 13756 leader_election.cc:304] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:16.087839 15069 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:16.088419 15069 raft_consensus.cc:697] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:16.086385 14399 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:16.089684 14399 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:16.089452 15069 consensus_queue.cc:237] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:16.096876 14399 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:16.112375 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:16.113052 13708 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:16.121263 13708 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:16.129802 14367 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:16.130776 15393 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:16.131307 15393 raft_consensus.cc:697] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:16.132256 15393 consensus_queue.cc:237] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:16.128858 14399 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:16.070091 13710 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:16.141409 13756 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:16.070958 14401 pending_rounds.cc:85] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 5
I20260709 13:06:16.013203 13703 tablet_service.cc:1558] Processing DeleteTablet for tablet c7cc0929e3a64836993d9ee880b12800 with delete_type TABLET_DATA_TOMBSTONED (TS b9d194f45e044e0988d5de1a99e5cd02 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:49478
I20260709 13:06:16.142915 14401 pending_rounds.cc:107] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:06:16.054890 15391 ts_tablet_manager.cc:1929] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:16.062217 15276 raft_consensus.cc:993] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03: : Instructing follower b9d194f45e044e0988d5de1a99e5cd02 to start an election
I20260709 13:06:16.011353 13612 catalog_manager.cc:5697] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 5 to 6, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 6 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:16.143829 15391 log.cc:1199] T 44fb07fff88a4dcf97841a29f2641f66 P b5029654a4384e43a68eb67b794949b7: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-2-root/wals/44fb07fff88a4dcf97841a29f2641f66
I20260709 13:06:16.144094 15276 raft_consensus.cc:1081] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Signalling peer b9d194f45e044e0988d5de1a99e5cd02 to start an election
I20260709 13:06:16.146260 15457 tablet_replica.cc:333] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:06:16.124944 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:16.142505 15398 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:16.146409 13708 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:49488
I20260709 13:06:16.146615 13601 catalog_manager.cc:5028] TS b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): tablet 44fb07fff88a4dcf97841a29f2641f66 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:06:16.147557 15398 raft_consensus.cc:697] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:16.147892 13708 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:16.148214 13856 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:16.148310 13708 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:16.148527 15398 consensus_queue.cc:237] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:16.143323 14401 raft_consensus.cc:2889] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:16.152915 13857 raft_consensus.cc:3055] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:16.153847 13857 raft_consensus.cc:740] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:16.155684 13857 consensus_queue.cc:260] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:16.159329 13857 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:16.162010 13708 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:16.172024 13708 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:16.172099 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:16.172708 13856 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:16.172379 13863 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:16.180087 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:16.180619 13789 raft_consensus.cc:3055] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:16.180883 13789 raft_consensus.cc:740] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:16.181556 13789 consensus_queue.cc:260] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:16.182492 15457 raft_consensus.cc:2243] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:16.182713 13789 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:16.183539 15457 raft_consensus.cc:2272] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:16.186825 13857 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:16.190120 15457 ts_tablet_manager.cc:1916] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:16.205544 13856 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:16.206693 13682 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:16.209410 15217 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:16.209913 15217 raft_consensus.cc:697] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:16.210785 15217 consensus_queue.cc:237] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:16.219173 13611 catalog_manager.cc:5697] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 1 to 2, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 2 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:16.223047 13789 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:16.253228 13612 catalog_manager.cc:5697] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 1 to 2, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:16.279225 13611 catalog_manager.cc:5697] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 1 to 2, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 2 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:16.282207 13611 catalog_manager.cc:5697] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 2 to 3, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 3 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:16.293207 13610 catalog_manager.cc:5697] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 4 to 5, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 5 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:16.317966 15457 ts_tablet_manager.cc:1929] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:06:16.322157 15457 log.cc:1199] T c7cc0929e3a64836993d9ee880b12800 P b9d194f45e044e0988d5de1a99e5cd02: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-0-root/wals/c7cc0929e3a64836993d9ee880b12800
I20260709 13:06:16.325330 13600 catalog_manager.cc:5028] TS b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): tablet c7cc0929e3a64836993d9ee880b12800 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:06:16.478736 13708 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:16.481146 15387 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:16.496160 13857 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:16.498027 15386 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:16.565762 13789 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:16.567150 15013 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:16.596942 13857 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:16.598541 15013 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:16.614723 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:16.629685 13863 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:16.634660 15386 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:16.688544 13710 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:16.691150 13708 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:16.690995 15393 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:16.697028 15069 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:16.704784 13861 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:16.716519 15082 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:16.726065 13789 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:16.741288 13863 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:16.744907 15393 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:16.761987 15339 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:16.892518 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:16.943755 13789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:06:16.944413 13789 raft_consensus.cc:606] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:06:16.947180 13789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:06:16.947793 13789 raft_consensus.cc:606] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Received request to transfer leadership to TS ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:16.952682 13708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:06:16.953276 13708 raft_consensus.cc:606] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:06:16.960044 13863 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:06:16.960647 13863 raft_consensus.cc:606] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Received request to transfer leadership to TS ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:16.968715 13708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:06:16.969365 13708 raft_consensus.cc:606] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:06:16.971045 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:16.977561 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:17.001688 15398 raft_consensus.cc:993] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03: : Instructing follower ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:06:17.002346 15398 raft_consensus.cc:1081] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Signalling peer ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:06:17.004480 14401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:56582
I20260709 13:06:17.005051 14401 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:17.005389 14401 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.014644 14401 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:17.018952 14401 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:17.019213 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:17.020009 13787 raft_consensus.cc:3055] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:17.020323 13787 raft_consensus.cc:740] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:17.021119 13787 consensus_queue.cc:260] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:17.022419 13787 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.028854 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:17.043540 13708 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.050261 13708 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:06:17.050392 13787 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:06:17.051649 14367 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:17.052670 15405 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:17.053175 15405 raft_consensus.cc:697] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:17.054148 15405 consensus_queue.cc:237] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:17.100754 15082 raft_consensus.cc:993] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: : Instructing follower b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:17.101370 15013 raft_consensus.cc:1081] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Signalling peer b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:17.104816 15298 raft_consensus.cc:993] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7: : Instructing follower ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:06:17.106307 14970 raft_consensus.cc:1081] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Signalling peer ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:06:17.108192 13857 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:59792
I20260709 13:06:17.108325 14401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:56558
I20260709 13:06:17.109061 13857 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:17.109172 14401 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:17.109611 13857 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.109645 14401 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.117023 14401 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:17.125053 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:17.125720 13710 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.136783 13612 catalog_manager.cc:5697] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 4 to 5, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 5 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:17.141801 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:17.142458 13863 raft_consensus.cc:3055] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:17.142740 13863 raft_consensus.cc:740] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:17.143487 13863 consensus_queue.cc:260] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:17.144462 13863 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.155555 14401 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:17.122884 13857 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:17.157088 13863 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:17.158452 14368 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:17.159312 15405 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:17.160838 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:17.161444 13708 raft_consensus.cc:3055] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:17.161739 13708 raft_consensus.cc:740] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:17.162452 13708 consensus_queue.cc:260] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:17.164637 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:17.165246 13708 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.165231 14401 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.166864 13710 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:17.170254 13857 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:17.202673 15013 raft_consensus.cc:993] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02: : Instructing follower 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:17.203150 15013 raft_consensus.cc:1081] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Signalling peer 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:17.205439 13787 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:48928
I20260709 13:06:17.205966 13787 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:17.206331 13787 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.234298 13708 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:06:17.235708 15405 raft_consensus.cc:697] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:17.236604 13830 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:17.238469 15336 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:17.238948 15336 raft_consensus.cc:697] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:17.239805 15336 consensus_queue.cc:237] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:17.248885 15405 consensus_queue.cc:237] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:17.250437 13787 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:17.254993 14401 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:06:17.272333 13787 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:17.272743 15386 raft_consensus.cc:993] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03: : Instructing follower b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:17.273236 15386 raft_consensus.cc:1081] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Signalling peer b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:17.277029 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:17.277570 13857 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.278038 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:17.278556 13712 raft_consensus.cc:3055] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:17.278844 13712 raft_consensus.cc:740] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:17.279546 13712 consensus_queue.cc:260] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:17.282363 13712 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.281222 13861 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:59780
I20260709 13:06:17.284644 13861 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:17.285027 13861 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:17.320730 13662 auto_rebalancer.cc:629] Failed to schedule move for tablet 0b0054f48c4947acaea83521993a8f01: Remote error: Service unavailable: leader transfer in progress
I20260709 13:06:17.329418 13857 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:17.331251 13757 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:17.333294 15398 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:17.333895 15398 raft_consensus.cc:697] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:17.336138 15398 consensus_queue.cc:237] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:17.344245 13708 consensus_queue.cc:237] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:17.333434 13611 catalog_manager.cc:5697] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 2 to 3, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 3 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:17.368229 13861 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:17.384408 13610 catalog_manager.cc:5697] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 3 to 4, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 4 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:17.427834 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:17.428639 13713 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.439872 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:17.440610 13789 raft_consensus.cc:3055] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:17.440939 13789 raft_consensus.cc:740] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:17.441741 13789 consensus_queue.cc:260] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:17.442847 13789 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.452296 13861 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:17.455868 13712 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:17.457247 13713 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:06:17.468364 13785 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:17.470574 15082 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:17.461014 13787 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:17.462206 13789 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:06:17.472960 15474 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:17.474115 13861 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:17.474786 13680 consensus_peers.cc:597] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ebc19cb1c68943cba711cd721c8caa91. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:17.475733 13830 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:17.485042 15082 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:17.491070 15298 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:17.491801 15298 raft_consensus.cc:697] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 5 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:17.491304 13610 catalog_manager.cc:5697] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 3 to 4, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 4 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:17.504117 15082 raft_consensus.cc:2955] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:17.508273 13789 raft_consensus.cc:2955] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:17.492805 15298 consensus_queue.cc:237] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:17.525223 13713 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:17.527489 15393 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:17.564333 13610 catalog_manager.cc:5697] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:17.566752 13611 catalog_manager.cc:5697] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 4 to 5, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 5 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:17.604918 13863 raft_consensus.cc:2955] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:17.613737 13710 consensus_queue.cc:237] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:17.654867 13863 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:17.656394 15082 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:17.658761 13680 consensus_peers.cc:597] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4c6f358793c54a8fa2409a5d4c5505f8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:17.663151 13785 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:17.665238 15082 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:17.676592 14399 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:17.682173 15336 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:17.692963 13863 raft_consensus.cc:2955] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:17.690459 15013 raft_consensus.cc:2955] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:17.706357 13857 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:17.712615 13789 raft_consensus.cc:2955] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:17.714433 13611 catalog_manager.cc:5697] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:17.725324 13710 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:17.729991 15298 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:17.714346 15474 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:06:17.749478 13713 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:17.751065 15484 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:17.766783 13713 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:17.772701 13857 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:17.775264 15386 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:17.781695 15069 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:06:17.788492 13662 auto_rebalancer.cc:629] Failed to schedule move for tablet 6f7de615f578424d8bafe69fe6bea9f9: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:06:17.914940 15501 log.cc:927] Time spent T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 13:06:17.951052 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 61693.4us
I20260709 13:06:17.973452 13713 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:17.976854 15336 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.978472 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:18.027272 13789 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:18.030666 15490 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:18.079380 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:18.091766 15507 ts_tablet_manager.cc:933] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533)
I20260709 13:06:18.164548 13857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:06:18.165146 13857 raft_consensus.cc:606] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:18.169776 13861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:06:18.170316 13861 raft_consensus.cc:606] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:06:18.179322 15490 raft_consensus.cc:993] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7: : Instructing follower 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:18.179783 15490 raft_consensus.cc:1081] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Signalling peer 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:18.182337 15490 raft_consensus.cc:993] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7: : Instructing follower b9d194f45e044e0988d5de1a99e5cd02 to start an election
I20260709 13:06:18.182776 15336 raft_consensus.cc:1081] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Signalling peer b9d194f45e044e0988d5de1a99e5cd02 to start an election
I20260709 13:06:18.183210 13785 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:48914
I20260709 13:06:18.183792 13785 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:18.184103 13785 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:18.185218 13713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:49490
I20260709 13:06:18.185578 13787 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:06:18.185750 13713 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:18.186085 13713 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:18.186105 13787 raft_consensus.cc:606] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:18.190156 13785 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:18.203816 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:18.204615 13716 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:18.212857 13713 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:18.214263 13716 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:18.215706 13785 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:18.215793 13710 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:06:18.216440 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:18.216590 13710 raft_consensus.cc:606] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:06:18.216964 13861 raft_consensus.cc:3055] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:18.217289 13861 raft_consensus.cc:740] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:18.218235 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:06:18.219907 13713 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:18.220640 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:18.221192 13857 raft_consensus.cc:3055] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:18.221468 13756 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:18.221388 13861 consensus_queue.cc:260] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:18.219914 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:18.221483 13857 raft_consensus.cc:740] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:18.222667 13861 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:18.223013 13857 consensus_queue.cc:260] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:18.224072 13857 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:18.227367 15503 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:18.227869 15503 raft_consensus.cc:697] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:18.228669 15503 consensus_queue.cc:237] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:18.232029 13857 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:18.233109 13682 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:18.233143 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:18.233815 14394 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:18.233946 15013 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:18.234484 15013 raft_consensus.cc:697] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 2 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:18.251482 13861 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:18.235251 15013 consensus_queue.cc:237] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:18.200721 15507 tablet_copy_client.cc:323] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.129:37533
I20260709 13:06:18.283674 13726 tablet_copy_service.cc:140] P b9d194f45e044e0988d5de1a99e5cd02: Received BeginTabletCopySession request for tablet 4c6f358793c54a8fa2409a5d4c5505f8 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:58552)
I20260709 13:06:18.284241 13726 tablet_copy_service.cc:161] P b9d194f45e044e0988d5de1a99e5cd02: Beginning new tablet copy session on tablet 4c6f358793c54a8fa2409a5d4c5505f8 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:58552: session id = ceb06175847b428ea8bd77055fcddf58-4c6f358793c54a8fa2409a5d4c5505f8
W20260709 13:06:18.290304 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 53283.3us
W20260709 13:06:18.302403 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 49177.5us
I20260709 13:06:18.319557 15506 ts_tablet_manager.cc:933] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533)
I20260709 13:06:18.323076 14394 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:18.332721 13610 catalog_manager.cc:5697] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 1 to 2, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:18.338851 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 65989.9us
I20260709 13:06:18.339370 13726 tablet_copy_source_session.cc:215] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:18.344714 15507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c6f358793c54a8fa2409a5d4c5505f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.351948 15506 tablet_copy_client.cc:323] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.129:37533
I20260709 13:06:18.355269 13726 tablet_copy_service.cc:140] P b9d194f45e044e0988d5de1a99e5cd02: Received BeginTabletCopySession request for tablet ebc19cb1c68943cba711cd721c8caa91 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:58552)
I20260709 13:06:18.355861 13726 tablet_copy_service.cc:161] P b9d194f45e044e0988d5de1a99e5cd02: Beginning new tablet copy session on tablet ebc19cb1c68943cba711cd721c8caa91 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:58552: session id = ceb06175847b428ea8bd77055fcddf58-ebc19cb1c68943cba711cd721c8caa91
I20260709 13:06:18.366148 13726 tablet_copy_source_session.cc:215] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:18.373562 15506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebc19cb1c68943cba711cd721c8caa91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:18.399380 15339 raft_consensus.cc:993] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: : Instructing follower 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:18.399950 15511 raft_consensus.cc:1081] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Signalling peer 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:18.402992 13787 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:48928
I20260709 13:06:18.403506 13787 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:18.403882 13787 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:18.411633 13787 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:18.414130 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:18.414716 14394 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:18.418926 15398 raft_consensus.cc:993] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03: : Instructing follower b9d194f45e044e0988d5de1a99e5cd02 to start an election
I20260709 13:06:18.418978 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:18.419672 15398 raft_consensus.cc:1081] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Signalling peer b9d194f45e044e0988d5de1a99e5cd02 to start an election
I20260709 13:06:18.419772 13710 raft_consensus.cc:3055] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:18.420185 13710 raft_consensus.cc:740] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:18.420948 13710 consensus_queue.cc:260] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:18.421777 13716 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:49488
I20260709 13:06:18.422310 13716 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:18.422679 13716 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:18.422071 13710 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:18.429498 13716 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:18.431329 13612 catalog_manager.cc:5697] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 3 to 4, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 4 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:18.432231 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:18.432768 13861 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:18.434969 14394 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:18.439102 13755 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:18.440130 15503 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:18.440600 15503 raft_consensus.cc:697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:18.441496 15503 consensus_queue.cc:237] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:18.446643 13861 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:18.447716 13682 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:18.449462 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:18.450021 13789 raft_consensus.cc:3055] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:18.450322 13789 raft_consensus.cc:740] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:18.443230 13710 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:18.451016 13789 consensus_queue.cc:260] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:18.451505 15515 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:18.456063 13787 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:18.454536 15506 tablet_copy_client.cc:806] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:18.456956 15515 raft_consensus.cc:697] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:18.457648 15506 tablet_copy_client.cc:670] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:18.452553 13789 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:18.461118 15515 consensus_queue.cc:237] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:18.464504 15506 tablet_copy_client.cc:538] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:18.465550 15507 tablet_copy_client.cc:806] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:18.466176 15507 tablet_copy_client.cc:670] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:18.453908 13716 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:18.478454 13789 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:18.479118 15507 tablet_copy_client.cc:538] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:18.483906 15506 tablet_bootstrap.cc:492] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:06:18.487830 13612 catalog_manager.cc:5697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 4 to 5, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 5 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:18.503135 15507 tablet_bootstrap.cc:492] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:06:18.520411 13612 catalog_manager.cc:5697] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 2 to 3, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 3 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:18.646718 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 43665.3us
I20260709 13:06:18.662904 13861 raft_consensus.cc:1275] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:18.665525 15398 consensus_queue.cc:1048] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:18.706746 14394 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:18.712387 15217 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:18.726266 13716 raft_consensus.cc:1275] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:18.727998 15503 consensus_queue.cc:1048] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:18.729717 15506 tablet_bootstrap.cc:492] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:18.740192 15506 tablet_bootstrap.cc:492] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:06:18.743312 15506 ts_tablet_manager.cc:1403] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.260s	user 0.018s	sys 0.006s
I20260709 13:06:18.747337 15506 raft_consensus.cc:359] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:18.756888 15506 raft_consensus.cc:740] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:06:18.758157 15506 consensus_queue.cc:260] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:18.768610 15506 ts_tablet_manager.cc:1434] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.004s
I20260709 13:06:18.769989 15507 tablet_bootstrap.cc:492] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:18.771905 13726 tablet_copy_service.cc:342] P b9d194f45e044e0988d5de1a99e5cd02: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-ebc19cb1c68943cba711cd721c8caa91 received from {username='slave'} at 127.0.0.1:58552
I20260709 13:06:18.772434 13726 tablet_copy_service.cc:434] P b9d194f45e044e0988d5de1a99e5cd02: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-ebc19cb1c68943cba711cd721c8caa91 on tablet ebc19cb1c68943cba711cd721c8caa91 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:18.772884 15507 tablet_bootstrap.cc:492] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:06:18.774435 15507 ts_tablet_manager.cc:1403] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.272s	user 0.016s	sys 0.016s
I20260709 13:06:18.783735 15507 raft_consensus.cc:359] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:18.784782 15507 raft_consensus.cc:740] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:06:18.785558 15507 consensus_queue.cc:260] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:18.797928 15507 ts_tablet_manager.cc:1434] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:06:18.801080 13726 tablet_copy_service.cc:342] P b9d194f45e044e0988d5de1a99e5cd02: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-4c6f358793c54a8fa2409a5d4c5505f8 received from {username='slave'} at 127.0.0.1:58552
I20260709 13:06:18.801589 13726 tablet_copy_service.cc:434] P b9d194f45e044e0988d5de1a99e5cd02: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-4c6f358793c54a8fa2409a5d4c5505f8 on tablet 4c6f358793c54a8fa2409a5d4c5505f8 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:18.801566 13857 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:18.836071 15515 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:18.973176 13716 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:18.975760 15398 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:18.984786 13857 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:18.986328 15339 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:19.040438 14401 raft_consensus.cc:1217] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:19.045012 14394 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:19.046667 15398 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:19.074880 13789 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:19.078826 15511 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:19.222961 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:19.291041 14394 raft_consensus.cc:1217] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:19.451923 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:19.796130 15339 raft_consensus.cc:1064] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:06:19.800509 15339 consensus_queue.cc:237] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:19.807771 15217 raft_consensus.cc:1064] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:06:19.814604 15217 consensus_queue.cc:237] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:19.862602 13785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8591822f3dc3430e935360afdb260fce"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:06:19.863374 13785 raft_consensus.cc:606] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:06:19.901413 13710 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:06:19.902017 13710 raft_consensus.cc:606] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:06:19.903625 13863 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:19.906924 13863 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:19.908088 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:06:19.909759 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:19.918761 14401 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:19.924764 15548 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:19.925251 14401 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:19.927448 13787 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:19.927450 15548 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:19.931277 13787 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:19.947575 15549 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:19.950016 15549 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:19.954459 15217 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:19.957538 15217 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:19.995929 15545 raft_consensus.cc:993] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02: : Instructing follower 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:19.996659 15546 raft_consensus.cc:1081] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Signalling peer 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:20.000891 13787 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:48928
I20260709 13:06:20.001588 13787 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:20.001976 13787 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:20.010583 15545 raft_consensus.cc:2955] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:20.015952 15550 raft_consensus.cc:2955] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:20.034140 13787 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:20.041810 13785 raft_consensus.cc:2955] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:20.073822 13787 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:20.074599 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:20.075213 13710 raft_consensus.cc:3055] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:20.075524 13710 raft_consensus.cc:740] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:20.076217 13710 consensus_queue.cc:260] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:20.077229 13710 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:20.078051 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:20.078595 14399 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:20.047221 13789 raft_consensus.cc:2955] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:20.050935 14401 raft_consensus.cc:2955] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:20.049485 14394 raft_consensus.cc:2955] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:20.059180 13857 raft_consensus.cc:2955] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:20.088680 13710 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:20.089893 13756 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:20.090689 15514 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:20.091140 15514 raft_consensus.cc:697] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:20.092386 15514 consensus_queue.cc:237] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:20.101720 13612 catalog_manager.cc:5697] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:20.110787 14399 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:20.118772 13863 raft_consensus.cc:2955] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:20.188908 13710 consensus_queue.cc:237] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:20.201525 15514 raft_consensus.cc:993] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03: : Instructing follower b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:20.202039 15514 raft_consensus.cc:1081] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Signalling peer b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:20.201845 13611 catalog_manager.cc:5697] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:20.218739 13863 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8591822f3dc3430e935360afdb260fce"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:59780
I20260709 13:06:20.219427 13863 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:20.219825 13863 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:20.236781 13863 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:20.238402 14399 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:20.238498 13857 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:20.240166 15549 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:20.244325 15549 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:20.251281 15547 raft_consensus.cc:2955] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:20.262818 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:20.263571 13710 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:20.263725 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:20.264464 13863 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:20.264376 13861 raft_consensus.cc:2955] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:20.264387 13789 raft_consensus.cc:3055] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:20.267374 13789 raft_consensus.cc:740] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:20.268205 13789 consensus_queue.cc:260] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:20.269335 13789 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:20.277305 13614 catalog_manager.cc:5697] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 1 to 2, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 2 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:20.278368 13710 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:20.279680 13830 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:20.280682 15541 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:20.281168 15541 raft_consensus.cc:697] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:20.282013 15541 consensus_queue.cc:237] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:20.282145 14399 raft_consensus.cc:2955] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:20.325492 13789 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
W20260709 13:06:20.354717 15552 log.cc:927] Time spent T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.074s	user 0.004s	sys 0.004s
I20260709 13:06:20.361359 13611 catalog_manager.cc:5697] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:06:20.369781 15559 log.cc:927] Time spent T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7: Append to log took a long time: real 0.054s	user 0.003s	sys 0.004s
I20260709 13:06:20.371182 13600 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ebc19cb1c68943cba711cd721c8caa91 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:20.392088 13777 tablet_service.cc:1558] Processing DeleteTablet for tablet ebc19cb1c68943cba711cd721c8caa91 with delete_type TABLET_DATA_TOMBSTONED (TS 35ecb005831740438d7537dd4b840e03 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48902
I20260709 13:06:20.405716 13713 consensus_queue.cc:237] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:20.412515 13857 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:20.413861 15549 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:20.425917 15545 raft_consensus.cc:2955] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:20.414925 15564 tablet_replica.cc:333] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:06:20.428481 15564 raft_consensus.cc:2243] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.415032 14399 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:20.429281 15564 raft_consensus.cc:2272] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.430856 13861 raft_consensus.cc:2955] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:20.433020 15564 ts_tablet_manager.cc:1916] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:20.433866 13612 catalog_manager.cc:5697] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 2 to 3, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 3 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:20.435580 15547 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:20.441536 14399 raft_consensus.cc:2955] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:20.464820 15564 ts_tablet_manager.cc:1929] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:20.465684 13600 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4c6f358793c54a8fa2409a5d4c5505f8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:20.467743 15564 log.cc:1199] T ebc19cb1c68943cba711cd721c8caa91 P 35ecb005831740438d7537dd4b840e03: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-1-root/wals/ebc19cb1c68943cba711cd721c8caa91
I20260709 13:06:20.471151 13599 catalog_manager.cc:5028] TS 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): tablet ebc19cb1c68943cba711cd721c8caa91 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:06:20.477669 13611 catalog_manager.cc:5697] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index 3 to 4, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New cstate: current_term: 1 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:20.480203 13710 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:20.483728 15514 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:20.501924 14399 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:20.503456 13777 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c6f358793c54a8fa2409a5d4c5505f8 with delete_type TABLET_DATA_TOMBSTONED (TS 35ecb005831740438d7537dd4b840e03 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48902
I20260709 13:06:20.504653 15564 tablet_replica.cc:333] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:06:20.505815 15564 raft_consensus.cc:2243] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.506470 15564 raft_consensus.cc:2272] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.506691 15513 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:20.511344 15564 ts_tablet_manager.cc:1916] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:20.541433 15564 ts_tablet_manager.cc:1929] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:20.545919 15564 log.cc:1199] T 4c6f358793c54a8fa2409a5d4c5505f8 P 35ecb005831740438d7537dd4b840e03: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-1-root/wals/4c6f358793c54a8fa2409a5d4c5505f8
I20260709 13:06:20.558370 13599 catalog_manager.cc:5028] TS 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): tablet 4c6f358793c54a8fa2409a5d4c5505f8 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:06:20.827214 13787 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:20.828406 13710 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:20.829304 15541 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:20.831094 15502 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:20.910703 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:21.134866 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:21.195840 13858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:06:21.196493 13858 raft_consensus.cc:606] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:06:21.205636 13713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:06:21.206307 13713 raft_consensus.cc:606] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Received request to transfer leadership to TS ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:21.223635 13787 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:06:21.227340 13787 raft_consensus.cc:606] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:06:21.230674 13787 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:06:21.234555 13787 raft_consensus.cc:606] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:21.235977 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:06:21.237749 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:21.364552 15562 raft_consensus.cc:993] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7: : Instructing follower 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:21.365165 15562 raft_consensus.cc:1081] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Signalling peer 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:21.366945 13787 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:48914
I20260709 13:06:21.370474 13787 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:21.371125 13787 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:21.391489 13787 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:21.394727 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:21.395401 13710 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:21.401043 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:21.401757 13858 raft_consensus.cc:3055] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:21.402086 13858 raft_consensus.cc:740] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:21.402977 13858 consensus_queue.cc:260] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:21.408531 13858 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:21.415129 15573 raft_consensus.cc:993] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02: : Instructing follower ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:06:21.415725 15573 raft_consensus.cc:1081] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Signalling peer ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:06:21.419623 14399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:56570
I20260709 13:06:21.420210 14399 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:21.420567 14399 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:21.451088 13858 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:21.454382 13757 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:21.455295 15398 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:21.455907 15398 raft_consensus.cc:697] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:21.458840 15398 consensus_queue.cc:237] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:21.480023 14399 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:21.480942 13787 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:21.487600 13611 catalog_manager.cc:5697] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 2 to 3, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 3 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:21.477340 13710 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:21.558974 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:21.562083 13713 raft_consensus.cc:3055] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:21.562393 13713 raft_consensus.cc:740] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:21.563166 13713 consensus_queue.cc:260] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:21.566378 13713 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:21.546527 15398 raft_consensus.cc:993] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03: : Instructing follower b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:21.571971 15398 raft_consensus.cc:1081] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Signalling peer b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:21.573773 13858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:59780
I20260709 13:06:21.574389 13858 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:21.574762 13858 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:21.583952 13713 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:21.585338 14367 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:21.593549 15540 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:21.604609 15540 raft_consensus.cc:697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:21.614128 14399 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:21.615267 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:21.628160 13785 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:21.635345 13785 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:21.622171 15540 consensus_queue.cc:237] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:21.583242 13858 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:21.642570 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:21.643249 13710 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:21.647709 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:21.648936 13785 raft_consensus.cc:3055] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:21.649289 13785 raft_consensus.cc:740] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:21.649670 13858 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:21.652480 13785 consensus_queue.cc:260] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:21.655002 13785 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:21.657660 13710 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:06:21.662988 13830 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:21.665884 15541 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:21.667136 15541 raft_consensus.cc:697] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 5 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:21.668097 15541 consensus_queue.cc:237] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:21.674749 13785 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:06:21.693871 15513 raft_consensus.cc:993] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03: : Instructing follower b9d194f45e044e0988d5de1a99e5cd02 to start an election
I20260709 13:06:21.694415 15513 raft_consensus.cc:1081] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Signalling peer b9d194f45e044e0988d5de1a99e5cd02 to start an election
I20260709 13:06:21.696247 13713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:49488
I20260709 13:06:21.697014 13713 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:21.697356 13713 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:21.749986 13713 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:21.756542 13713 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:21.759609 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:21.760280 13786 raft_consensus.cc:3055] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:21.760654 13786 raft_consensus.cc:740] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:21.761950 13786 consensus_queue.cc:260] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:21.763147 13786 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:21.765575 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:21.766191 13858 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:21.775750 13858 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:21.776856 13682 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:21.777109 13612 catalog_manager.cc:5697] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 4 to 5, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 5 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:21.777941 15547 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:21.778482 15547 raft_consensus.cc:697] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:21.779309 15547 consensus_queue.cc:237] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:21.781832 13610 catalog_manager.cc:5697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 1 to 2, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 2 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:21.795324 13786 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:21.821745 13614 catalog_manager.cc:5697] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 4 to 5, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 5 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:22.013839 13858 raft_consensus.cc:1275] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:22.017331 15503 consensus_queue.cc:1048] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:22.059351 13713 raft_consensus.cc:1275] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:22.064601 13786 raft_consensus.cc:1275] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:22.064481 15513 consensus_queue.cc:1048] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:22.069032 15585 consensus_queue.cc:1048] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:22.073140 13786 consensus_queue.cc:237] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:22.094825 13857 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:22.096163 15513 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:06:22.097056 13755 consensus_peers.cc:597] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5171bcd42ea14ad3af7399ab8c6a7e35. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:22.099916 13710 raft_consensus.cc:1275] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:22.107976 13786 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:22.110522 13713 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:22.113556 15585 consensus_queue.cc:1048] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:22.118546 15576 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:22.136734 15514 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:22.217085 15513 raft_consensus.cc:2955] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:22.233700 13863 raft_consensus.cc:2955] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:22.238734 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:22.271766 13708 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:22.274693 13708 raft_consensus.cc:2955] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:22.296586 13857 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:22.298655 15545 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:22.304055 15576 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:22.309365 13861 consensus_queue.cc:237] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:22.311069 13610 catalog_manager.cc:5697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index -1 to 3, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 3 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:22.391597 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 77571.8us
I20260709 13:06:22.397714 13790 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:22.403496 15547 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:22.403998 13713 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:06:22.405993 13829 consensus_peers.cc:597] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d32f086650d45b7b7ae3e0d858e360b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:22.411017 15562 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:22.415376 13790 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:22.417111 15585 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:22.431216 15562 raft_consensus.cc:2955] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:22.434674 13790 raft_consensus.cc:2955] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:22.450058 13713 raft_consensus.cc:2955] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:22.453540 13791 consensus_queue.cc:237] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:22.507028 13614 catalog_manager.cc:5697] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index -1 to 3, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 3 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
W20260709 13:06:22.555706 13755 consensus_peers.cc:597] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b022fc3eb21246ff9f62e8a747bac6c4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:22.558108 13861 raft_consensus.cc:1275] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:22.559621 15513 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:22.563807 13713 raft_consensus.cc:1275] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:22.565754 15398 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:22.589426 15513 raft_consensus.cc:2955] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:22.597402 13861 raft_consensus.cc:2955] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:22.599972 13713 raft_consensus.cc:2955] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:22.605216 15613 ts_tablet_manager.cc:933] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:22.624310 13612 catalog_manager.cc:5697] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index -1 to 4, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 4 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:22.643042 15613 tablet_copy_client.cc:323] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.130:36047
I20260709 13:06:22.643816 13710 consensus_queue.cc:237] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:22.644884 13800 tablet_copy_service.cc:140] P 35ecb005831740438d7537dd4b840e03: Received BeginTabletCopySession request for tablet 5171bcd42ea14ad3af7399ab8c6a7e35 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:45134)
I20260709 13:06:22.645411 13800 tablet_copy_service.cc:161] P 35ecb005831740438d7537dd4b840e03: Beginning new tablet copy session on tablet 5171bcd42ea14ad3af7399ab8c6a7e35 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:45134: session id = ceb06175847b428ea8bd77055fcddf58-5171bcd42ea14ad3af7399ab8c6a7e35
I20260709 13:06:22.655505 13800 tablet_copy_source_session.cc:215] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:22.667368 13790 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:22.668386 13861 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:06:22.668896 13680 consensus_peers.cc:597] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4648ad5742bd4fe09563b72eb2dfc059. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:22.672511 15547 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:22.673503 15603 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:22.686551 15613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5171bcd42ea14ad3af7399ab8c6a7e35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.693131 15603 raft_consensus.cc:2955] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:22.701292 13861 raft_consensus.cc:2955] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:22.709154 13790 raft_consensus.cc:2955] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:22.711602 15613 tablet_copy_client.cc:806] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:22.712167 15613 tablet_copy_client.cc:670] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:22.723301 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:22.730199 13614 catalog_manager.cc:5697] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index -1 to 4, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 4 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:22.734019 15613 tablet_copy_client.cc:538] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:22.743065 15613 tablet_bootstrap.cc:492] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:06:22.824005 15613 tablet_bootstrap.cc:492] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:22.828845 15613 tablet_bootstrap.cc:492] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:06:22.829605 15613 ts_tablet_manager.cc:1403] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.087s	user 0.035s	sys 0.032s
I20260709 13:06:22.833017 15613 raft_consensus.cc:359] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:22.833815 15613 raft_consensus.cc:740] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:06:22.834450 15613 consensus_queue.cc:260] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:22.837282 15613 ts_tablet_manager.cc:1434] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:06:22.839471 13800 tablet_copy_service.cc:342] P 35ecb005831740438d7537dd4b840e03: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-5171bcd42ea14ad3af7399ab8c6a7e35 received from {username='slave'} at 127.0.0.1:45134
I20260709 13:06:22.839952 13800 tablet_copy_service.cc:434] P 35ecb005831740438d7537dd4b840e03: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-5171bcd42ea14ad3af7399ab8c6a7e35 on tablet 5171bcd42ea14ad3af7399ab8c6a7e35 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:22.872400 15613 ts_tablet_manager.cc:933] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:22.875480 13861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8591822f3dc3430e935360afdb260fce"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:06:22.875593 15613 tablet_copy_client.cc:323] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.131:46015
I20260709 13:06:22.876103 13861 raft_consensus.cc:606] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:06:22.878046 13875 tablet_copy_service.cc:140] P b5029654a4384e43a68eb67b794949b7: Received BeginTabletCopySession request for tablet 2d32f086650d45b7b7ae3e0d858e360b from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:42104)
I20260709 13:06:22.878569 13875 tablet_copy_service.cc:161] P b5029654a4384e43a68eb67b794949b7: Beginning new tablet copy session on tablet 2d32f086650d45b7b7ae3e0d858e360b from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:42104: session id = ceb06175847b428ea8bd77055fcddf58-2d32f086650d45b7b7ae3e0d858e360b
I20260709 13:06:22.885828 13786 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:06:22.886402 13786 raft_consensus.cc:606] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:22.889703 13713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:06:22.890254 13713 raft_consensus.cc:606] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:06:22.891873 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:06:22.892763 15585 raft_consensus.cc:993] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7: : Instructing follower 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:22.893246 15585 raft_consensus.cc:1081] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Signalling peer 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:22.893361 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:22.895083 13786 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8591822f3dc3430e935360afdb260fce"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:48914
I20260709 13:06:22.895581 13786 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:22.895903 13786 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:22.903136 13875 tablet_copy_source_session.cc:215] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:22.918169 13786 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:22.928433 15613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d32f086650d45b7b7ae3e0d858e360b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.929055 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:22.929625 13861 raft_consensus.cc:3055] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:22.929910 13861 raft_consensus.cc:740] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:22.930635 13861 consensus_queue.cc:260] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:22.932150 13861 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:22.943949 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:22.944566 13713 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:22.972985 13786 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:22.997723 13861 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:23.001073 13757 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:23.002311 15513 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:23.005044 15513 raft_consensus.cc:697] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:23.005755 15513 consensus_queue.cc:237] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:22.985877 13713 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:23.025682 13610 catalog_manager.cc:5697] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 3 to 4, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 4 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:23.028942 15613 tablet_copy_client.cc:806] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:23.029667 15613 tablet_copy_client.cc:670] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:23.035491 15613 tablet_copy_client.cc:538] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:23.044570 15613 tablet_bootstrap.cc:492] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:06:23.050916 14399 raft_consensus.cc:1217] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:06:23.084539 15613 tablet_bootstrap.cc:492] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:23.085532 15613 tablet_bootstrap.cc:492] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:06:23.086226 15613 ts_tablet_manager.cc:1403] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.042s	user 0.024s	sys 0.005s
I20260709 13:06:23.089167 15613 raft_consensus.cc:359] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:23.090031 15613 raft_consensus.cc:740] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:06:23.090770 15613 consensus_queue.cc:260] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:23.097492 15613 ts_tablet_manager.cc:1434] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:06:23.099205 15603 raft_consensus.cc:993] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02: : Instructing follower b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:23.099740 15545 raft_consensus.cc:1081] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 LEADER]: Signalling peer b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:23.100931 13875 tablet_copy_service.cc:342] P b5029654a4384e43a68eb67b794949b7: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-2d32f086650d45b7b7ae3e0d858e360b received from {username='slave'} at 127.0.0.1:42104
I20260709 13:06:23.101375 13875 tablet_copy_service.cc:434] P b5029654a4384e43a68eb67b794949b7: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-2d32f086650d45b7b7ae3e0d858e360b on tablet 2d32f086650d45b7b7ae3e0d858e360b with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:23.101285 13861 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:59792
I20260709 13:06:23.101855 13861 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:23.102185 13861 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:23.111667 13861 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:23.114236 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:23.114817 13710 raft_consensus.cc:3055] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:23.115134 13710 raft_consensus.cc:740] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:23.115829 13710 consensus_queue.cc:260] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:23.116281 15613 ts_tablet_manager.cc:933] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:23.116905 13710 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:23.127954 13710 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:23.130041 13830 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:23.130841 15601 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:23.131502 15601 raft_consensus.cc:697] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:23.131560 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:23.132172 13786 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:23.132370 15601 consensus_queue.cc:237] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:23.129071 13861 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:23.149108 13786 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:23.171474 13610 catalog_manager.cc:5697] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 2 to 3, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 3 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.175563 15623 ts_tablet_manager.cc:933] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533)
I20260709 13:06:23.185571 15613 tablet_copy_client.cc:323] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.130:36047
I20260709 13:06:23.187618 13800 tablet_copy_service.cc:140] P 35ecb005831740438d7537dd4b840e03: Received BeginTabletCopySession request for tablet b022fc3eb21246ff9f62e8a747bac6c4 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:45134)
I20260709 13:06:23.188231 13800 tablet_copy_service.cc:161] P 35ecb005831740438d7537dd4b840e03: Beginning new tablet copy session on tablet b022fc3eb21246ff9f62e8a747bac6c4 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:45134: session id = ceb06175847b428ea8bd77055fcddf58-b022fc3eb21246ff9f62e8a747bac6c4
I20260709 13:06:23.195137 13800 tablet_copy_source_session.cc:215] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:23.203176 15623 tablet_copy_client.cc:323] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.129:37533
I20260709 13:06:23.205545 13726 tablet_copy_service.cc:140] P b9d194f45e044e0988d5de1a99e5cd02: Received BeginTabletCopySession request for tablet 4648ad5742bd4fe09563b72eb2dfc059 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:58552)
I20260709 13:06:23.206063 13726 tablet_copy_service.cc:161] P b9d194f45e044e0988d5de1a99e5cd02: Beginning new tablet copy session on tablet 4648ad5742bd4fe09563b72eb2dfc059 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:58552: session id = ceb06175847b428ea8bd77055fcddf58-4648ad5742bd4fe09563b72eb2dfc059
I20260709 13:06:23.218012 15613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b022fc3eb21246ff9f62e8a747bac6c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:23.223441 13726 tablet_copy_source_session.cc:215] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:23.226514 15623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4648ad5742bd4fe09563b72eb2dfc059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:23.268146 15623 tablet_copy_client.cc:806] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:23.268792 15623 tablet_copy_client.cc:670] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:23.272737 15623 tablet_copy_client.cc:538] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:23.293202 15613 tablet_copy_client.cc:806] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:23.293929 15613 tablet_copy_client.cc:670] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:23.300458 15623 tablet_bootstrap.cc:492] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:06:23.308244 15613 tablet_copy_client.cc:538] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:23.333163 14394 raft_consensus.cc:1217] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:06:23.347484 15514 raft_consensus.cc:993] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03: : Instructing follower b9d194f45e044e0988d5de1a99e5cd02 to start an election
I20260709 13:06:23.347967 15514 raft_consensus.cc:1081] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Signalling peer b9d194f45e044e0988d5de1a99e5cd02 to start an election
I20260709 13:06:23.351959 13710 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:49488
I20260709 13:06:23.352497 13710 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:23.352850 13710 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:23.356885 15613 tablet_bootstrap.cc:492] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:06:23.373288 13710 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:23.376080 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:23.376626 13790 raft_consensus.cc:3055] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:23.376924 13790 raft_consensus.cc:740] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:23.377610 13790 consensus_queue.cc:260] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:23.378667 13790 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:23.385489 13790 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:06:23.389119 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:23.390076 14394 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:23.399264 14394 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:06:23.400580 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:23.401402 15547 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:23.401887 15547 raft_consensus.cc:697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:23.402725 15547 consensus_queue.cc:237] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:23.389585 13710 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:23.436283 15623 tablet_bootstrap.cc:492] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:23.438860 13610 catalog_manager.cc:5697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 5 to 6, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 6 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:23.441425 15623 tablet_bootstrap.cc:492] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:06:23.450475 15623 ts_tablet_manager.cc:1403] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.150s	user 0.024s	sys 0.004s
I20260709 13:06:23.454018 15623 raft_consensus.cc:359] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:23.470178 15623 raft_consensus.cc:740] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:06:23.472644 15623 consensus_queue.cc:260] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:23.475375 15623 ts_tablet_manager.cc:1434] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:06:23.502302 15514 raft_consensus.cc:1064] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:06:23.514412 15514 consensus_queue.cc:237] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:23.533493 13710 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:23.540979 15513 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:23.550887 13713 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:23.554939 15562 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:23.565219 13861 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:23.568984 15513 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:23.588632 13726 tablet_copy_service.cc:342] P b9d194f45e044e0988d5de1a99e5cd02: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-4648ad5742bd4fe09563b72eb2dfc059 received from {username='slave'} at 127.0.0.1:58552
I20260709 13:06:23.589136 13726 tablet_copy_service.cc:434] P b9d194f45e044e0988d5de1a99e5cd02: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-4648ad5742bd4fe09563b72eb2dfc059 on tablet 4648ad5742bd4fe09563b72eb2dfc059 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:23.618011 13790 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:23.620074 15562 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:23.627560 15613 tablet_bootstrap.cc:492] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:23.631258 15613 tablet_bootstrap.cc:492] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:06:23.633291 15613 ts_tablet_manager.cc:1403] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.277s	user 0.030s	sys 0.020s
I20260709 13:06:23.647430 15613 raft_consensus.cc:359] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:23.648326 15613 raft_consensus.cc:740] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:06:23.648942 15613 consensus_queue.cc:260] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:23.652374 15613 ts_tablet_manager.cc:1434] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:06:23.663710 13800 tablet_copy_service.cc:342] P 35ecb005831740438d7537dd4b840e03: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-b022fc3eb21246ff9f62e8a747bac6c4 received from {username='slave'} at 127.0.0.1:45134
I20260709 13:06:23.664183 13800 tablet_copy_service.cc:434] P 35ecb005831740438d7537dd4b840e03: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-b022fc3eb21246ff9f62e8a747bac6c4 on tablet b022fc3eb21246ff9f62e8a747bac6c4 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:23.695331 14399 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEARNER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:23.698211 13857 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:23.709062 15503 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:23.712670 15513 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:23.793180 14394 raft_consensus.cc:1217] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
W20260709 13:06:23.863551 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 52234.3us
W20260709 13:06:23.870929 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 47913.2us
I20260709 13:06:23.914919 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:23.927210 15646 log.cc:927] Time spent T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.065s	user 0.000s	sys 0.006s
I20260709 13:06:23.936324 13790 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:23.941645 15603 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:06:23.941879 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 122639us
W20260709 13:06:23.957659 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 148452us
I20260709 13:06:23.959601 13710 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:23.970646 14401 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:24.023976 15644 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:06:24.038303 14394 raft_consensus.cc:1217] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:06:23.996272 15545 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:06:24.085630 15603 raft_consensus.cc:1064] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:06:24.088557 15603 consensus_queue.cc:237] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:24.090067 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 91052.9us
I20260709 13:06:24.139894 15502 raft_consensus.cc:1064] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:06:24.142159 15502 consensus_queue.cc:237] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:24.147449 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 338028us
I20260709 13:06:24.195937 15644 raft_consensus.cc:2955] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:06:24.276026 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 113456us
I20260709 13:06:24.306594 14401 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 3 LEARNER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:24.306141 14394 raft_consensus.cc:2955] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:24.308171 15657 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:24.316404 13789 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:24.317919 15643 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:24.318923 13709 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:24.321439 15643 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:24.375329 13857 raft_consensus.cc:2955] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:24.377192 13715 raft_consensus.cc:2955] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:24.354802 13610 catalog_manager.cc:5697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 3 to 4, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:24.436707 13861 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:24.440757 15547 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:24.441118 14401 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEARNER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:24.445590 15655 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:24.487380 13790 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:24.492280 15545 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:24.493019 15502 raft_consensus.cc:2955] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:24.494800 13786 raft_consensus.cc:2955] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:24.527375 13710 raft_consensus.cc:2955] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:24.530117 14399 raft_consensus.cc:2955] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:24.570001 15547 raft_consensus.cc:2955] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:24.571134 14401 raft_consensus.cc:2955] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:24.577211 13786 raft_consensus.cc:2955] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:24.599014 13861 raft_consensus.cc:2955] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:24.740427 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:24.739835 13612 catalog_manager.cc:5697] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 3 to 4, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:24.742803 13612 catalog_manager.cc:5697] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 4 to 5, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:24.804236 15645 raft_consensus.cc:1064] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:06:24.763355 13786 consensus_queue.cc:237] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:24.849174 14399 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:24.853106 15513 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:24.870229 13861 consensus_queue.cc:237] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:24.889071 14399 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:24.889300 13790 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:24.895090 15562 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:24.882380 15645 consensus_queue.cc:237] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:24.900420 15643 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:24.907908 15514 raft_consensus.cc:2955] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:24.909104 13861 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:24.919174 14401 raft_consensus.cc:2955] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:24.921810 13709 consensus_queue.cc:237] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:24.937156 15643 raft_consensus.cc:2955] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:24.938222 13790 raft_consensus.cc:2955] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:24.944167 13861 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:24.946192 15547 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:24.946285 14399 raft_consensus.cc:2955] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:24.957612 15654 raft_consensus.cc:2955] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:24.948006 15513 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:24.951210 14394 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:24.968590 15545 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:24.973780 13858 raft_consensus.cc:2955] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:24.974167 14402 raft_consensus.cc:2955] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:24.987726 13599 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5171bcd42ea14ad3af7399ab8c6a7e35 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:24.988933 13861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:06:24.992022 13600 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4648ad5742bd4fe09563b72eb2dfc059 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:24.992436 13857 raft_consensus.cc:2955] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:24.987823 13612 catalog_manager.cc:5697] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index 5 to 6, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New cstate: current_term: 4 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:24.993187 13610 catalog_manager.cc:5697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 4 to 5, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New cstate: current_term: 3 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:24.997486 13610 catalog_manager.cc:5697] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 4 to 5, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New cstate: current_term: 3 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:25.041611 13777 tablet_service.cc:1558] Processing DeleteTablet for tablet 4648ad5742bd4fe09563b72eb2dfc059 with delete_type TABLET_DATA_TOMBSTONED (TS 35ecb005831740438d7537dd4b840e03 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:48902
I20260709 13:06:25.050444 13703 tablet_service.cc:1558] Processing DeleteTablet for tablet 5171bcd42ea14ad3af7399ab8c6a7e35 with delete_type TABLET_DATA_TOMBSTONED (TS b9d194f45e044e0988d5de1a99e5cd02 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:49478
I20260709 13:06:25.052178 13704 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d32f086650d45b7b7ae3e0d858e360b with delete_type TABLET_DATA_TOMBSTONED (TS b9d194f45e044e0988d5de1a99e5cd02 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:49478
I20260709 13:06:25.069401 13859 raft_consensus.cc:1275] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:25.071607 13709 raft_consensus.cc:1275] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:25.071084 14402 raft_consensus.cc:1275] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEARNER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:25.074813 15658 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:25.078678 15658 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:25.089937 15658 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:25.092171 13601 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2d32f086650d45b7b7ae3e0d858e360b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:25.094213 13861 raft_consensus.cc:606] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:06:25.103322 15684 tablet_replica.cc:333] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:06:25.106389 15684 raft_consensus.cc:2243] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:25.109015 15684 raft_consensus.cc:2272] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:25.104357 15685 tablet_replica.cc:333] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:06:25.124531 15685 raft_consensus.cc:2243] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:25.125437 15685 raft_consensus.cc:2272] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:25.140522 13710 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3618fd55609843fca70082d3565b459b"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:06:25.141248 13710 raft_consensus.cc:606] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Received request to transfer leadership to TS ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:25.144179 13790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:06:25.148586 15685 ts_tablet_manager.cc:1916] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:25.144785 13790 raft_consensus.cc:606] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:25.150969 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:06:25.152529 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:25.157320 15684 ts_tablet_manager.cc:1916] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:25.211246 15658 raft_consensus.cc:2955] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:25.217952 14401 raft_consensus.cc:2955] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:25.217103 15645 raft_consensus.cc:993] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03: : Instructing follower b9d194f45e044e0988d5de1a99e5cd02 to start an election
I20260709 13:06:25.225910 15645 raft_consensus.cc:1081] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Signalling peer b9d194f45e044e0988d5de1a99e5cd02 to start an election
I20260709 13:06:25.227129 15684 ts_tablet_manager.cc:1929] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:06:25.227790 15684 log.cc:1199] T 4648ad5742bd4fe09563b72eb2dfc059 P 35ecb005831740438d7537dd4b840e03: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-1-root/wals/4648ad5742bd4fe09563b72eb2dfc059
I20260709 13:06:25.228188 13715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:49488
I20260709 13:06:25.228822 13715 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:25.229149 13715 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:25.229647 13599 catalog_manager.cc:5028] TS 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): tablet 4648ad5742bd4fe09563b72eb2dfc059 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:06:25.230317 13859 raft_consensus.cc:2955] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:25.242057 13710 raft_consensus.cc:2955] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:25.249316 13715 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:25.251475 13614 catalog_manager.cc:5697] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index 4 to 5, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:25.272682 15685 ts_tablet_manager.cc:1929] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:06:25.273597 13786 consensus_queue.cc:237] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:25.274513 15685 log.cc:1199] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b9d194f45e044e0988d5de1a99e5cd02: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-0-root/wals/5171bcd42ea14ad3af7399ab8c6a7e35
I20260709 13:06:25.278831 15685 tablet_replica.cc:333] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:06:25.281963 15685 raft_consensus.cc:2243] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:25.282994 15685 raft_consensus.cc:2272] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:25.295338 13600 catalog_manager.cc:5028] TS b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): tablet 5171bcd42ea14ad3af7399ab8c6a7e35 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:06:25.296516 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:25.302748 13790 raft_consensus.cc:3055] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:25.303064 13790 raft_consensus.cc:740] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:25.303321 14401 raft_consensus.cc:1275] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:25.293008 15685 ts_tablet_manager.cc:1916] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:25.305591 13710 raft_consensus.cc:1275] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:25.304775 13715 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:25.307631 13790 consensus_queue.cc:260] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:25.309440 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:25.309984 14401 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:25.306068 15635 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:06:25.315490 15514 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:25.317332 13790 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:25.323498 15503 raft_consensus.cc:2955] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:25.335875 14399 raft_consensus.cc:2955] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:25.336830 13790 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:25.337009 13599 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b022fc3eb21246ff9f62e8a747bac6c4 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:25.347535 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:25.348843 15547 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:25.349277 15547 raft_consensus.cc:697] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:25.349988 15547 consensus_queue.cc:237] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:25.370014 14401 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:25.383229 13614 catalog_manager.cc:5697] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 2 to 3, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 3 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:25.406502 15648 raft_consensus.cc:993] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7: : Instructing follower 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:25.407028 15648 raft_consensus.cc:1081] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Signalling peer 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:25.417268 13790 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:48914
I20260709 13:06:25.417820 13790 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:25.418149 13790 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:25.413637 13715 raft_consensus.cc:2955] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:25.415047 13614 catalog_manager.cc:5697] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 5 to 6, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New cstate: current_term: 4 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:25.406702 15685 ts_tablet_manager.cc:1929] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:06:25.427790 15685 log.cc:1199] T 2d32f086650d45b7b7ae3e0d858e360b P b9d194f45e044e0988d5de1a99e5cd02: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-0-root/wals/2d32f086650d45b7b7ae3e0d858e360b
I20260709 13:06:25.431680 13600 catalog_manager.cc:5028] TS b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): tablet 2d32f086650d45b7b7ae3e0d858e360b (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:06:25.433347 13790 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:25.436301 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:25.436899 14399 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:25.436301 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:25.440124 13859 raft_consensus.cc:3055] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:25.440409 13859 raft_consensus.cc:740] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:25.441190 13859 consensus_queue.cc:260] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:25.442305 13859 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:25.455070 13859 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:25.460651 13757 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:25.460922 13848 tablet_service.cc:1558] Processing DeleteTablet for tablet b022fc3eb21246ff9f62e8a747bac6c4 with delete_type TABLET_DATA_TOMBSTONED (TS b5029654a4384e43a68eb67b794949b7 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:59764
I20260709 13:06:25.461130 13790 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:25.460692 14399 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:25.466392 15635 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:25.468676 15635 raft_consensus.cc:697] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:25.469645 15635 consensus_queue.cc:237] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:25.485526 15690 tablet_replica.cc:333] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:06:25.507316 15547 raft_consensus.cc:993] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02: : Instructing follower ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:06:25.507843 15545 raft_consensus.cc:1081] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Signalling peer ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:06:25.511615 14399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3618fd55609843fca70082d3565b459b"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:56570
I20260709 13:06:25.512218 14399 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:25.512591 14399 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:25.517393 13614 catalog_manager.cc:5697] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 3 to 4, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 4 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:25.537546 15690 raft_consensus.cc:2243] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:25.537751 14399 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:25.538360 15690 raft_consensus.cc:2272] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:25.541543 14399 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:25.541985 15690 ts_tablet_manager.cc:1916] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:25.542594 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:25.543159 13715 raft_consensus.cc:3055] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:25.543499 13715 raft_consensus.cc:740] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:25.544366 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:25.544195 13715 consensus_queue.cc:260] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:25.545006 13786 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:25.545594 13715 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:25.562358 13786 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:06:25.565575 14366 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:25.566665 15650 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:25.567150 15650 raft_consensus.cc:697] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:25.567991 15650 consensus_queue.cc:237] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:25.572422 13715 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:06:25.584147 15690 ts_tablet_manager.cc:1929] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:06:25.584720 15690 log.cc:1199] T b022fc3eb21246ff9f62e8a747bac6c4 P b5029654a4384e43a68eb67b794949b7: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-2-root/wals/b022fc3eb21246ff9f62e8a747bac6c4
I20260709 13:06:25.600644 13614 catalog_manager.cc:5697] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 6 to 7, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 7 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:25.617307 13601 catalog_manager.cc:5028] TS b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): tablet b022fc3eb21246ff9f62e8a747bac6c4 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:06:25.768286 13790 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:25.776093 15545 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:25.833355 14399 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:25.836409 15573 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:25.937798 14401 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:25.942704 15658 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:25.953529 13859 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:25.955232 15503 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:25.970352 13709 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:25.971910 15629 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:26.030860 13786 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:26.064759 15576 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:06:26.129897 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 53094.9us
I20260709 13:06:26.153578 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:26.571866 13858 consensus_queue.cc:237] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:26.583112 13709 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:26.588642 13790 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:26.593251 15562 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:26.602643 15643 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:06:26.614224 13829 consensus_peers.cc:597] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 79adc3f3cf6a48518016b2d56c531dbd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:26.669770 15562 raft_consensus.cc:2955] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:26.673039 13715 raft_consensus.cc:2955] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:26.690510 13790 consensus_queue.cc:237] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:26.706840 13614 catalog_manager.cc:5697] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index -1 to 3, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 3 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.712050 13786 raft_consensus.cc:2955] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:26.733037 13859 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:26.735140 13755 consensus_peers.cc:597] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 82aefa8c282f4143b3c3d55f5a4d0bcf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:26.736482 13709 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:26.738924 15699 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:26.742475 15699 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:26.782747 15635 raft_consensus.cc:2955] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:26.784340 13858 raft_consensus.cc:2955] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:26.798081 13709 raft_consensus.cc:2955] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:26.809660 13787 consensus_queue.cc:237] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
W20260709 13:06:26.830777 13755 consensus_peers.cc:597] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8591822f3dc3430e935360afdb260fce. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:26.832494 13709 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:26.832974 13859 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:26.834182 15700 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:26.840725 15700 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:26.883579 15635 raft_consensus.cc:2955] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:26.903281 13716 raft_consensus.cc:2955] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:26.904819 13610 catalog_manager.cc:5697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index -1 to 2, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:26.907975 13859 raft_consensus.cc:2955] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:26.933467 13787 consensus_queue.cc:237] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:26.946691 13612 catalog_manager.cc:5697] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index -1 to 5, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 4 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.954280 13857 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:06:26.955121 13755 consensus_peers.cc:597] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d07097a615d345468e43de064c67057d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:26.955952 15700 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:26.987721 13716 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:26.989530 15700 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:06:27.018980 15700 raft_consensus.cc:2955] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:27.024068 13858 raft_consensus.cc:2955] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:27.035816 13716 raft_consensus.cc:2955] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:27.056655 13612 catalog_manager.cc:5697] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index -1 to 4, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 3 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:27.217680 15722 ts_tablet_manager.cc:933] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:27.224691 15722 tablet_copy_client.cc:323] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.131:46015
I20260709 13:06:27.230947 13875 tablet_copy_service.cc:140] P b5029654a4384e43a68eb67b794949b7: Received BeginTabletCopySession request for tablet 79adc3f3cf6a48518016b2d56c531dbd from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:42104)
I20260709 13:06:27.231530 13875 tablet_copy_service.cc:161] P b5029654a4384e43a68eb67b794949b7: Beginning new tablet copy session on tablet 79adc3f3cf6a48518016b2d56c531dbd from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:42104: session id = ceb06175847b428ea8bd77055fcddf58-79adc3f3cf6a48518016b2d56c531dbd
I20260709 13:06:27.250509 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:27.297513 13875 tablet_copy_source_session.cc:215] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:27.315528 15722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79adc3f3cf6a48518016b2d56c531dbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:27.320432 15725 ts_tablet_manager.cc:933] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:27.321798 15724 ts_tablet_manager.cc:933] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:27.348309 15725 tablet_copy_client.cc:323] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.130:36047
I20260709 13:06:27.350301 13800 tablet_copy_service.cc:140] P 35ecb005831740438d7537dd4b840e03: Received BeginTabletCopySession request for tablet 8591822f3dc3430e935360afdb260fce from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:45134)
I20260709 13:06:27.350940 13800 tablet_copy_service.cc:161] P 35ecb005831740438d7537dd4b840e03: Beginning new tablet copy session on tablet 8591822f3dc3430e935360afdb260fce from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:45134: session id = ceb06175847b428ea8bd77055fcddf58-8591822f3dc3430e935360afdb260fce
I20260709 13:06:27.362520 13800 tablet_copy_source_session.cc:215] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:27.363839 15724 tablet_copy_client.cc:323] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.130:36047
I20260709 13:06:27.370370 13800 tablet_copy_service.cc:140] P 35ecb005831740438d7537dd4b840e03: Received BeginTabletCopySession request for tablet 82aefa8c282f4143b3c3d55f5a4d0bcf from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:45134)
I20260709 13:06:27.371034 13800 tablet_copy_service.cc:161] P 35ecb005831740438d7537dd4b840e03: Beginning new tablet copy session on tablet 82aefa8c282f4143b3c3d55f5a4d0bcf from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:45134: session id = ceb06175847b428ea8bd77055fcddf58-82aefa8c282f4143b3c3d55f5a4d0bcf
I20260709 13:06:27.372473 15725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8591822f3dc3430e935360afdb260fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:27.401723 13800 tablet_copy_source_session.cc:215] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:27.405073 15724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82aefa8c282f4143b3c3d55f5a4d0bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:27.410750 15722 tablet_copy_client.cc:806] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:27.411444 15722 tablet_copy_client.cc:670] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:27.412999 15725 tablet_copy_client.cc:806] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:27.413573 15725 tablet_copy_client.cc:670] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:27.425805 15722 tablet_copy_client.cc:538] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:27.434048 13786 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:06:27.434741 13786 raft_consensus.cc:606] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:06:27.439268 13716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:06:27.439879 13716 raft_consensus.cc:606] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:06:27.441394 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:06:27.443173 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:27.475214 15699 raft_consensus.cc:993] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03: : Instructing follower b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:27.475781 15503 raft_consensus.cc:1081] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Signalling peer b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:27.479291 15728 ts_tablet_manager.cc:933] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:27.483129 13858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:59780
I20260709 13:06:27.483793 13858 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:27.484196 13858 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.494127 15728 tablet_copy_client.cc:323] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.130:36047
I20260709 13:06:27.496192 13801 tablet_copy_service.cc:140] P 35ecb005831740438d7537dd4b840e03: Received BeginTabletCopySession request for tablet d07097a615d345468e43de064c67057d from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:45134)
I20260709 13:06:27.496752 13801 tablet_copy_service.cc:161] P 35ecb005831740438d7537dd4b840e03: Beginning new tablet copy session on tablet d07097a615d345468e43de064c67057d from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:45134: session id = ceb06175847b428ea8bd77055fcddf58-d07097a615d345468e43de064c67057d
I20260709 13:06:27.550643 13801 tablet_copy_source_session.cc:215] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:27.568555 13858 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:27.571691 13858 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:27.572319 15728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d07097a615d345468e43de064c67057d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:27.571956 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:27.573608 13716 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.573693 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:27.574254 13787 raft_consensus.cc:3055] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:27.574548 13787 raft_consensus.cc:740] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:27.575193 13787 consensus_queue.cc:260] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:27.576519 13787 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.581868 15725 tablet_copy_client.cc:538] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:27.584421 13716 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:06:27.584558 13787 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:06:27.587793 13829 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:27.588570 15643 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:27.589109 15643 raft_consensus.cc:697] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:27.590066 15643 consensus_queue.cc:237] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:27.595197 15722 tablet_bootstrap.cc:492] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:06:27.619838 15725 tablet_bootstrap.cc:492] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:06:27.639566 13612 catalog_manager.cc:5697] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 5 to 6, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 6 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:27.661841 15724 tablet_copy_client.cc:806] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:27.690083 15728 tablet_copy_client.cc:806] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:27.697180 15728 tablet_copy_client.cc:670] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:27.684227 15724 tablet_copy_client.cc:670] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:27.701269 15728 tablet_copy_client.cc:538] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:27.710165 15724 tablet_copy_client.cc:538] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:27.741724 15728 tablet_bootstrap.cc:492] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:06:27.817081 15724 tablet_bootstrap.cc:492] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:06:27.835623 15573 raft_consensus.cc:993] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: : Instructing follower 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:27.836164 15573 raft_consensus.cc:1081] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Signalling peer 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:27.840297 13787 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:48928
I20260709 13:06:27.840860 13787 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:27.841171 13787 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.877725 13787 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:27.937140 13787 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:27.941499 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:27.941097 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:27.942128 13858 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.942400 13716 raft_consensus.cc:3055] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:27.942759 13716 raft_consensus.cc:740] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:27.945065 15722 tablet_bootstrap.cc:492] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:27.946014 15722 tablet_bootstrap.cc:492] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:06:27.946745 15722 ts_tablet_manager.cc:1403] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.375s	user 0.022s	sys 0.007s
I20260709 13:06:27.943982 13716 consensus_queue.cc:260] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:27.958755 13716 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.964548 13858 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:27.966140 13757 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:27.972559 13716 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:27.974388 15503 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:27.975019 15503 raft_consensus.cc:697] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:27.990366 15503 consensus_queue.cc:237] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:28.001111 15722 raft_consensus.cc:359] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:28.002071 15722 raft_consensus.cc:740] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:06:28.004899 13787 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:28.006310 15562 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.009979 15725 tablet_bootstrap.cc:492] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:28.018566 15725 tablet_bootstrap.cc:492] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:06:28.019336 15725 ts_tablet_manager.cc:1403] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.400s	user 0.029s	sys 0.020s
I20260709 13:06:28.002803 15722 consensus_queue.cc:260] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
W20260709 13:06:28.180186 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 173207us
W20260709 13:06:28.187179 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 83848.5us
I20260709 13:06:28.325911 13614 catalog_manager.cc:5697] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 1 to 2, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 2 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.369484 14401 raft_consensus.cc:1217] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:06:28.394261 15722 ts_tablet_manager.cc:1434] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.447s	user 0.013s	sys 0.007s
I20260709 13:06:28.396709 15724 tablet_bootstrap.cc:492] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:28.404855 15724 tablet_bootstrap.cc:492] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:06:28.428344 13716 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:28.418798 15724 ts_tablet_manager.cc:1403] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.602s	user 0.027s	sys 0.009s
I20260709 13:06:28.438483 13875 tablet_copy_service.cc:342] P b5029654a4384e43a68eb67b794949b7: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-79adc3f3cf6a48518016b2d56c531dbd received from {username='slave'} at 127.0.0.1:42104
I20260709 13:06:28.449822 13875 tablet_copy_service.cc:434] P b5029654a4384e43a68eb67b794949b7: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-79adc3f3cf6a48518016b2d56c531dbd on tablet 79adc3f3cf6a48518016b2d56c531dbd with peer ceb06175847b428ea8bd77055fcddf58
W20260709 13:06:28.488137 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 58887us
I20260709 13:06:28.505923 15725 raft_consensus.cc:359] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:28.527683 15740 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:06:28.544800 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:28.528029 15725 raft_consensus.cc:740] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:06:28.612383 15724 raft_consensus.cc:359] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:28.613330 15724 raft_consensus.cc:740] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:06:28.614054 15724 consensus_queue.cc:260] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
W20260709 13:06:28.627537 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 47527.7us
I20260709 13:06:28.630447 15728 tablet_bootstrap.cc:492] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:28.655563 15725 consensus_queue.cc:260] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:28.667039 13857 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:28.686643 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 74834.5us
I20260709 13:06:28.686746 15748 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:06:28.689721 15728 tablet_bootstrap.cc:492] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:06:28.690541 15728 ts_tablet_manager.cc:1403] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.949s	user 0.019s	sys 0.024s
I20260709 13:06:28.718196 15725 ts_tablet_manager.cc:1434] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.698s	user 0.009s	sys 0.004s
W20260709 13:06:28.718632 15725 ts_tablet_manager.cc:1467] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Tablet startup took 698ms
I20260709 13:06:28.716840 15728 raft_consensus.cc:359] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:28.736225 15728 raft_consensus.cc:740] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:06:28.757737 15724 ts_tablet_manager.cc:1434] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.313s	user 0.012s	sys 0.003s
I20260709 13:06:28.757773 15728 consensus_queue.cc:260] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:28.762758 15766 raft_consensus.cc:1064] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:06:28.764966 15728 ts_tablet_manager.cc:1434] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.074s	user 0.010s	sys 0.002s
I20260709 13:06:28.770247 13716 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:28.771874 13800 tablet_copy_service.cc:342] P 35ecb005831740438d7537dd4b840e03: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-82aefa8c282f4143b3c3d55f5a4d0bcf received from {username='slave'} at 127.0.0.1:45134
I20260709 13:06:28.772431 13800 tablet_copy_service.cc:434] P 35ecb005831740438d7537dd4b840e03: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-82aefa8c282f4143b3c3d55f5a4d0bcf on tablet 82aefa8c282f4143b3c3d55f5a4d0bcf with peer ceb06175847b428ea8bd77055fcddf58
W20260709 13:06:28.722163 15725 ts_tablet_manager.cc:1469] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Trace:
0709 13:06:27.236354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.239858 (+  3504us) service_pool.cc:224] Handling call
0709 13:06:27.322130 (+ 82272us) ts_tablet_manager.cc:934] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
0709 13:06:27.369715 (+ 47585us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:27.399006 (+ 29291us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:27.399126 (+   120us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:27.410072 (+ 10946us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:27.410354 (+   282us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:27.412196 (+  1842us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:27.412256 (+    60us) inbound_call.cc:177] Queueing success response
0709 13:06:27.619452 (+207196us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:06:28.019686 (+400234us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:06:28.332085 (+312399us) tablet_replica.cc:261] Starting instrumentation
0709 13:06:28.382634 (+ 50549us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":260,"raft.queue_time_us":3214,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"tablet-copy.queue_time_us":80111,"tablet-download-pool.queue_time_us":113,"tablet-download-pool.run_cpu_time_us":1001,"tablet-download-pool.run_wall_time_us":167669,"thread_start_us":108141,"threads_started":2}
W20260709 13:06:28.790830 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 43985.4us
I20260709 13:06:28.789498 13800 tablet_copy_service.cc:342] P 35ecb005831740438d7537dd4b840e03: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-d07097a615d345468e43de064c67057d received from {username='slave'} at 127.0.0.1:45134
I20260709 13:06:28.796530 13800 tablet_copy_service.cc:434] P 35ecb005831740438d7537dd4b840e03: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-d07097a615d345468e43de064c67057d on tablet d07097a615d345468e43de064c67057d with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:28.796871 15749 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:06:28.803874 13801 tablet_copy_service.cc:342] P 35ecb005831740438d7537dd4b840e03: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-8591822f3dc3430e935360afdb260fce received from {username='slave'} at 127.0.0.1:45134
I20260709 13:06:28.804415 13801 tablet_copy_service.cc:434] P 35ecb005831740438d7537dd4b840e03: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-8591822f3dc3430e935360afdb260fce on tablet 8591822f3dc3430e935360afdb260fce with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:28.827889 14401 raft_consensus.cc:1217] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:06:28.809851 15766 consensus_queue.cc:237] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:28.901917 14401 raft_consensus.cc:1217] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:28.906013 14399 raft_consensus.cc:1217] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.4->[4.5-4.5]   Dedup: 4.5->[]
W20260709 13:06:28.936796 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 72865.6us
I20260709 13:06:28.966127 14401 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 3 LEARNER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:28.979825 15731 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.985658 13791 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:28.987879 15730 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.989678 13716 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:28.992841 15766 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:29.021934 15562 raft_consensus.cc:2955] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:29.032861 13716 raft_consensus.cc:2955] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:29.040510 13612 catalog_manager.cc:5697] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index 3 to 4, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:29.055217 13861 consensus_queue.cc:237] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:29.030752 13789 raft_consensus.cc:2955] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:29.034652 14401 raft_consensus.cc:2955] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:29.102264 14402 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:29.105690 15562 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:29.113817 13791 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:29.116240 15766 raft_consensus.cc:2955] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:29.121058 15562 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:29.120903 14402 raft_consensus.cc:2955] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:29.126421 13791 raft_consensus.cc:2955] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:29.148166 13601 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 79adc3f3cf6a48518016b2d56c531dbd with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:29.157207 13612 catalog_manager.cc:5697] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index 4 to 5, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New cstate: current_term: 3 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:29.206398 13703 tablet_service.cc:1558] Processing DeleteTablet for tablet 79adc3f3cf6a48518016b2d56c531dbd with delete_type TABLET_DATA_TOMBSTONED (TS b9d194f45e044e0988d5de1a99e5cd02 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:49478
I20260709 13:06:29.224896 15785 tablet_replica.cc:333] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:06:29.227591 15785 raft_consensus.cc:2243] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:29.228487 15785 raft_consensus.cc:2272] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:29.244267 15785 ts_tablet_manager.cc:1916] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:29.276022 15785 ts_tablet_manager.cc:1929] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:06:29.281881 15785 log.cc:1199] T 79adc3f3cf6a48518016b2d56c531dbd P b9d194f45e044e0988d5de1a99e5cd02: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-0-root/wals/79adc3f3cf6a48518016b2d56c531dbd
I20260709 13:06:29.286204 13600 catalog_manager.cc:5028] TS b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): tablet 79adc3f3cf6a48518016b2d56c531dbd (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:06:29.376854 15749 raft_consensus.cc:1064] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:06:29.379863 15749 consensus_queue.cc:237] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:29.656991 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:29.665324 13863 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:29.678378 14402 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 3 LEARNER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:29.686522 15749 raft_consensus.cc:1064] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:06:29.705377 13715 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:29.678143 15790 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:06:29.692533 15749 consensus_queue.cc:237] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:29.741804 15790 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:29.752183 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 54527.5us
I20260709 13:06:29.769357 15750 raft_consensus.cc:1064] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
W20260709 13:06:29.806852 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 64262.2us
I20260709 13:06:29.852159 15758 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:06:29.884452 15750 consensus_queue.cc:237] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:29.946703 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 138830us
I20260709 13:06:29.948562 14399 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 1 LEARNER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:29.964246 15791 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:29.966965 14399 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 4 LEARNER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:06:29.977629 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 155375us
I20260709 13:06:29.978147 13857 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:29.985948 15791 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:29.991483 15758 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:06:30.002509 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 153512us
W20260709 13:06:30.012049 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 172083us
I20260709 13:06:30.027526 13707 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:30.041052 15789 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:30.044178 15750 raft_consensus.cc:2955] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:30.046468 13863 raft_consensus.cc:2955] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:30.052052 13710 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:30.056538 15790 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:06:30.058954 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 218565us
W20260709 13:06:30.059053 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 55169.5us
I20260709 13:06:30.093933 13791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:06:30.094580 13791 raft_consensus.cc:606] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:06:30.100760 13859 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:30.128023 15790 raft_consensus.cc:2955] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:30.132159 13861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:06:30.133261 13612 catalog_manager.cc:5697] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index 4 to 5, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:06:30.133975 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 47750.5us
I20260709 13:06:30.136888 13709 raft_consensus.cc:2955] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:30.139853 13861 raft_consensus.cc:606] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:06:30.138381 15809 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:30.167335 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:06:30.169490 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:30.198558 13861 raft_consensus.cc:2955] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:06:30.266628 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 100275us
W20260709 13:06:30.354242 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 65980.9us
W20260709 13:06:30.392729 15815 log.cc:927] Time spent T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:06:30.392369 13611 catalog_manager.cc:5697] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index 5 to 6, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:06:30.395521 15821 log.cc:927] Time spent T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:06:30.424499 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 55002.3us
I20260709 13:06:30.423578 15803 raft_consensus.cc:2955] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:30.428675 13863 raft_consensus.cc:2955] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:06:30.415215 15816 log.cc:927] Time spent T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:06:30.484778 13707 raft_consensus.cc:2955] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:30.467347 13709 raft_consensus.cc:2955] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:30.519269 14401 raft_consensus.cc:2955] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:30.550433 15803 raft_consensus.cc:993] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03: : Instructing follower b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:30.550997 15803 raft_consensus.cc:1081] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Signalling peer b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:06:30.556243 13858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:59780
I20260709 13:06:30.555563 14394 raft_consensus.cc:2955] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:30.556790 13858 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:30.557127 13858 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:30.564033 13858 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:30.566411 13858 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:30.568244 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:30.568930 13791 raft_consensus.cc:3055] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:30.569242 13791 raft_consensus.cc:740] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:30.570155 13791 consensus_queue.cc:260] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:30.571264 13791 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:30.578570 13791 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:06:30.579618 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:30.580523 14401 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:30.579758 13829 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:30.582459 15766 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:30.583782 15793 raft_consensus.cc:993] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: : Instructing follower 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:30.584227 15793 raft_consensus.cc:1081] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Signalling peer 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:30.585145 15766 raft_consensus.cc:697] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 5 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:30.586210 15766 consensus_queue.cc:237] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:30.587858 14401 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:06:30.588032 13786 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:48914
I20260709 13:06:30.597709 13786 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:30.598183 13786 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:30.612464 13786 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:30.624267 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:30.624879 13858 raft_consensus.cc:3055] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:30.625162 13858 raft_consensus.cc:740] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:30.625844 13858 consensus_queue.cc:260] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:30.626847 13858 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:30.639117 14401 raft_consensus.cc:2955] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:30.645948 13858 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:30.646807 13786 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:30.647714 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:30.648276 14394 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:30.666993 14394 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:30.678403 13757 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:30.699564 15805 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:30.700170 15805 raft_consensus.cc:697] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:30.701146 15805 consensus_queue.cc:237] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:30.765702 13612 catalog_manager.cc:5697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index 2 to 3, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:30.767198 13791 consensus_queue.cc:237] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:30.781184 13612 catalog_manager.cc:5697] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 4 to 5, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 5 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.789525 14394 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:30.791220 15750 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:30.800640 15700 raft_consensus.cc:2955] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:30.809504 14401 raft_consensus.cc:2955] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:30.817512 13599 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d07097a615d345468e43de064c67057d with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:30.827183 13863 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:30.834256 15750 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:30.850962 13863 raft_consensus.cc:2955] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:30.876235 13612 catalog_manager.cc:5697] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index 5 to 6, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New cstate: current_term: 3 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:30.879184 13612 catalog_manager.cc:5697] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 3 to 4, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 4 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.926470 13703 tablet_service.cc:1558] Processing DeleteTablet for tablet d07097a615d345468e43de064c67057d with delete_type TABLET_DATA_TOMBSTONED (TS b9d194f45e044e0988d5de1a99e5cd02 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:49478
I20260709 13:06:30.929944 13786 consensus_queue.cc:237] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:30.940934 14394 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:30.944744 13707 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:30.946661 15750 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:30.951041 15805 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:30.958942 13791 consensus_queue.cc:237] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:30.967356 15749 raft_consensus.cc:2955] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:30.972458 13710 raft_consensus.cc:2955] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:31.002039 14394 raft_consensus.cc:2955] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:31.007053 13599 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8591822f3dc3430e935360afdb260fce with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:31.007764 14401 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:31.010643 13710 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:31.005141 15829 tablet_replica.cc:333] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:06:31.020396 15829 raft_consensus.cc:2243] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.022351 15829 raft_consensus.cc:2272] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.022956 15805 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:31.026258 15750 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:31.030367 13612 catalog_manager.cc:5697] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index 6 to 7, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New cstate: current_term: 4 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:31.041426 14401 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:31.040598 15802 raft_consensus.cc:2955] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:31.044026 15754 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:31.067754 14400 raft_consensus.cc:2955] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:31.037670 15829 ts_tablet_manager.cc:1916] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:31.088246 13710 raft_consensus.cc:2955] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:31.105866 13848 tablet_service.cc:1558] Processing DeleteTablet for tablet 8591822f3dc3430e935360afdb260fce with delete_type TABLET_DATA_TOMBSTONED (TS b5029654a4384e43a68eb67b794949b7 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:59764
I20260709 13:06:31.110654 13599 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 82aefa8c282f4143b3c3d55f5a4d0bcf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:31.127115 15829 ts_tablet_manager.cc:1929] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:06:31.144485 15829 log.cc:1199] T d07097a615d345468e43de064c67057d P b9d194f45e044e0988d5de1a99e5cd02: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-0-root/wals/d07097a615d345468e43de064c67057d
I20260709 13:06:31.159929 13612 catalog_manager.cc:5697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 3 to 4, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New cstate: current_term: 1 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:31.174456 13791 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:31.177965 13863 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:31.185699 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:31.202229 15809 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:06:31.236549 14398 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:31.212019 15766 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:06:31.227643 15832 tablet_replica.cc:333] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:06:31.253153 15802 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:06:31.288193 15832 raft_consensus.cc:2243] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.289215 15832 raft_consensus.cc:2272] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.324007 13600 catalog_manager.cc:5028] TS b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): tablet d07097a615d345468e43de064c67057d (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
W20260709 13:06:31.325251 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 52673.6us
I20260709 13:06:31.422041 15832 ts_tablet_manager.cc:1916] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:06:31.488152 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 131333us
W20260709 13:06:31.628551 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 139196us
W20260709 13:06:31.664414 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 157181us
W20260709 13:06:31.666666 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 95698.2us
W20260709 13:06:31.671237 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 97406.9us
W20260709 13:06:31.674793 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 100963us
W20260709 13:06:31.683741 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 109559us
W20260709 13:06:31.707222 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 130599us
W20260709 13:06:31.737167 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 53326.2us
I20260709 13:06:31.734330 13848 tablet_service.cc:1558] Processing DeleteTablet for tablet 82aefa8c282f4143b3c3d55f5a4d0bcf with delete_type TABLET_DATA_TOMBSTONED (TS b5029654a4384e43a68eb67b794949b7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59764
W20260709 13:06:31.751824 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 78696.5us
W20260709 13:06:31.787237 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 44940.9us
W20260709 13:06:31.814045 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 140478us
W20260709 13:06:31.829000 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 120116us
W20260709 13:06:31.828045 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 140603us
W20260709 13:06:31.915764 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 119068us
I20260709 13:06:31.940354 15863 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:31.941053 15863 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:31.944193 15863 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:31.944893 15858 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:06:31.956403 15832 ts_tablet_manager.cc:1929] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 13:06:31.956898 15832 log.cc:1199] T 8591822f3dc3430e935360afdb260fce P b5029654a4384e43a68eb67b794949b7: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-2-root/wals/8591822f3dc3430e935360afdb260fce
I20260709 13:06:31.958546 15832 tablet_replica.cc:333] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:06:31.963474 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:31.964426 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:31.959532 15832 raft_consensus.cc:2243] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.965695 15832 raft_consensus.cc:2272] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.967942 13829 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:31.968571 15832 ts_tablet_manager.cc:1916] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:06:31.968708 13829 raft_consensus.cc:2686] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:06:32.064882 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 341886us
I20260709 13:06:32.134030 15832 ts_tablet_manager.cc:1929] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:32.134591 15832 log.cc:1199] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b5029654a4384e43a68eb67b794949b7: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-2-root/wals/82aefa8c282f4143b3c3d55f5a4d0bcf
I20260709 13:06:32.138473 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:32.142980 13601 catalog_manager.cc:5028] TS b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): tablet 8591822f3dc3430e935360afdb260fce (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:06:32.168619 13601 catalog_manager.cc:5028] TS b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): tablet 82aefa8c282f4143b3c3d55f5a4d0bcf (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:06:32.670742 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:32.753739 13858 consensus_queue.cc:237] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
W20260709 13:06:32.779855 13829 consensus_peers.cc:597] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f09ef105d67b41dba510b44a6567d790. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:32.781657 13785 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:32.783891 13707 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:32.786293 15874 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:32.788913 15874 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:32.850111 13858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:06:32.850764 13858 raft_consensus.cc:606] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:06:32.857182 15868 raft_consensus.cc:2955] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:32.860639 13708 raft_consensus.cc:2955] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:32.864109 13791 raft_consensus.cc:2955] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
W20260709 13:06:33.998317 13791 consensus_meta.cc:287] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 1.132s	user 0.010s	sys 0.009s
I20260709 13:06:34.262698 15887 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:06:34.267118 13708 consensus_meta.cc:287] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 1.404s	user 0.022s	sys 0.000s
I20260709 13:06:34.270423 15880 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:34.271166 15884 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:34.304838 15880 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.319754 15892 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:34.320477 15892 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:34.321935 15893 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:34.322530 15893 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.322860 15892 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.377213 15898 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:34.377911 15882 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:34.378044 15898 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.378840 15882 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.382266 15882 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:34.382447 15898 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:34.284888 15887 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.402074 15900 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:34.323652 15884 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:34.402213 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1353) took 1538 ms. Trace:
I20260709 13:06:34.333829 15891 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:34.405735 13791 rpcz_store.cc:276] 0709 13:06:32.863465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.863592 (+   127us) service_pool.cc:224] Handling call
0709 13:06:32.863858 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.864019 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:33.998876 (+1134857us) log.cc:844] Serialized 14 byte log entry
0709 13:06:34.401778 (+402902us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:34.401852 (+    74us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:34.401905 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.401984 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.402128 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44531,"thread_start_us":357858,"threads_started":2,"wal-append.queue_time_us":385909}
I20260709 13:06:34.443656 15888 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:34.444483 15888 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.452517 15896 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:34.453044 15887 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.453145 15896 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:34.411722 15891 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.458787 15891 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.431326 15894 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:34.460158 15894 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.462630 15894 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:06:34.464231 15899 log.cc:927] Time spent T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:34.464795 15884 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.517179 15893 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.404394 15880 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.432840 15898 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:34.521540 15898 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.524794 15898 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.527674 15896 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.447247 15888 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:34.409579 15900 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.643229 15900 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:34.696365 15886 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:34.697114 15886 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.699910 15886 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:34.701610 15895 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:34.702476 15895 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.705075 15895 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:34.705762 15895 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:34.706375 15895 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:34.708655 15900 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:34.709396 15900 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.712015 15900 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:34.724367 15895 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.730329 15896 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:34.731249 15896 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.734355 15896 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:34.734961 15892 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:34.735793 15892 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:34.738137 15892 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.738682 15892 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:34.739202 15892 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:34.740329 15883 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:34.799763 15883 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.802021 15883 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:34.743706 15884 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:34.803802 15884 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.804054 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:34.805935 15884 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:34.745932 15890 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:34.807425 15890 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:34.809471 15890 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.809594 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:34.810056 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:34.811904 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:34.813354 15892 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.771157 15886 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:34.814226 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:34.814129 15886 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.815989 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:34.771539 13707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1600) took 1913 ms. Trace:
I20260709 13:06:34.775233 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:34.776469 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:34.777024 15908 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:34.777979 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:34.779735 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:34.783208 15901 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:34.784942 15879 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:34.818142 13711 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:34.785691 15896 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:34.786228 15913 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:34.788561 15882 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:34.788698 15888 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:34.827597 15901 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.834149 15888 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.834857 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:34.789016 15880 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:34.789292 15894 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:34.789424 15893 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:34.791317 15907 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:34.792682 15898 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:34.793433 15889 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:34.795343 15905 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:34.845999 15905 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.796866 15909 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:34.797704 15887 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:34.848989 15887 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.850698 14395 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:34.852008 15898 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.854899 15898 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.844559 15893 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.848848 15909 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:34.857595 15893 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.858116 15893 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:34.858572 15893 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.842931 15894 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.859673 15885 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:34.860432 15885 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:34.861418 15894 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.861960 15894 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:34.862403 15894 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.863183 15885 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.798102 15891 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:34.798209 13791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "536b1fc131984687bf3b13417507e21d"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:06:34.798344 15904 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:34.798945 15903 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:34.869616 15904 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.869714 15903 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.871078 15900 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:34.871961 15904 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:34.819764 13829 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.021s	sys 0.014s
I20260709 13:06:34.872321 15903 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:34.828925 15879 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.836896 15896 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:34.838487 15888 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.827826 15908 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:34.874308 15896 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.838953 15880 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.874312 15879 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:34.874526 15891 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.875324 15879 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:34.875813 15879 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.846920 15889 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.876279 15880 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.878556 15887 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:34.847856 15907 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:34.880144 15893 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:34.874781 15908 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.881191 15907 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.840250 15913 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.836369 15902 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:34.871678 15900 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:34.872578 13829 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.021s	sys 0.014s
I20260709 13:06:34.833350 15882 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.755597 15897 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:34.880192 15889 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:34.928915 15917 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:34.929221 15893 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:34.929512 15917 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.930034 15900 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.929905 15893 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.882790 15901 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:34.932875 15901 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:34.933048 15887 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:34.933388 15901 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.933723 15887 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.899307 15911 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:34.936095 15911 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:34.936829 15913 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:34.885916 15891 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.938134 15911 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.938581 15879 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:34.938696 15894 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.888546 15914 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:34.940737 15887 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.886680 15878 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:34.916819 15909 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.942174 15878 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:34.942868 15897 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.883701 15886 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:34.944569 15878 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:34.883481 15905 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:34.924099 15912 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:34.946264 15912 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.947467 15901 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:34.940608 15914 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.948329 15887 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:34.948928 15887 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:34.949882 14423 debug-util.cc:398] Leaking SignalData structure 0x7b080034b9c0 after lost signal to thread 12597
I20260709 13:06:34.928970 15902 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.951030 15914 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:34.951086 15887 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.941288 15893 leader_election.cc:290] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.937311 15889 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:34.955806 15889 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.956836 15914 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:34.957612 15914 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.959015 15889 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:34.960301 15914 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:34.934082 15920 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:34.970597 15920 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:34.963119 15897 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:34.941596 15882 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:34.968339 15917 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:34.969158 15902 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:34.949056 15912 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:34.973028 15920 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:35.008412 13714 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:35.009159 13712 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 1.
I20260709 13:06:34.817800 13707 rpcz_store.cc:276] 0709 13:06:32.858103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.770635 (+1912532us) service_pool.cc:224] Handling call
0709 13:06:34.770988 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.771171 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:34.771196 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:34.771247 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:34.771279 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.771341 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.771481 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:34.823367 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1601) took 1965 ms. Trace:
I20260709 13:06:35.021310 13708 rpcz_store.cc:276] 0709 13:06:32.858423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.859807 (+  1384us) service_pool.cc:224] Handling call
0709 13:06:32.860111 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.860352 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:34.284033 (+1423681us) log.cc:844] Serialized 14 byte log entry
0709 13:06:34.823053 (+539020us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:34.823101 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:34.823145 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.823207 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.823312 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13460,"raft.queue_time_us":62947,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":520561,"threads_started":2,"wal-append.queue_time_us":125706}
I20260709 13:06:34.868152 13791 raft_consensus.cc:606] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:35.036293 15886 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:35.036854 15908 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:35.037170 15913 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:35.037820 15886 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:35.039932 15904 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:35.040877 15904 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.042485 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.031992 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.041229 14367 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:35.039978 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:35.049048 14423 debug-util.cc:398] Leaking SignalData structure 0x7b08003078e0 after lost signal to thread 13648
W20260709 13:06:35.093089 14423 debug-util.cc:398] Leaking SignalData structure 0x7b08002e24c0 after lost signal to thread 13662
I20260709 13:06:35.093015 15914 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:35.094264 15914 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.038094 15913 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.036363 15896 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:35.043795 15879 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:35.056131 15924 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:06:35.090889 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 50014.8us
I20260709 13:06:35.092207 15902 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:35.094676 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.057000 15878 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:35.095736 15882 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:35.099848 15897 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:35.037890 15908 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.107977 15905 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:35.123559 15884 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:35.123957 15921 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:35.124248 15905 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.124477 15884 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:35.125175 15914 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:35.125617 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.125849 15914 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:35.126516 13859 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:35.126667 15914 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.127290 15903 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:06:35.109885 14423 debug-util.cc:398] Leaking SignalData structure 0x7b08002dfae0 after lost signal to thread 13740
I20260709 13:06:35.128047 15903 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:35.129093 14423 debug-util.cc:398] Leaking SignalData structure 0x7b08002df320 after lost signal to thread 13815
I20260709 13:06:35.129778 15908 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:35.130523 14423 debug-util.cc:398] Leaking SignalData structure 0x7b08002991e0 after lost signal to thread 13889
I20260709 13:06:35.110298 15915 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:35.131326 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.132370 15892 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:35.116084 15913 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:35.133174 15924 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.130541 15903 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:35.122200 15902 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:35.123109 15890 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:35.135654 15902 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.124881 15921 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:35.135973 15879 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:35.136024 15890 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:35.138384 15890 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:35.138438 15879 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:35.111275 15904 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:35.139008 15879 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:35.115573 15907 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:35.131914 15915 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.133279 15896 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:35.122884 15878 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:35.122892 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.149045 15896 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:35.109452 15917 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:35.149087 15878 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:35.150223 15917 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:35.151719 15907 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:35.153474 15917 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:35.099892 15918 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:35.154358 15907 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:35.151144 15915 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:35.154692 15918 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.158654 15918 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:35.142161 14423 debug-util.cc:398] Leaking SignalData structure 0x7b080030ed20 after lost signal to thread 14426
I20260709 13:06:35.142504 15914 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:35.159859 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.160634 15924 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:35.131939 15882 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:35.158592 15922 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:35.163789 15922 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:35.164825 15882 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:35.160651 13707 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 1.
I20260709 13:06:35.141925 15886 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:35.118445 13715 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:35.166523 15922 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:35.158566 15878 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:35.167510 15878 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.168016 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.170634 15878 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:35.170892 13863 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:35.127121 15905 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:35.171962 13859 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:35.135633 15884 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:35.139518 15921 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:35.176925 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.183667 15892 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:35.210916 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.184973 15927 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:35.186230 15907 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:35.187359 15911 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:35.219123 15911 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.222395 15911 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:35.187996 15886 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:35.223094 15900 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:35.223881 15900 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:35.188934 15909 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:35.193478 15912 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:35.193650 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.225083 15909 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:35.194875 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.197701 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.226504 13864 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:35.227385 15909 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:35.227339 15927 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.225090 15912 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.191521 15916 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:35.199805 15879 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.234634 15879 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:35.200611 15897 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:35.201033 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.237149 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.237591 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.203694 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.238900 13713 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:35.204432 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.239800 13715 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:35.204838 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.215701 15907 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:35.242913 15907 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:35.199337 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.223583 15886 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.231436 15916 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:35.231900 15912 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:35.202523 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.240103 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.242815 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.237717 15897 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:35.250656 15886 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:35.252926 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.253640 13757 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:35.254818 15927 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:35.214277 15892 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:35.257498 14367 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:35.230257 15900 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:35.263078 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.269793 13857 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:06:35.271085 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.272614 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.281944 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.282794 13864 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:35.287714 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.288458 13789 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:06:35.288700 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.289517 13614 catalog_manager.cc:5697] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index -1 to 4, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 3 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:35.290948 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.291245 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.291468 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.291836 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.292258 13785 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:35.293314 14367 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:35.298156 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.298326 15885 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.298377 15920 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:35.298893 14400 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:06:35.298915 15885 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:35.299077 15920 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:35.299547 15885 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.299800 15920 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.303925 15889 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.304481 15889 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:35.305004 15889 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.306512 14367 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:35.307961 15894 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:35.308195 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 421732us
I20260709 13:06:35.308532 15894 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:35.308986 15894 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:35.309173 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 55836.9us
I20260709 13:06:35.311949 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.312711 14400 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:06:35.316841 15902 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.318131 14401 raft_consensus.cc:1240] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:35.321866 15902 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:35.338563 15916 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:35.345204 15889 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.319303 15894 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.349591 15894 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:35.354035 15920 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.363988 15900 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:35.364677 15920 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:35.364849 15900 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:35.370035 15889 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:35.376371 14367 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:35.376338 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.378043 15900 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:35.377889 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.372944 15879 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:35.377025 15907 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:35.379570 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.373121 15886 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:35.381402 15907 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.381793 15886 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:35.382926 15905 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:35.383901 15907 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:35.383644 15905 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.384418 15886 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:35.384485 15907 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:35.385252 13785 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:06:35.386219 13757 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:35.386952 15918 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:35.388005 15932 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.387751 15918 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.388486 15932 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:35.388929 15932 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.390404 15918 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:35.379046 14401 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:35.390997 15921 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:35.391901 13755 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:35.391745 15921 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:35.393085 15885 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.393913 15900 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:35.394868 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:06:35.394944 15900 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:35.395648 15900 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.398968 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:35.401523 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.403029 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.403525 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.404770 14398 raft_consensus.cc:1240] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:35.406713 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.386270 15905 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:35.408759 15889 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:35.408950 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.409198 15889 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:35.409685 15889 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.401578 13757 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:35.410307 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.410872 15918 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:35.411262 15918 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:35.411672 15918 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.412643 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.416453 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.395342 15885 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:35.419246 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.379648 15879 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.423729 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.423908 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.416831 15921 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:35.433427 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.433418 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.448236 15931 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:35.449126 15931 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:35.452437 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.460748 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.458137 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.456581 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.463326 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.456203 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.456990 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.465513 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.457320 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:06:35.470757 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 47707us
I20260709 13:06:35.468029 13856 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 1.
I20260709 13:06:35.461005 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.476227 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.476490 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.477392 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.477607 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.478554 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.478715 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.385234 15907 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:35.455693 15921 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:35.467502 13858 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:35.483670 13757 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:35.483844 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.484156 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.455833 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.478787 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:35.487897 13860 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 1.
I20260709 13:06:35.485759 14367 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:35.457973 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.489120 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.489822 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.489296 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.490939 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.493618 15931 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:35.487931 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.494447 13786 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:35.495319 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.495919 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:35.496649 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.496840 15917 consensus_queue.cc:1059] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:35.496680 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.498026 15905 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:35.497717 15923 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:35.498122 15917 raft_consensus.cc:3055] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:35.498467 15905 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:35.498642 15917 raft_consensus.cc:740] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:35.498975 15905 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.498556 15923 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:35.492515 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.501638 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.506310 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.498884 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.502950 14397 raft_consensus.cc:2393] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 5: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:35.509855 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.493738 15915 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:35.515815 15915 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:35.516213 15915 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.513034 14367 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:35.501973 15923 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.488173 15921 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.533057 15921 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:35.515348 15907 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:35.504117 14396 raft_consensus.cc:2393] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 2: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:35.518421 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.518488 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.525034 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.525267 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.525951 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.527120 15879 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:35.507479 15920 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:35.533735 15894 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:35.559465 15920 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:35.559541 15894 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:35.559990 15920 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.548852 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.559163 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.560848 13856 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:35.538763 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:35.563298 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 49125.4us
I20260709 13:06:35.499224 15900 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.551748 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.551894 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.552443 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.554828 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.556030 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.556092 15917 consensus_queue.cc:260] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.560045 15894 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.548375 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.633277 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.566004 13757 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:35.546568 15932 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.637681 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.711097 15885 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:35.711442 13785 raft_consensus.cc:1240] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:35.547024 15889 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.711622 15885 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:35.712152 15885 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.712242 14398 raft_consensus.cc:1240] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:35.713734 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.707185 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.715037 13782 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:06:35.715476 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.715956 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.716115 13785 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:35.717049 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.717593 13785 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 1.
I20260709 13:06:35.717623 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:35.717963 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 150273us
I20260709 13:06:35.640828 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.644119 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.645797 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.719066 13786 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:06:35.719508 13787 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:06:35.718736 13859 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 1.
W20260709 13:06:35.721678 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 155720us
I20260709 13:06:35.636358 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.673139 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.717671 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.703190 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.711444 13864 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 1.
I20260709 13:06:35.878633 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.838050 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.724247 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.838913 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.878080 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:35.827943 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 104131us
I20260709 13:06:35.720149 13788 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:06:35.899567 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.900674 13757 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:35.901115 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.901698 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.565320 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.896528 13865 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
W20260709 13:06:35.886869 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.712817 15932 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:35.906350 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.868517 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.543882 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.910136 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.630298 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:35.910375 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.911180 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.814909 15900 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:35.883606 15917 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.910317 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:35.848129 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.946097 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.938949 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.942293 15934 ts_tablet_manager.cc:933] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:35.942121 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.910452 15907 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.942860 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.957801 13786 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:06:35.943140 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.943792 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.958223 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.959344 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:35.960480 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.961203 13782 raft_consensus.cc:2393] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 4: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:35.961916 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.910856 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.946269 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.946830 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.947054 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.567745 15905 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:35.953112 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:35.953787 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.910631 15889 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:35.945267 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.964318 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.958256 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.707831 15915 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.653563 15920 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:35.954034 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.970286 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.970906 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.971135 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.971194 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.972148 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.992699 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.972990 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.974412 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.975485 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.728875 15923 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:35.976172 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 65924.3us
I20260709 13:06:35.993291 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:35.962986 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.966817 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:35.983773 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.972247 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:35.963505 15907 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:35.992012 13709 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:35.992527 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:36.000836 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:36.004673 13791 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:36.007076 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:36.007388 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:36.008986 15934 tablet_copy_client.cc:323] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.131:46015
I20260709 13:06:36.009616 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:36.007764 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:36.010368 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:36.013602 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:36.014510 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:36.014714 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:35.968591 15879 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.017266 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:36.015316 13788 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
W20260709 13:06:35.983600 15918 consensus_meta.cc:287] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.000s
I20260709 13:06:36.020285 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:36.020200 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:36.003454 15907 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.024801 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:36.025100 15905 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:36.026162 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:36.027724 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:36.027922 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:36.029263 13786 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:36.029784 15894 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.031971 15894 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:36.017513 15885 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.027077 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:36.036092 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:36.035853 15918 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:36.036535 15923 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:36.037392 13785 raft_consensus.cc:1240] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:36.037607 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:36.038193 15918 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:36.038491 13785 raft_consensus.cc:1240] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:36.039705 13789 raft_consensus.cc:2393] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 5: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:36.040381 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:36.042296 13790 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:36.043958 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 91354.4us
I20260709 13:06:36.035161 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:36.045578 15916 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:36.046011 15916 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:36.046085 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:36.046512 15916 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.023224 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:36.026094 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:36.048156 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:36.049863 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:36.059211 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:36.063746 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:36.063848 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:36.065505 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:36.080674 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:36.081169 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:36.083215 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:36.093986 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 56612us
I20260709 13:06:36.095214 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:36.095834 14401 raft_consensus.cc:1240] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.096429 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:36.097882 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:36.098286 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:36.099036 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:36.099670 13865 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:36.099937 13863 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:36.103705 15920 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:36.104628 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:36.107268 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:36.109354 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:36.111325 13713 consensus_queue.cc:237] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:36.112089 15915 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:36.114761 14368 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.114845 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
W20260709 13:06:36.119673 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 105991us
I20260709 13:06:36.125360 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:36.127496 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:36.125049 14398 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.099774 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:36.130250 14368 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.130685 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:36.134188 15894 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:36.134655 15894 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:36.135040 15894 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.136679 13756 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.137985 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:36.129886 15885 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:36.140540 14368 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.141682 15923 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:36.142110 15923 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:36.142498 15923 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.143123 13829 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.144505 13829 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.144570 15920 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:36.145047 15920 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:36.145228 15930 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:36.145447 15920 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:36.145678 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.145829 13829 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:36.145931 15930 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:36.146709 15921 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:36.146824 13829 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:36.147161 15921 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:36.146376 15930 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:36.147552 15921 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.147603 15941 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:36.148149 15941 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:36.148527 15941 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.149580 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:36.150116 15901 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:36.150484 15901 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:36.150849 15901 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.151037 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:36.151587 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:36.151973 14366 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.152621 15935 consensus_queue.cc:1059] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:36.147806 15930 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.153650 14366 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.153834 15942 raft_consensus.cc:3055] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:36.154244 15942 raft_consensus.cc:740] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:36.143016 14368 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.155169 14366 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.158490 13756 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.160640 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.182914 14366 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:36.156353 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:36.153692 15935 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:36.155593 15889 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:36.186029 14367 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.151176 15918 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.208245 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.188242 15902 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.185545 15915 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:36.220436 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 62008.6us
I20260709 13:06:36.130373 15907 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:36.190781 15889 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:36.190915 15935 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:36.204840 15886 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.241616 13756 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:06:36.242300 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.238358 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.239614 13755 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.237917 15889 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:36.250490 13786 raft_consensus.cc:1240] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.212191 15905 consensus_queue.cc:1059] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:06:36.257210 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 67342.3us
I20260709 13:06:36.237455 15935 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.258942 13829 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:36.259447 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.155230 15942 consensus_queue.cc:260] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.236379 15947 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:36.269819 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:06:36.271011 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 128059us
I20260709 13:06:36.250618 15932 consensus_queue.cc:1059] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:06:36.254326 15943 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:36.264827 15885 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:36.273569 13680 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.263522 15940 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.263536 15947 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:06:36.279241 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 96423.8us
I20260709 13:06:36.275833 13755 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.279762 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.274745 15901 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:36.274080 15943 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:36.277712 15900 raft_consensus.cc:3055] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:36.278394 15918 consensus_queue.cc:1059] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:06:36.282907 15950 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:36.298405 15895 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:36.283135 15947 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:36.303436 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 96270.3us
I20260709 13:06:36.284500 15929 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:36.312386 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 126493us
I20260709 13:06:36.297603 15900 raft_consensus.cc:740] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:36.326169 15941 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.327245 15900 consensus_queue.cc:260] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.328504 15941 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:36.329144 15941 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:36.329213 15900 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:36.329885 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 54097.6us
I20260709 13:06:36.330689 13755 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.332312 13755 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.296078 15940 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:36.296007 15943 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.340435 14366 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.297214 15950 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:36.294133 15948 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:36.309448 15949 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:36.355674 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 114178us
I20260709 13:06:36.340423 15942 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:36.358498 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 83926.7us
W20260709 13:06:36.357149 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 52322.7us
I20260709 13:06:36.342373 15885 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.352631 15929 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.341782 15927 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.354420 15948 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:36.352893 15950 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.358100 15907 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:36.356734 15932 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:36.385121 13756 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.356468 15951 raft_consensus.cc:3055] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:36.385452 14366 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.353130 15940 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.389004 13830 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:06:36.392104 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.397584 14368 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.401386 15954 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:36.406188 15889 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.406774 15894 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.409482 15894 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:36.411751 15940 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:36.412696 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:36.413094 15920 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.393522 15951 raft_consensus.cc:740] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:36.415993 15951 consensus_queue.cc:260] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.419008 13756 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.419864 15954 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.420320 13756 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.420639 15921 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:36.421188 15954 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:36.421581 13756 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.422403 15954 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.366822 15948 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.367121 15949 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:36.424176 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 60086us
I20260709 13:06:36.424892 13756 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.428840 15923 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.423230 15921 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:36.430984 15945 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:36.431923 15901 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:36.435963 13857 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:36.439023 13830 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:06:36.441161 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 182301us
I20260709 13:06:36.442685 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.393879 15957 raft_consensus.cc:3055] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:36.443662 15957 raft_consensus.cc:740] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:36.444604 15957 consensus_queue.cc:260] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.445722 15895 raft_consensus.cc:993] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03: : Instructing follower b9d194f45e044e0988d5de1a99e5cd02 to start an election
I20260709 13:06:36.445892 15957 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.447407 15895 raft_consensus.cc:1081] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Signalling peer b9d194f45e044e0988d5de1a99e5cd02 to start an election
I20260709 13:06:36.402954 15947 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.452962 15947 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:36.457427 15902 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:36.415215 15920 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:36.457237 15916 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.458153 15923 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:36.459506 15916 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:36.459167 15889 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:36.461453 15930 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.463058 15930 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:36.464745 15879 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.465462 13830 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.466665 13830 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.467087 15879 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.467607 15941 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:36.471946 15941 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:36.472447 15941 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.474738 13830 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.468044 15901 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:36.470614 15894 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:36.480727 15894 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:36.481119 15894 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:36.482632 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 57847.3us
I20260709 13:06:36.483400 13756 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.484572 15907 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:36.484680 13756 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:36.485213 15907 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:36.485777 13756 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.486244 15907 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:36.486629 15907 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:36.486958 15907 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.489872 15943 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.492070 15950 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.492739 15901 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.494105 15950 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:36.494851 15918 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:36.494045 13830 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.475332 15935 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:36.467754 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 70282.4us
I20260709 13:06:36.496107 13756 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.497148 15952 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:36.498626 15935 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:36.498891 14368 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:36.499682 15901 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:36.500114 14368 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:36.501914 14368 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.502806 15942 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:36.503155 15929 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.503253 15942 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:36.503911 15942 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.503999 13830 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.508001 15943 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:36.509311 15901 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:36.510105 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 230396us
I20260709 13:06:36.512251 15901 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:36.512674 15901 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:36.513034 15901 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:36.479930 15948 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:36.517066 15948 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:36.511129 15894 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.518018 14368 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.511598 15950 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.520318 13857 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:36.520923 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 78454.3us
I20260709 13:06:36.521306 15941 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.521838 13829 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:36.518759 13830 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.523154 15889 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.497195 13756 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.523924 15889 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:36.536082 13858 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:36.536514 13680 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.537117 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:36.537705 13756 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.520020 15901 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:36.540669 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 155327us
W20260709 13:06:36.538370 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 225162us
I20260709 13:06:36.541360 13830 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.538542 13829 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.543774 14368 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.545106 13756 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.546612 14396 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.547896 14398 raft_consensus.cc:1240] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:36.543649 15952 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:36.538878 15948 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:36.549117 14395 raft_consensus.cc:1240] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.549453 15948 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:36.550117 15949 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:36.550379 14393 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:36.550688 15949 raft_consensus.cc:697] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:36.551695 14400 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:36.551663 15949 consensus_queue.cc:237] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.553110 14397 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.554411 14401 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.523291 15941 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:36.539737 15957 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:36.557869 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 224159us
I20260709 13:06:36.558310 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:36.549870 15948 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:36.543478 15879 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.560225 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:36.560781 13756 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.575017 13756 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.561069 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:36.575987 13830 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.561295 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:36.561546 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:36.573011 13829 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.562001 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:36.578709 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:36.579363 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:36.584100 15915 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.591912 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:36.560984 15961 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:36.593003 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:36.565057 15951 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.596303 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:36.592621 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:36.563160 15952 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:36.560384 15943 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.597568 13716 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "536b1fc131984687bf3b13417507e21d"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:49488
I20260709 13:06:36.592154 13784 raft_consensus.cc:1240] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:36.598248 13716 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:36.598680 13716 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.566233 15942 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.594705 14366 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:36.593827 15927 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:36.600625 14366 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:36.592074 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:36.601385 15942 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:36.602001 15942 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:36.602119 14366 leader_election.cc:304] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:36.602625 15889 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.603272 15950 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:36.576808 15957 consensus_queue.cc:1059] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:06:36.592525 13682 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:36.604607 15957 raft_consensus.cc:3055] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.604969 15957 raft_consensus.cc:740] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:36.605398 13682 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:36.605787 15957 consensus_queue.cc:260] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.606530 15964 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:36.592725 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:36.590368 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:36.594333 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:36.609278 15901 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:36.606750 13682 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.610733 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.610922 15964 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:36.627681 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 43804.7us
I20260709 13:06:36.639235 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:36.639576 13875 tablet_copy_service.cc:140] P b5029654a4384e43a68eb67b794949b7: Received BeginTabletCopySession request for tablet f09ef105d67b41dba510b44a6567d790 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:42104)
I20260709 13:06:36.639752 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:36.640198 13875 tablet_copy_service.cc:161] P b5029654a4384e43a68eb67b794949b7: Beginning new tablet copy session on tablet f09ef105d67b41dba510b44a6567d790 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:42104: session id = ceb06175847b428ea8bd77055fcddf58-f09ef105d67b41dba510b44a6567d790
I20260709 13:06:36.640363 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:36.640625 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:36.641099 13791 raft_consensus.cc:2393] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 3: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:36.641865 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:36.642755 15943 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.581820 15905 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.643674 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:36.644600 13862 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:36.565244 15960 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.645287 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:36.631460 15916 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:36.646783 15916 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:36.644495 13863 raft_consensus.cc:1240] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:36.647199 15916 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:36.647552 15879 consensus_queue.cc:1059] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:36.631868 14366 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:36.633040 15957 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.583374 13755 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.610782 13682 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:36.635694 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:36.581434 15894 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:36.637697 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:36.644471 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:06:36.650497 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 67205.6us
I20260709 13:06:36.636327 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:36.646970 13715 raft_consensus.cc:1240] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:36.651703 13755 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.652949 15905 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.656503 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:36.657224 13790 raft_consensus.cc:2393] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 2: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:36.639778 15948 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:36.657903 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:06:36.659021 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 48317.5us
I20260709 13:06:36.592072 15917 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.659723 13682 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:36.660455 15947 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:36.660795 15947 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:36.661118 15947 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.632499 15965 consensus_queue.cc:1059] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:36.663646 15954 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:36.644496 13782 raft_consensus.cc:2393] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 5: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:36.668183 15964 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.649391 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:36.659715 15948 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:36.670295 15960 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.673070 14366 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.673918 15920 raft_consensus.cc:3055] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:36.674036 15965 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.674301 15920 raft_consensus.cc:740] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:36.673084 15966 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.648638 15879 raft_consensus.cc:3055] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:36.675614 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:36.675825 15879 raft_consensus.cc:740] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:36.675300 15920 consensus_queue.cc:260] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.676703 15879 consensus_queue.cc:260] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.677214 15920 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.677937 15879 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.678983 13875 tablet_copy_source_session.cc:215] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:36.681770 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:36.682348 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:36.683517 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:36.683548 13863 raft_consensus.cc:1240] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:36.691583 13682 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:06:36.691847 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 107544us
I20260709 13:06:36.693038 15943 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.694267 15964 consensus_queue.cc:1059] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:36.692759 13682 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:36.695281 15940 raft_consensus.cc:3055] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:36.695771 15956 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:36.695911 15940 raft_consensus.cc:740] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:36.696137 13682 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:36.696902 15964 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.662896 13716 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:36.697340 13682 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:36.698031 13755 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.699753 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:36.701671 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:36.701874 14397 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:36.696898 15940 consensus_queue.cc:260] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:36.702752 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:36.706573 13830 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.706754 13756 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.555642 15907 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:36.710201 13830 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.710484 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:36.711817 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:36.713574 15930 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.714265 15901 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.715873 15947 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:36.711196 15940 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.717336 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:06:36.719020 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 66347.7us
I20260709 13:06:36.722519 15942 consensus_queue.cc:1059] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:06:36.722965 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:36.724792 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:36.721984 14366 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.726912 14367 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.728354 15947 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:36.728092 15966 raft_consensus.cc:3055] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:36.728204 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:36.734048 15966 raft_consensus.cc:740] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:36.733454 15927 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.734863 15950 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:36.728221 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:36.735280 15920 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.728469 14368 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.739269 15942 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.741063 15894 consensus_queue.cc:1059] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:36.742199 15950 raft_consensus.cc:3055] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:36.742656 15950 raft_consensus.cc:740] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:36.743577 15950 consensus_queue.cc:260] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.727589 15943 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:36.746165 14368 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.747017 15965 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.750612 13829 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.751513 13785 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:36.752112 15960 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:36.753441 15907 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:36.753824 15966 consensus_queue.cc:260] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.755113 15966 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.727330 15951 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.756771 15965 consensus_queue.cc:1059] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:36.757565 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:36.757871 15965 raft_consensus.cc:3055] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:36.758268 15965 raft_consensus.cc:740] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:36.759850 15950 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:36.760311 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 63036.7us
I20260709 13:06:36.761453 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:36.761016 13682 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.746960 15916 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.763166 15943 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.765416 15916 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:36.703231 15929 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.759101 15965 consensus_queue.cc:260] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.769933 15965 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.768450 14393 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:36.772562 15963 consensus_queue.cc:1059] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:36.773610 15963 raft_consensus.cc:3055] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.730197 13716 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:36.773976 15963 raft_consensus.cc:740] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:36.730311 14366 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.776201 15894 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:36.777149 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 46882.2us
I20260709 13:06:36.776212 13786 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:06:36.778342 13682 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:06:36.778650 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 53115.1us
I20260709 13:06:36.781641 15929 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.782523 14401 raft_consensus.cc:1240] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.774935 15963 consensus_queue.cc:260] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.783653 15963 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.784548 15927 consensus_queue.cc:1059] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:36.785622 15907 raft_consensus.cc:3055] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:36.785964 15907 raft_consensus.cc:740] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:36.786793 15907 consensus_queue.cc:260] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.750697 13784 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:06:36.788997 13829 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:06:36.789707 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 60734.9us
I20260709 13:06:36.790834 13756 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.792116 15905 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.793648 13756 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.794045 15907 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.794489 14368 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.795644 14368 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.797044 15894 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.797632 15894 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.799386 14368 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.799991 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:36.804251 13829 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.805006 15961 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.805454 15879 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.807574 13682 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:36.808851 15943 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.826234 15934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09ef105d67b41dba510b44a6567d790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:36.811856 13829 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.823992 13682 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:36.813388 15894 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.836298 15943 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.825692 15905 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.826805 13610 catalog_manager.cc:5697] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 3 to 4, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 4 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:36.837129 15961 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:36.838371 13682 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.839442 15943 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.841298 15943 consensus_queue.cc:1059] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:36.842135 14366 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:36.842374 15916 raft_consensus.cc:3055] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:36.842829 15916 raft_consensus.cc:740] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:36.843551 15894 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.843765 15916 consensus_queue.cc:260] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:36.846767 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.847074 15917 consensus_queue.cc:1059] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:36.847533 15916 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.847616 15960 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:36.848078 15917 raft_consensus.cc:3055] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:36.848225 15960 raft_consensus.cc:697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:36.848474 15917 raft_consensus.cc:740] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:36.849254 15960 consensus_queue.cc:237] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.849362 15917 consensus_queue.cc:260] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:36.851127 15917 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.853801 14366 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.825371 14368 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.856115 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:36.857545 15920 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:36.858314 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.858378 15920 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.859447 13716 raft_consensus.cc:1240] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:36.859913 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:36.860517 15951 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:36.861069 15951 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.860555 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:36.862128 13860 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.863822 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:36.866036 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 168783us
I20260709 13:06:36.866710 13680 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:36.867841 15951 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:36.833007 14395 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:06:36.868803 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:36.869395 13860 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:36.872717 13755 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.874090 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:36.874846 15917 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:36.875479 15917 raft_consensus.cc:697] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 5 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:36.876484 15917 consensus_queue.cc:237] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.879943 13716 raft_consensus.cc:1240] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:36.880450 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:36.881909 13829 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:36.882125 15959 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.882948 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:36.883514 15963 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.880086 15879 consensus_queue.cc:1059] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:06:36.883014 15959 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:36.884631 15959 raft_consensus.cc:697] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:36.885561 15959 consensus_queue.cc:237] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.889092 13756 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:36.890161 13682 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:36.888447 15964 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:36.891572 15879 raft_consensus.cc:3055] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:36.892063 15879 raft_consensus.cc:740] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:36.887571 13611 catalog_manager.cc:5697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 3 to 4, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 4 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:36.893313 15879 consensus_queue.cc:260] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.888586 13680 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:36.900704 15929 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:36.896186 15905 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:36.896448 15964 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:36.896587 15943 consensus_queue.cc:1059] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:06:36.901247 15929 raft_consensus.cc:697] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:36.903261 15943 raft_consensus.cc:3055] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:36.903363 15962 consensus_queue.cc:1059] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:36.903944 15929 consensus_queue.cc:237] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:36.904851 15905 raft_consensus.cc:3055] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:36.901120 13860 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:36.905231 15905 raft_consensus.cc:740] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:36.906198 15905 consensus_queue.cc:260] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:36.903834 15943 raft_consensus.cc:740] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:36.895254 15879 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.913388 13680 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:36.914458 13680 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:36.915591 13680 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:36.916344 15947 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:36.916425 15940 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.919135 15964 consensus_queue.cc:1059] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:36.920114 15947 raft_consensus.cc:3055] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:36.920468 15947 raft_consensus.cc:740] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:36.920949 15905 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.921276 15947 consensus_queue.cc:260] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:36.922601 14393 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:36.924450 15943 consensus_queue.cc:260] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.922596 15947 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.925681 15943 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.911576 15961 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:36.931771 15961 raft_consensus.cc:697] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:36.932360 13755 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:36.932578 15961 consensus_queue.cc:237] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.933182 15927 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:36.933645 15927 raft_consensus.cc:697] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:36.935563 15927 consensus_queue.cc:237] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.939213 15964 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:36.937544 15940 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:36.942308 15940 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:36.915544 15963 consensus_queue.cc:1059] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:06:36.951648 13784 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:06:36.950852 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.951995 14401 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:36.958950 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:36.928872 15916 consensus_queue.cc:1059] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:06:36.967877 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:36.968856 13863 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 4: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:36.969161 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:36.969792 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:36.971916 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:36.976078 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:36.953604 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:36.988126 14400 raft_consensus.cc:1240] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:37.016327 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:37.018581 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:37.019881 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:37.027892 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:37.028267 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:36.969278 15940 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:36.954457 15956 consensus_queue.cc:1059] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 13:06:37.104971 14401 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
W20260709 13:06:37.127528 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 137845us
I20260709 13:06:37.127197 14396 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 5: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:37.148407 15956 raft_consensus.cc:3055] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.149020 15956 raft_consensus.cc:740] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:37.150221 15956 consensus_queue.cc:260] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:37.162083 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:37.173448 15971 log.cc:927] Time spent T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:06:37.195207 13716 raft_consensus.cc:1240] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:37.199673 15975 consensus_queue.cc:1059] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:37.199972 15940 consensus_queue.cc:1059] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:37.200953 15975 consensus_queue.cc:1059] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:37.201108 15947 consensus_queue.cc:1059] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:37.202081 15975 consensus_queue.cc:1059] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:37.202893 15929 consensus_queue.cc:1059] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:37.204104 15973 raft_consensus.cc:3055] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.204489 15973 raft_consensus.cc:740] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:37.205370 15973 consensus_queue.cc:260] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:37.206851 15973 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.207605 15978 raft_consensus.cc:3055] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:37.208031 15978 raft_consensus.cc:740] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:37.208680 15943 raft_consensus.cc:3055] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.209110 15943 raft_consensus.cc:740] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:37.208977 15978 consensus_queue.cc:260] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:37.210376 15978 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:37.210112 15943 consensus_queue.cc:260] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:37.211892 15916 raft_consensus.cc:3055] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.212397 15916 raft_consensus.cc:740] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:37.211826 15974 raft_consensus.cc:3055] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:37.213284 15916 consensus_queue.cc:260] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:37.213938 15974 raft_consensus.cc:740] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:37.202162 15947 consensus_queue.cc:1059] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:37.214973 15947 raft_consensus.cc:3055] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.214821 15974 consensus_queue.cc:260] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:37.215384 15947 raft_consensus.cc:740] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:37.216313 15974 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:37.216591 15947 consensus_queue.cc:260] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:37.218111 15947 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.219828 15975 raft_consensus.cc:3055] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:37.220304 15975 raft_consensus.cc:740] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:37.221187 15975 consensus_queue.cc:260] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:37.228993 13716 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:37.236202 13709 raft_consensus.cc:1240] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:37.244629 13791 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:37.235656 15950 consensus_queue.cc:1059] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
W20260709 13:06:37.249878 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 49800.7us
I20260709 13:06:37.257900 13858 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:06:37.253894 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 117983us
I20260709 13:06:37.224203 15943 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.256704 15975 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:37.277098 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:37.280400 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 90254.1us
I20260709 13:06:37.286898 14397 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:37.278211 15953 consensus_queue.cc:1059] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:06:37.288417 15953 raft_consensus.cc:3055] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:37.288782 15953 raft_consensus.cc:740] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:37.295986 13716 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:06:37.298413 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.301793 13680 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:37.271392 15965 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:06:37.304258 15927 consensus_queue.cc:1059] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:06:37.316568 15905 raft_consensus.cc:3055] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:37.317018 15905 raft_consensus.cc:740] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:37.317862 15905 consensus_queue.cc:260] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:37.320155 15941 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:37.298302 15953 consensus_queue.cc:260] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:37.331121 15953 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:37.335726 15952 raft_consensus.cc:3055] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:37.336128 15952 raft_consensus.cc:740] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:37.339154 15968 raft_consensus.cc:3055] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:37.339574 15968 raft_consensus.cc:740] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:37.340337 15968 consensus_queue.cc:260] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:37.341488 15968 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:37.345257 15956 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.352892 13716 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:37.353627 15905 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:37.303659 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:37.309024 15934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:56558 (request call id 535) took 1896 ms. Trace:
I20260709 13:06:37.302138 15947 consensus_queue.cc:1059] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:06:37.302870 15979 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:37.365057 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 61480.6us
I20260709 13:06:37.367576 15974 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:37.370301 15889 raft_consensus.cc:3055] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:37.370711 15889 raft_consensus.cc:740] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:37.370767 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:37.370357 15974 raft_consensus.cc:697] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:37.371676 15889 consensus_queue.cc:260] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:37.372896 15889 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:37.376587 15916 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.372757 15974 consensus_queue.cc:237] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:37.387370 13791 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:37.338459 15952 consensus_queue.cc:260] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:37.389020 15907 consensus_queue.cc:1175] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b5029654a4384e43a68eb67b794949b7" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:06:37.360276 15934 rpcz_store.cc:276] 0709 13:06:35.413005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.416699 (+  3694us) service_pool.cc:224] Handling call
0709 13:06:35.957654 (+540955us) ts_tablet_manager.cc:934] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
0709 13:06:36.824906 (+867252us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:37.128142 (+303236us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:37.132711 (+  4569us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:37.308137 (+175426us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:37.308490 (+   353us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:37.308844 (+   354us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:37.308908 (+    64us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":283,"tablet-copy.queue_time_us":349684,"thread_start_us":60007,"threads_started":2}
I20260709 13:06:37.396788 15934 tablet_copy_client.cc:806] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:37.397466 15934 tablet_copy_client.cc:670] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
W20260709 13:06:37.365406 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 102435us
I20260709 13:06:37.400389 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:37.403937 15961 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:06:37.408927 15952 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:37.409394 15968 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:37.414542 15934 tablet_copy_client.cc:538] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:37.415650 13790 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:37.417596 15986 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:37.398566 15975 raft_consensus.cc:3055] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:37.419612 13680 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:37.421497 14397 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:37.421725 14393 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:37.424989 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:37.437750 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:37.440608 15947 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:37.423705 15975 raft_consensus.cc:740] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:37.428023 15968 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:37.443554 15974 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:37.481698 13863 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:37.482765 13680 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:37.488036 13791 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:37.491145 13790 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:37.491145 15929 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:37.505278 14401 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:37.506361 15879 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:37.513561 14401 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:37.520952 13614 catalog_manager.cc:5697] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 4 to 5, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 5 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:37.527948 13858 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:37.528118 13790 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:37.530010 15954 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:37.527832 15968 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:37.547631 15948 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:37.548199 14397 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:37.511787 15923 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:06:37.562443 13782 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:37.564690 15934 tablet_bootstrap.cc:492] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
W20260709 13:06:37.572937 15992 log.cc:927] Time spent T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:06:37.532786 15975 consensus_queue.cc:260] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:37.586318 15989 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:06:37.575372 15968 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:06:37.593883 15959 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:06:37.638049 14393 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:37.704813 14395 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:06:37.743984 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.746080 15952 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:37.770823 15975 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:37.795570 13610 catalog_manager.cc:5697] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 2 to 3, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 3 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:37.804199 13610 catalog_manager.cc:5697] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 4 to 5, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 5 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:37.809676 15986 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:06:37.801549 14393 raft_consensus.cc:1275] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:37.876386 13785 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:37.880841 13614 catalog_manager.cc:5697] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 2 to 3, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 3 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:37.852022 15975 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:06:37.922333 13611 catalog_manager.cc:5697] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 5 to 6, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 6 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:37.929512 13611 catalog_manager.cc:5697] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 4 to 5, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 5 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:06:37.943958 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 98463us
I20260709 13:06:37.948351 13785 raft_consensus.cc:1275] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:37.950941 15975 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:06:37.981699 15975 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.982889 15949 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.983068 15975 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:37.983464 15949 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:37.985510 15975 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:37.985764 15949 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:37.987018 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:37.987584 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:37.988183 13791 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:37.988358 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:37.988986 13790 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:37.989636 14366 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:37.990552 13680 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:37.991397 15975 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:37.993947 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:37.994582 13863 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:37.993033 15975 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.997882 15975 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:37.994753 15949 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:38.005730 15949 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.006177 15949 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:38.040468 15934 tablet_bootstrap.cc:492] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:38.047749 15941 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.049494 15941 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.051744 15941 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:38.055848 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:38.060421 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:38.061622 13790 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:38.067405 14366 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:38.068557 15918 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.070071 15918 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.072295 15918 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:38.073748 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:38.074411 14393 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:38.075891 13755 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:38.079599 15982 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:38.080009 15982 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.080343 15982 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:38.081183 15975 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:38.082263 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:38.082878 13709 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:38.082978 15975 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:38.083781 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:38.084457 13790 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:38.085732 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:38.086295 13863 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:38.070465 15935 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:38.094599 15935 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.094973 15935 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.095036 13790 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:06:38.096486 13680 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:38.097280 15968 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:38.097581 15934 tablet_bootstrap.cc:492] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:06:38.097739 15968 raft_consensus.cc:697] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:38.098412 15934 ts_tablet_manager.cc:1403] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.534s	user 0.033s	sys 0.019s
I20260709 13:06:38.098627 15968 consensus_queue.cc:237] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:38.094162 15956 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.100242 15956 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.102342 15956 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:38.099718 15947 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:38.104013 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:38.102998 15947 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.105548 15941 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.106058 15941 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.107277 15947 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:38.108127 15941 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:38.108616 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:38.109288 13709 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:38.109468 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:38.108556 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:38.110124 13790 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:38.110257 14367 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:38.110885 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:38.111152 15941 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:38.111696 15941 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.112392 15941 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:38.119446 15949 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.104604 13785 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:06:38.121615 15949 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:38.122198 15918 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.122747 15918 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.123899 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:38.124727 13680 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:38.125201 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:38.126955 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:38.128659 13791 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:38.128175 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:38.130482 13785 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:38.130664 15947 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:38.130705 15975 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:38.131250 15947 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.131606 15975 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:38.131677 15947 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:38.132158 15975 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.136652 15952 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:38.137234 15952 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:38.139739 15952 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:38.126091 13863 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:06:38.140940 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:38.141705 13858 raft_consensus.cc:2393] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 4: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:38.141671 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:38.142477 13709 raft_consensus.cc:2410] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:38.135272 13791 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:38.118906 15982 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.144577 14366 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:38.146346 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:38.148070 13756 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:38.148109 15930 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:38.148773 15930 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.150785 15930 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:38.151775 15966 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.152328 15966 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.153518 15952 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:38.153337 15935 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.153739 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:38.154502 13785 raft_consensus.cc:2368] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 3. Current term is 4.
I20260709 13:06:38.154506 14395 raft_consensus.cc:2368] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 2. Current term is 3.
I20260709 13:06:38.156397 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:38.156991 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:38.145593 15941 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.157274 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:38.159536 13709 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:38.157533 13785 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.158685 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:38.164084 13829 leader_election.cc:400] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 3. Current term is 4.
I20260709 13:06:38.164454 13829 leader_election.cc:403] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:38.168198 13680 leader_election.cc:400] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 2. Current term is 3.
I20260709 13:06:38.154605 15949 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:38.175884 15918 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:38.176427 14393 raft_consensus.cc:2393] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 5: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:38.176507 15949 raft_consensus.cc:697] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:38.177016 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:38.177690 14395 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:38.177599 15949 consensus_queue.cc:237] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.178563 14367 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:38.179044 13755 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:38.179942 15953 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:38.180593 15953 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.181021 15953 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.181417 15918 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:38.181800 15918 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.182134 15918 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.172119 15948 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:38.188958 15941 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:38.189195 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:38.189651 15934 raft_consensus.cc:359] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:38.189772 15918 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.190557 15934 raft_consensus.cc:740] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:06:38.191231 15934 consensus_queue.cc:260] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:38.193315 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:38.193914 14395 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.194921 15982 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:38.196404 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:38.197027 13789 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:38.199277 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:38.199761 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:38.199914 14396 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:38.200335 13713 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:38.204174 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 55307.3us
I20260709 13:06:38.206573 15953 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.207685 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:38.208683 15953 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:38.214588 14395 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:38.215629 13755 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:38.216210 14396 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:06:38.217285 13755 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:38.218003 15905 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:38.218284 13713 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:06:38.218524 15905 raft_consensus.cc:697] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:38.219561 15954 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:38.219504 15905 consensus_queue.cc:237] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.220093 15954 raft_consensus.cc:697] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:38.220891 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:38.220920 15954 consensus_queue.cc:237] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.222668 15989 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:38.221549 13708 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.223181 15989 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.225199 15989 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:38.153337 15947 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.225561 13789 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:06:38.226516 13709 raft_consensus.cc:2393] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 5: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:38.214990 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:38.199687 15966 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:38.228605 15918 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:38.230731 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:38.231814 13785 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:38.232189 15975 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.233139 13716 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.232916 14366 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:38.193955 15934 ts_tablet_manager.cc:1434] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.000s
I20260709 13:06:38.240394 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:38.240962 13708 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:38.230247 15947 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:38.159404 15935 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:38.236382 14366 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:06:38.280118 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 43834.8us
I20260709 13:06:38.238019 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:38.228871 13791 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:38.268500 15948 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 3. Current term is 4.
I20260709 13:06:38.187081 15952 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:38.264863 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:38.266425 15975 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:38.267755 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:38.278900 13789 raft_consensus.cc:2393] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 5: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:38.269188 16016 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.300285 16016 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:38.302702 16016 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:38.303336 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:38.303963 13708 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:38.281853 15966 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:38.305277 15966 raft_consensus.cc:697] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:38.307649 13875 tablet_copy_service.cc:342] P b5029654a4384e43a68eb67b794949b7: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-f09ef105d67b41dba510b44a6567d790 received from {username='slave'} at 127.0.0.1:42104
I20260709 13:06:38.308003 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:38.308164 13875 tablet_copy_service.cc:434] P b5029654a4384e43a68eb67b794949b7: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-f09ef105d67b41dba510b44a6567d790 on tablet f09ef105d67b41dba510b44a6567d790 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:38.308307 15935 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.308621 13791 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:06:38.308867 15935 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.311276 13829 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:38.312529 15989 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:38.312906 15989 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.313235 15989 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:38.296970 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:38.292022 15953 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:38.315974 15966 consensus_queue.cc:237] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.263667 15956 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.299364 13787 raft_consensus.cc:2368] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 2. Current term is 3.
W20260709 13:06:38.277431 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 49112.8us
I20260709 13:06:38.318854 14367 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:38.296142 15943 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:38.319823 15941 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:38.319933 15943 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.320497 15941 raft_consensus.cc:697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 3 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:38.322113 15943 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:38.316740 15953 raft_consensus.cc:697] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:38.323511 15953 consensus_queue.cc:237] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.324278 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:38.325644 14397 raft_consensus.cc:2393] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 4: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:38.323529 13680 leader_election.cc:400] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 2. Current term is 3.
I20260709 13:06:38.327265 13680 leader_election.cc:403] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:38.326844 15956 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:38.327873 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:38.328481 13860 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:06:38.330379 15961 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.331954 13682 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:38.331945 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:38.333596 13787 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:06:38.334270 15930 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.323477 13611 catalog_manager.cc:5697] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:38.334625 13680 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:38.334744 15930 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:38.335578 15968 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:38.336011 15968 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:38.336397 15968 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:38.336812 15930 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:38.339707 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:38.340771 15920 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.330869 15961 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:38.341310 15920 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.343035 15961 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:38.290679 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:38.343256 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:38.343590 13860 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:06:38.343886 13709 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:38.345309 14395 raft_consensus.cc:2368] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3.
I20260709 13:06:38.345945 13830 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:38.346925 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:38.346927 15941 consensus_queue.cc:237] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.348472 15943 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:38.351229 15943 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.351645 15943 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:38.351964 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:38.352553 13787 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:38.353485 15986 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:38.353937 15986 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.354301 15986 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.363652 13829 leader_election.cc:400] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3.
I20260709 13:06:38.364038 13829 leader_election.cc:403] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:38.286109 13716 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:38.367271 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:38.368005 13787 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:06:38.369067 15949 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.382417 13829 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:38.388731 15920 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:38.370850 15956 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:38.388749 15986 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:38.380491 15947 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.389917 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:38.396669 13863 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:06:38.380244 15949 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.398038 14368 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:38.394556 15960 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:38.380489 15961 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.398119 15947 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:38.406713 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:38.407295 13711 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:38.408641 15947 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:38.371521 15975 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 2. Current term is 3.
I20260709 13:06:38.405989 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:38.395453 16016 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:38.415655 13713 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:38.416421 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:38.417902 13611 catalog_manager.cc:5697] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:38.420334 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:38.423305 13863 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:38.422672 13787 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:38.424989 13682 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:38.425447 14367 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:38.426522 13611 catalog_manager.cc:5697] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:38.402370 15960 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.431370 15953 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:38.431819 15953 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.432190 15953 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.433769 15947 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:38.434409 15947 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.434796 15947 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:38.439587 15953 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.441782 15953 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:38.443953 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:38.450947 15961 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3.
I20260709 13:06:38.454996 15947 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:38.421259 15920 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:38.469493 15920 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.469977 15920 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:38.462713 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 60945.4us
I20260709 13:06:38.472468 15930 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:38.472795 15989 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:38.473191 15930 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.475055 15989 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:38.424252 16016 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.443840 15960 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:38.444092 15968 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.479344 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:38.496551 13787 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:38.497097 15968 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:38.498050 15941 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.498714 15941 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.481426 15930 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:38.485914 15935 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:38.501250 15935 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.501322 15986 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:38.501729 15935 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.502326 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:38.502888 13785 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.503212 16016 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:38.487669 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:38.505786 13789 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:38.506124 13863 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.507732 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:38.488452 15943 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:38.511081 15943 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:38.511715 13709 raft_consensus.cc:2393] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 5: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:38.514375 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:38.515172 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:38.516098 14398 raft_consensus.cc:2368] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3.
I20260709 13:06:38.516917 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:38.517464 13791 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:38.518155 15960 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:38.519876 15935 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:38.527056 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:38.528508 13680 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:38.531801 13787 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:06:38.533427 13829 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:38.534014 13789 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:06:38.535166 13680 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:38.535053 16016 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:38.536351 15968 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:38.537092 15968 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:38.536563 16016 raft_consensus.cc:697] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 5 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:38.485445 15966 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.490566 15947 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:38.491910 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:38.542573 13829 leader_election.cc:400] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3.
I20260709 13:06:38.511709 13785 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:38.553017 13829 leader_election.cc:403] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:38.553114 14397 raft_consensus.cc:2393] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 5: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:06:38.552423 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 127040us
I20260709 13:06:38.537909 15968 raft_consensus.cc:697] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:38.554908 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:38.554647 15968 consensus_queue.cc:237] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:38.554323 15966 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.555524 13709 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.539348 13791 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:38.539623 13863 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:38.559324 14401 raft_consensus.cc:2393] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 4: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:38.559363 13680 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:38.555714 13829 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:38.560901 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:38.561573 13716 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:38.534173 15920 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.569046 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:38.569474 14368 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:38.569691 13716 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:38.564857 15986 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:38.571597 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:38.572005 15986 raft_consensus.cc:697] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:38.572193 13716 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:38.572918 15986 consensus_queue.cc:237] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:38.562675 15989 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3.
I20260709 13:06:38.564909 15943 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:38.562879 15953 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.581142 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:38.583271 13708 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.584128 15941 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:38.581576 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:38.612490 13713 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:06:38.585768 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:38.613351 13716 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:38.581465 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:38.587519 15943 raft_consensus.cc:697] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:38.588304 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:38.590993 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:38.592125 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:38.595674 13708 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:38.636982 13864 raft_consensus.cc:2393] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 5: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:38.637183 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:38.637732 13863 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:38.596653 13709 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:38.587555 15949 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:38.595579 15953 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.598416 15920 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:38.599699 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:38.611243 15935 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:38.608247 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:38.609056 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:38.607191 13611 catalog_manager.cc:5697] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:38.609719 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:38.621861 13830 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:38.610540 15966 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:38.596903 16016 consensus_queue.cc:237] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:38.649220 13858 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:06:38.602882 16033 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.653257 13860 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:38.656028 13862 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:38.664568 15930 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:38.665567 15930 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:38.665175 15943 consensus_queue.cc:237] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:38.665997 15930 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:38.668488 14368 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:38.669309 16028 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:38.669674 16028 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.669734 15953 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:38.670045 16028 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:38.670593 13860 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:38.659976 15961 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:38.672026 15905 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:38.672608 15961 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.674188 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:38.674331 16033 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.676031 15989 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:38.676319 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:38.676534 15989 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.677029 14401 raft_consensus.cc:2393] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 2: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:38.674644 13791 raft_consensus.cc:1275] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:38.678032 16033 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:38.659541 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:38.678546 15989 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:38.679287 15968 consensus_queue.cc:1048] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:38.662600 15935 raft_consensus.cc:697] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:38.657088 14367 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:38.680919 15935 consensus_queue.cc:237] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.681610 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:38.681896 14367 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:38.682317 14401 raft_consensus.cc:2393] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 2: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:38.682955 15920 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.683450 15920 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.684574 15960 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:38.684989 15953 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:38.685364 15949 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:38.685491 15920 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:38.687556 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:38.687817 15920 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.663277 13682 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:38.688316 15920 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.689608 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:38.690728 15975 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:38.690888 15949 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.691146 15920 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:38.691560 15975 raft_consensus.cc:697] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:38.689983 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:38.692912 15975 consensus_queue.cc:237] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.691936 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:38.695377 15947 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.689368 13862 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:06:38.696142 15947 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.660485 13863 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:06:38.701627 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:38.682983 14367 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:38.721683 13858 raft_consensus.cc:1275] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:38.691604 15949 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:38.724210 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:38.724817 13707 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:06:38.725638 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:38.725946 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:38.726238 13713 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:06:38.726575 13712 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:06:38.685580 15941 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.686941 14401 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:38.688323 13787 raft_consensus.cc:2393] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 5: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:38.699860 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:38.657895 13716 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:06:38.730189 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:38.730311 14367 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:38.730811 13707 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:38.732208 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:38.732779 13716 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:06:38.735493 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:38.736099 13707 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:38.674696 15961 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:38.712592 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:38.737092 13709 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:38.700809 14368 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:38.713598 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:38.738292 13708 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:38.685376 15953 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.738999 15953 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.698904 15947 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:38.744657 15947 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.745136 15947 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.747896 13858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:06:38.748909 13858 raft_consensus.cc:606] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Received request to transfer leadership to TS ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:38.748041 15947 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:38.752210 15961 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:38.756242 15961 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.752350 15953 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.763221 13829 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:06:38.764272 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 63540.7us
I20260709 13:06:38.765607 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:38.766729 14401 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:38.774300 13713 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:06:38.776281 13680 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:06:38.777738 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 47513.7us
I20260709 13:06:38.766358 15918 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:38.767388 15920 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:38.764015 14395 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:06:38.778744 16029 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:38.764421 16025 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:06:38.802167 16036 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:38.828163 16036 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.828622 16036 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:38.809844 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:38.802352 15918 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.818866 13858 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:38.763688 15956 consensus_queue.cc:1048] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:06:38.844298 15968 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:38.877154 15968 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.877636 15968 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.721338 16028 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.764099 15941 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.901116 14367 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:38.881404 15943 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.801261 16031 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:38.911072 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:38.816599 15961 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:38.912312 13713 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:38.915643 13711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:06:38.819913 16029 raft_consensus.cc:697] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:38.803260 15920 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.807776 15952 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:38.919574 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 85045.4us
I20260709 13:06:38.827368 15930 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.945246 15956 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:38.935528 15920 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:38.917395 15943 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:38.959721 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 58701.9us
I20260709 13:06:38.960651 14367 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:38.962016 14367 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:38.945230 15930 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:38.940344 15952 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:38.945228 15941 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:38.947757 15956 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.999713 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:06:38.980674 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 170921us
W20260709 13:06:38.954082 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 110495us
I20260709 13:06:38.993477 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:38.994324 16029 consensus_queue.cc:237] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:38.995606 16031 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:38.955248 16025 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.005635 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:39.010221 13711 raft_consensus.cc:606] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:06:39.017655 14401 raft_consensus.cc:2368] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 5. Current term is 6.
I20260709 13:06:39.017452 13711 raft_consensus.cc:614] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:39.018486 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 56569.6us
I20260709 13:06:39.028306 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:39.028561 13830 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:39.028975 13860 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:06:38.968744 16034 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:06:39.018918 16031 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:39.008342 15956 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:39.015163 15941 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.032800 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:39.038594 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:39.046838 13710 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:39.047147 13708 raft_consensus.cc:2393] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 3: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:39.046838 13860 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.038916 13713 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:06:39.040805 13829 leader_election.cc:400] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 5. Current term is 6.
I20260709 13:06:39.041348 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:39.049533 13829 leader_election.cc:403] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:06:39.049997 13787 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:39.041815 13830 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:39.016443 16045 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:39.024567 16046 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:39.030323 16053 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.026295 15954 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:39.035044 15953 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:39.073406 13860 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:39.057459 16047 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:06:39.106271 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 64227.1us
I20260709 13:06:39.065529 16045 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.060061 16055 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:39.114565 14366 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:39.020717 16025 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:39.121987 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 79037.9us
I20260709 13:06:39.102882 16028 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:39.104806 16044 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:39.059799 15941 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:39.122970 15901 raft_consensus.cc:2764] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:06:39.125737 16055 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:39.168480 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 126775us
I20260709 13:06:39.122547 16045 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:39.076476 16046 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:39.173496 16039 log.cc:927] Time spent T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.228s	user 0.005s	sys 0.000s
W20260709 13:06:39.173978 16040 log.cc:927] Time spent T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 13:06:39.176131 16031 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:39.104597 15954 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:39.179862 16034 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:39.180382 15941 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:39.169663 13830 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:39.160619 16044 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.164395 15959 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:39.103380 16053 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:39.166594 15961 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.192955 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:39.207547 13787 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:39.178570 16055 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:39.188338 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 147802us
I20260709 13:06:39.174957 16036 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:39.122709 16047 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:39.189648 16034 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.213291 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:39.198840 14368 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:39.200518 16051 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.244155 13862 raft_consensus.cc:1275] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:39.227815 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:39.262390 13856 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:06:39.198109 16044 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.264580 13857 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:06:39.284472 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 259596us
W20260709 13:06:39.405432 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 193986us
I20260709 13:06:39.209667 15961 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:39.216035 16034 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:39.465212 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 183461us
I20260709 13:06:39.243788 15918 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:39.215051 15943 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:39.242022 16052 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:39.220996 15930 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:39.209084 16056 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.303s
I20260709 13:06:39.338976 16051 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:39.467351 15961 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.515071 13682 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:39.695732 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:39.704720 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 189711us
I20260709 13:06:39.708889 13708 raft_consensus.cc:1275] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:06:39.551723 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 493961us
I20260709 13:06:39.700007 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:39.711733 13715 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.689862 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:39.714983 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:39.715659 13708 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:06:39.728628 13711 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:39.730777 13713 raft_consensus.cc:2393] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 2: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:06:39.561535 15935 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.006s	sys 0.005s
W20260709 13:06:39.724807 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 217447us
I20260709 13:06:39.506546 15952 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:39.554595 16052 raft_consensus.cc:697] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:39.688534 16066 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.736680 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:39.751847 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 46422.5us
I20260709 13:06:39.737552 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:39.752228 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:39.752525 13708 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:39.699117 15930 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:39.744454 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:39.748553 14401 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:39.656577 16025 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:39.750834 14367 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:39.751348 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:39.753183 13707 raft_consensus.cc:2393] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 8: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:39.754315 13709 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:39.758569 13712 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:39.734601 15935 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.010s	sys 0.011s
I20260709 13:06:39.716137 15943 consensus_queue.cc:1048] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:06:39.760843 15930 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.761497 15954 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:39.754978 16081 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:39.796008 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:39.797071 13785 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:06:39.798684 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:39.799436 14402 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
W20260709 13:06:39.799590 16073 log.cc:927] Time spent T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:06:39.782850 16070 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:39.753508 16079 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:06:39.818125 16070 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:39.796032 16081 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.819881 16081 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:39.814013 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:39.815513 16052 consensus_queue.cc:237] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:39.817469 16087 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:39.823931 13715 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:39.767879 16029 consensus_queue.cc:1048] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:06:39.835561 13712 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:06:39.832412 13755 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:39.799978 16025 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:39.781702 16062 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:06:39.807936 16060 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:39.760558 16066 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:39.835259 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:39.845319 16086 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:39.848299 16050 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:39.848987 15968 consensus_meta.cc:287] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.970s	user 0.007s	sys 0.003s
I20260709 13:06:39.849190 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:39.874754 13714 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:39.849839 16055 consensus_meta.cc:287] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.000s
I20260709 13:06:39.851769 15930 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:39.835279 15920 consensus_meta.cc:287] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.856s	user 0.012s	sys 0.000s
I20260709 13:06:39.858002 16051 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:39.861373 16037 log.cc:927] Time spent T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.918s	user 0.007s	sys 0.003s
W20260709 13:06:39.872347 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 99383.2us
I20260709 13:06:39.872920 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:39.873554 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:39.875226 14367 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:39.885892 13864 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:06:39.886934 13682 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:39.828799 15954 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:06:39.882431 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:39.883687 13710 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:39.838354 16047 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:39.875317 16050 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.908844 13757 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:39.880085 16053 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:39.973907 16070 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:39.953313 16050 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:39.878799 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 464014us
I20260709 13:06:39.908924 13712 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:39.868552 16025 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:40.000665 13756 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:39.884091 15920 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:39.885618 15968 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:39.962124 15901 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:39.984913 16056 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:39.981691 16047 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:39.972707 15943 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:39.885293 16055 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:40.021870 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:39.985558 16061 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:39.875767 16060 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:40.017900 16076 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:40.019335 15920 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:40.022631 13715 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:39.932725 16034 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:40.001529 15957 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:06:40.058238 15956 consensus_meta.cc:287] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.994s	user 0.009s	sys 0.002s
I20260709 13:06:40.070468 14393 raft_consensus.cc:2368] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 8. Current term is 9.
I20260709 13:06:40.017445 16052 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:40.023334 15943 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.057135 16086 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:40.076383 14395 raft_consensus.cc:2368] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 3. Current term is 4.
W20260709 13:06:40.069026 15949 consensus_meta.cc:287] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 1.294s	user 0.013s	sys 0.000s
W20260709 13:06:40.071197 16045 consensus_meta.cc:287] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.885s	user 0.009s	sys 0.003s
I20260709 13:06:40.016801 15901 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:40.032858 16047 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:40.023460 16056 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:40.070899 15956 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:40.061156 16061 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:40.467818 13711 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.009s	sys 0.000s
W20260709 13:06:40.726322 13711 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.015s	sys 0.008s
W20260709 13:06:40.708375 13714 consensus_meta.cc:287] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.827s	user 0.010s	sys 0.000s
I20260709 13:06:40.727270 13714 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
W20260709 13:06:40.600100 13757 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.018s	sys 0.015s
I20260709 13:06:40.235972 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:06:40.704854 13755 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.009s	sys 0.012s
W20260709 13:06:40.750213 13755 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.011s	sys 0.012s
W20260709 13:06:40.728286 13757 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.021s	sys 0.019s
W20260709 13:06:40.752637 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 843826us
I20260709 13:06:40.753857 16108 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.729136 13861 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:40.460606 16095 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:40.761396 16106 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:40.762151 16106 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:40.371676 16029 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.410390 13715 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
W20260709 13:06:40.764448 13756 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.010s	sys 0.012s
I20260709 13:06:40.765000 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58552 (request call id 447) took 1027 ms. Trace:
W20260709 13:06:40.764971 13756 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.010s	sys 0.012s
I20260709 13:06:40.765443 13714 rpcz_store.cc:276] 0709 13:06:39.700961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.848916 (+147955us) service_pool.cc:224] Handling call
0709 13:06:40.728061 (+879145us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:40.809784 13709 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.001s	sys 0.004s
W20260709 13:06:40.810376 13709 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.001s	sys 0.004s
I20260709 13:06:40.830312 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:40.831177 13711 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:40.105662 15943 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.239773 16042 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:40.843066 16060 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:40.080876 15957 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:40.798877 15975 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.821s	user 0.027s	sys 0.032s
I20260709 13:06:40.120790 15954 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.718578 16102 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.459936 16077 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:40.876253 13712 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.003s	sys 0.005s
W20260709 13:06:40.902465 13712 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.003s	sys 0.005s
I20260709 13:06:40.460426 16080 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:40.461112 16070 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:40.878082 13716 raft_consensus.cc:2368] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5.
W20260709 13:06:40.517117 15959 consensus_meta.cc:287] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 1.314s	user 0.010s	sys 0.001s
I20260709 13:06:40.754387 16108 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:40.833729 13865 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.007s	sys 0.000s
I20260709 13:06:40.721418 16104 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:40.750587 16066 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:40.766208 15986 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:40.722438 16074 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:40.562539 16105 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:40.600091 15905 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:40.465989 15941 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:40.817437 16055 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:40.909700 16042 raft_consensus.cc:697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:40.762106 16095 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:40.898507 15975 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.952s	user 0.027s	sys 0.033s
I20260709 13:06:40.902281 16060 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:40.142454 16086 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:40.764145 16045 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:40.068807 16076 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:40.069624 15982 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:40.772394 16029 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:40.902745 15954 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:40.912890 13861 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
W20260709 13:06:41.036593 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 241847us
I20260709 13:06:41.044483 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:41.045332 13861 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:40.991645 16109 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:40.919113 15959 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 5. Current term is 6.
I20260709 13:06:40.982271 15989 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.046077 16109 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:41.046768 13757 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:41.047003 15989 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:41.048273 14368 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:40.539604 16069 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:40.539891 16088 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:41.017268 16055 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:06:41.017972 14367 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.029s	sys 0.043s
I20260709 13:06:40.976234 16034 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:40.106638 16052 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:40.941056 16070 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:40.975929 15953 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:40.919713 16080 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:40.940675 16077 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:40.961855 16066 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:40.970695 16074 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:40.984531 16025 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:40.988484 15968 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:41.037002 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2401) took 1158 ms. Trace:
I20260709 13:06:40.962841 15949 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:41.040830 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:40.917402 16102 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:40.993376 15930 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:40.966323 13755 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.132:43039 timed out after 1.791s (SENT) [suppressed 11 similar messages]
I20260709 13:06:40.911655 15920 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:40.974465 15986 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:40.978264 15905 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:40.984970 15941 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:40.995342 16060 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:40.956144 16104 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:40.976624 16105 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:41.048974 16069 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:41.216768 13785 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:06:41.295636 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 248953us
I20260709 13:06:41.035323 15975 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.786522 13790 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
W20260709 13:06:41.787540 14367 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.272s	user 0.039s	sys 0.080s
I20260709 13:06:41.788421 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:41.792320 13788 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:06:41.545397 14399 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEARNER]: Advancing to term 5
W20260709 13:06:41.799258 13711 consensus_meta.cc:287] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.967s	user 0.009s	sys 0.000s
I20260709 13:06:41.804998 13711 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
W20260709 13:06:41.805766 13711 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58552 (request call id 461) took 1338 ms (client timeout 1781 ms). Trace:
W20260709 13:06:41.709793 13710 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58552 (request call id 445) took 2146 ms (client timeout 1567 ms). Trace:
W20260709 13:06:41.879865 13711 rpcz_store.cc:269] 0709 13:06:40.467082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.829955 (+362873us) service_pool.cc:224] Handling call
0709 13:06:41.805687 (+975732us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:41.879980 13710 rpcz_store.cc:269] 0709 13:06:39.548391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.689196 (+140805us) service_pool.cc:224] Handling call
0709 13:06:41.694575 (+2005379us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54002e8bd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:41.694723 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":411086720}
I20260709 13:06:41.049177 16028 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:41.049515 15954 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:41.784564 16081 consensus_meta.cc:287] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 1.964s	user 0.011s	sys 0.001s
I20260709 13:06:41.898491 15968 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:41.900940 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:06:41.693248 16112 log.cc:927] Time spent T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.656s	user 0.000s	sys 0.000s
W20260709 13:06:41.773334 15961 consensus_meta.cc:287] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 2.054s	user 0.012s	sys 0.001s
I20260709 13:06:41.785799 15957 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:41.793025 13865 rpcz_store.cc:276] 0709 13:06:39.871707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.871841 (+   134us) service_pool.cc:224] Handling call
0709 13:06:39.883296 (+ 11455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.883523 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:40.235185 (+351662us) log.cc:844] Serialized 14 byte log entry
0709 13:06:41.029714 (+794529us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.029785 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:41.029850 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.029938 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.030097 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26702,"prepare.queue_time_us":867101,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":58,"raft.queue_time_us":377932,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":13681,"thread_start_us":1027864,"threads_started":3,"wal-append.queue_time_us":740377}
I20260709 13:06:41.330819 16106 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:41.542820 16087 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.778165 16045 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:41.747711 16125 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:06:41.712384 16114 log.cc:927] Time spent T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.685s	user 0.001s	sys 0.000s
I20260709 13:06:41.757519 16110 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:41.692477 16096 log.cc:927] Time spent T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.599s	user 0.001s	sys 0.000s
I20260709 13:06:41.692288 16115 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:41.321624 16107 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:41.619668 16098 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.620680 15956 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:41.974323 13681 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.002s	sys 0.047s
W20260709 13:06:42.013823 13681 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.002s	sys 0.047s
I20260709 13:06:41.809783 15920 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:41.692417 16016 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:41.604686 15901 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:41.543624 16101 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:41.464706 16063 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:41.334565 15982 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:41.542048 16061 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:41.678629 16047 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:41.977445 13831 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.000s	sys 0.021s
W20260709 13:06:42.029996 13831 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.000s	sys 0.021s
I20260709 13:06:41.810149 16076 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:41.872231 16025 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:41.543435 16120 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:06:42.006609 13679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.000s	sys 0.048s
I20260709 13:06:41.871551 15953 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:41.992053 16087 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:41.872041 15975 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:41.901388 16029 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:41.991811 15957 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:41.894258 16066 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:41.991477 16106 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:42.019340 15905 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:42.032366 16134 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:42.034289 16108 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:41.878031 16055 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:42.008754 15989 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:41.978785 15968 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:42.029459 15982 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:42.043737 13679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.000s	sys 0.048s
I20260709 13:06:41.336127 16088 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:42.022536 15956 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:42.100189 15956 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:42.100610 16052 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:42.019800 16095 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:41.977191 16081 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:42.064414 16105 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:42.067065 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 457) took 2036 ms. Trace:
I20260709 13:06:42.039280 16025 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:42.083809 16080 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:42.055711 16131 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:42.057508 15941 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:42.024910 16016 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:42.016917 16107 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:42.073894 16044 consensus_meta.cc:287] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 2.655s	user 0.007s	sys 0.007s
I20260709 13:06:42.061872 16061 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:41.975528 15961 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:42.088666 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 527) took 1044 ms. Trace:
I20260709 13:06:42.061290 16074 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:42.014189 16110 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:42.112030 16104 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:42.013342 16098 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:41.450641 16042 consensus_queue.cc:237] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:42.177626 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2403) took 1413 ms. Trace:
I20260709 13:06:42.120669 13707 raft_consensus.cc:2393] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 7: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:42.018221 16115 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:42.126475 15953 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:42.069214 15957 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:42.124071 13712 rpcz_store.cc:276] 0709 13:06:40.021209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.021601 (+   392us) service_pool.cc:224] Handling call
0709 13:06:40.021970 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.022478 (+   508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.022505 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:40.053813 (+ 31308us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.902922 (+849109us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:40.902966 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.903080 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:42.057536 (+1154456us) raft_consensus.cc:1685] finished
0709 13:06:42.057564 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.057741 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":578,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":27595,"spinlock_wait_cycles":26368,"thread_start_us":810583,"threads_started":1,"wal-append.queue_time_us":892570}
I20260709 13:06:42.144141 16065 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:42.144830 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 867) took 2389 ms. Trace:
I20260709 13:06:42.159241 16044 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:42.185525 14398 rpcz_store.cc:276] 0709 13:06:39.755087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.759967 (+  4880us) service_pool.cc:224] Handling call
0709 13:06:42.143952 (+2383985us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b5800077d98. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:42.144179 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.144402 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.144432 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.144480 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:42.144529 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.144596 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.144746 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6192384}
I20260709 13:06:42.145203 16126 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:42.089375 16106 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:42.004119 16125 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:42.029351 16063 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:42.152941 15968 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:42.153518 16016 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:42.117851 16060 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:42.119429 15949 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:42.141404 16025 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.158416 16121 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.172083 16131 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:42.160674 16061 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:42.209400 15968 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.211130 15956 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:42.159286 13865 rpcz_store.cc:276] 0709 13:06:41.047529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.030532 (+983003us) service_pool.cc:224] Handling call
0709 13:06:42.087966 (+ 57434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.088199 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.088250 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.088307 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:42.088354 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.088451 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.088591 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:42.147725 16070 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:42.175846 15920 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:42.042721 16101 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:42.109823 16134 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:42.178136 13862 rpcz_store.cc:276] 0709 13:06:40.764088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.765905 (+  1817us) service_pool.cc:224] Handling call
0709 13:06:42.176740 (+1410835us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b5800021698. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:42.176989 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.177213 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.177249 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.177303 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:42.177364 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.177436 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.177560 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39004928}
I20260709 13:06:42.190275 16044 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:42.150395 16069 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:42.052049 16120 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:42.178442 15986 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:42.190848 16126 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:42.236901 16088 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:42.241171 16101 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:42.245267 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:42.221897 16077 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:42.204733 16065 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:42.243794 15956 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:42.271883 13682 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.022s	user 0.040s	sys 0.138s
I20260709 13:06:42.239318 16102 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:42.245440 16070 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:42.279659 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:42.242983 16066 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:42.242821 16055 leader_election.cc:290] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:42.282207 13682 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.033s	user 0.040s	sys 0.138s
I20260709 13:06:42.296018 13862 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:06:42.301025 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:42.235875 15968 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:42.308629 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:42.314625 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:42.326943 14399 consensus_meta.cc:287] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.000s
I20260709 13:06:42.328191 14399 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEARNER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:42.329918 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2406) took 1283 ms. Trace:
I20260709 13:06:42.295889 16070 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:42.281414 15982 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:42.330636 13862 rpcz_store.cc:276] 0709 13:06:41.046426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.328905 (+1282479us) service_pool.cc:224] Handling call
0709 13:06:42.329291 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.329508 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.329530 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.329584 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:42.329635 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.329716 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.329848 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:42.298233 16081 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:42.341765 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:42.319716 16050 consensus_meta.cc:287] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 2.336s	user 0.014s	sys 0.001s
I20260709 13:06:42.307876 16088 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:42.308918 16107 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:42.312319 16126 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:42.347836 16110 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:42.350214 14365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.018s	sys 0.030s
I20260709 13:06:42.231333 16121 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:42.373358 16065 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:42.300709 15956 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:42.379077 14365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.018s	sys 0.031s
I20260709 13:06:42.358152 16063 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:42.378585 16134 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:42.396139 13829 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.214s	user 0.060s	sys 0.115s
W20260709 13:06:42.396561 13829 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.214s	user 0.060s	sys 0.115s
I20260709 13:06:42.397797 16131 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:42.390280 16106 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:42.390568 15957 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:42.416419 13864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:06:42.416949 13859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 526) took 1835 ms. Trace:
W20260709 13:06:42.417923 13716 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2173) took 2674 ms (client timeout 2086 ms). Trace:
W20260709 13:06:42.418381 13716 rpcz_store.cc:269] 0709 13:06:39.744011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.744155 (+   144us) service_pool.cc:224] Handling call
0709 13:06:42.417716 (+2673561us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540034d0d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:42.417840 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2579122432}
I20260709 13:06:42.417023 13864 raft_consensus.cc:606] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:06:42.417431 13859 rpcz_store.cc:276] 0709 13:06:40.581183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.581404 (+   221us) service_pool.cc:224] Handling call
0709 13:06:40.937837 (+356433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.938170 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.938223 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:40.960954 (+ 22731us) log.cc:844] Serialized 26 byte log entry
0709 13:06:41.424481 (+463527us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:41.424524 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.424594 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:42.416759 (+992165us) raft_consensus.cc:1685] finished
0709 13:06:42.416777 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.416896 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":443009,"threads_started":1,"wal-append.queue_time_us":1335134}
W20260709 13:06:42.425719 14368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.004s	sys 0.011s
W20260709 13:06:42.426178 14368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.004s	sys 0.011s
W20260709 13:06:42.431385 13757 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.003s	sys 0.001s
W20260709 13:06:42.431902 13757 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.003s	sys 0.001s
I20260709 13:06:42.398859 16098 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:42.358508 16088 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:42.433943 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57574 (request call id 13) took 2354 ms. Trace:
I20260709 13:06:42.447928 13864 rpcz_store.cc:276] 0709 13:06:40.067023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.416281 (+2349258us) service_pool.cc:224] Handling call
0709 13:06:42.419571 (+  3290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:42.405153 15961 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:42.454340 14367 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.008s	sys 0.007s
W20260709 13:06:42.456171 14367 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.008s	sys 0.007s
I20260709 13:06:42.353108 16050 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:42.458433 13755 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.004s	sys 0.006s
W20260709 13:06:42.468284 13755 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.004s	sys 0.006s
W20260709 13:06:42.468725 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 1.5023e+06us
I20260709 13:06:42.414769 16061 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:42.472447 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:42.406052 16125 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:42.486088 15943 consensus_meta.cc:287] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 1.589s	user 0.004s	sys 0.008s
W20260709 13:06:42.486953 14366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.001s	sys 0.015s
W20260709 13:06:42.512555 14366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.001s	sys 0.015s
I20260709 13:06:42.454150 16028 raft_consensus.cc:697] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:42.457703 16131 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:42.590078 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1481) took 1548 ms. Trace:
I20260709 13:06:42.581207 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:06:42.582778 13754 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.014s	sys 0.001s
W20260709 13:06:42.597427 13754 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.014s	sys 0.002s
I20260709 13:06:42.589447 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 524) took 2584 ms. Trace:
I20260709 13:06:42.598527 13858 rpcz_store.cc:276] 0709 13:06:40.005417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.005542 (+   125us) service_pool.cc:224] Handling call
0709 13:06:40.005843 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.844315 (+838472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.844345 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:40.844384 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:40.844413 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.589121 (+1744708us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b540024f254. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:42.589174 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.589347 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1927869312}
I20260709 13:06:42.616039 13712 raft_consensus.cc:1275] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:42.595523 13791 rpcz_store.cc:276] 0709 13:06:41.041353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.041482 (+   129us) service_pool.cc:224] Handling call
0709 13:06:41.041782 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.048987 (+  7205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.049018 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.049059 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:41.049092 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.589805 (+1540713us) spinlock_profiling.cc:243] Waited 7.01 ms on lock 0x7b54000ec9d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:42.589859 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.589991 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16161920}
I20260709 13:06:42.658627 15961 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:42.659246 15961 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:42.662761 16061 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:42.666615 16135 raft_consensus.cc:993] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7: : Instructing follower 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:42.667102 16135 raft_consensus.cc:1081] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Signalling peer 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:06:42.486923 16115 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:42.586769 15954 consensus_meta.cc:287] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.612s	user 0.010s	sys 0.001s
W20260709 13:06:42.654016 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 57862.8us
I20260709 13:06:42.596899 16046 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:42.516444 16133 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:42.585534 15956 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:42.584321 16088 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:42.557106 16110 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:42.516671 16136 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:42.672302 16080 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:42.516361 15968 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:42.582703 16055 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:42.655455 15948 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:42.669799 16074 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.486312 16025 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:42.579725 15935 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:42.654755 16131 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:42.554095 16087 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:42.731449 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:43.005268 16070 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:43.006436 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:43.007169 13709 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:43.011679 16087 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:43.012619 16043 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.905308 16088 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.797189 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:43.013527 16043 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:43.014539 14367 connection.cc:256] RPC call timeout handler was delayed by -1.6343025789999501s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
I20260709 13:06:42.681818 16106 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.012775 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:42.690279 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:43.020545 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:42.728034 16123 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:43.399181 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 517) took 4186 ms. Trace:
I20260709 13:06:43.401517 13784 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:06:42.796240 16133 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:43.040575 16080 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:43.403014 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:43.068133 16135 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.359607 16043 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:43.401738 13863 rpcz_store.cc:276] 0709 13:06:39.212788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.212932 (+   144us) service_pool.cc:224] Handling call
0709 13:06:39.214681 (+  1749us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.404920 (+190239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.404949 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:42.517298 (+3112349us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b2c000cc698. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5230dd7a11 00007f5230de7372 00007f5232519a01 00007f52324de43a 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2
0709 13:06:42.517851 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 13:06:42.727627 (+209776us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:42.727698 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.728180 (+   482us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.192170 (+463990us) raft_consensus.cc:1685] finished
0709 13:06:43.192203 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.399115 (+206912us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":234744,"raft.queue_time_us":262389,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":35045,"spinlock_wait_cycles":24590592,"thread_start_us":209280,"threads_started":1,"wal-append.queue_time_us":672272}
I20260709 13:06:42.731159 16121 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:43.321020 13682 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.009s	sys 0.018s
I20260709 13:06:43.404742 16080 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:43.406029 13682 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.013s	sys 0.018s
I20260709 13:06:42.514856 15943 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:43.406402 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 811289us
I20260709 13:06:43.407953 15943 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:43.020998 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:42.688287 14395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 591) took 3698 ms (client timeout 1587 ms). Trace:
W20260709 13:06:43.143662 13707 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1705) took 3330 ms (client timeout 2702 ms). Trace:
I20260709 13:06:43.105681 13714 raft_consensus.cc:2368] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 3. Current term is 4.
I20260709 13:06:43.106870 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:43.399925 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:43.404727 16133 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:43.417263 13712 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.411459 13757 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:06:43.392028 13857 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.012s	sys 0.009s
W20260709 13:06:43.256734 13829 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.020s	sys 0.016s
W20260709 13:06:43.418669 13829 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.022s	sys 0.019s
I20260709 13:06:43.021119 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:43.421348 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:43.418354 13857 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.012s	sys 0.010s
W20260709 13:06:43.424604 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 766452us
W20260709 13:06:43.052315 13830 connection.cc:256] RPC call timeout handler was delayed by -1.8895014789999323s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
I20260709 13:06:43.105387 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:43.052902 15957 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.425088 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 1783) took 3469 ms. Trace:
I20260709 13:06:43.426898 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:43.416760 13707 rpcz_store.cc:269] 0709 13:06:39.813493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.813687 (+   194us) service_pool.cc:224] Handling call
0709 13:06:43.143339 (+3329652us) spinlock_profiling.cc:243] Waited 2.3 s on lock 0x7b5400041854. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:43.143547 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5286905216}
I20260709 13:06:43.427706 13863 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:43.428180 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:43.426050 13829 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:43.404881 16135 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:43.443384 14398 raft_consensus.cc:2368] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5.
I20260709 13:06:43.443809 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:43.436831 16121 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:43.444401 13865 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.444636 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:43.444609 16121 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.445004 16135 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:43.445247 16121 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:43.445860 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:43.446580 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:43.447011 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:43.431672 13829 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:43.440227 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:43.441797 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:43.442598 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:06:43.425513 16094 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.011s	sys 0.020s
I20260709 13:06:43.436133 16074 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:43.435725 13709 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:43.447640 16025 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:43.447992 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:43.014206 16088 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:43.447657 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:43.430276 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:43.448908 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:43.464531 13711 raft_consensus.cc:2393] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 5: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:43.465487 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:43.466780 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:43.426941 13857 rpcz_store.cc:276] 0709 13:06:39.955781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.577028 (+2621247us) service_pool.cc:224] Handling call
0709 13:06:42.577402 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.577893 (+   491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.577931 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:42.654903 (+ 76972us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.424773 (+769870us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:43.424812 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.424876 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.424919 (+    43us) raft_consensus.cc:1685] finished
0709 13:06:43.424929 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.425041 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":155,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":3174,"thread_start_us":738019,"threads_started":1,"wal-append.queue_time_us":721767}
I20260709 13:06:42.819670 16050 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:43.454623 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:43.441284 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:43.457463 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:43.192411 16138 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:43.047258 16070 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:43.019600 16016 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:43.470994 13856 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:43.435111 15935 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:43.427807 13783 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:06:43.130846 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:42.688048 15954 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:43.468466 13711 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:43.499034 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:43.427067 15948 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:43.458964 16133 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:43.470614 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:06:43.462667 16094 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.012s	sys 0.021s
I20260709 13:06:43.440307 16058 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:43.510677 16058 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:43.485443 13712 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:43.067885 16134 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:42.731284 16110 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:43.475641 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:43.492949 16144 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:43.435724 16146 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.462097 13710 raft_consensus.cc:2368] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3.
I20260709 13:06:43.047454 16106 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:43.461135 15961 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:43.014206 16055 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:43.468871 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:43.500273 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:43.522404 13856 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:06:43.522989 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:43.502130 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:43.401584 16123 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:43.465490 14398 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:43.506778 13711 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:43.466193 16135 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:43.529608 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:42.908839 16028 consensus_queue.cc:237] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:43.426443 15957 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:43.510139 16088 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:43.068727 16136 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:43.552855 16136 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:43.552978 15957 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:43.556528 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:43.557219 13711 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:43.557514 13682 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:43.558218 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:43.558835 13711 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:06:43.559194 16094 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:43.559630 16094 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:43.511597 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:43.472254 15968 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:43.426250 16150 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:06:43.515287 13707 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.472498 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:43.416038 14395 rpcz_store.cc:269] 0709 13:06:38.958773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.968907 (+ 10134us) service_pool.cc:224] Handling call
0709 13:06:42.594159 (+3625252us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540068a1d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:42.656846 (+ 62687us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2324598016}
I20260709 13:06:43.503371 16138 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:43.496860 15943 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:43.512727 16058 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.494282 16016 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:43.530447 13864 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:43.530117 15948 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:43.531340 14398 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
W20260709 13:06:43.641548 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 175203us
I20260709 13:06:43.531896 16106 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:43.532511 16036 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:43.532588 15935 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:43.533300 16055 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:43.533963 15954 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:43.548193 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:43.507740 16070 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:43.513156 16133 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:43.511493 13716 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.011s	sys 0.040s
W20260709 13:06:43.656963 13716 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.011s	sys 0.040s
I20260709 13:06:43.558682 13682 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:06:43.550608 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 56516.6us
I20260709 13:06:43.561479 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:43.560087 16094 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.597594 13709 raft_consensus.cc:2393] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 3: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:43.516214 13712 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:43.660418 13829 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:43.604635 13865 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
W20260709 13:06:43.625075 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 175306us
I20260709 13:06:43.519639 16134 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:43.643067 14367 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:43.639400 16157 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:43.524061 16146 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:43.651487 13857 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:06:43.520725 16144 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:43.680199 16151 log.cc:927] Time spent T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:06:43.680721 16144 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:43.653944 13859 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:06:43.681473 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1707) took 1113 ms. Trace:
I20260709 13:06:43.681847 13716 rpcz_store.cc:276] 0709 13:06:42.568376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.575498 (+  7122us) service_pool.cc:224] Handling call
0709 13:06:42.575850 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.576292 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.576332 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:42.576878 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.657379 (+1080501us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:43.657409 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.657460 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.681272 (+ 23812us) raft_consensus.cc:1685] finished
0709 13:06:43.681290 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.681415 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":77331,"thread_start_us":983073,"threads_started":1,"wal-append.queue_time_us":922528}
I20260709 13:06:43.683454 13859 raft_consensus.cc:2955] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:43.684396 16110 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:43.666782 16074 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:43.665491 14367 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:06:43.644402 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 48754.4us
I20260709 13:06:43.601543 15968 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:43.667389 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:43.692018 13865 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:43.672135 13829 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:43.674289 15947 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:43.674398 16134 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:43.674816 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:43.675109 13715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2177) took 2586 ms. Trace:
I20260709 13:06:43.675949 16056 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:43.665059 13713 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1699) took 3975 ms (client timeout 1622 ms). Trace:
I20260709 13:06:43.678242 13790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1492) took 1901 ms. Trace:
I20260709 13:06:43.702468 13715 rpcz_store.cc:276] 0709 13:06:41.088908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.089084 (+   176us) service_pool.cc:224] Handling call
0709 13:06:41.367726 (+278642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.092746 (+725020us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.092788 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.092842 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:42.092890 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.674873 (+1581983us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b5400149454. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:43.674914 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.675033 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1666759936}
I20260709 13:06:43.690007 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2404) took 2925 ms. Trace:
I20260709 13:06:43.708493 13861 rpcz_store.cc:276] 0709 13:06:40.764394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.046075 (+281681us) service_pool.cc:224] Handling call
0709 13:06:41.046339 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.901923 (+855584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.901958 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.901997 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:41.902033 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.689772 (+1787739us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b5400235354. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:43.689824 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.689954 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1967211264}
I20260709 13:06:43.709266 16064 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.709959 16144 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.710150 16064 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:43.710625 16144 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:43.636422 15943 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:43.660281 16131 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:43.684497 16146 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:43.707290 13790 rpcz_store.cc:276] 0709 13:06:41.776518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.790221 (+ 13703us) service_pool.cc:224] Handling call
0709 13:06:41.790603 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.966622 (+176019us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.966675 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.966730 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:41.966783 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.678070 (+1711287us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54001e8054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:43.678113 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.678195 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":404271872}
I20260709 13:06:43.671717 16055 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:06:43.724124 13680 connection.cc:256] RPC call timeout handler was delayed by -2.1005448079999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
I20260709 13:06:43.688156 16088 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:06:43.706538 13713 rpcz_store.cc:269] 0709 13:06:39.689445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.689562 (+   117us) service_pool.cc:224] Handling call
0709 13:06:43.664846 (+3975284us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b5400391554. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:43.664987 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41618688}
I20260709 13:06:43.779853 13864 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:06:43.674422 16016 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:43.827921 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 269260us
I20260709 13:06:43.686030 16145 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:06:43.828734 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 126156us
I20260709 13:06:43.697428 15947 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.878386 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 598) took 2544 ms. Trace:
I20260709 13:06:43.714995 16131 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.859277 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 459) took 3803 ms. Trace:
I20260709 13:06:43.889204 13708 rpcz_store.cc:276] 0709 13:06:40.056016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.790216 (+734200us) service_pool.cc:224] Handling call
0709 13:06:40.790605 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.156867 (+1366262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.156910 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.156956 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:42.156989 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.859060 (+1702071us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b540010cf54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:43.859103 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.859221 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3141593856}
I20260709 13:06:43.854522 16135 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.861814 16133 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:43.720901 16074 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:43.857461 14396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 865) took 4111 ms. Trace:
I20260709 13:06:43.865129 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:43.777029 15975 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:43.868387 15935 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:44.062309 16074 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:43.843907 16053 consensus_queue.cc:1048] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.149s
I20260709 13:06:43.872184 14367 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:06:43.923728 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 67320.8us
I20260709 13:06:43.830727 16068 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.780206 16064 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:43.777547 16121 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:43.878871 14402 rpcz_store.cc:276] 0709 13:06:41.333613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.420657 (+ 87044us) service_pool.cc:224] Handling call
0709 13:06:43.877567 (+2456910us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b5800077d98. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:43.877809 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.878024 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.878055 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:43.878103 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:43.878146 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.878209 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.878322 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2379136}
W20260709 13:06:43.782330 14393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 873) took 3979 ms (client timeout 2048 ms). Trace:
I20260709 13:06:43.777186 14398 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:06:44.063148 14401 raft_consensus.cc:2368] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 3. Current term is 4.
I20260709 13:06:43.715049 15943 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:43.774518 16138 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:43.781037 16070 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:43.776387 16110 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:44.087603 16074 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:44.106629 13830 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:06:44.069432 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 197319us
I20260709 13:06:44.125070 16094 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:43.690616 16157 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:44.135219 13707 consensus_meta.cc:287] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.543s	user 0.007s	sys 0.000s
I20260709 13:06:43.994099 16135 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:44.142809 14401 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 869) took 4364 ms (client timeout 1791 ms). Trace:
I20260709 13:06:43.857551 16055 raft_consensus.cc:697] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:44.157171 13715 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:44.070044 14394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 601) took 2610 ms. Trace:
I20260709 13:06:43.929071 15947 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:44.158878 13830 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:44.153178 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:44.153513 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:44.161041 13713 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:44.161314 13716 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
W20260709 13:06:44.155912 14401 rpcz_store.cc:269] 0709 13:06:39.773117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.773323 (+   206us) service_pool.cc:224] Handling call
0709 13:06:43.656734 (+3883411us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b5800077d98. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:06:43.864987 (+208253us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b5800077d98. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9e9c 00007f522f3b9a5b 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:06:44.137324 (+272337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20142720}
I20260709 13:06:44.156304 13707 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:44.116496 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 595) took 2779 ms. Trace:
I20260709 13:06:44.162513 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.126008 15948 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:43.856896 16088 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:44.151607 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:44.065150 16131 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:44.157734 14394 rpcz_store.cc:276] 0709 13:06:41.460079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.868895 (+408816us) service_pool.cc:224] Handling call
0709 13:06:41.869268 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.069573 (+200305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.069609 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.069662 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:42.069716 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.069791 (+2000075us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54006b5154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:44.069844 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.069978 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":460140416}
I20260709 13:06:44.174715 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.166316 13830 leader_election.cc:400] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3.
I20260709 13:06:44.143484 16036 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:44.168511 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.142438 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 610) took 1232 ms. Trace:
I20260709 13:06:44.181574 13830 leader_election.cc:403] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:44.169557 13611 catalog_manager.cc:5697] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:44.163975 16016 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:44.174985 16144 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:44.182976 16059 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3.
I20260709 13:06:44.182543 13713 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:06:44.062599 14396 rpcz_store.cc:276] 0709 13:06:39.744869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.745537 (+   668us) service_pool.cc:224] Handling call
0709 13:06:39.785682 (+ 40145us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.014693 (+229011us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.023481 (+  8788us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.533993 (+3510512us) spinlock_profiling.cc:243] Waited 7.51 ms on lock 0x7b2c00012878. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5230dd7a11 00007f5230de7372 00007f5232519a01 00007f52324de43a 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2
0709 13:06:43.534584 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.665860 (+131276us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:43.666958 (+  1098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.673142 (+  6184us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.784561 (+111419us) raft_consensus.cc:1685] finished
0709 13:06:43.830246 (+ 45685us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.856026 (+ 25780us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1851,"raft.queue_time_us":34738,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"spinlock_wait_cycles":17271168,"thread_start_us":297275,"threads_started":2,"wal-append.queue_time_us":186626}
I20260709 13:06:44.187721 14398 rpcz_store.cc:276] 0709 13:06:42.910274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.665648 (+755374us) service_pool.cc:224] Handling call
0709 13:06:44.142288 (+476640us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.188243 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.188722 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.188863 14396 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:44.189749 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.189864 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.190337 14396 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:06:44.190594 14398 raft_consensus.cc:2393] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 3: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:44.185212 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.191226 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.192596 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.192692 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:44.193390 14396 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.183965 16055 consensus_queue.cc:237] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:44.193648 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:44.189890 16059 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:44.194730 16059 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:44.183319 13786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1487) took 2635 ms. Trace:
I20260709 13:06:44.183611 16016 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:44.196645 16016 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.196775 16059 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:44.197868 16148 log.cc:927] Time spent T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.666s	user 0.005s	sys 0.004s
I20260709 13:06:44.187258 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.198328 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.185781 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 877) took 1517 ms. Trace:
I20260709 13:06:44.195820 13786 rpcz_store.cc:276] 0709 13:06:41.547671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.547907 (+   236us) service_pool.cc:224] Handling call
0709 13:06:41.863945 (+316038us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.903521 (+ 39576us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.903562 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.903616 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:41.903662 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.183068 (+2279406us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b540033bb54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:44.183111 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.183228 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90595712}
I20260709 13:06:44.194386 14394 raft_consensus.cc:2393] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 5: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:44.200232 14402 rpcz_store.cc:276] 0709 13:06:42.668896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.158966 (+1490070us) service_pool.cc:224] Handling call
0709 13:06:44.185724 (+ 26758us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.192719 13789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1484) took 2899 ms. Trace:
I20260709 13:06:44.199141 14400 raft_consensus.cc:2368] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 2. Current term is 3.
I20260709 13:06:44.203500 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.201382 13789 rpcz_store.cc:276] 0709 13:06:41.293548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.324522 (+ 30974us) service_pool.cc:224] Handling call
0709 13:06:44.192068 (+2867546us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b580001c598. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:44.192238 (+   170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.192434 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.192458 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.192498 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:44.192533 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.192585 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.192671 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32204672}
I20260709 13:06:44.136899 16068 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:44.224085 14400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 875) took 1593 ms. Trace:
I20260709 13:06:44.224583 14400 rpcz_store.cc:276] 0709 13:06:42.612869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.613009 (+   140us) service_pool.cc:224] Handling call
0709 13:06:44.187115 (+1574106us) spinlock_profiling.cc:243] Waited 8.2 ms on lock 0x7b5800077d98. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:06:44.206102 (+ 18987us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18856704}
I20260709 13:06:44.225927 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.228153 16088 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:44.230957 16121 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:44.233250 16068 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:44.164335 14397 rpcz_store.cc:276] 0709 13:06:41.321618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.324783 (+  3165us) service_pool.cc:224] Handling call
0709 13:06:41.546209 (+221426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.045367 (+499158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.048410 (+  3043us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.060455 (+ 12045us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:42.065603 (+  5148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.061608 (+1996005us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b5400595bd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:44.064494 (+  2886us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.101141 (+ 36647us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":996270336}
I20260709 13:06:44.235386 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.240309 14399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 604) took 1643 ms. Trace:
I20260709 13:06:44.240749 14399 rpcz_store.cc:276] 0709 13:06:42.597154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.597262 (+   108us) service_pool.cc:224] Handling call
0709 13:06:44.239383 (+1642121us) spinlock_profiling.cc:243] Waited 7.98 ms on lock 0x7b5800077d98. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:44.239643 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.239881 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.239917 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.239970 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:44.240022 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.240090 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.240209 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18344320}
I20260709 13:06:44.243076 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.244773 14394 raft_consensus.cc:1240] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:44.245877 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.246757 16123 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:44.251384 13787 raft_consensus.cc:1275] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:44.256471 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1477) took 3216 ms. Trace:
I20260709 13:06:44.252635 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.258772 14401 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 6: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:44.157682 16042 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:06:44.256865 13787 rpcz_store.cc:276] 0709 13:06:41.040153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.040276 (+   123us) service_pool.cc:224] Handling call
0709 13:06:44.247691 (+3207415us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b580001c598. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:44.247866 (+   175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.256127 (+  8261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.256398 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31996800}
I20260709 13:06:44.172446 16150 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:44.221477 13782 raft_consensus.cc:2393] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 7: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:44.249140 16036 raft_consensus.cc:697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:44.269872 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.270215 16036 consensus_queue.cc:237] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:44.126248 14393 rpcz_store.cc:269] 0709 13:06:39.802567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.808419 (+  5852us) service_pool.cc:224] Handling call
0709 13:06:43.782121 (+3973702us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400631354. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:43.782258 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342736768}
I20260709 13:06:43.876302 16145 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:44.280459 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 179048us
I20260709 13:06:44.262362 15968 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:44.269044 16150 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:06:44.313445 16170 log.cc:927] Time spent T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:06:44.315541 14398 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:06:44.320335 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:44.321539 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:44.322113 13787 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:06:44.322780 16109 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:44.323107 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.324301 13786 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:48914
I20260709 13:06:44.324869 13786 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:44.325332 13786 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.333034 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:44.333645 13789 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:06:44.309105 16150 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.379390 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:06:44.392448 13859 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.068s	sys 0.073s
W20260709 13:06:44.392982 13859 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.068s	sys 0.073s
I20260709 13:06:44.403249 13708 raft_consensus.cc:1240] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:44.403334 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 72651.3us
I20260709 13:06:44.406185 13829 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:44.324950 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.416923 14393 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:06:44.417201 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:44.417905 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.419040 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.416139 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:44.420006 13862 raft_consensus.cc:2410] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:44.420158 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:44.421159 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.422498 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:44.423097 13858 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:44.422214 14393 raft_consensus.cc:2393] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 5: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:44.424149 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.424362 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:44.421496 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:44.425007 13864 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 1.
I20260709 13:06:44.425654 14393 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:44.426664 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.427634 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:44.427897 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:06:44.428581 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 262378us
I20260709 13:06:44.428637 14393 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:44.431775 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:44.432365 13858 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:44.429453 13830 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:44.433804 13830 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:44.434219 13829 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:44.436009 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.440227 13680 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:44.442008 13680 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:44.445098 13860 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:06:44.451741 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:44.459712 13707 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:44.458093 13682 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:44.461516 13682 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:44.431689 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.464967 13682 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:44.432749 16110 raft_consensus.cc:697] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 9 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:44.453666 16176 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:44.465448 16144 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:44.471634 13682 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:44.453220 16105 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:44.454237 15968 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:44.452872 16068 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:44.450263 16179 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:44.472137 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:06:44.482770 13680 consensus_peers.cc:597] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ac05b1933cb74e488759c38bd76d8d00. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.499738 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 50161.5us
I20260709 13:06:44.501149 13680 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:44.502321 13680 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:44.517071 13790 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:44.513756 13785 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:44.525650 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:44.526878 13858 raft_consensus.cc:2393] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 3: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:44.462186 13786 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:44.485672 13789 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.454329 16088 consensus_queue.cc:1059] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:06:44.470932 15943 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:44.474159 16176 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.463728 16053 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:44.486404 15975 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:44.539887 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:44.604223 13707 raft_consensus.cc:2376] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3. Re-sending same reply.
I20260709 13:06:44.465641 16059 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:44.541749 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:44.609056 13785 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:06:44.518308 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.543366 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:44.614442 13790 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:06:44.543344 13714 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1715) took 1846 ms (client timeout 2240 ms). Trace:
W20260709 13:06:44.558179 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 55928.9us
W20260709 13:06:44.615658 13714 rpcz_store.cc:269] 0709 13:06:42.697121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.697388 (+   267us) service_pool.cc:224] Handling call
0709 13:06:44.543178 (+1845790us) spinlock_profiling.cc:243] Waited 87.5 ms on lock 0x7b54000c6054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:44.543295 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201333632}
I20260709 13:06:44.568661 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.569172 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:44.474331 16146 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:44.618604 16146 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:44.618875 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.619166 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:44.572778 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:44.474381 16178 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:44.584312 13830 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:06:44.587250 13756 connection.cc:256] RPC call timeout handler was delayed by -2.9798315980000325s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
I20260709 13:06:44.587635 16138 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:44.589511 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:44.465641 16109 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:44.483503 15968 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:44.601601 13786 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:44.485723 16105 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:44.518867 16133 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:44.607360 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:44.600409 16088 raft_consensus.cc:3055] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:44.619059 16146 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.480518 16144 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.568657 16068 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:44.626722 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:44.682261 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:44.684017 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:44.684698 13865 raft_consensus.cc:2376] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3. Re-sending same reply.
I20260709 13:06:44.685680 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:44.630066 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:44.533304 16179 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:44.583604 16094 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:44.567939 15943 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:44.623214 15975 raft_consensus.cc:697] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:06:44.659157 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 202756us
I20260709 13:06:44.717298 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:44.660634 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:44.638022 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:44.718932 13707 raft_consensus.cc:2368] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3.
I20260709 13:06:44.588838 16176 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:44.541810 13784 raft_consensus.cc:1275] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:44.662676 13789 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:44.665452 13830 leader_election.cc:400] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 3. Current term is 4.
I20260709 13:06:44.728394 13830 leader_election.cc:403] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:06:44.606173 16134 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:44.605585 16053 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:44.670241 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.592361 16157 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:44.598989 16086 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:44.688125 13864 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:06:44.680092 16144 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.681239 13862 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 1.
I20260709 13:06:44.656374 16138 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:44.791771 16190 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 3. Current term is 4.
I20260709 13:06:44.728870 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:44.663096 16105 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.710889 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:44.696956 16179 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.738840 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:44.799079 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:44.665658 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.775801 15959 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:44.666613 16088 raft_consensus.cc:740] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:44.698272 16068 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:44.621958 16059 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:44.772920 13790 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:44.786227 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:44.660696 16109 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:44.786598 13785 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:06:44.816792 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:44.729351 15943 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.790566 16123 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:44.700722 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:44.660126 15968 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:44.631273 16178 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:44.796345 13789 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.824595 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:44.783644 16058 consensus_meta.cc:287] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 1.138s	user 0.014s	sys 0.010s
I20260709 13:06:44.738634 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:44.663288 16133 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:44.751658 16134 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:44.753003 16053 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.659830 16110 consensus_queue.cc:237] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:44.739451 14396 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:44.814495 13859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 1804) took 1288 ms. Trace:
I20260709 13:06:44.698738 16130 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:44.817004 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:44.817426 13785 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:44.818810 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:44.802114 16187 log.cc:927] Time spent T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:06:44.794688 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:06:44.802937 16183 log.cc:927] Time spent T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:06:44.821655 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:44.848928 13786 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:06:44.811023 15959 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.825991 13784 raft_consensus.cc:2376] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4. Re-sending same reply.
I20260709 13:06:44.826828 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:06:44.806121 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 184179us
I20260709 13:06:44.815711 16068 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.809978 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:44.831678 13789 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:44.843890 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:44.844973 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:44.855268 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:44.834875 13859 rpcz_store.cc:276] 0709 13:06:43.526038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.682826 (+156788us) service_pool.cc:224] Handling call
0709 13:06:43.683075 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.683245 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:43.830565 (+147320us) log.cc:844] Serialized 14 byte log entry
0709 13:06:44.561495 (+730930us) log.cc:844] Serialized 14 byte log entry
0709 13:06:44.814159 (+252664us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.814208 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:44.814260 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.814325 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.814444 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3130,"prepare.queue_time_us":357022,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":144339,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":53112,"thread_start_us":938936,"threads_started":3,"wal-append.queue_time_us":484603}
I20260709 13:06:44.849243 13857 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:44.849823 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:44.856329 13789 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 6: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:44.856269 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:44.856678 13786 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:06:44.857080 13785 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:44.857441 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:44.850867 16186 log.cc:927] Time spent T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:06:44.851475 16185 log.cc:927] Time spent T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:06:44.829993 16133 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:44.853075 13787 raft_consensus.cc:2376] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9. Re-sending same reply.
I20260709 13:06:44.855273 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:44.865810 13784 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:06:44.857740 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:44.846812 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 181558us
I20260709 13:06:44.860415 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:44.866946 13786 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:06:44.867266 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:44.862421 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:44.868742 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:44.853935 15959 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.822535 15975 consensus_queue.cc:237] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:44.849381 14396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 751) took 1186 ms. Trace:
I20260709 13:06:44.830251 16058 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:44.847064 16088 consensus_queue.cc:260] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:44.886986 16198 log.cc:927] Time spent T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:06:44.888118 16120 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:44.890617 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1724) took 1336 ms. Trace:
I20260709 13:06:44.891142 15948 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:44.854651 14393 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 1.
I20260709 13:06:44.892982 13612 catalog_manager.cc:5697] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 3 to 5, now has a pending config: VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129), VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130), VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131), NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 5 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
W20260709 13:06:44.879627 16074 consensus_meta.cc:287] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.712s	user 0.010s	sys 0.001s
I20260709 13:06:44.897809 13786 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:06:44.845741 16130 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:44.970377 13860 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42104 (request call id 516) took 5757 ms (client timeout 2977 ms). Trace:
I20260709 13:06:44.980497 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:44.980967 13682 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:44.914309 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:44.975334 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.988677 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:06:44.893419 15947 consensus_meta.cc:287] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.720s	user 0.016s	sys 0.000s
I20260709 13:06:45.026636 13612 catalog_manager.cc:5697] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 3 to 4, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 4 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:45.189772 14400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 750) took 1526 ms. Trace:
I20260709 13:06:45.295298 14400 rpcz_store.cc:276] 0709 13:06:43.662998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.225533 (+562535us) service_pool.cc:224] Handling call
0709 13:06:45.189519 (+963986us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b5400147154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:45.189694 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1187115392}
W20260709 13:06:45.187057 13791 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1493) took 2168 ms (client timeout 1576 ms). Trace:
I20260709 13:06:45.098523 13856 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.022174 13710 rpcz_store.cc:276] 0709 13:06:43.554181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.555213 (+  1032us) service_pool.cc:224] Handling call
0709 13:06:43.555609 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.679453 (+123844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.679483 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:43.679544 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:43.679598 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.890377 (+1210779us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54000c4754. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:44.890422 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.890559 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284156160}
W20260709 13:06:45.297124 13791 rpcz_store.cc:269] 0709 13:06:43.018860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.186779 (+2167919us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:45.186940 (+   161us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:45.317565 14402 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 6: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:45.102337 13830 leader_election.cc:400] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3.
W20260709 13:06:45.321477 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 219282us
I20260709 13:06:45.168810 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:45.326172 13857 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:45.176090 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 479) took 1022 ms. Trace:
I20260709 13:06:45.319864 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:45.309185 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 328262us
I20260709 13:06:45.331985 13708 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:45.334053 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:45.337283 13708 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
W20260709 13:06:44.988168 16189 log.cc:927] Time spent T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:06:45.332238 13682 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:45.318859 13707 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
W20260709 13:06:45.324203 13860 rpcz_store.cc:269] 0709 13:06:39.212475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.213058 (+   583us) service_pool.cc:224] Handling call
0709 13:06:44.970073 (+5757015us) spinlock_profiling.cc:243] Waited 5.03 s on lock 0x7b5400387054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:44.970222 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11575675264}
W20260709 13:06:45.276932 16150 consensus_meta.cc:287] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.874s	user 0.009s	sys 0.000s
I20260709 13:06:45.336344 14367 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:06:45.396991 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 64824.1us
W20260709 13:06:45.397183 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 60943.6us
W20260709 13:06:45.099725 16016 consensus_meta.cc:287] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.903s	user 0.012s	sys 0.004s
I20260709 13:06:45.406235 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:06:45.387986 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 60012.3us
W20260709 13:06:44.930814 16135 consensus_meta.cc:287] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.762s	user 0.010s	sys 0.000s
I20260709 13:06:45.393880 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:45.028059 14396 rpcz_store.cc:276] 0709 13:06:43.663292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.192478 (+529186us) service_pool.cc:224] Handling call
0709 13:06:44.846106 (+653628us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:45.284757 16176 consensus_meta.cc:287] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.000s
W20260709 13:06:45.389376 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 69991.5us
W20260709 13:06:45.506577 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 108162us
I20260709 13:06:45.558066 16176 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:45.558676 14367 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:45.561417 13858 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:45.438524 13756 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.013s	sys 0.045s
I20260709 13:06:45.563362 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:45.563702 13756 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.026s	sys 0.065s
I20260709 13:06:45.564038 13788 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:45.565055 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:45.565606 13788 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:45.566586 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:44.987390 16193 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:44.902086 16059 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:44.988395 16134 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:44.988312 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.884613 16138 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:44.974632 16146 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:45.107570 16058 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:45.117895 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 876) took 2501 ms. Trace:
I20260709 13:06:45.182359 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:44.901005 16178 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:45.027695 16109 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:45.294751 16088 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.098234 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:45.645562 14393 raft_consensus.cc:2368] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 2. Current term is 3.
W20260709 13:06:45.564064 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 710488us
I20260709 13:06:45.658560 13756 leader_election.cc:400] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5.
I20260709 13:06:45.658926 13756 leader_election.cc:403] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:45.111188 16123 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:45.332736 16051 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:45.676137 16051 raft_consensus.cc:697] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:45.030344 15948 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:45.676836 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:45.560128 16176 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:45.173918 13782 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1495) took 2154 ms (client timeout 2032 ms). Trace:
W20260709 13:06:45.879371 13782 rpcz_store.cc:269] 0709 13:06:43.019796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.040299 (+ 20503us) service_pool.cc:224] Handling call
0709 13:06:45.173619 (+2133320us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b5400205154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:45.173794 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1502563072}
I20260709 13:06:45.881577 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:45.882472 13782 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:06:45.553079 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:45.552461 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:45.847370 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:45.884277 13707 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:45.369007 13716 rpcz_store.cc:276] 0709 13:06:44.153197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.162093 (+  8896us) service_pool.cc:224] Handling call
0709 13:06:44.162308 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.221394 (+ 59086us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:44.464974 (+243580us) log.cc:844] Serialized 14 byte log entry
0709 13:06:44.596996 (+132022us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.597079 (+    83us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:44.597156 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.175841 (+578685us) spinlock_profiling.cc:243] Waited 58.8 ms on lock 0x7b540012e154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:45.175892 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.176027 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8153,"prepare.queue_time_us":199233,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":24960,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":9785,"spinlock_wait_cycles":135263488,"thread_start_us":346122,"threads_started":2,"wal-append.queue_time_us":400825}
I20260709 13:06:45.884577 13710 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:45.885136 13707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2192) took 1093 ms. Trace:
I20260709 13:06:45.844843 16221 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:45.467042 13708 raft_consensus.cc:2368] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 2. Current term is 3.
I20260709 13:06:45.885677 13707 rpcz_store.cc:276] 0709 13:06:44.792220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.395560 (+603340us) service_pool.cc:224] Handling call
0709 13:06:45.885058 (+489498us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:45.886044 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:45.886721 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2198) took 1039 ms. Trace:
I20260709 13:06:45.661006 13756 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:45.887308 13716 raft_consensus.cc:2368] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8.
I20260709 13:06:45.886447 16221 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:45.887360 13708 rpcz_store.cc:276] 0709 13:06:44.846909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.405875 (+558966us) service_pool.cc:224] Handling call
0709 13:06:45.886527 (+480652us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:45.887938 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2181) took 1277 ms. Trace:
I20260709 13:06:45.885692 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1736) took 1388 ms. Trace:
I20260709 13:06:45.884647 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2193) took 1089 ms. Trace:
I20260709 13:06:45.888475 13716 rpcz_store.cc:276] 0709 13:06:44.610672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.885547 (+1274875us) service_pool.cc:224] Handling call
0709 13:06:45.887846 (+  2299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:45.889444 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:45.889583 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:45.889959 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:45.890372 13707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2197) took 1061 ms. Trace:
I20260709 13:06:45.888561 13710 rpcz_store.cc:276] 0709 13:06:44.497684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.396684 (+899000us) service_pool.cc:224] Handling call
0709 13:06:45.885566 (+488882us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:45.890818 13708 raft_consensus.cc:2410] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:45.891458 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:45.889194 13714 rpcz_store.cc:276] 0709 13:06:44.795225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.429103 (+633878us) service_pool.cc:224] Handling call
0709 13:06:45.884534 (+455431us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:45.891489 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2194) took 1091 ms. Trace:
I20260709 13:06:45.891644 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:45.892663 13708 rpcz_store.cc:276] 0709 13:06:44.799716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.888674 (+1088958us) service_pool.cc:224] Handling call
0709 13:06:45.891405 (+  2731us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":821760}
I20260709 13:06:45.890799 13707 rpcz_store.cc:276] 0709 13:06:44.829406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.887122 (+1057716us) service_pool.cc:224] Handling call
0709 13:06:45.890307 (+  3185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:45.893059 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:45.893990 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:45.893958 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:45.894182 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2196) took 1072 ms. Trace:
I20260709 13:06:45.890769 13716 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:45.895601 13714 rpcz_store.cc:276] 0709 13:06:44.821762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.892642 (+1070880us) service_pool.cc:224] Handling call
0709 13:06:45.894120 (+  1478us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:45.897198 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:45.898223 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2202) took 1021 ms. Trace:
I20260709 13:06:45.898762 13714 rpcz_store.cc:276] 0709 13:06:44.876766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.896725 (+1019959us) service_pool.cc:224] Handling call
0709 13:06:45.898158 (+  1433us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:45.893172 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2187) took 1220 ms. Trace:
I20260709 13:06:45.899504 13710 rpcz_store.cc:276] 0709 13:06:44.673017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.891230 (+1218213us) service_pool.cc:224] Handling call
0709 13:06:45.893107 (+  1877us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:45.899922 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:45.900961 13714 raft_consensus.cc:2410] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:06:45.901298 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2199) took 1046 ms. Trace:
I20260709 13:06:45.901309 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1733) took 1427 ms. Trace:
I20260709 13:06:45.901671 13714 rpcz_store.cc:276] 0709 13:06:44.854882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.899589 (+1044707us) service_pool.cc:224] Handling call
0709 13:06:45.901251 (+  1662us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:45.901861 13710 rpcz_store.cc:276] 0709 13:06:44.473919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.900167 (+1426248us) service_pool.cc:224] Handling call
0709 13:06:45.900651 (+   484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.900987 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.901013 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.901069 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:45.901102 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.901152 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.901246 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:45.894788 13782 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.894763 16221 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:45.894994 13707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1732) took 1424 ms. Trace:
I20260709 13:06:45.903430 13707 rpcz_store.cc:276] 0709 13:06:44.470373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.893596 (+1423223us) service_pool.cc:224] Handling call
0709 13:06:45.894946 (+  1350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280}
I20260709 13:06:45.904193 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1735) took 1420 ms. Trace:
I20260709 13:06:45.904732 13710 rpcz_store.cc:276] 0709 13:06:44.484059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.903032 (+1418973us) service_pool.cc:224] Handling call
0709 13:06:45.903401 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.903847 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.903875 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.903946 (+    71us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:45.903981 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.904040 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.904141 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:45.907142 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1738) took 1325 ms. Trace:
I20260709 13:06:45.895877 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2201) took 1026 ms. Trace:
I20260709 13:06:45.907994 13708 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 6: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:45.907801 13716 rpcz_store.cc:276] 0709 13:06:44.869719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.889529 (+1019810us) service_pool.cc:224] Handling call
0709 13:06:45.895794 (+  6265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:45.908630 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2195) took 1097 ms. Trace:
I20260709 13:06:45.909073 13708 rpcz_store.cc:276] 0709 13:06:44.810891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.893483 (+1082592us) service_pool.cc:224] Handling call
0709 13:06:45.908557 (+ 15074us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20224}
I20260709 13:06:45.567242 13788 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:45.911036 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:45.911813 13788 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:45.912817 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:45.914280 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:45.561450 13786 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:45.917073 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:45.917793 13786 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:06:45.638422 13791 raft_consensus.cc:1240] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:45.908349 13710 rpcz_store.cc:276] 0709 13:06:44.582060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.905857 (+1323797us) service_pool.cc:224] Handling call
0709 13:06:45.906348 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.906742 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.906775 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.906844 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:45.906914 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.906979 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.907088 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:45.920696 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:45.922459 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:45.923123 13791 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 1.
I20260709 13:06:45.928731 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:45.929685 13791 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:06:45.930852 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:45.931917 13791 raft_consensus.cc:2393] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 3: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:45.932832 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:45.915148 13788 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:45.934237 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:45.935170 13788 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:45.936460 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:45.937287 13788 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:45.938323 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:45.943783 13791 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
W20260709 13:06:45.576552 13829 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.022s	sys 0.033s
W20260709 13:06:45.961330 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 300242us
W20260709 13:06:45.962278 13755 connection.cc:256] RPC call timeout handler was delayed by -1.84196900500001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
I20260709 13:06:45.976572 13707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1737) took 1434 ms. Trace:
I20260709 13:06:45.977100 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:46.026278 13755 connection.cc:256] RPC call timeout handler was delayed by -1.8068690050000669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16160000000000002s for a response
I20260709 13:06:45.618160 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 1785) took 2188 ms. Trace:
W20260709 13:06:46.027530 13829 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.216s	user 0.022s	sys 0.039s
I20260709 13:06:46.027938 13863 rpcz_store.cc:276] 0709 13:06:43.430129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.430243 (+   114us) service_pool.cc:224] Handling call
0709 13:06:43.436306 (+  6063us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.518565 (+ 82259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.518584 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.525728 (+  7144us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.667209 (+141481us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:43.667241 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.604418 (+1937177us) spinlock_profiling.cc:243] Waited 82 ms on lock 0x7b54000d1bd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:45.604464 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:45.604506 (+    42us) raft_consensus.cc:1685] finished
0709 13:06:45.604520 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.618095 (+ 13575us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188685184,"thread_start_us":69830,"threads_started":1,"wal-append.queue_time_us":296923,"wal-append.run_cpu_time_us":1795,"wal-append.run_wall_time_us":1001815}
W20260709 13:06:46.001245 13680 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.540s (SENT) [suppressed 47 similar messages]
I20260709 13:06:46.032851 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:45.686343 14366 connection.cc:256] RPC call timeout handler was delayed by -1.2519162520000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
I20260709 13:06:46.034528 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:46.035459 14366 connection.cc:256] RPC call timeout handler was delayed by -1.2222162519999529s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
W20260709 13:06:46.036366 14366 connection.cc:256] RPC call timeout handler was delayed by -1.183516252000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2162s for a response
I20260709 13:06:46.026424 13707 rpcz_store.cc:276] 0709 13:06:44.542589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.904538 (+1361949us) service_pool.cc:224] Handling call
0709 13:06:45.905119 (+   581us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:45.905825 (+   706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.905871 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:45.906674 (+   803us) log.cc:844] Serialized 26 byte log entry
0709 13:06:45.976088 (+ 69414us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:45.976144 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.976264 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:45.976319 (+    55us) raft_consensus.cc:1685] finished
0709 13:06:45.976335 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.976478 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1872,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":163,"thread_start_us":68799,"threads_started":1,"wal-append.queue_time_us":55394}
W20260709 13:06:46.037168 14366 connection.cc:256] RPC call timeout handler was delayed by -1.1021188889999394s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
I20260709 13:06:46.039093 15948 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:45.609851 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 51360.7us
I20260709 13:06:45.619513 14398 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:45.553066 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:06:46.002815 14368 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.010s	sys 0.014s
I20260709 13:06:46.044305 14400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 893) took 1064 ms. Trace:
W20260709 13:06:46.044477 14368 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.011s	sys 0.014s
I20260709 13:06:46.044689 14400 rpcz_store.cc:276] 0709 13:06:44.979849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.296345 (+316496us) service_pool.cc:224] Handling call
0709 13:06:46.044101 (+747756us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:46.045192 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 721492us
W20260709 13:06:45.688694 14395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 606) took 3032 ms (client timeout 1962 ms). Trace:
I20260709 13:06:46.048133 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 894) took 1063 ms. Trace:
W20260709 13:06:46.047875 14395 rpcz_store.cc:269] 0709 13:06:42.656262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.649261 (+992999us) service_pool.cc:224] Handling call
0709 13:06:45.182213 (+1532952us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b5800077d98. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9eee 0000000000375939 00007f523742d1e0 00007f52374f60c4 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:06:45.685766 (+503553us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11408128}
I20260709 13:06:46.048796 14398 rpcz_store.cc:276] 0709 13:06:44.980054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.987986 (+  7932us) service_pool.cc:224] Handling call
0709 13:06:46.043364 (+1055378us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:45.624639 14397 rpcz_store.cc:276] 0709 13:06:42.616951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.236592 (+1619641us) service_pool.cc:224] Handling call
0709 13:06:44.236997 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:44.273483 (+ 36486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.277392 (+  3909us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:44.290118 (+ 12726us) log.cc:844] Serialized 26 byte log entry
0709 13:06:44.472418 (+182300us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:44.581266 (+108848us) log.cc:844] Serialized 14 byte log entry
0709 13:06:44.609321 (+ 28055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.626629 (+ 17308us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:45.114333 (+487704us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b18002bf840. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f13f3 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
0709 13:06:45.117471 (+  3138us) raft_consensus.cc:1685] finished
0709 13:06:45.117628 (+   157us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.117810 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72305,"prepare.queue_time_us":66825,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":48720,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":5595,"spinlock_wait_cycles":82204160,"thread_start_us":172607,"threads_started":1,"wal-append.queue_time_us":277342}
I20260709 13:06:45.280952 15943 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:45.318578 15947 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:46.053866 15947 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:45.181010 15959 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:45.699712 15968 consensus_meta.cc:287] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.871s	user 0.012s	sys 0.000s
I20260709 13:06:45.505692 16016 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:46.058780 16124 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:46.060482 13857 raft_consensus.cc:1240] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:44.972494 16043 raft_consensus.cc:2955] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:46.062611 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:45.280727 16053 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:46.064327 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.064800 13712 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 5: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:46.008219 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:45.650002 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:46.009028 16048 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.009518 16057 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:46.009864 13856 consensus_meta.cc:287] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.661s	user 0.013s	sys 0.002s
I20260709 13:06:45.265836 16068 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:46.076279 16048 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:46.078148 16068 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:45.332340 16074 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:46.079546 13856 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:46.078969 16048 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:45.398538 16084 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.210s
I20260709 13:06:46.081210 13861 raft_consensus.cc:1240] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:45.171180 16105 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:46.069036 16057 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:45.596521 16113 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:45.675565 16123 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:46.083813 13862 raft_consensus.cc:1240] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:45.747298 16133 consensus_meta.cc:287] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.872s	user 0.007s	sys 0.004s
I20260709 13:06:45.509096 16150 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:45.608492 16161 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:06:45.676999 16051 consensus_queue.cc:237] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:46.089136 16133 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:45.796485 16179 consensus_meta.cc:287] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.984s	user 0.014s	sys 0.004s
I20260709 13:06:46.090849 16179 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:45.553789 16190 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:45.630041 16091 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:46.092760 16190 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:46.093268 14367 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:46.094028 16091 raft_consensus.cc:697] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:45.753456 16130 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:46.095073 16036 consensus_queue.cc:1059] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:45.605333 16135 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:45.697273 16145 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:45.761539 16146 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:45.615688 16193 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:45.759291 16207 log.cc:927] Time spent T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:06:46.019819 16208 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:46.021528 13786 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
W20260709 13:06:46.026721 13755 connection.cc:256] RPC call timeout handler was delayed by -1.7141690050000307s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
I20260709 13:06:45.596588 16045 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:46.118384 16045 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:46.118958 16045 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.119918 13829 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:46.121321 16193 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:46.095619 16091 consensus_queue.cc:237] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:46.125273 15948 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:46.126466 16124 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:46.128755 16134 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:46.129499 16134 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:46.130126 16134 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:46.133244 13782 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:46.134029 16109 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.134575 16109 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:46.136665 16123 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:46.070623 13713 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:06:46.067484 13788 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:46.080614 15968 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:46.140502 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:46.141498 15968 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:46.083165 15943 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:45.110608 16144 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:46.142043 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:46.142820 13788 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:46.143800 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:46.143951 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:46.144368 13788 raft_consensus.cc:2376] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7. Re-sending same reply.
I20260709 13:06:46.144511 16144 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:46.079164 13716 raft_consensus.cc:1240] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:46.084378 16105 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:46.087870 13756 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:45.679714 16178 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.145813 13710 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:46.146466 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 78255.6us
I20260709 13:06:46.095572 16161 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:46.100106 16057 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:46.100850 16036 raft_consensus.cc:3055] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:46.151026 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:46.151294 16036 raft_consensus.cc:740] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:46.151706 13707 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.151847 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:46.098268 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.103719 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:46.114006 13755 connection.cc:256] RPC call timeout handler was delayed by -1.6853690049999841s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
I20260709 13:06:46.065701 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.116654 16048 consensus_queue.cc:1048] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:46.116859 16133 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:46.145154 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:46.150828 16057 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:46.152638 13788 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
W20260709 13:06:46.153128 13755 connection.cc:256] RPC call timeout handler was delayed by -1.507169005000037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
I20260709 13:06:46.152654 16036 consensus_queue.cc:260] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:46.156617 13786 raft_consensus.cc:2393] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 3: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:46.138331 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:46.156320 13755 connection.cc:256] RPC call timeout handler was delayed by -1.5053690050000341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
I20260709 13:06:46.160146 13785 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:06:46.160207 13755 connection.cc:256] RPC call timeout handler was delayed by -1.5037320860000136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
W20260709 13:06:46.161028 13755 connection.cc:256] RPC call timeout handler was delayed by -1.4576690050000707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
W20260709 13:06:46.161479 13755 connection.cc:256] RPC call timeout handler was delayed by -1.4234690050000154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
W20260709 13:06:46.161856 13755 connection.cc:256] RPC call timeout handler was delayed by -1.4200320860001057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
W20260709 13:06:46.162250 13755 connection.cc:256] RPC call timeout handler was delayed by -1.383869005000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
W20260709 13:06:46.162617 13755 connection.cc:256] RPC call timeout handler was delayed by -1.3451690050000025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
W20260709 13:06:46.162995 13755 connection.cc:256] RPC call timeout handler was delayed by -1.3388690049999923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2136s for a response
W20260709 13:06:46.163362 13755 connection.cc:256] RPC call timeout handler was delayed by -1.2686690049999925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2214s for a response
W20260709 13:06:46.163877 13755 connection.cc:256] RPC call timeout handler was delayed by -1.2517320860000609s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
W20260709 13:06:46.164925 13755 connection.cc:256] RPC call timeout handler was delayed by -1.0717320859999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
I20260709 13:06:46.138855 16134 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:46.166544 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 562) took 1604 ms. Trace:
I20260709 13:06:46.170166 13791 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:06:46.171475 16131 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:46.171761 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:46.172281 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:46.172650 13708 raft_consensus.cc:2393] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 7: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:46.156788 16161 raft_consensus.cc:697] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:46.168857 13785 rpcz_store.cc:276] 0709 13:06:44.559860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.868627 (+308767us) service_pool.cc:224] Handling call
0709 13:06:46.038898 (+1170271us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b580001c598. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9e9c 00007f522f3b9a5b 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:46.039218 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.160689 (+121471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.164525 (+  3836us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37203200}
I20260709 13:06:46.168504 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:46.179178 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:46.178877 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:46.181363 16036 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.177454 16123 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:46.189049 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:46.190829 16195 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:46.191370 16195 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:46.191860 16195 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.192093 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 546) took 1503 ms. Trace:
I20260709 13:06:46.192517 13858 rpcz_store.cc:276] 0709 13:06:44.688673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.798179 (+109506us) service_pool.cc:224] Handling call
0709 13:06:44.798497 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.570680 (+772183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.191570 (+620890us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b5400375fd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:46.191864 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1754012416}
I20260709 13:06:46.193832 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.195320 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.195758 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.198312 13863 raft_consensus.cc:2368] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 6. Current term is 8.
I20260709 13:06:46.198875 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:46.199246 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.199805 13785 raft_consensus.cc:2393] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 3: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:46.200456 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.200569 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:46.200711 13708 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:46.201259 16150 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:46.201553 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.202193 13786 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:06:46.202814 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.203142 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:46.201630 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.198117 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:46.201562 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:46.204195 13708 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:46.204644 13785 raft_consensus.cc:2376] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3. Re-sending same reply.
I20260709 13:06:46.211668 13755 leader_election.cc:400] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5.
I20260709 13:06:46.203568 16179 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:46.214444 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:46.215473 13788 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:06:46.216480 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:46.217796 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:46.221973 13757 leader_election.cc:400] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 6. Current term is 8.
I20260709 13:06:46.222301 13788 raft_consensus.cc:2410] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:06:46.222433 13757 leader_election.cc:403] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:46.223109 16161 consensus_queue.cc:237] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:46.224525 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.225701 14368 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:46.226902 16065 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:46.226977 14368 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:46.227474 16065 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:46.227592 16057 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:46.227979 16065 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:46.228226 16071 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:46.228731 16071 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:46.229192 16071 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:46.229792 16124 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:46.213730 16119 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:06:46.223299 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:46.235556 13788 raft_consensus.cc:2376] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3. Re-sending same reply.
I20260709 13:06:46.237035 13782 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 6: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:46.236415 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:46.239943 13786 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:46.247996 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1725) took 2693 ms. Trace:
W20260709 13:06:46.248910 13856 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1803) took 2734 ms (client timeout 1567 ms). Trace:
I20260709 13:06:46.249451 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:46.251353 13791 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:46.253051 15959 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:46.248631 13711 rpcz_store.cc:276] 0709 13:06:43.554484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.666546 (+112062us) service_pool.cc:224] Handling call
0709 13:06:43.672898 (+  6352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.830611 (+157713us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.830642 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:43.830685 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:43.830727 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.239829 (+2409102us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b540010c054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:46.247480 (+  7651us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.247745 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362182912}
I20260709 13:06:46.257293 16045 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:46.249351 13856 rpcz_store.cc:269] 0709 13:06:43.514810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.522814 (+  8004us) service_pool.cc:224] Handling call
0709 13:06:46.248646 (+2725832us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54003016d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:46.248793 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3622243072}
I20260709 13:06:46.258924 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:46.259519 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.260636 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.260581 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.261579 13782 raft_consensus.cc:2393] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 4: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:46.261950 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.262358 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 545) took 1586 ms. Trace:
I20260709 13:06:46.262636 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:46.263001 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.263391 13789 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
W20260709 13:06:46.263913 13789 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 556) took 1709 ms (client timeout 2119 ms). Trace:
I20260709 13:06:46.263957 14393 raft_consensus.cc:1240] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:46.264334 13789 rpcz_store.cc:269] 0709 13:06:44.554244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.857033 (+302789us) service_pool.cc:224] Handling call
0709 13:06:46.262359 (+1405326us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b580001c598. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:06:46.263850 (+  1491us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":756163968}
I20260709 13:06:46.265458 16190 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:46.267254 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.268102 13860 raft_consensus.cc:2393] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 6: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:46.260957 16045 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:46.242394 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:46.262879 13865 rpcz_store.cc:276] 0709 13:06:44.675788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.802338 (+126550us) service_pool.cc:224] Handling call
0709 13:06:44.802652 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.827682 (+ 25030us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.827716 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.827755 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:44.827791 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.261857 (+1434066us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b540035aa54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:46.261934 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.262149 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57120000}
I20260709 13:06:46.281283 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:46.282364 13788 raft_consensus.cc:2410] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:06:46.280979 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:46.271431 14366 leader_election.cc:336] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.538s (SENT)
I20260709 13:06:46.283726 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.296432 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.329111 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:46.329886 13865 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.330076 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:46.329567 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:46.331152 13785 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
W20260709 13:06:46.305815 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 122946us
W20260709 13:06:46.297672 13680 leader_election.cc:336] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.592s (SENT)
I20260709 13:06:46.312577 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2200) took 1448 ms. Trace:
I20260709 13:06:46.334375 13707 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:46.341498 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:46.336251 13716 rpcz_store.cc:276] 0709 13:06:44.865459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.908688 (+1043229us) service_pool.cc:224] Handling call
0709 13:06:45.909083 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.145324 (+236241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.312175 (+166851us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54002e81d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:46.312455 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390510848}
I20260709 13:06:46.340662 13680 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:46.342691 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:46.355896 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:46.343607 16057 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 6. Current term is 8.
I20260709 13:06:46.364014 13856 raft_consensus.cc:3055] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:46.364766 13856 raft_consensus.cc:740] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:46.368948 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:46.379930 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:46.381673 16178 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5.
W20260709 13:06:46.386649 13682 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.025s	sys 0.033s
W20260709 13:06:46.395699 13682 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.027s	sys 0.033s
I20260709 13:06:46.387848 13860 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:46.397328 13707 raft_consensus.cc:2393] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 5: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:46.388193 14401 raft_consensus.cc:2376] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3. Re-sending same reply.
I20260709 13:06:46.411044 13787 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:06:46.382233 13755 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:46.360085 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:46.439209 13716 raft_consensus.cc:1240] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:46.545329 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 544) took 1884 ms. Trace:
W20260709 13:06:46.549904 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 268980us
I20260709 13:06:46.577716 13860 raft_consensus.cc:2410] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:06:46.413108 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 1.01517e+06us
I20260709 13:06:46.506768 13865 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:46.462517 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:46.448961 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 551) took 1122 ms. Trace:
I20260709 13:06:46.611577 14401 raft_consensus.cc:2393] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 5: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:46.610705 13857 rpcz_store.cc:276] 0709 13:06:45.326244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.554156 (+227912us) service_pool.cc:224] Handling call
0709 13:06:45.608802 (+ 54646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.061071 (+452269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.411172 (+350101us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b54003dc7d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:46.448897 (+ 37725us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1037215488}
I20260709 13:06:46.465610 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:46.475838 13856 consensus_queue.cc:260] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:46.465071 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:46.607933 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:46.608146 13862 rpcz_store.cc:276] 0709 13:06:44.661008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.790505 (+129497us) service_pool.cc:224] Handling call
0709 13:06:44.790853 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.084329 (+1293476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.544932 (+460603us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400345154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:46.545247 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2972260096}
W20260709 13:06:46.617055 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 376245us
I20260709 13:06:46.617220 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.619084 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.572448 16211 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:46.621748 13864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:06:46.622068 14400 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:46.479573 16222 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:46.470465 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:46.440076 16134 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:46.568583 16043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:58544 (request call id 11) took 10521 ms. Trace:
I20260709 13:06:46.384809 16065 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:46.629419 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.625569 13864 raft_consensus.cc:606] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Received request to transfer leadership to TS ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:46.463016 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:46.383093 16071 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:46.641455 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 137801us
I20260709 13:06:46.638037 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.644322 13856 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.597015 16195 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:46.649165 13865 raft_consensus.cc:1240] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:46.643088 14400 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:46.650476 13864 raft_consensus.cc:614] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:46.651846 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 1808) took 2079 ms. Trace:
I20260709 13:06:46.652226 13861 rpcz_store.cc:276] 0709 13:06:44.572116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.573949 (+  1833us) service_pool.cc:224] Handling call
0709 13:06:44.574328 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.081710 (+1507382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.641864 (+560154us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54003dccd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:46.651791 (+  9927us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3464144256}
I20260709 13:06:46.652925 16065 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:46.653509 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:46.646762 14366 leader_election.cc:336] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.553s (SENT)
W20260709 13:06:46.654090 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.654945 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:46.655172 14366 leader_election.cc:336] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.781s (SENT)
I20260709 13:06:46.654117 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.661607 13860 raft_consensus.cc:1240] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:46.665563 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 481) took 2398 ms. Trace:
I20260709 13:06:46.665759 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:46.665988 13713 rpcz_store.cc:276] 0709 13:06:44.267633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.267789 (+   156us) service_pool.cc:224] Handling call
0709 13:06:44.268105 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.139130 (+1871025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.665253 (+526123us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54000c6a54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:46.665503 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4110264192}
I20260709 13:06:46.666440 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:46.667194 13862 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:46.670054 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 304429us
W20260709 13:06:46.670258 13680 leader_election.cc:336] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.634s (SENT)
I20260709 13:06:46.670943 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.674081 16203 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.675789 13680 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:46.680526 13857 raft_consensus.cc:1240] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:46.670678 14395 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:46.679170 16121 consensus_queue.cc:1059] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:06:46.683902 16051 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:46.674760 16203 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:46.690613 16205 raft_consensus.cc:3055] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:06:46.693797 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.688937 13682 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:46.702944 13755 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:46.708472 13856 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:46.713423 13757 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:46.715456 13755 leader_election.cc:400] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 2. Current term is 3.
I20260709 13:06:46.717204 13783 raft_consensus.cc:1240] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:46.717655 16135 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:46.718130 13783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1510) took 1966 ms. Trace:
I20260709 13:06:46.718398 13755 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:46.716166 16057 consensus_queue.cc:1059] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:46.720167 13784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 550) took 2176 ms. Trace:
I20260709 13:06:46.690814 16071 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:46.724092 13863 raft_consensus.cc:2393] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 3: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:46.702482 16205 raft_consensus.cc:740] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:06:46.732012 13829 connection.cc:256] RPC call timeout handler was delayed by -1.1532110260000081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
I20260709 13:06:46.720578 13784 rpcz_store.cc:276] 0709 13:06:44.543686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.868128 (+324442us) service_pool.cc:224] Handling call
0709 13:06:46.719106 (+1850978us) spinlock_profiling.cc:243] Waited 47.4 ms on lock 0x7b580001c598. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:46.719377 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.719660 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.719684 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:46.719760 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:46.719819 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.719885 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.720009 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108954496}
I20260709 13:06:46.736649 13856 raft_consensus.cc:1240] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:46.739941 14366 leader_election.cc:336] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.901s (SENT)
I20260709 13:06:46.727782 16178 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:46.736819 16016 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:46.749048 13680 leader_election.cc:336] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.677s (SENT)
I20260709 13:06:46.752123 13680 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:46.718660 13783 rpcz_store.cc:276] 0709 13:06:44.751464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.885873 (+134409us) service_pool.cc:224] Handling call
0709 13:06:46.716426 (+1830553us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b580001c598. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:46.716777 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.717797 (+  1020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.718052 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":799875328}
I20260709 13:06:46.751212 16121 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:46.741645 16075 consensus_queue.cc:1059] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:06:46.762248 16121 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:46.762547 13856 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:46.762869 16075 raft_consensus.cc:3055] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:46.762548 15956 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:46.763279 16075 raft_consensus.cc:740] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:46.763432 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:46.764336 16075 consensus_queue.cc:260] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:46.765586 16075 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:46.767783 15956 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:46.767904 16087 consensus_queue.cc:1059] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:46.768318 15956 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.768956 16087 raft_consensus.cc:3055] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:46.769344 16087 raft_consensus.cc:740] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:46.770177 16087 consensus_queue.cc:260] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:46.762720 16121 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:46.789866 13862 raft_consensus.cc:2410] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:46.771368 16087 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.640623 16043 rpcz_store.cc:276] 0709 13:06:36.046968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.047265 (+   297us) service_pool.cc:224] Handling call
0709 13:06:36.183587 (+136322us) log.cc:844] Serialized 506 byte log entry
0709 13:06:46.568328 (+10384741us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95,"raft.queue_time_us":2642,"raft.run_cpu_time_us":2032,"raft.run_wall_time_us":2309,"spinlock_wait_cycles":37248,"thread_start_us":17552,"threads_started":2,"wal-append.queue_time_us":22088,"wal-append.run_cpu_time_us":2100,"wal-append.run_wall_time_us":1027060}
I20260709 13:06:46.774226 16195 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:46.799229 13755 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:46.799988 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:46.794586 16051 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:46.792829 16241 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:46.808950 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 73435.2us
I20260709 13:06:46.809625 14368 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:46.812794 13857 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:46.810832 16178 raft_consensus.cc:697] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:46.815449 16043 consensus_queue.cc:1059] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:06:46.814620 16236 log.cc:927] Time spent T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:06:46.814929 16211 consensus_queue.cc:1059] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:06:46.825502 13862 raft_consensus.cc:1240] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:46.819979 16091 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:46.830802 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1734) took 2347 ms. Trace:
I20260709 13:06:46.831270 13714 rpcz_store.cc:276] 0709 13:06:44.482348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.902403 (+1420055us) service_pool.cc:224] Handling call
0709 13:06:45.902816 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.120070 (+217254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.120109 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:46.120153 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:46.120189 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.829512 (+709323us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54001c57d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:46.829574 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.829737 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":498834816}
I20260709 13:06:46.832260 13790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1509) took 2081 ms. Trace:
I20260709 13:06:46.825256 13783 raft_consensus.cc:2368] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3.
I20260709 13:06:46.814314 14396 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:06:46.832638 13790 rpcz_store.cc:276] 0709 13:06:44.751161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.879845 (+128684us) service_pool.cc:224] Handling call
0709 13:06:46.825401 (+1945556us) spinlock_profiling.cc:243] Waited 47.1 ms on lock 0x7b580001c598. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:46.831692 (+  6291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.831889 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.831911 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:46.831960 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:46.831990 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.832041 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.832119 (+    78us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108345216}
I20260709 13:06:46.816365 16178 consensus_queue.cc:237] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:46.840634 16211 raft_consensus.cc:3055] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:46.841089 16211 raft_consensus.cc:740] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:46.842060 16211 consensus_queue.cc:260] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:46.845660 13708 raft_consensus.cc:1240] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:46.843739 13712 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1730) took 2386 ms (client timeout 1908 ms). Trace:
I20260709 13:06:46.845364 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 552) took 1518 ms. Trace:
I20260709 13:06:46.860778 13860 rpcz_store.cc:276] 0709 13:06:45.326491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.625897 (+1299406us) service_pool.cc:224] Handling call
0709 13:06:46.651579 (+ 25682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.662065 (+ 10486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.845104 (+183039us) spinlock_profiling.cc:243] Waited 9.83 ms on lock 0x7b5400387554. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:46.845275 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22618368}
I20260709 13:06:46.859035 13680 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:06:46.860473 13712 rpcz_store.cc:269] 0709 13:06:44.456988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.168514 (+711526us) service_pool.cc:224] Handling call
0709 13:06:46.838419 (+1669905us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b540010cf54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:46.843639 (+  5220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1678417792}
I20260709 13:06:46.866451 13713 raft_consensus.cc:1240] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:46.868451 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 72148.5us
I20260709 13:06:46.870692 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.871376 13861 raft_consensus.cc:2393] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 4: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:06:46.872562 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 67915.8us
I20260709 13:06:46.811322 16205 consensus_queue.cc:260] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:46.871299 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 70311.1us
W20260709 13:06:46.884652 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.875849 16243 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:46.876579 16207 log.cc:927] Time spent T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260709 13:06:46.876909 16235 log.cc:927] Time spent T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.135s	user 0.001s	sys 0.001s
I20260709 13:06:46.877202 14395 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:06:46.879264 16121 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:46.880620 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:46.881161 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:46.880360 14368 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:46.854494 16109 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:46.861212 16053 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:46.901675 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 551) took 2357 ms. Trace:
I20260709 13:06:46.901988 13710 raft_consensus.cc:2368] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3.
I20260709 13:06:46.902120 13787 rpcz_store.cc:276] 0709 13:06:44.543924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.863811 (+319887us) service_pool.cc:224] Handling call
0709 13:06:46.171941 (+1308130us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b580001c598. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:06:46.898907 (+726966us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54001b67d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:46.901604 (+  2697us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1178764928}
I20260709 13:06:46.902453 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:46.902972 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:46.903390 13859 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:46.904126 13709 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 7: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:46.904647 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:46.905400 16075 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:46.905728 16161 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:46.906558 13829 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:46.907083 16075 consensus_queue.cc:1059] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:46.908809 16065 raft_consensus.cc:3055] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:46.909260 16195 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:46.909205 16065 raft_consensus.cc:740] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:46.860653 16203 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:46.891083 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:46.891832 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:46.894057 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:46.894891 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:46.883879 16051 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:46.897066 13863 raft_consensus.cc:1240] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:46.864754 15956 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:46.900895 14400 raft_consensus.cc:1240] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:46.900806 13755 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:46.909162 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:46.911098 13757 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:46.843405 16211 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:46.889823 16243 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:06:46.938787 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 64395.8us
I20260709 13:06:46.939430 13716 raft_consensus.cc:2393] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 4: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:46.928910 13711 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:06:46.941140 13715 raft_consensus.cc:2393] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 3: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:46.948979 13707 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:06:46.951550 13755 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:46.935645 16109 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:46.953044 16109 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.953471 16109 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.953274 16244 consensus_queue.cc:1059] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:06:46.954519 16244 raft_consensus.cc:3055] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:46.954908 16244 raft_consensus.cc:740] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:46.955561 16057 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:46.955921 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:06:46.956288 16234 log.cc:927] Time spent T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.165s	user 0.001s	sys 0.001s
I20260709 13:06:46.957114 14398 raft_consensus.cc:2410] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:46.919988 16065 consensus_queue.cc:260] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:46.956112 16057 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:46.958176 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:46.929790 16051 raft_consensus.cc:697] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:06:46.958596 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 78305.6us
W20260709 13:06:46.960390 13680 leader_election.cc:336] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.855s (SENT)
I20260709 13:06:46.937546 16243 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.950657 16016 raft_consensus.cc:1064] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
W20260709 13:06:46.967559 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 60812.9us
I20260709 13:06:46.966616 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:46.970050 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:46.972790 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:46.949976 16053 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:46.972932 13709 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.951550 16075 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:46.988333 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:46.966763 16057 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:46.990722 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:46.991876 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:46.994361 13712 raft_consensus.cc:1240] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:46.995177 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:46.995915 16051 consensus_queue.cc:237] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:46.997123 16016 consensus_queue.cc:237] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:46.946285 16247 consensus_queue.cc:1059] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:06:46.975971 16053 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:06:47.006187 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 57501.2us
I20260709 13:06:47.006664 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:47.016346 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:47.018455 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:47.019914 16246 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:06:46.998095 16242 raft_consensus.cc:3055] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:47.022284 16242 raft_consensus.cc:740] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:46.991864 16178 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:47.039008 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 90949us
I20260709 13:06:47.039825 13711 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:06:47.034896 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 69262.3us
I20260709 13:06:47.029232 13755 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:47.041826 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:46.985620 16161 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:06:47.052201 14400 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.024695 16053 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:47.006278 16205 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.955958 16244 consensus_queue.cc:260] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:47.054401 13680 leader_election.cc:336] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.873s (SENT)
I20260709 13:06:47.062326 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:47.052763 14368 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:47.074472 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:47.039256 16075 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:06:47.082531 13712 raft_consensus.cc:2393] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 3: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:06:47.093214 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 64095.9us
W20260709 13:06:47.094609 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 94328.2us
I20260709 13:06:47.066888 15956 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:47.102469 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:47.057166 16256 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:47.096716 13680 leader_election.cc:336] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.883s (SENT)
I20260709 13:06:47.108078 13755 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:47.108240 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:47.108949 13862 raft_consensus.cc:2393] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 4: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:47.111502 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:47.118782 14400 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:06:47.097882 16244 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.082216 16043 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:47.129228 13707 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:06:47.133363 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 49104.9us
I20260709 13:06:47.112286 16121 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:47.121141 16241 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:47.132211 15956 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:47.167850 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 54446.4us
I20260709 13:06:47.171032 13755 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:47.196138 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:47.200970 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:47.201592 13707 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 5: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:47.143013 16262 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:47.176141 16091 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
W20260709 13:06:47.219610 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 48679.5us
W20260709 13:06:47.230674 16255 log.cc:927] Time spent T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 13:06:47.231834 16258 log.cc:927] Time spent T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:06:47.236876 16109 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:47.246637 13713 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:47.249249 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:47.252548 13787 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:47.253383 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:47.264106 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 223381us
I20260709 13:06:47.268800 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:47.269528 13785 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:47.269677 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:47.272428 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:47.268149 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:47.268646 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:47.195480 16257 consensus_queue.cc:1048] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.128s
I20260709 13:06:47.270473 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:47.278913 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:47.257078 16241 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:47.280099 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:47.282464 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:47.282801 13715 raft_consensus.cc:2393] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 3: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:47.283200 13782 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
W20260709 13:06:47.286727 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.287065 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:47.284578 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:47.289780 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:47.291925 14368 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:47.289255 13865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:06:47.298843 13787 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 4: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:47.300745 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:47.307673 16265 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:47.308729 16265 consensus_queue.cc:1059] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:47.309813 16265 raft_consensus.cc:3055] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:47.310233 16265 raft_consensus.cc:740] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:47.311914 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:47.313550 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:47.314379 14393 raft_consensus.cc:2376] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4. Re-sending same reply.
I20260709 13:06:47.301246 13865 raft_consensus.cc:606] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Received request to transfer leadership to TS ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:47.317387 13865 raft_consensus.cc:614] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:47.320083 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:06:47.324075 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.322212 13680 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:06:47.325330 16239 log.cc:927] Time spent T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.579s	user 0.006s	sys 0.000s
I20260709 13:06:47.325410 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:47.311290 16265 consensus_queue.cc:260] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:47.326962 16265 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.329981 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:47.331153 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:47.331971 13863 raft_consensus.cc:2393] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 4: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:47.332155 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:47.280171 16190 consensus_queue.cc:1059] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:06:47.333938 16190 raft_consensus.cc:3055] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:47.334311 16190 raft_consensus.cc:740] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:47.301790 16075 consensus_queue.cc:1059] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:06:47.336279 16267 raft_consensus.cc:3055] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:47.336647 16267 raft_consensus.cc:740] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:47.337237 16074 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:47.337437 16267 consensus_queue.cc:260] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:47.326258 13858 raft_consensus.cc:2393] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 2: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:47.341181 13829 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:47.352260 16267 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.354346 13611 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49444 (request call id 318) took 7481 ms. Trace:
I20260709 13:06:47.355751 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:47.356550 14397 raft_consensus.cc:2393] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 6: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:47.356969 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:47.357244 16051 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:47.357607 14401 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.357788 16051 raft_consensus.cc:697] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:06:47.358935 13756 connection.cc:256] RPC call timeout handler was delayed by -1.1312784269999838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
W20260709 13:06:47.359678 13680 leader_election.cc:336] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 2.004s (SENT)
I20260709 13:06:47.359789 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:47.360203 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:47.360255 13680 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:47.356367 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:06:47.359325 13756 connection.cc:256] RPC call timeout handler was delayed by -1.0808784269999023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
I20260709 13:06:47.354664 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:06:47.363852 13756 connection.cc:256] RPC call timeout handler was delayed by -1.0331784269999389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
I20260709 13:06:47.360435 13712 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:47.358788 16051 consensus_queue.cc:237] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:47.301476 16091 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:06:47.340092 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:47.372658 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:47.383543 13791 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.374197 16262 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:47.374624 14366 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:47.375515 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:06:47.375931 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.377246 13712 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:47.381892 14394 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:06:47.388784 14366 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:47.389194 16242 consensus_queue.cc:260] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:47.390156 14366 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:47.390653 16242 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.392377 16251 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:47.393126 16251 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:47.393803 13755 leader_election.cc:400] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 2. Current term is 3.
I20260709 13:06:47.394115 13755 leader_election.cc:403] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:47.394789 13755 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:47.395061 16270 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:47.395773 16265 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:47.361204 16071 consensus_queue.cc:1175] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b9d194f45e044e0988d5de1a99e5cd02" responder_term: 3 status { last_received { term: 3 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 3 index: 5 } }
I20260709 13:06:47.379513 14396 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:47.400166 16113 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:47.400350 16222 raft_consensus.cc:3055] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:47.400787 16222 raft_consensus.cc:740] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:47.335224 16190 consensus_queue.cc:260] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:47.401705 16222 consensus_queue.cc:260] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:47.402772 16190 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:47.402990 16222 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.377665 16195 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:47.396622 13680 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:47.405529 13682 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:47.407042 14366 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:47.407706 16043 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:47.407896 16259 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:47.408216 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:47.408519 16250 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.409058 13783 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:47.410049 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:47.411116 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:47.407743 16241 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 2. Current term is 3.
I20260709 13:06:47.412261 16241 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:47.408186 14366 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:47.408267 16043 raft_consensus.cc:697] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:47.414799 16251 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:47.418900 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.420259 13755 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:47.421845 16178 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:47.422252 16178 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:47.422618 16178 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.408375 16259 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:47.424630 13755 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:47.426831 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:47.437829 13861 raft_consensus.cc:2393] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 4: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:47.438094 16109 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:47.438851 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:47.439472 14399 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:47.439917 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:47.438707 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:47.436076 16195 raft_consensus.cc:697] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:47.440752 13861 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 7: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:47.440963 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:47.441155 16195 consensus_queue.cc:237] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:47.436630 16259 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.436836 14401 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
W20260709 13:06:47.426105 13680 leader_election.cc:336] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.567s (SENT)
W20260709 13:06:47.447923 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 48618.9us
I20260709 13:06:47.451620 13709 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:06:47.452525 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 497) took 1098 ms. Trace:
I20260709 13:06:47.453306 13714 raft_consensus.cc:1240] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:47.452899 13708 rpcz_store.cc:276] 0709 13:06:46.346204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.382766 (+ 36562us) service_pool.cc:224] Handling call
0709 13:06:46.845457 (+462691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.860051 (+ 14594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.444298 (+584247us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b540010cf50. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:47.444436 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1063208704}
I20260709 13:06:47.453655 13856 raft_consensus.cc:1240] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:47.453902 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:47.454684 13862 raft_consensus.cc:2376] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3. Re-sending same reply.
I20260709 13:06:47.455123 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:47.458199 13857 raft_consensus.cc:2393] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 3: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:47.460186 13786 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
W20260709 13:06:47.460534 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 79474us
W20260709 13:06:47.443619 16211 consensus_meta.cc:287] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.516s	user 0.005s	sys 0.005s
I20260709 13:06:47.462226 13863 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:47.457978 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:47.465947 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:47.394814 16267 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:47.470722 13612 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49428 (request call id 326) took 3197 ms. Trace:
I20260709 13:06:47.470538 13614 catalog_manager.cc:5697] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.477298 16276 ts_tablet_manager.cc:933] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533)
I20260709 13:06:47.354809 13611 rpcz_store.cc:276] 0709 13:06:39.873225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.873334 (+   109us) service_pool.cc:224] Handling call
0709 13:06:47.354113 (+7480779us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:44.429447 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:44.590086 (+160639us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:44.597802 (+  7716us) write_op.cc:435] Acquired schema lock
0709 13:06:44.608386 (+ 10584us) tablet.cc:662] Decoding operations
0709 13:06:44.697302 (+ 88916us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:44.716259 (+ 18957us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:44.716312 (+    53us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:44.726137 (+  9825us) tablet.cc:701] Row locks acquired
0709 13:06:44.726161 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:06:44.737792 (+ 11631us) write_op.cc:270] Start()
0709 13:06:44.737959 (+   167us) write_op.cc:276] Timestamp: P: 1783602404726271 usec, L: 0
0709 13:06:44.737986 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:06:44.838745 (+100759us) log.cc:844] Serialized 599 byte log entry
0709 13:06:45.645641 (+806896us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b18003556c0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f13f3 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
0709 13:06:46.635188 (+989547us) spinlock_profiling.cc:243] Waited 7.27 ms on lock 0x7b54003ee318. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f523249a7bc 00007f523249d2c0 00007f523249d248 00007f523249d1c8 00007f523249d183 00007f523249c44c 00007f5238349626 00007f5238343dd8 00007f5232085b41 00007f5232078f2a
0709 13:06:46.803112 (+167924us) op_driver.cc:464] REPLICATION: finished
0709 13:06:47.048366 (+245254us) write_op.cc:301] APPLY: starting
0709 13:06:47.063610 (+ 15244us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:47.063737 (+   127us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:47.063772 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:47.064131 (+   359us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:47.134325 (+ 70194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:47.134390 (+    65us) write_op.cc:312] APPLY: finished
0709 13:06:47.134683 (+   293us) log.cc:844] Serialized 23 byte log entry
0709 13:06:47.134892 (+   209us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:47.135006 (+   114us) write_op.cc:454] Released schema lock
0709 13:06:47.135075 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:47.146538 (+ 11463us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:47.146583 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":180248,"apply.run_cpu_time_us":2941,"apply.run_wall_time_us":121539,"num_ops":1,"prepare.queue_time_us":243624,"prepare.run_cpu_time_us":25599,"prepare.run_wall_time_us":889838,"raft.queue_time_us":127464,"raft.run_cpu_time_us":58161,"raft.run_wall_time_us":330066,"replication_time_us":2045534,"spinlock_wait_cycles":47511552,"thread_start_us":594737,"threads_started":4,"wal-append.queue_time_us":486067}]]}
W20260709 13:06:47.485677 13662 auto_rebalancer.cc:629] Failed to schedule move for tablet 8d8b741328f1468cb4ac726ffe62e9e8: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:06:47.487596 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:47.488166 16252 consensus_queue.cc:1059] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:47.414839 16043 consensus_queue.cc:237] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:47.466850 16109 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:47.447065 16113 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:06:47.491644 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:47.492379 13863 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:47.492859 13862 raft_consensus.cc:1240] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:47.495631 13859 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:47.497192 13682 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:47.498566 16065 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.444300 16243 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:47.502566 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:47.504695 13708 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:47.507457 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:47.508762 14395 raft_consensus.cc:2410] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:06:47.511665 13830 leader_election.cc:336] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Timed out: RequestConsensusVote RPC to 127.12.76.129:37533 timed out after 2.702s (SENT)
I20260709 13:06:47.539315 13756 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:47.541038 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:47.543618 13788 raft_consensus.cc:2393] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 7: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:47.544662 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:47.566634 13861 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.501096 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:47.510885 16057 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:47.566655 13858 raft_consensus.cc:1275] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:06:47.569125 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 120577us
I20260709 13:06:47.569315 13715 raft_consensus.cc:2368] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3.
I20260709 13:06:47.468114 16053 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:47.578295 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 153754us
I20260709 13:06:47.526569 13612 rpcz_store.cc:276] 0709 13:06:44.273148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.273304 (+   156us) service_pool.cc:224] Handling call
0709 13:06:47.470526 (+3197222us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:46.020356 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:46.046051 (+ 25695us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:46.046103 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:06:46.046133 (+    30us) tablet.cc:662] Decoding operations
0709 13:06:46.046782 (+   649us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:46.046846 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:46.046885 (+    39us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:06:46.047277 (+   392us) tablet.cc:701] Row locks acquired
0709 13:06:46.047327 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:06:46.066604 (+ 19277us) write_op.cc:270] Start()
0709 13:06:46.075730 (+  9126us) write_op.cc:276] Timestamp: P: 1783602406057336 usec, L: 0
0709 13:06:46.084821 (+  9091us) op_driver.cc:348] REPLICATION: starting
0709 13:06:46.132952 (+ 48131us) log.cc:844] Serialized 1175 byte log entry
0709 13:06:46.985744 (+852792us) op_driver.cc:464] REPLICATION: finished
0709 13:06:47.134740 (+148996us) write_op.cc:301] APPLY: starting
0709 13:06:47.134830 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:47.135007 (+   177us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:47.135159 (+   152us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:47.200546 (+ 65387us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:47.245492 (+ 44946us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:06:47.252296 (+  6804us) write_op.cc:312] APPLY: finished
0709 13:06:47.267992 (+ 15696us) log.cc:844] Serialized 29 byte log entry
0709 13:06:47.271871 (+  3879us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:47.277677 (+  5806us) write_op.cc:454] Released schema lock
0709 13:06:47.279963 (+  2286us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:47.292548 (+ 12585us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:47.292576 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":54372,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":142965,"apply.run_cpu_time_us":3404,"apply.run_wall_time_us":157670,"mutex_wait_us":412,"num_ops":2,"prepare.queue_time_us":185555,"prepare.run_cpu_time_us":4551,"prepare.run_wall_time_us":112990,"replication_time_us":872315,"thread_start_us":90391,"threads_started":1}]]}
I20260709 13:06:47.592566 14401 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:06:47.598701 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 87050.5us
I20260709 13:06:47.610883 13756 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:47.612178 13860 raft_consensus.cc:1240] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:47.586772 13614 catalog_manager.cc:5697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 1 to 3, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 3 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:47.643826 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:47.647567 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:47.655390 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 45007.8us
I20260709 13:06:47.579818 16211 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:47.682324 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 95345.6us
I20260709 13:06:47.684043 13829 leader_election.cc:400] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3.
I20260709 13:06:47.684360 13829 leader_election.cc:403] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:06:47.687045 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 189900us
I20260709 13:06:47.688098 13682 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:47.692049 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:47.693774 13786 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:06:47.714874 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 120536us
W20260709 13:06:47.716135 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.744552 13682 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:47.681399 15956 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:06:47.773584 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 173785us
W20260709 13:06:47.773757 13680 leader_election.cc:336] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.540s (SENT)
W20260709 13:06:47.780531 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 97253.9us
I20260709 13:06:47.780979 13680 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:47.610565 16109 consensus_queue.cc:1048] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 13:06:47.682675 16211 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:47.778759 13614 catalog_manager.cc:5697] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 1 to 3, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 3 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.691828 16256 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:47.788902 13786 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:06:47.823156 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 46135.1us
I20260709 13:06:47.822404 13614 catalog_manager.cc:5697] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 3 to 5, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 5 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.825172 13756 leader_election.cc:400] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8.
I20260709 13:06:47.825542 13756 leader_election.cc:403] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:47.783548 16211 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:47.836292 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:47.837193 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.690644 16241 consensus_queue.cc:1059] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.136s
I20260709 13:06:47.792228 16256 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:47.841450 13614 catalog_manager.cc:5697] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 1 to 3, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 3 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.814368 16291 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:06:47.862996 16291 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:06:47.863675 16282 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:06:47.863613 16291 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:47.865844 16291 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:47.854728 16243 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:47.869158 16244 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8.
W20260709 13:06:47.872318 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 48450.4us
W20260709 13:06:47.861855 16283 log.cc:927] Time spent T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:06:47.848120 15956 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:47.883549 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 187340us
I20260709 13:06:47.845638 16256 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.892781 13708 raft_consensus.cc:1240] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:47.832633 16178 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:47.861943 16287 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:47.912639 13682 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:47.899992 16057 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:47.899935 16053 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:47.905364 16288 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:47.928382 16291 consensus_queue.cc:1059] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:47.929605 14401 raft_consensus.cc:1240] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:47.929629 16291 raft_consensus.cc:3055] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:47.930356 16291 raft_consensus.cc:740] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:47.931231 16291 consensus_queue.cc:260] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:47.932171 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:47.932428 16291 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:47.923669 15956 consensus_queue.cc:1059] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:47.932834 16259 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:47.934001 15956 raft_consensus.cc:3055] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:47.934422 15956 raft_consensus.cc:740] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:47.940168 16178 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:47.941030 13682 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:47.942385 16178 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:47.942927 16178 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:47.943265 16291 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:47.944908 16222 consensus_meta.cc:287] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.519s	user 0.008s	sys 0.000s
I20260709 13:06:47.925606 13861 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:47.926431 16287 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:47.926429 16293 consensus_queue.cc:1059] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 13:06:47.927911 16087 consensus_meta.cc:287] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 1.126s	user 0.012s	sys 0.000s
I20260709 13:06:47.928098 14398 raft_consensus.cc:1240] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:47.929821 16250 consensus_meta.cc:287] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.521s	user 0.005s	sys 0.003s
W20260709 13:06:47.922762 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 182779us
W20260709 13:06:48.044093 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 219780us
W20260709 13:06:48.044792 13784 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.026s	sys 0.045s
W20260709 13:06:48.048503 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 260451us
W20260709 13:06:48.049381 13784 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.026s	sys 0.045s
W20260709 13:06:48.050042 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:48.052515 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 174728us
I20260709 13:06:48.054544 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:48.055960 13756 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:48.052671 16250 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.042620 16074 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3.
I20260709 13:06:48.048530 16287 raft_consensus.cc:697] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:48.069514 16121 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.059504 16299 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.070551 13755 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:06:48.072157 16301 log.cc:927] Time spent T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
W20260709 13:06:48.073172 16065 consensus_meta.cc:287] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.000s
I20260709 13:06:48.046581 16256 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:48.096720 16256 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:48.056502 16178 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:48.097594 13786 raft_consensus.cc:1240] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:48.071664 16057 consensus_queue.cc:1059] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:06:47.935281 15956 consensus_queue.cc:260] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:48.090957 16242 consensus_meta.cc:287] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.700s	user 0.009s	sys 0.003s
W20260709 13:06:48.091369 13785 consensus_meta.cc:287] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.000s
I20260709 13:06:48.107846 13785 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:06:48.059423 16259 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:48.098990 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 44503us
I20260709 13:06:48.100414 14393 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:48.062909 16203 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.092571 16267 raft_consensus.cc:3055] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:48.083154 16211 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:48.106217 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:48.084503 16287 consensus_queue.cc:237] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:48.090799 13707 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:06:48.110792 13829 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:48.124312 13788 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:06:48.110888 13756 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:48.127861 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:48.112892 16178 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:06:48.137156 16279 log.cc:927] Time spent T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.676s	user 0.011s	sys 0.012s
W20260709 13:06:48.137503 13791 consensus_meta.cc:287] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.702s	user 0.006s	sys 0.001s
I20260709 13:06:48.137813 13791 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:06:48.098286 16299 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:48.142648 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:48.148602 16290 log.cc:927] Time spent T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
W20260709 13:06:48.149394 13783 consensus_meta.cc:287] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.737s	user 0.010s	sys 0.001s
I20260709 13:06:48.149829 13783 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:06:48.150871 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:48.152732 16190 consensus_meta.cc:287] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.749s	user 0.008s	sys 0.000s
I20260709 13:06:48.117607 16267 raft_consensus.cc:740] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:48.154397 15956 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.154232 16267 consensus_queue.cc:260] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:48.155261 16267 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.157070 16244 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.157168 13789 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:06:48.157733 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:48.158448 13787 raft_consensus.cc:2393] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 4: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:48.111680 16203 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:48.159780 16203 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.161144 13864 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:48.164261 13788 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
W20260709 13:06:48.164214 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 53516.3us
I20260709 13:06:48.165400 13829 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:48.166610 13790 raft_consensus.cc:1240] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:48.167156 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 61323.6us
I20260709 13:06:48.168418 13756 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:48.171918 16298 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:48.172859 16294 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:48.175794 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:48.176424 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:48.177537 13863 raft_consensus.cc:2393] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 7: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:48.165911 13757 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:48.108726 16276 tablet_copy_client.cc:323] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.129:37533
I20260709 13:06:48.195992 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:48.201413 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:06:48.202008 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 151402us
I20260709 13:06:48.200752 13830 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:48.203106 13756 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:48.205358 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:48.168049 16057 consensus_queue.cc:1059] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:06:48.203509 16178 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:48.196096 16298 raft_consensus.cc:697] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:48.235857 13756 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:48.242223 13829 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:06:48.243233 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.243749 13830 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:48.204931 16242 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:48.253500 16274 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.792s	user 0.057s	sys 0.054s
I20260709 13:06:48.240902 16109 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.256719 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:48.258912 13784 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
W20260709 13:06:48.261528 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 52000.2us
I20260709 13:06:48.262693 13830 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:48.266636 13789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1525) took 1023 ms. Trace:
I20260709 13:06:48.264741 13829 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:48.267097 13789 rpcz_store.cc:276] 0709 13:06:47.242963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.289382 (+ 46419us) service_pool.cc:224] Handling call
0709 13:06:48.266461 (+977079us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b540033b154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:48.266589 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1833792256}
W20260709 13:06:48.269640 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.271142 13830 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:48.239697 16051 consensus_queue.cc:1059] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:06:48.250689 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:48.273273 13829 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:48.276611 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:48.277436 16298 consensus_queue.cc:237] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:48.298945 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:48.299064 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:48.299427 16195 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.256336 16299 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:48.279665 16134 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:48.300977 16134 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:48.280144 16293 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:48.280486 16284 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:48.272715 16294 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:48.281795 16211 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:48.286540 16016 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:48.318084 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:48.289728 13680 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:48.280439 13786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1528) took 1002 ms. Trace:
I20260709 13:06:48.292589 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:48.259439 16241 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:48.295704 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:48.301606 13755 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:48.301059 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:48.283561 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.304996 13756 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:48.304425 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:48.301578 16134 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:48.285863 16203 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:48.331848 13789 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:48.296872 16256 raft_consensus.cc:3055] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:48.327934 13786 rpcz_store.cc:276] 0709 13:06:47.278094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.789955 (+511861us) service_pool.cc:224] Handling call
0709 13:06:47.808225 (+ 18270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.098072 (+289847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.280212 (+182140us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54002eb8d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:48.280378 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":664972672}
I20260709 13:06:48.335294 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:48.340094 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:48.340802 14394 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:48.333923 14398 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEARNER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:48.340818 13791 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 6: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:48.344295 13755 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:48.304428 15956 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:48.346971 13756 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:48.348583 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:48.350607 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:48.328261 16190 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:48.351936 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:48.363324 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.337076 16205 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.345106 16244 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.348073 16304 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.339370 16016 raft_consensus.cc:697] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:48.354908 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:48.339223 16256 raft_consensus.cc:740] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:48.394454 16016 consensus_queue.cc:237] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:48.395133 16256 consensus_queue.cc:260] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:48.397357 16256 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.338896 16294 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:48.357100 16313 raft_consensus.cc:2764] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:48.356791 16203 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:48.361394 13756 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:48.326881 16293 raft_consensus.cc:697] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:48.362959 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:48.402774 13786 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:48.363641 13789 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:06:48.334470 16211 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:48.301942 16109 consensus_queue.cc:1059] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:06:48.337823 16178 raft_consensus.cc:697] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:48.345214 16287 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.408938 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:48.410548 13856 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:48.393330 16190 raft_consensus.cc:697] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:48.412348 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 635) took 1090 ms. Trace:
I20260709 13:06:48.412439 13784 raft_consensus.cc:2393] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 4: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:48.402109 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:48.417286 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 127649us
I20260709 13:06:48.390955 15956 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:48.414811 14393 rpcz_store.cc:276] 0709 13:06:47.322967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.341909 (+ 18942us) service_pool.cc:224] Handling call
0709 13:06:48.412186 (+1070277us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b54004c18d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:48.412291 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1576261376}
I20260709 13:06:48.420118 13786 raft_consensus.cc:1240] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:48.398813 16244 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:48.424190 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:48.424386 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 153352us
I20260709 13:06:48.425283 13830 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:06:48.425401 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 64097.2us
I20260709 13:06:48.425990 13786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1533) took 1091 ms. Trace:
I20260709 13:06:48.426352 13786 rpcz_store.cc:276] 0709 13:06:47.329057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.415104 (+1086047us) service_pool.cc:224] Handling call
0709 13:06:48.419864 (+  4760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.420597 (+   733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.420834 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.427341 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:48.428193 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:48.440210 13784 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:48.440909 13784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1537) took 1110 ms. Trace:
I20260709 13:06:48.441242 13784 rpcz_store.cc:276] 0709 13:06:47.330103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.425180 (+1095077us) service_pool.cc:224] Handling call
0709 13:06:48.440002 (+ 14822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.440658 (+   656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.440856 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.425297 16304 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.445269 13726 tablet_copy_service.cc:140] P b9d194f45e044e0988d5de1a99e5cd02: Received BeginTabletCopySession request for tablet ac05b1933cb74e488759c38bd76d8d00 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:58552)
I20260709 13:06:48.445403 16293 consensus_queue.cc:237] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:48.429451 16262 consensus_queue.cc:1059] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:06:48.446537 16178 consensus_queue.cc:237] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:48.447345 16285 log.cc:927] Time spent T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.577s	user 0.003s	sys 0.000s
I20260709 13:06:48.439944 16016 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:48.449249 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:48.454538 16109 consensus_queue.cc:1059] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:48.459385 16016 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:48.479539 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:48.480280 14393 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:48.459251 16190 consensus_queue.cc:237] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:48.459879 13726 tablet_copy_service.cc:161] P b9d194f45e044e0988d5de1a99e5cd02: Beginning new tablet copy session on tablet ac05b1933cb74e488759c38bd76d8d00 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:58552: session id = ceb06175847b428ea8bd77055fcddf58-ac05b1933cb74e488759c38bd76d8d00
I20260709 13:06:48.460083 13783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1539) took 1129 ms. Trace:
I20260709 13:06:48.460325 16243 raft_consensus.cc:3055] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:48.462607 13680 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:48.457710 16287 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:48.401111 16294 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:48.464644 13790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1530) took 1136 ms. Trace:
I20260709 13:06:48.498203 13790 rpcz_store.cc:276] 0709 13:06:47.328235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.866748 (+538513us) service_pool.cc:224] Handling call
0709 13:06:47.867041 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.167100 (+300059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.464390 (+297290us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b540033bb54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:48.464573 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":688421760}
I20260709 13:06:48.468232 13786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1538) took 1137 ms. Trace:
I20260709 13:06:48.470597 16244 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:48.474457 16121 raft_consensus.cc:3055] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:48.475732 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 577) took 1233 ms. Trace:
I20260709 13:06:48.451503 16043 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:48.476766 13784 raft_consensus.cc:1240] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:48.484442 13788 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:48.486284 13830 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:48.462886 13787 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:48.487825 13756 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:48.489663 13755 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:48.499336 13786 rpcz_store.cc:276] 0709 13:06:47.330352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.444178 (+1113826us) service_pool.cc:224] Handling call
0709 13:06:48.457808 (+ 13630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.467789 (+  9981us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.467828 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:48.467888 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:48.467940 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.468021 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.468157 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:48.507148 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 57975.9us
I20260709 13:06:48.507166 13782 rpcz_store.cc:276] 0709 13:06:47.242126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.290622 (+ 48496us) service_pool.cc:224] Handling call
0709 13:06:47.300177 (+  9555us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:47.386388 (+ 86211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.386419 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:47.436388 (+ 49969us) log.cc:844] Serialized 26 byte log entry
0709 13:06:47.689201 (+252813us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:47.806057 (+116856us) log.cc:844] Serialized 14 byte log entry
0709 13:06:47.806367 (+   310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.806489 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:47.869811 (+ 63322us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b1800153220. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f1522 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
0709 13:06:48.278627 (+408816us) spinlock_profiling.cc:243] Waited 4.04 ms on lock 0x7b1800153220. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f1557 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
0709 13:06:48.446767 (+168140us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:06:48.475501 (+ 28734us) raft_consensus.cc:1685] finished
0709 13:06:48.475531 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.475669 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25027,"prepare.queue_time_us":131721,"prepare.run_wall_time_us":39,"raft.queue_time_us":32705,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":15287,"spinlock_wait_cycles":32426240,"thread_start_us":143056,"threads_started":1,"wal-append.queue_time_us":383011}
I20260709 13:06:48.482282 16016 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.514889 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:48.489727 16243 raft_consensus.cc:740] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:48.497368 16195 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.520603 15956 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:48.528512 13756 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:48.526558 13829 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:48.506929 16121 raft_consensus.cc:740] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:48.512600 16051 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:48.538679 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.521373 16244 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:48.542297 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 79798.6us
I20260709 13:06:48.538702 13829 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:06:48.541092 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 54995us
I20260709 13:06:48.546871 13680 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:48.549486 16134 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:48.550662 16287 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.551103 16262 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.551862 16134 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:48.551645 16262 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:48.554114 16262 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:48.525251 16109 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:48.523684 16043 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:48.486933 13783 rpcz_store.cc:276] 0709 13:06:47.330599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.459145 (+1128546us) service_pool.cc:224] Handling call
0709 13:06:48.459516 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.459722 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.459754 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:48.459805 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:48.459842 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.459908 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.460027 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.557366 16043 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:48.539800 16051 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:48.558717 16051 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.559180 13680 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:48.560029 13756 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:48.536345 16065 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.527405 16294 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:48.533152 16318 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:48.542465 16244 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.536509 16324 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:48.564277 16178 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.563740 16262 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.602700 13790 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:48.567637 16134 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:48.612093 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 62835.1us
I20260709 13:06:48.613327 13680 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:48.560216 15956 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:06:48.594877 16244 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.592240 16043 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.594587 16324 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.565687 16241 consensus_queue.cc:1059] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:06:48.587276 16065 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:48.599293 16299 raft_consensus.cc:3055] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:48.626796 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:48.596693 16318 raft_consensus.cc:697] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 5 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:48.589691 16256 consensus_queue.cc:1059] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:06:48.617303 16267 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:48.625953 16304 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.599897 16320 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:06:48.636956 16287 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:48.637209 16288 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:48.629694 16299 raft_consensus.cc:740] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:48.625880 16324 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.610879 16262 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:48.670693 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 102361us
I20260709 13:06:48.673506 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:48.649875 16121 consensus_queue.cc:260] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:48.680429 16043 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:48.680847 16043 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:48.681200 16043 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:48.682301 16299 consensus_queue.cc:260] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:48.683564 16299 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:48.683625 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:48.674983 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:48.687115 13790 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 6: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:48.689133 13829 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:06:48.654198 16329 log.cc:927] Time spent T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:48.693307 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:48.698470 16043 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:48.654667 16288 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:48.690467 16074 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:06:48.702133 16288 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:48.669639 16267 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:48.704547 16267 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:48.705331 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:48.706228 13786 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:48.649361 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:48.707060 13787 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:06:48.656975 16318 consensus_queue.cc:237] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:48.709165 16043 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:48.709987 16036 raft_consensus.cc:3055] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:48.710428 16036 raft_consensus.cc:740] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:48.711310 16036 consensus_queue.cc:260] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:48.712190 16262 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:48.712301 16036 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.664264 16065 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:48.713640 16326 log.cc:927] Time spent T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.209s	user 0.003s	sys 0.000s
I20260709 13:06:48.709978 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:48.716187 13787 raft_consensus.cc:2393] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 4: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:48.651309 16287 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:48.716717 16287 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.717023 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:48.718199 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:48.718781 13787 raft_consensus.cc:2376] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8. Re-sending same reply.
I20260709 13:06:48.722137 16065 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.722678 16065 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:48.725229 16065 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:48.727560 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:48.732705 13680 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:48.733946 16043 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:48.735319 13680 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:48.736460 16043 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.736851 16043 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:48.737321 16043 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.737532 13680 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:48.652686 16281 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.757161 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:48.744132 14366 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:48.746129 13710 raft_consensus.cc:1275] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:48.746340 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:48.748533 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:48.749826 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:48.750191 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:48.760156 13680 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:48.750290 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:48.747272 16195 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.751883 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:48.695223 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:48.763156 13790 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 6: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:48.707324 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:48.774240 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 85262us
I20260709 13:06:48.791846 13786 raft_consensus.cc:2393] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 5: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:48.790053 16324 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:48.796808 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:48.797394 13786 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.798233 16324 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:48.791141 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 47115.4us
I20260709 13:06:48.800460 16053 raft_consensus.cc:3055] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:48.800899 16053 raft_consensus.cc:740] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:48.802821 14366 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:48.790372 13713 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:48.804229 16043 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:48.806704 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:48.806842 16241 raft_consensus.cc:3055] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:48.810352 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:48.811198 13784 raft_consensus.cc:2393] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 6: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:48.812516 13784 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:48.818080 13708 raft_consensus.cc:2393] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 3: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:48.761394 13714 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:48.816179 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:48.820003 13782 raft_consensus.cc:2393] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 6: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:48.802702 16065 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:48.795398 16252 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:48.796936 13726 tablet_copy_source_session.cc:215] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:06:48.794575 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 230155us
I20260709 13:06:48.822232 14393 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:48.825544 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:48.830268 13830 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:48.830276 13709 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
W20260709 13:06:48.822937 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 83635.7us
I20260709 13:06:48.827011 13786 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:48.835577 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:48.823670 16036 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:06:48.836264 14366 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:48.838989 13786 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:48.814796 16134 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:48.840193 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:48.859877 13860 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:48.790640 15956 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.840378 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:48.841127 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:48.841272 13858 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:48.839346 16195 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:48.863246 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 52007.2us
I20260709 13:06:48.863404 16195 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:48.866426 16195 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:48.827782 16087 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.846236 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:48.867597 13714 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.820825 16241 raft_consensus.cc:740] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:48.849259 16051 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:48.852335 13756 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:48.832746 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:48.764678 16288 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:48.869251 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:48.876124 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 45931.8us
I20260709 13:06:48.877349 13707 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:48.883703 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:48.883888 13830 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:48.880031 13856 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 2.
I20260709 13:06:48.881498 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:48.881395 13756 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:48.884460 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:48.888140 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:48.888348 13860 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:06:48.888835 13856 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:48.890357 13856 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:48.890826 14368 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:48.892076 13830 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:48.893149 13713 raft_consensus.cc:1240] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:48.882288 16071 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.896095 13715 raft_consensus.cc:2393] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 6: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:48.879483 16299 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.883047 16284 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:48.897048 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 69105.8us
I20260709 13:06:48.897064 14368 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:48.886056 16313 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.907955 14368 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:48.889619 16324 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:48.897176 16288 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:48.888981 16043 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:48.886224 16281 consensus_queue.cc:1059] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:06:48.895982 16109 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:48.913955 16267 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.908959 14368 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:06:48.954663 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 45784.8us
W20260709 13:06:48.917757 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 48900.5us
I20260709 13:06:48.955947 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:48.921308 14366 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:48.892776 16190 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.883888 16134 raft_consensus.cc:697] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:48.929878 16051 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:48.885911 16057 consensus_queue.cc:1048] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:06:48.946319 13714 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:48.900235 16087 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:48.949416 13756 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:48.899039 16334 consensus_queue.cc:1059] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:06:48.894930 16333 consensus_queue.cc:1059] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:06:48.925218 16252 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:48.905376 16195 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:48.978500 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 74751.1us
I20260709 13:06:48.938540 16287 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:48.947769 16288 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:48.967088 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:48.996769 16288 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.997957 13680 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:48.999219 16043 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:49.000175 16043 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:48.967356 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 46160us
I20260709 13:06:49.002420 14366 leader_election.cc:304] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:49.003976 16265 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.966435 16087 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.926272 16241 consensus_queue.cc:260] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:49.005002 16287 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:49.005801 16241 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.006016 16071 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:49.008134 16288 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.010919 13830 leader_election.cc:400] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3.
I20260709 13:06:48.901283 16298 consensus_queue.cc:1059] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:06:49.011639 16288 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:48.962553 16036 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:48.977918 16284 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:48.907856 16306 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:06:49.024034 16036 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.024694 16036 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.957120 16267 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.025825 16267 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.027913 16288 consensus_queue.cc:1059] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:48.966603 16161 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:49.029040 16288 raft_consensus.cc:3055] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:49.029377 16161 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:49.029377 16288 raft_consensus.cc:740] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:49.029868 16161 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.030391 16288 consensus_queue.cc:260] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:49.031927 16243 consensus_queue.cc:260] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.033316 16318 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:49.036453 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:49.035436 14396 raft_consensus.cc:1240] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:49.039249 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:49.040136 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:49.040457 14394 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:49.040750 14402 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:49.041249 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:48.989771 16333 raft_consensus.cc:3055] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:49.042188 16333 raft_consensus.cc:740] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:49.042385 14366 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:49.043274 16333 consensus_queue.cc:260] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.044813 16333 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.045634 16071 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:48.987203 16134 consensus_queue.cc:237] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.048687 16211 raft_consensus.cc:3055] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:49.049178 16211 raft_consensus.cc:740] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:48.988029 16334 raft_consensus.cc:3055] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:49.050010 16211 consensus_queue.cc:260] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.050798 16334 raft_consensus.cc:740] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:49.051362 16211 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:49.051528 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:49.051759 16334 consensus_queue.cc:260] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.053056 16334 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.053400 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:49.054572 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:48.964257 16299 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:49.055639 16299 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:49.056061 16299 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:49.056563 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.979611 16252 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.988049 16057 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:48.992264 16016 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:48.992751 16121 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.993121 13756 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:48.966737 16065 consensus_queue.cc:1059] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:06:48.951568 16109 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:49.012050 16298 raft_consensus.cc:3055] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:49.070808 16298 raft_consensus.cc:740] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:49.004997 16087 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.972304 16244 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.063145 16252 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:49.076697 13787 raft_consensus.cc:2368] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6.
W20260709 13:06:49.079304 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 96856.1us
I20260709 13:06:49.019444 16195 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.023308 13830 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:48.988754 16317 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.040621 14398 raft_consensus.cc:1240] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:49.044829 14366 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:49.060154 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:49.088214 13865 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:49.067082 16036 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.096161 16244 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:49.096428 16036 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:49.096587 16065 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.067392 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:49.097167 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:49.097774 14398 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.099114 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:49.099747 13856 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.099509 16317 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:49.101701 16317 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:49.103614 16298 consensus_queue.cc:260] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:49.104990 16298 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:49.081557 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 175085us
I20260709 13:06:49.105713 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:49.106361 13709 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:49.104719 14398 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:06:49.105748 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:49.107589 13714 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.107664 13755 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:49.109017 13788 raft_consensus.cc:2393] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 4: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:06:49.082597 13785 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1522) took 1840 ms (client timeout 1907 ms). Trace:
W20260709 13:06:49.109514 13785 rpcz_store.cc:269] 0709 13:06:47.242126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.277343 (+ 35217us) service_pool.cc:224] Handling call
0709 13:06:49.082359 (+1805016us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b5400370d54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:49.082523 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413334912}
I20260709 13:06:49.110579 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:49.111248 13785 raft_consensus.cc:2393] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 6: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:49.111294 13856 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:06:49.088584 13713 raft_consensus.cc:3055] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:49.111981 13713 raft_consensus.cc:740] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:49.063398 16057 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:06:49.094553 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 49819.5us
I20260709 13:06:49.077450 16109 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:49.065974 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.088912 13715 raft_consensus.cc:1240] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:49.079782 16288 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:49.085148 16211 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:49.119946 13714 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:06:49.120347 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:49.132486 13680 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:49.113881 14368 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:49.129287 14366 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:49.109179 13786 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 3: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
W20260709 13:06:49.130270 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 107047us
W20260709 13:06:49.119519 16339 log.cc:927] Time spent T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.180s	user 0.000s	sys 0.003s
I20260709 13:06:49.127139 16317 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:49.142405 14366 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:49.127840 13713 consensus_queue.cc:260] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:49.149605 13713 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.130848 16057 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.148226 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:49.157940 15956 consensus_queue.cc:1059] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:49.133054 16195 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:49.134891 16211 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:49.141510 16051 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:49.141265 16036 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:49.146087 16262 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:49.165572 16317 raft_consensus.cc:697] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:49.170109 16341 consensus_queue.cc:1059] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:06:49.276250 16348 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.288578 16348 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:49.289455 16341 raft_consensus.cc:3055] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:49.289961 16341 raft_consensus.cc:740] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:49.291085 16341 consensus_queue.cc:260] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:49.292238 16341 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.302644 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:49.303404 13785 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.147743 16043 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.167s
I20260709 13:06:49.322863 16109 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:49.325649 16109 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:49.330420 13785 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:06:49.331759 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:49.333701 13785 raft_consensus.cc:1240] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 5. Current term is 6. Ops: [3.4-5.5]
I20260709 13:06:49.337843 16252 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.346149 16252 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:49.359277 16016 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:49.366449 13713 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:06:49.366827 13713 pending_rounds.cc:85] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 1
I20260709 13:06:49.367034 13713 pending_rounds.cc:107] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:06:49.367300 13713 raft_consensus.cc:2889] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:49.147187 16265 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.223s
I20260709 13:06:49.380559 16267 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.389065 16087 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.394287 16087 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:49.396483 16267 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:49.174094 16195 raft_consensus.cc:697] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:49.414713 16195 consensus_queue.cc:237] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:49.422857 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 270431us
I20260709 13:06:49.433681 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:49.429039 13789 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:49.591022 16317 consensus_queue.cc:237] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.592635 14395 raft_consensus.cc:1240] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:06:49.603569 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 169927us
I20260709 13:06:49.603351 16043 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:06:49.606804 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.606858 16043 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:49.607510 16043 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:49.609846 16299 consensus_meta.cc:287] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.553s	user 0.006s	sys 0.006s
I20260709 13:06:49.609797 16043 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:49.610420 16299 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:49.613269 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.614625 16299 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:49.615497 16057 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:49.615993 16298 consensus_meta.cc:287] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.511s	user 0.015s	sys 0.001s
I20260709 13:06:49.617964 16057 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:48.838610 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:49.633992 13614 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57116 (request call id 227) took 5482 ms. Trace:
I20260709 13:06:49.634788 13614 rpcz_store.cc:276] 0709 13:06:44.151501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.151615 (+   114us) service_pool.cc:224] Handling call
0709 13:06:49.633924 (+5482309us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:48.094603 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:48.095141 (+   538us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:48.095176 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:06:48.095197 (+    21us) tablet.cc:662] Decoding operations
0709 13:06:48.095898 (+   701us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:48.095958 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:48.095987 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:06:48.096544 (+   557us) tablet.cc:701] Row locks acquired
0709 13:06:48.096563 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:06:48.096703 (+   140us) write_op.cc:270] Start()
0709 13:06:48.096812 (+   109us) write_op.cc:276] Timestamp: P: 1783602408096656 usec, L: 0
0709 13:06:48.096832 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:06:48.097469 (+   637us) log.cc:844] Serialized 2069 byte log entry
0709 13:06:48.407262 (+309793us) op_driver.cc:464] REPLICATION: finished
0709 13:06:48.535431 (+128169us) write_op.cc:301] APPLY: starting
0709 13:06:48.535568 (+   137us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:48.535831 (+   263us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:48.579138 (+ 43307us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:48.664212 (+ 85074us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:48.664545 (+   333us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:06:48.664623 (+    78us) write_op.cc:312] APPLY: finished
0709 13:06:48.664934 (+   311us) log.cc:844] Serialized 47 byte log entry
0709 13:06:48.665159 (+   225us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:48.665318 (+   159us) write_op.cc:454] Released schema lock
0709 13:06:48.665397 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:48.666029 (+   632us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:48.666057 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":184317,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":113344,"apply.run_cpu_time_us":4137,"apply.run_wall_time_us":130491,"num_ops":5,"prepare.queue_time_us":222734,"prepare.run_cpu_time_us":3158,"prepare.run_wall_time_us":3159,"replication_time_us":294361,"thread_start_us":242574,"threads_started":2}]]}
I20260709 13:06:49.637975 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:49.638147 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:49.640836 13787 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:49.641705 13716 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.034s	sys 0.077s
W20260709 13:06:49.642066 13716 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.034s	sys 0.077s
I20260709 13:06:49.638804 16109 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.654951 16109 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.658365 16109 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:49.639427 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
W20260709 13:06:49.661401 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.665184 16324 raft_consensus.cc:3055] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:49.665625 16324 raft_consensus.cc:740] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:49.666464 16324 consensus_queue.cc:260] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:49.669955 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:49.670364 16299 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:49.671630 16299 raft_consensus.cc:697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:49.672708 13787 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:06:49.672459 16299 consensus_queue.cc:237] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.674844 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:49.675689 16043 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:49.676165 16043 raft_consensus.cc:697] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:49.677021 16043 consensus_queue.cc:237] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.680747 16324 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.682431 13713 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:49.683759 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:49.686743 13708 raft_consensus.cc:2393] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 5: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:49.685050 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:49.687685 13714 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:49.700974 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:49.705663 13708 raft_consensus.cc:1240] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:49.706944 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:49.710176 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:49.710752 13709 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.712903 13714 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
I20260709 13:06:49.717639 13709 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:06:49.719044 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:49.720737 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:49.721299 13858 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:49.722431 13856 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:49.727257 13858 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:49.729003 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:49.729532 13858 raft_consensus.cc:2376] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2. Re-sending same reply.
I20260709 13:06:49.732049 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:49.733671 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:49.738008 14395 raft_consensus.cc:1240] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:49.738802 16065 consensus_meta.cc:287] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.642s	user 0.008s	sys 0.004s
I20260709 13:06:49.739253 16065 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:49.739908 16317 consensus_queue.cc:1059] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:49.736903 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:49.806123 13858 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:49.806456 13860 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:49.741988 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:49.750104 13716 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:49.758191 13830 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:49.766004 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:49.766882 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:06:49.808038 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 49939us
I20260709 13:06:49.810000 13830 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:49.810909 16334 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:49.767827 14368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.020s	sys 0.015s
W20260709 13:06:49.811864 14368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.020s	sys 0.015s
W20260709 13:06:49.812170 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 671588us
I20260709 13:06:49.812480 16334 consensus_queue.cc:1059] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:49.767836 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:49.813549 16334 consensus_queue.cc:1059] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:49.814077 13856 raft_consensus.cc:2368] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 5. Current term is 6.
I20260709 13:06:49.814445 16334 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:49.814817 16265 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.814896 16334 raft_consensus.cc:697] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 7 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:49.815460 16087 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.815694 16016 raft_consensus.cc:3055] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:49.816131 16016 raft_consensus.cc:740] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:49.816017 16087 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.817049 16320 raft_consensus.cc:3055] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:49.817442 16320 raft_consensus.cc:740] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:49.818269 16087 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:49.818579 14400 raft_consensus.cc:1240] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:49.818197 16320 consensus_queue.cc:260] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:49.818792 16087 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.819536 16252 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:49.820040 16252 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.821223 13830 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:49.822029 16134 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:49.822137 16252 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:49.773348 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:49.822253 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:49.822665 16134 raft_consensus.cc:697] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:49.775908 16036 raft_consensus.cc:697] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:49.823534 16265 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.824075 16134 consensus_queue.cc:237] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:49.824390 16036 consensus_queue.cc:237] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.825551 16265 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:49.826637 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:49.827209 13857 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:49.778673 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.828028 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:49.829151 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:49.829850 13858 raft_consensus.cc:2393] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 2: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:49.830247 16043 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.830899 16043 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.831785 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:49.832346 13856 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:49.833042 16320 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.833441 16043 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:49.788481 13783 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:49.835034 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:49.835633 13864 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.842828 13864 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:49.803846 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:49.844120 13791 raft_consensus.cc:2393] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 4: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:49.844611 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 595) took 1211 ms. Trace:
W20260709 13:06:49.845427 14366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.011s	sys 0.026s
W20260709 13:06:49.845850 14366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.011s	sys 0.026s
I20260709 13:06:49.845880 16043 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:06:49.846410 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 704031us
I20260709 13:06:49.846552 16043 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.848830 16043 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:49.817063 16016 consensus_queue.cc:260] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:49.849637 16243 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.852126 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:49.852802 16324 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:49.855938 13709 raft_consensus.cc:1275] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:49.856426 16205 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.857086 16205 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.857946 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:49.860391 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:49.861004 14398 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:06:49.863139 16053 consensus_queue.cc:260] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.864163 16053 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.865166 16334 consensus_queue.cc:237] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.844983 13791 rpcz_store.cc:276] 0709 13:06:48.633105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.721743 (+ 88638us) service_pool.cc:224] Handling call
0709 13:06:49.803210 (+1081467us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b580001c598. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:06:49.844546 (+ 41336us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68867456}
I20260709 13:06:49.869869 13755 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:49.872941 14368 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:49.870352 13856 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:06:49.875182 14368 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:49.849702 16016 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.777565 13680 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:49.792914 13682 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:06:49.899232 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 121779us
W20260709 13:06:49.901288 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 108465us
I20260709 13:06:49.897141 13863 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:06:49.903185 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:49.892978 13861 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:06:49.896595 13859 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:49.899214 14366 leader_election.cc:400] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6.
I20260709 13:06:49.907773 14366 leader_election.cc:403] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:06:49.907588 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:49.864435 16320 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:06:49.908814 13682 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:49.896441 16252 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:49.875697 16317 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:49.879969 16205 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:49.897544 16109 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:49.915832 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:49.898204 16265 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:49.898607 16043 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:49.917270 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:49.819269 16087 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.908324 16287 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.924073 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:49.925635 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:49.926288 13863 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:49.913371 16065 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6.
I20260709 13:06:49.927868 13861 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:06:49.916215 16109 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.911355 16341 consensus_queue.cc:1059] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:06:49.920967 16252 raft_consensus.cc:697] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:06:49.929749 16161 consensus_meta.cc:287] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.899s	user 0.014s	sys 0.000s
I20260709 13:06:49.948601 16087 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:49.940994 16057 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
W20260709 13:06:49.952575 16288 consensus_meta.cc:287] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.818s	user 0.013s	sys 0.000s
I20260709 13:06:49.940793 16109 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.954744 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:49.956456 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 47734.8us
I20260709 13:06:49.928086 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:49.930055 16265 raft_consensus.cc:697] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:49.918460 16317 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.962188 14366 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:49.964912 13861 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:06:49.965193 13716 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:06:49.976327 13716 pending_rounds.cc:85] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 4
I20260709 13:06:49.976629 13716 pending_rounds.cc:107] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:06:49.976833 14368 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:49.977586 16288 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:49.977989 16057 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.978514 16057 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:49.976866 13716 raft_consensus.cc:2889] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:49.980989 16351 raft_consensus.cc:3055] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:49.981377 16057 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:49.940732 16267 consensus_queue.cc:1059] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:06:49.981389 16351 raft_consensus.cc:740] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:49.981989 16109 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.983809 16350 consensus_queue.cc:1059] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:06:49.965797 13682 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:49.984915 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:49.985188 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:49.985395 13682 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:49.985827 13859 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.986929 15956 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:49.987480 16341 raft_consensus.cc:2764] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:49.964318 16363 consensus_queue.cc:1059] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:06:49.988754 16341 raft_consensus.cc:3055] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:49.989137 16341 raft_consensus.cc:740] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:06:49.989372 16352 log.cc:927] Time spent T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.366s	user 0.029s	sys 0.030s
I20260709 13:06:49.989969 16341 consensus_queue.cc:260] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.989146 16265 consensus_queue.cc:237] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:49.991981 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:49.992961 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:49.995080 13859 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:49.174033 16211 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:49.972853 13857 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:06:49.996345 13757 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:49.946259 16287 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:06:50.000754 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:50.003226 14368 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:50.004402 16267 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:50.005026 16087 raft_consensus.cc:3055] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:50.006156 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:49.960731 16161 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:50.018512 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 56420.1us
I20260709 13:06:50.000541 15956 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:06:50.060906 16368 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.037043 16358 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.061607 16368 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:50.061880 16358 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:50.063560 16057 raft_consensus.cc:476] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Not starting pre-election -- already a leader
I20260709 13:06:50.038025 13712 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:50.050105 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:50.070500 14393 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.071110 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:50.071982 13788 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:49.993661 16043 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:50.064456 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 77977.4us
I20260709 13:06:50.064731 13784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 599) took 1323 ms. Trace:
W20260709 13:06:50.045085 16361 log.cc:927] Time spent T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:06:50.074098 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:50.082027 13783 raft_consensus.cc:1240] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:06:50.047632 16364 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.038476 16366 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:50.093508 13784 rpcz_store.cc:276] 0709 13:06:48.741379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.813214 (+ 71835us) service_pool.cc:224] Handling call
0709 13:06:48.813577 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:48.844946 (+ 31369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.844975 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:48.845414 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:06:48.880722 (+ 35308us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:48.880766 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.880840 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:49.098947 (+218107us) spinlock_profiling.cc:243] Waited 7.44 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:06:50.064346 (+965399us) raft_consensus.cc:1685] finished
0709 13:06:50.064366 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.064644 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13763,"raft.queue_time_us":32031,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":17109760,"thread_start_us":34932,"threads_started":1,"wal-append.queue_time_us":66825}
I20260709 13:06:50.095109 16364 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:50.095161 16366 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:50.095830 16368 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:50.096340 13682 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:50.068070 16267 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.097271 16267 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:50.037853 16365 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:50.098899 16365 raft_consensus.cc:697] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:50.064010 16358 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:50.044438 16109 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:50.006423 16205 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:50.020105 16065 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:50.070134 16356 log.cc:927] Time spent T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.378s	user 0.005s	sys 0.000s
I20260709 13:06:50.100112 16365 consensus_queue.cc:237] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:50.104960 16262 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:50.098841 16036 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:50.123536 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.131597 13682 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:50.133071 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:50.020352 16363 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:50.067927 16087 raft_consensus.cc:740] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:50.140287 13784 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:06:50.141814 13682 leader_election.cc:400] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 5. Current term is 6.
I20260709 13:06:50.142581 13682 leader_election.cc:403] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:06:50.147334 13682 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:50.135454 16368 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:50.146463 16243 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.150386 16287 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:50.150729 16043 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:50.135145 16205 raft_consensus.cc:697] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:50.163513 13709 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:06:50.150898 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 227660us
I20260709 13:06:50.149430 13682 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:50.165602 13682 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:49.982046 16252 consensus_queue.cc:237] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:50.160609 16373 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.142254 16358 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:50.161996 14393 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:50.168641 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:50.142576 16036 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:50.171481 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:50.173637 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:50.194532 13783 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
W20260709 13:06:50.175278 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.141319 16262 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:50.164389 16109 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:50.204202 13756 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:50.145901 16363 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:50.218206 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:50.171887 16374 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:50.193122 16378 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:50.195907 16368 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:50.221189 14366 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:50.171761 16324 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:06:50.224082 13756 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:50.198719 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:50.168673 16243 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:50.207086 16057 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:50.230634 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 65103us
I20260709 13:06:50.231637 14396 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:50.231925 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:06:50.244170 13645 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1660 after lost signal to thread 12597
I20260709 13:06:50.245723 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:50.220530 16366 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:50.222653 16377 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:50.256345 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.225765 16368 raft_consensus.cc:697] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:50.229063 16374 raft_consensus.cc:697] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:50.259635 16366 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:50.222258 16109 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:50.267043 16374 consensus_queue.cc:237] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:50.268061 16071 raft_consensus.cc:3055] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:50.268486 16071 raft_consensus.cc:740] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:50.268743 16109 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:50.270113 16109 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:50.270259 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:50.235677 16364 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:50.269977 16368 consensus_queue.cc:237] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:50.271126 13857 raft_consensus.cc:2393] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 4: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:50.173974 16373 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:50.235167 16057 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:50.226255 16378 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:50.267076 16211 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:49.173297 16051 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.286643 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:50.223757 16087 consensus_queue.cc:260] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:50.236519 16287 raft_consensus.cc:697] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:50.258374 16377 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.290287 16376 consensus_queue.cc:1059] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 13:06:50.318507 16371 log.cc:927] Time spent T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:06:50.318614 13645 debug-util.cc:398] Leaking SignalData structure 0x7b08003078a0 after lost signal to thread 13648
I20260709 13:06:50.229753 16205 consensus_queue.cc:237] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:50.284927 16262 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:50.328298 13715 raft_consensus.cc:1275] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:50.329262 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:50.352784 13645 debug-util.cc:398] Leaking SignalData structure 0x7b0800167ec0 after lost signal to thread 13662
I20260709 13:06:50.356469 13862 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
W20260709 13:06:50.319391 16370 log.cc:927] Time spent T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:06:50.289638 16373 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:50.324777 16057 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:50.313337 16051 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:50.367431 16376 raft_consensus.cc:3055] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:50.352103 16377 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:50.367795 16287 consensus_queue.cc:237] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:50.368628 16363 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:50.320539 16381 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:50.412930 16376 raft_consensus.cc:740] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:50.440627 16376 consensus_queue.cc:260] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:50.443178 16036 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:50.444021 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.373977 16267 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:50.351933 16109 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.328435 16243 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:50.322960 16043 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 5. Current term is 6.
W20260709 13:06:50.404861 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 179714us
W20260709 13:06:50.357190 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 184302us
I20260709 13:06:50.420640 16382 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:50.451689 14400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 795) took 1404 ms. Trace:
I20260709 13:06:50.457463 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:50.457142 14400 rpcz_store.cc:276] 0709 13:06:49.039766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.041627 (+  1861us) service_pool.cc:224] Handling call
0709 13:06:49.041916 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:49.818985 (+777069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.443894 (+624909us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b540070eed4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:50.444126 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1785595136}
I20260709 13:06:50.401710 16373 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.484947 16373 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:50.413326 16057 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.486208 16057 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:50.434701 16381 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:50.327438 16351 consensus_queue.cc:260] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:50.715628 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.464741 16243 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:06:50.575234 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.755393 16243 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:50.757627 16243 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:50.490867 16382 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:50.760874 16382 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:50.465296 16363 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:50.462232 16109 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:50.773566 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.782425 13715 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:50.784096 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:50.779562 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:50.790115 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 330901us
I20260709 13:06:50.447518 16376 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:50.491703 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:50.554747 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:06:50.791531 13756 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.006s	sys 0.015s
I20260709 13:06:50.486965 16378 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:50.556010 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:06:50.896974 13756 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.007s	sys 0.016s
I20260709 13:06:50.909469 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:50.897828 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:50.910065 14399 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:50.771234 16379 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.899893 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:50.913268 13791 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:50.900646 14395 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:50.898631 13680 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:50.491240 14398 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:50.777288 16393 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:06:50.905958 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:50.896705 13645 debug-util.cc:398] Leaking SignalData structure 0x7b0800391aa0 after lost signal to thread 13740
I20260709 13:06:50.790822 15956 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:06:50.910274 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 686198us
I20260709 13:06:50.767976 16368 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:50.910687 13707 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:06:50.911185 14401 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:50.912451 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:50.927722 13756 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:50.928270 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:50.928923 13707 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:50.878715 16388 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:50.916985 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:50.918184 13714 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
W20260709 13:06:50.915489 13662 auto_rebalancer.cc:629] Failed to schedule move for tablet 19de5233e495495dbff7c520c86d37c7: Illegal state: Replica b5029654a4384e43a68eb67b794949b7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:06:50.929605 13755 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:50.908221 16016 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.939431 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:50.907833 16262 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.940866 13756 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:50.946295 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:50.948073 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:50.949039 13714 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:06:50.909364 16243 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:50.946131 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:50.932933 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:50.939942 16382 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:50.935451 16267 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:50.969426 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:50.964592 16205 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:50.920001 16379 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:50.939306 15956 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:50.969400 16378 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.971318 16057 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:50.955731 16368 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:50.966382 16287 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:50.933458 16393 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:51.013018 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 114316us
I20260709 13:06:50.983511 16360 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.956122 16262 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:50.974733 16395 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.957404 16016 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:50.947391 16388 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.028929 13707 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:06:50.972443 16382 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.968750 16243 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:51.040122 13710 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:06:51.038950 16377 consensus_meta.cc:287] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.609s	user 0.012s	sys 0.000s
I20260709 13:06:51.048035 13710 raft_consensus.cc:1240] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:51.023145 16205 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.048218 13783 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:51.031845 16287 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.036129 16057 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:51.056532 13680 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:06:51.059993 16394 log.cc:927] Time spent T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:06:51.044847 16382 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.065068 13712 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:06:51.057893 16287 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.043305 16395 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:51.076699 16051 consensus_meta.cc:287] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.641s	user 0.010s	sys 0.000s
I20260709 13:06:51.077152 16051 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.078053 16395 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:51.078271 13713 raft_consensus.cc:2393] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 6: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:51.078624 16395 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:51.080847 16388 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:51.044390 16360 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.083477 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 608) took 1014 ms. Trace:
I20260709 13:06:51.072943 16373 leader_election.cc:290] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:51.084139 16397 log.cc:927] Time spent T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:06:51.084055 13782 rpcz_store.cc:276] 0709 13:06:50.069170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.069308 (+   138us) service_pool.cc:224] Handling call
0709 13:06:50.069674 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:50.445858 (+376184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.445890 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:50.446323 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:06:50.890492 (+444169us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:50.945041 (+ 54549us) log.cc:844] Serialized 14 byte log entry
0709 13:06:50.956590 (+ 11549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.956666 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:51.083250 (+126584us) raft_consensus.cc:1685] finished
0709 13:06:51.083269 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.083397 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11285,"prepare.queue_time_us":161687,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":15868,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":19977,"thread_start_us":738309,"threads_started":3,"wal-append.queue_time_us":576838}
I20260709 13:06:51.052495 16377 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.086867 14400 raft_consensus.cc:2368] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6.
I20260709 13:06:51.083562 16360 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:51.092983 13755 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:51.094058 16401 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.094074 16360 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.094589 16401 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:51.095350 16393 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:51.095171 16360 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:51.096196 16287 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:51.097667 16051 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:51.097870 16355 log.cc:927] Time spent T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 1.352s	user 0.003s	sys 0.010s
I20260709 13:06:51.098179 16287 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:51.099629 16360 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:06:51.099879 16398 log.cc:927] Time spent T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:06:51.100337 16382 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:51.101425 16016 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:51.102447 16382 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:51.102728 13611 catalog_manager.cc:5697] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 2 to 3, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 3 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:51.104316 13611 catalog_manager.cc:5697] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:51.105595 16161 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:51.068879 16057 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.118315 13755 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:51.120638 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:51.121192 13782 raft_consensus.cc:2376] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2. Re-sending same reply.
I20260709 13:06:51.121488 13786 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:06:51.122141 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 146775us
I20260709 13:06:51.122704 13756 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:51.106458 16243 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:51.107950 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2472) took 2451 ms. Trace:
I20260709 13:06:51.054968 16205 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.109968 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:51.129958 14395 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:06:51.129572 13865 rpcz_store.cc:276] 0709 13:06:48.656184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.656328 (+   144us) service_pool.cc:224] Handling call
0709 13:06:48.656619 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:49.088635 (+432016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.107695 (+2019060us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b54002d96d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:51.107862 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":992129408}
I20260709 13:06:51.131306 13782 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:51.116866 13611 catalog_manager.cc:5697] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 1 to 3, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 3 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
W20260709 13:06:51.112651 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.128738 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:51.146796 13785 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:51.141383 13611 catalog_manager.cc:5697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:51.108210 16368 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:51.119626 16267 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.174218 14394 raft_consensus.cc:1240] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:51.174893 13789 raft_consensus.cc:1240] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:51.189189 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:51.175554 14399 raft_consensus.cc:1240] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:51.176357 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:51.175071 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:51.190459 13785 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.190788 14395 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.178267 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 610) took 1104 ms. Trace:
I20260709 13:06:51.177214 13784 raft_consensus.cc:1240] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:51.112545 16377 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:51.192390 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:51.192865 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 70201us
I20260709 13:06:51.112885 16317 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:51.118196 16262 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:51.191664 13788 rpcz_store.cc:276] 0709 13:06:50.073676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.073821 (+   145us) service_pool.cc:224] Handling call
0709 13:06:51.178025 (+1104204us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b54000df554. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:51.178197 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1931383552}
W20260709 13:06:51.197184 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:51.201010 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.201390 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:51.202210 13788 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:06:51.203321 13680 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:51.197432 13756 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:51.188342 16382 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:51.204221 16404 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:51.204519 16382 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.158455 16401 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:51.205122 16382 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.205827 16376 consensus_queue.cc:1059] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:51.197180 16267 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.204690 16404 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.210762 16404 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:51.212110 16267 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:51.213876 16360 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.214381 16360 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:51.175957 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:51.207923 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:51.219302 13789 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:06:51.174741 16057 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:51.222213 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:51.192169 16373 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:51.176004 16342 log.cc:927] Time spent T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.867s	user 0.006s	sys 0.007s
I20260709 13:06:51.203219 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:51.194512 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:51.217438 13756 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:51.208735 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:51.221367 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:51.222838 13789 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.209465 13785 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:51.225008 13755 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:51.215988 16243 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:06:51.350291 16057 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.331067 16408 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.350970 16057 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.351670 16408 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:51.352046 16341 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.353180 16057 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:51.350427 16358 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.354121 16408 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:51.216414 16393 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:51.362751 13790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 597) took 2711 ms. Trace:
I20260709 13:06:51.380579 16364 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.381332 16364 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.382212 16379 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:51.378487 16358 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.379846 13790 rpcz_store.cc:276] 0709 13:06:48.668312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.763996 (+ 95684us) service_pool.cc:224] Handling call
0709 13:06:48.855757 (+ 91761us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:48.868534 (+ 12777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.868566 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:48.878824 (+ 10258us) log.cc:844] Serialized 26 byte log entry
0709 13:06:48.939869 (+ 61045us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:48.956565 (+ 16696us) log.cc:844] Serialized 14 byte log entry
0709 13:06:48.959926 (+  3361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.960030 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:49.279731 (+319701us) spinlock_profiling.cc:243] Waited 7.89 ms on lock 0x7b180032caa0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f1522 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
0709 13:06:50.289601 (+1009870us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b180032caa0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f13f3 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
0709 13:06:51.175308 (+885707us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:06:51.362497 (+187189us) raft_consensus.cc:1685] finished
0709 13:06:51.362523 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.362666 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21538,"prepare.queue_time_us":16840,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":15765,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":7147,"spinlock_wait_cycles":44950912,"thread_start_us":39800,"threads_started":1,"wal-append.queue_time_us":94323}
I20260709 13:06:51.219034 16401 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:51.223507 16317 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:51.220490 16287 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.383803 13715 raft_consensus.cc:2410] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:51.374580 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:51.384555 14393 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:06:51.384344 16287 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:51.383777 16401 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.385504 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:51.386435 16287 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:51.386718 16378 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:51.238960 14397 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:06:51.387494 13788 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:51.378535 16350 raft_consensus.cc:3055] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:51.388432 16350 raft_consensus.cc:740] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:51.389410 16401 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:51.350281 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:51.389254 16350 consensus_queue.cc:260] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.216552 16368 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.390314 14394 raft_consensus.cc:2410] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:51.239292 16016 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.218883 16051 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:51.330109 14395 raft_consensus.cc:2410] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:51.360911 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:51.361212 13787 raft_consensus.cc:3055] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:51.406132 13787 raft_consensus.cc:740] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:51.394215 13789 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:51.396843 13790 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:51.373610 16071 consensus_queue.cc:260] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:51.239972 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.406843 13787 consensus_queue.cc:260] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:51.408768 13785 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:06:51.413739 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 196359us
W20260709 13:06:51.362840 16391 log.cc:927] Time spent T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.457s	user 0.000s	sys 0.001s
I20260709 13:06:51.425092 13756 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:51.379954 16087 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.391649 14397 raft_consensus.cc:1275] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:51.371168 15956 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:51.390425 16350 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.434154 13787 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:51.455384 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.408577 16057 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:51.390403 16368 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:51.456291 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 220021us
I20260709 13:06:51.397500 16276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac05b1933cb74e488759c38bd76d8d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:51.218446 16414 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:51.435602 16401 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.435708 16408 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.436127 16287 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:51.435619 16071 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:51.443209 16211 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:51.444727 16382 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.445878 16134 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.446497 16360 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:51.448807 16205 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:51.450417 13645 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1a20 after lost signal to thread 13815
W20260709 13:06:51.477442 13645 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1a00 after lost signal to thread 13816
W20260709 13:06:51.478377 13645 debug-util.cc:398] Leaking SignalData structure 0x7b0800303000 after lost signal to thread 13889
W20260709 13:06:51.409126 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 208206us
I20260709 13:06:51.453531 13756 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:06:51.399209 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 173152us
I20260709 13:06:51.462157 16057 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:51.455922 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:51.389801 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 168494us
I20260709 13:06:51.424467 16378 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:06:51.465332 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.224850 16373 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.496887 14367 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:51.467804 13787 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:51.409127 16016 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:51.503667 13784 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.505077 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:51.358999 16404 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:51.457111 16317 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:51.412747 16051 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:51.508425 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:51.509546 13787 raft_consensus.cc:2393] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 6: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:51.509805 16051 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:51.510378 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:51.511060 13787 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:06:51.511914 16317 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.512434 16317 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.514616 16317 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:51.515573 16317 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:51.516112 16317 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:51.479496 13645 debug-util.cc:398] Leaking SignalData structure 0x7b080035d320 after lost signal to thread 14426
I20260709 13:06:51.516978 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:06:51.517310 13645 debug-util.cc:398] Leaking SignalData structure 0x7b0800096620 after lost signal to thread 16257
W20260709 13:06:51.517640 13645 debug-util.cc:398] Leaking SignalData structure 0x7b08003c2920 after lost signal to thread 16259
W20260709 13:06:51.517710 14367 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.129:37533 timed out after 1.516s (SENT) [suppressed 50 similar messages]
W20260709 13:06:51.518128 13645 debug-util.cc:398] Leaking SignalData structure 0x7b08002d16a0 after lost signal to thread 16279
W20260709 13:06:51.518621 13645 debug-util.cc:398] Leaking SignalData structure 0x7b08003f8a40 after lost signal to thread 16290
W20260709 13:06:51.519325 13645 debug-util.cc:398] Leaking SignalData structure 0x7b08003f8720 after lost signal to thread 16327
I20260709 13:06:51.517650 14394 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:51.363541 16415 consensus_queue.cc:1048] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.103s
I20260709 13:06:51.484534 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:51.529637 13707 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:51.480984 16134 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.487356 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:51.490228 13680 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:51.485289 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:51.493211 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:51.532167 13790 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:06:51.506752 13785 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:51.495216 14366 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:51.489502 16057 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:51.516389 16425 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:51.537925 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:51.538209 13755 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:51.538724 13707 raft_consensus.cc:2393] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 9: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:51.524240 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:51.535897 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:51.539291 13787 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:06:51.541226 13756 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:51.482012 13829 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:51.526620 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:51.527014 13782 raft_consensus.cc:1240] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:51.493024 16357 log.cc:927] Time spent T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 1.757s	user 0.007s	sys 0.012s
I20260709 13:06:51.532054 16378 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.542429 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:51.502365 16373 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.493297 16211 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:51.475708 16414 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.568250 16393 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:51.568871 16393 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.569851 16414 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:51.550261 16051 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:06:51.571165 16393 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:51.572767 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 55075.9us
I20260709 13:06:51.556982 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:51.573695 13790 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.469914 16408 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:51.547288 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 52137us
W20260709 13:06:51.549209 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 84504.1us
I20260709 13:06:51.542950 16421 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:51.545852 16425 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:51.548982 14401 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:06:51.553485 13680 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:51.555455 16418 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:51.555799 16016 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:51.519148 16243 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.556047 16410 consensus_queue.cc:1059] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:06:51.555708 16378 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:51.556313 16402 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:51.556720 16413 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:51.557150 16409 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:51.556982 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:51.602684 13712 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.558797 16134 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:51.559015 16358 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:51.559700 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1776) took 1850 ms. Trace:
W20260709 13:06:51.560503 16417 log.cc:927] Time spent T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:06:51.560428 16380 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:06:51.564385 16368 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:51.565244 16399 log.cc:927] Time spent T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.544s	user 0.000s	sys 0.002s
I20260709 13:06:51.566483 16205 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:51.471040 16287 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:51.471251 16401 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:51.544147 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:51.582682 13755 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:51.584663 13784 raft_consensus.cc:1275] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:51.584646 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:06:51.591197 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.646733 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:51.646850 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 164900us
W20260709 13:06:51.646139 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 63583.9us
I20260709 13:06:51.647346 13861 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:51.647890 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:51.648490 13859 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:51.646464 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:51.649894 13784 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:06:51.650947 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:51.602272 16413 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.549919 16379 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:51.552484 16262 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.606575 13708 rpcz_store.cc:276] 0709 13:06:49.709440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.709893 (+   453us) service_pool.cc:224] Handling call
0709 13:06:49.710410 (+   517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:49.710732 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.710755 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.711698 (+   943us) log.cc:844] Serialized 564 byte log entry
0709 13:06:49.736397 (+ 24699us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:49.736437 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.736502 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:51.439888 (+1703386us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:06:51.559280 (+119392us) raft_consensus.cc:1685] finished
0709 13:06:51.559313 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.559620 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372440320,"thread_start_us":24417,"threads_started":1,"wal-append.queue_time_us":24090}
I20260709 13:06:51.584492 16418 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.620546 13712 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
W20260709 13:06:51.606561 16334 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.635s	user 0.026s	sys 0.026s
I20260709 13:06:51.650079 13865 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 8: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:51.583297 13756 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:51.660712 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:51.613734 16402 raft_consensus.cc:697] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:06:51.673156 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 88634.3us
I20260709 13:06:51.651516 13784 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.670722 13710 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:06:51.680296 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:51.671696 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:51.672341 13789 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:06:51.606208 16016 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:06:51.681144 13710 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:06:51.601637 16243 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.674954 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:51.673684 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:51.677040 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 93823.3us
I20260709 13:06:51.688966 13862 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:06:51.677379 13857 raft_consensus.cc:1240] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:06:51.689404 13756 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:51.678992 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:51.690151 13865 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.690412 16393 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:51.690222 13756 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:51.690928 16393 raft_consensus.cc:697] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:51.691376 13756 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:51.692255 16411 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:51.692684 14366 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:06:51.641796 16366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.375s	user 0.030s	sys 0.046s
W20260709 13:06:51.693707 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:51.694001 16366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.427s	user 0.033s	sys 0.048s
I20260709 13:06:51.694280 16366 raft_consensus.cc:697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:51.694682 16393 consensus_queue.cc:237] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:51.695138 16366 consensus_queue.cc:237] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:51.623138 16349 raft_consensus.cc:3055] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:51.697224 16349 raft_consensus.cc:740] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:51.698410 16401 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:51.698191 16349 consensus_queue.cc:260] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.699193 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:51.699671 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:51.699846 13863 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:06:51.682387 16205 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:51.700814 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:51.700964 16205 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:51.701429 16205 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:51.701813 16205 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:51.649379 16265 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:51.707778 13784 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:06:51.709585 13865 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:51.668511 16211 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:51.650213 16134 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.649477 16395 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:51.693565 16410 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:51.703192 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:51.671880 16379 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:51.715534 13710 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:51.672930 13859 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.717097 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:51.671804 16334 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.704s	user 0.026s	sys 0.026s
I20260709 13:06:51.680379 16422 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:51.672264 16414 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:51.621534 16421 raft_consensus.cc:697] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:51.672940 16418 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.670540 16413 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.720311 14367 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:51.710094 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:51.726678 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:51.762221 13865 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:06:51.686415 16358 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:51.712047 16262 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.768522 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:51.768632 16262 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.769186 13856 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:51.770967 16262 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:51.771791 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:51.771586 16358 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.772425 13857 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:06:51.723306 16379 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.714527 16211 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.728902 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:51.749425 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:51.764827 16421 consensus_queue.cc:237] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.766389 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:51.801908 13786 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:51.767756 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:51.759631 14366 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:06:51.807462 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 47923.6us
I20260709 13:06:51.772084 16057 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.686149 16051 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:51.708508 16401 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.710142 16349 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:51.774739 13708 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:06:51.801122 13865 raft_consensus.cc:1275] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:06:51.810793 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 120618us
I20260709 13:06:51.738077 16378 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:51.813037 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:51.817818 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:51.819711 13709 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.820437 13859 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:06:51.755370 13790 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:06:51.724100 16410 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:51.814551 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:51.747046 16422 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.740767 16364 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:51.800457 16211 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:51.742322 16425 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:51.824960 13710 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:51.734994 16430 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:51.833771 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:51.834461 13710 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
I20260709 13:06:51.778049 16065 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:51.740770 16243 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:51.827003 13786 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:06:51.714536 16265 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.812887 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:51.828951 14366 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:06:51.829977 16424 log.cc:927] Time spent T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:06:51.771401 16205 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:51.831472 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1781) took 1977 ms. Trace:
I20260709 13:06:51.874794 13787 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:51.874935 13716 rpcz_store.cc:276] 0709 13:06:49.854327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.854925 (+   598us) service_pool.cc:224] Handling call
0709 13:06:49.855186 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:49.979762 (+124576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.831151 (+1851389us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400041854. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:51.831367 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252101376}
I20260709 13:06:51.876989 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:51.878448 13716 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 1.
I20260709 13:06:51.777916 16411 raft_consensus.cc:697] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:51.885360 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:51.886720 16411 consensus_queue.cc:237] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:51.887648 13864 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:51.867707 16065 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.888612 16373 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.728363 16016 consensus_queue.cc:1059] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:06:51.834249 13756 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:51.733922 16317 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:51.835350 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:51.890005 16358 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:51.888692 16065 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.814172 16087 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:51.894531 16087 raft_consensus.cc:697] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:51.895776 16087 consensus_queue.cc:237] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:51.862715 13829 consensus_peers.cc:597] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ac05b1933cb74e488759c38bd76d8d00. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:51.898571 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 78382.7us
W20260709 13:06:51.899360 13713 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1774) took 2186 ms (client timeout 2709 ms). Trace:
W20260709 13:06:51.899912 13713 rpcz_store.cc:269] 0709 13:06:49.704421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.706692 (+  2271us) service_pool.cc:224] Handling call
0709 13:06:51.890456 (+2183764us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400260a54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:51.890570 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3151459200}
I20260709 13:06:51.901118 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:51.864331 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:51.902227 13786 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
W20260709 13:06:51.902554 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:51.902959 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.880458 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:51.881402 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.883613 16265 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:51.884742 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:06:51.885331 16427 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:06:51.885576 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:51.828118 16410 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:51.887686 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:51.875828 13680 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:51.828263 16414 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:51.892130 13709 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:06:51.899336 13829 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:51.864998 16376 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:51.829116 16422 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:51.723645 16134 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:51.904052 13716 raft_consensus.cc:2410] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:51.904790 13857 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:51.906039 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:51.743731 16402 consensus_queue.cc:237] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:51.901674 13713 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
W20260709 13:06:51.908401 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 74261.8us
I20260709 13:06:51.912565 16265 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:51.922610 16265 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.923097 14366 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:51.923482 13756 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:51.912140 13707 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:51.924343 13756 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:51.924594 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:51.819044 16401 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:51.915845 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:51.926278 13856 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:51.918850 13858 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:51.918674 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:51.927366 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:51.919844 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:51.918329 13829 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:51.928745 13709 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:51.926744 13756 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:51.937165 13756 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:51.938700 13862 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:51.912750 16036 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.940266 13830 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:51.914474 16393 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:51.943102 13830 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:51.915781 16358 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:51.913398 16414 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.920819 16057 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:51.967116 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.974092 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:51.944473 16395 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:51.867594 16430 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.939976 16317 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:51.971626 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:51.918378 16364 consensus_queue.cc:1059] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:06:51.945365 13861 raft_consensus.cc:1275] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:51.949286 13856 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:06:51.989357 16443 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.949851 16036 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:51.975781 16414 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.950165 16053 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:51.946978 16358 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:51.997896 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 54874.8us
I20260709 13:06:52.004033 13830 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:51.979370 16395 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:52.015373 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:52.022503 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:51.944873 16378 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:51.990913 16265 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:51.983918 16373 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:51.984052 16317 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:51.999568 16358 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.989969 16376 raft_consensus.cc:697] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:52.029767 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:51.944736 16393 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:51.976609 16360 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:06:51.990235 16065 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:52.085206 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.138098 13713 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
I20260709 13:06:52.140087 13830 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:06:52.140506 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 184922us
I20260709 13:06:52.136967 16445 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.159s
I20260709 13:06:52.142316 16445 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:52.142700 14394 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:52.143882 14396 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:52.144053 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:52.144655 14394 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:52.131479 16087 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:52.145819 16087 raft_consensus.cc:697] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:52.146015 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:52.146772 16087 consensus_queue.cc:237] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:52.150414 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:52.151626 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:52.153512 13713 raft_consensus.cc:2393] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 8: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:52.152581 14394 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:06:52.154558 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:52.156041 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:52.156735 14395 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:52.157888 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:52.158098 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:52.159235 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:52.161218 16364 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:52.161805 13680 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:52.163770 16364 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:52.166862 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:52.167937 16364 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.170800 13680 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:52.172554 16364 raft_consensus.cc:2764] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:06:51.997025 16435 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:52.185201 16435 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.194453 16435 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:52.026273 16395 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:52.132174 16299 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.448s	user 0.013s	sys 0.037s
I20260709 13:06:51.990064 16443 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:52.230944 14395 raft_consensus.cc:2393] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 5: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:52.034677 16317 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:52.034409 16378 raft_consensus.cc:697] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:52.136695 16423 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:52.136091 16433 raft_consensus.cc:3055] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:52.202805 16393 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.136809 16426 raft_consensus.cc:2764] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:06:52.228765 16299 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.545s	user 0.013s	sys 0.038s
I20260709 13:06:52.240463 16036 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:52.241587 16437 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:52.221361 16205 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:52.190852 16376 consensus_queue.cc:237] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:52.377743 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:06:52.287966 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.136538 16431 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.328s
I20260709 13:06:52.361797 16408 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:52.250240 16423 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:52.254062 16444 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:52.249333 16433 raft_consensus.cc:740] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:52.294656 16381 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:52.362047 16404 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:52.354784 16443 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:52.420282 16065 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:52.340884 16413 consensus_meta.cc:287] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.000s
I20260709 13:06:52.292490 16036 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:06:52.348860 16463 log.cc:927] Time spent T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:06:52.325799 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.436811 16461 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:52.302062 16401 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:52.362115 16382 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:52.132656 16053 raft_consensus.cc:2955] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 4 to 6, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:52.440443 16444 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:52.354069 16109 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:52.231465 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:52.233414 16134 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:52.278018 16437 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:52.303241 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 380199us
I20260709 13:06:52.279249 13711 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:52.349236 16418 consensus_meta.cc:287] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.585s	user 0.007s	sys 0.002s
I20260709 13:06:52.420185 16414 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:52.424144 14402 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 918) took 1627 ms (client timeout 1523 ms). Trace:
I20260709 13:06:52.425518 13860 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 7 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:52.378031 16379 consensus_meta.cc:287] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.605s	user 0.011s	sys 0.000s
I20260709 13:06:52.345638 16449 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.395467 16430 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:52.455652 16413 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:52.467053 16444 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:52.477413 16449 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:52.289412 16426 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:06:52.302678 16440 log.cc:927] Time spent T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.320s	user 0.001s	sys 0.000s
W20260709 13:06:52.447572 16211 consensus_meta.cc:287] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.585s	user 0.007s	sys 0.004s
I20260709 13:06:52.436058 16423 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:52.440745 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 298801us
I20260709 13:06:52.291051 16378 consensus_queue.cc:237] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:52.387004 16410 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:52.453630 16455 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:52.462064 16408 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:06:52.468422 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 190139us
W20260709 13:06:52.601146 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:52.471334 14402 rpcz_store.cc:269] 0709 13:06:50.797173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.905312 (+108139us) service_pool.cc:224] Handling call
0709 13:06:52.377517 (+1472205us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b5800077d98. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:06:52.424046 (+ 46529us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24953600}
W20260709 13:06:52.806981 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:52.576972 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.478235 13789 raft_consensus.cc:2393] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 4: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:52.688759 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2251) took 1101 ms. Trace:
I20260709 13:06:52.809482 13708 rpcz_store.cc:276] 0709 13:06:51.587227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.685355 (+ 98128us) service_pool.cc:224] Handling call
0709 13:06:52.688499 (+1003144us) spinlock_profiling.cc:243] Waited 74.4 ms on lock 0x7b54001c43d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:52.688673 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171191680}
W20260709 13:06:52.816730 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:52.811151 13788 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1567) took 1628 ms (client timeout 1693 ms). Trace:
W20260709 13:06:52.854547 13788 rpcz_store.cc:269] 0709 13:06:51.182687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.203010 (+ 20323us) service_pool.cc:224] Handling call
0709 13:06:52.810990 (+1607980us) spinlock_profiling.cc:243] Waited 38.6 ms on lock 0x7b5400205654. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:52.811096 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88864512}
W20260709 13:06:52.476413 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 159031us
W20260709 13:06:52.590682 16422 consensus_meta.cc:287] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.666s	user 0.010s	sys 0.001s
I20260709 13:06:52.494901 16413 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:52.827181 14368 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:52.827571 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:52.608587 16381 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.772217 16366 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.855911 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:06:52.861477 13682 connection.cc:256] RPC call timeout handler was delayed by -1.1390568479999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
I20260709 13:06:52.813796 16426 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.488216 14366 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:06:52.823081 16358 consensus_meta.cc:287] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.001s
I20260709 13:06:52.873432 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:52.572136 16430 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:52.880005 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:52.562413 16299 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:52.471160 16437 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.867022 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:52.865881 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:52.871111 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:52.573120 16317 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:52.874219 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 386047us
I20260709 13:06:52.871939 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:52.872349 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2027) took 1840 ms. Trace:
I20260709 13:06:52.870741 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:52.873394 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:52.873019 13682 connection.cc:256] RPC call timeout handler was delayed by -1.1345568479999883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
I20260709 13:06:52.485291 16414 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:52.880010 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 52493.9us
I20260709 13:06:52.595084 16395 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:52.878297 13756 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:52.882159 14393 raft_consensus.cc:1240] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:52.882485 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 54970.7us
I20260709 13:06:52.469722 16461 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:52.492532 16379 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:52.487349 16435 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:52.869565 16456 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.871236 16388 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:52.821132 16211 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:52.930269 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:52.930434 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:52.975916 13783 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:06:52.478369 16418 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:52.949779 16393 consensus_meta.cc:287] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.672s	user 0.007s	sys 0.002s
I20260709 13:06:52.869112 16470 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.880329 16465 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:52.935137 16430 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:52.866032 16422 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:52.878381 16366 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:53.009123 16418 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:53.027339 16435 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:53.027573 13784 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:53.027727 16430 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:53.028160 16435 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:53.028288 16430 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.028595 16435 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:53.029083 16435 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.028855 16430 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:53.030917 16430 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:53.032181 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 57030.5us
I20260709 13:06:52.878928 16426 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:52.823024 16408 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:52.938290 14400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 913) took 2394 ms (client timeout 2231 ms). Trace:
W20260709 13:06:52.938759 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.035854 14400 rpcz_store.cc:269] 0709 13:06:50.488711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.491404 (+  2693us) service_pool.cc:224] Handling call
0709 13:06:52.881851 (+2390447us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b5400596854. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:52.882930 (+  1079us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":426850560}
I20260709 13:06:52.935220 13708 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:52.940275 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:52.938917 14366 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:52.963937 13682 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:52.937839 13791 rpcz_store.cc:276] 0709 13:06:51.031576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.031704 (+   128us) service_pool.cc:224] Handling call
0709 13:06:51.032069 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:51.092069 (+ 60000us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.092096 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:51.112986 (+ 20890us) log.cc:844] Serialized 26 byte log entry
0709 13:06:51.229333 (+116347us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:51.338946 (+109613us) log.cc:844] Serialized 14 byte log entry
0709 13:06:51.350630 (+ 11684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.866449 (+1515819us) spinlock_profiling.cc:243] Waited 59.6 ms on lock 0x7b54002ebb54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:52.866535 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.866607 (+    72us) raft_consensus.cc:1685] finished
0709 13:06:52.872133 (+  5526us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.872280 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32777,"prepare.queue_time_us":109647,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":49237,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":11895,"spinlock_wait_cycles":137018240,"thread_start_us":115944,"threads_started":1,"wal-append.queue_time_us":227723,"wal-append.run_cpu_time_us":2009,"wal-append.run_wall_time_us":1029441}
W20260709 13:06:52.948042 16349 consensus_meta.cc:287] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 1.129s	user 0.011s	sys 0.003s
W20260709 13:06:52.936959 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 58731.6us
I20260709 13:06:52.934782 16252 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.984547 13712 raft_consensus.cc:2393] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 5: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:52.941884 16317 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:52.591768 16433 consensus_queue.cc:260] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:53.049942 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:53.050166 16425 consensus_queue.cc:1059] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:53.050696 16433 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.050837 16408 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:53.007809 16477 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:52.950948 16449 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:53.007907 16470 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:52.938088 16469 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:52.943043 16461 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:52.945501 16395 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:52.943186 16409 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:52.873986 16381 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:52.948587 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:56570 (request call id 784) took 5641 ms. Trace:
I20260709 13:06:52.882556 16358 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:52.823000 16455 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:53.034780 13784 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:06:53.009248 16465 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:52.940428 16334 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:06:53.047039 13755 leader_election.cc:400] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6.
W20260709 13:06:53.049329 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 110466us
I20260709 13:06:53.093307 13755 leader_election.cc:403] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:52.942606 16299 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:53.067680 16449 raft_consensus.cc:3055] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:53.027447 16366 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:53.032953 16430 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.104626 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:53.105278 13791 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:53.105033 16430 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:53.105782 16472 log.cc:927] Time spent T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:06:53.106177 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:53.106766 13791 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:06:52.983659 16388 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:53.107363 16475 log.cc:927] Time spent T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:06:53.107998 16430 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:53.109088 16388 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:53.008739 16393 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:53.110138 13791 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:06:53.066062 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 201357us
I20260709 13:06:53.053120 16476 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:53.058053 16265 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.078686 13865 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:06:53.001350 16414 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:06:52.977586 16456 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:53.051695 16431 consensus_queue.cc:1175] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "35ecb005831740438d7537dd4b840e03" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 4 index: 6 } }
I20260709 13:06:53.084229 14367 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:53.085489 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:53.123271 13708 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.060863 16376 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:53.045231 16421 consensus_queue.cc:1059] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:06:53.064265 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:06:53.096588 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 52409.8us
I20260709 13:06:53.055071 16065 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:53.097877 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:53.102578 16468 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:53.132172 13788 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:06:53.103137 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:53.132989 13783 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.097911 16449 raft_consensus.cc:740] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:53.104315 16299 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:53.117498 16377 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.111770 13787 raft_consensus.cc:2393] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 4: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:53.063253 14396 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:06:53.115353 13707 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 6: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:53.117239 16393 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:53.069156 16469 raft_consensus.cc:697] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:53.071018 16409 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.067303 16477 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:53.093389 16465 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:53.126829 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 80618.1us
I20260709 13:06:53.112591 16444 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.140502 16483 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:53.103165 16470 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:53.155334 13788 raft_consensus.cc:1275] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:53.144515 16087 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.112123 16109 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6.
I20260709 13:06:53.142300 14366 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:53.111287 13791 raft_consensus.cc:1240] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:53.116104 16410 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:53.143986 13861 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
W20260709 13:06:53.118088 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 154247us
W20260709 13:06:53.145087 16474 log.cc:927] Time spent T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:06:53.128351 16265 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:53.145488 16211 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:53.162281 16455 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:53.167088 13682 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:53.169090 13682 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:53.142261 16065 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:53.175550 13682 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:53.154619 16483 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.177999 16484 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:53.178575 16484 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:53.179029 16484 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.177909 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:53.180552 14366 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:53.157635 16379 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:53.146407 16377 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:53.185137 13783 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:06:53.180655 16483 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.188069 16065 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:53.157604 16421 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:06:53.168244 16455 consensus_queue.cc:1059] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:06:53.190625 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:53.176721 16252 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:53.176652 16418 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:53.179677 16469 consensus_queue.cc:237] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:53.194624 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:53.196066 16473 log.cc:927] Time spent T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:06:53.197547 16423 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:53.175925 16470 consensus_queue.cc:1059] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:06:53.200181 16410 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:53.143764 16468 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:53.203683 14397 raft_consensus.cc:2410] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:53.182860 16461 consensus_queue.cc:1048] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:06:53.205097 16265 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:53.205323 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:53.192827 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:53.233650 13786 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.182261 16043 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:53.180347 16476 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:53.159147 16444 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:53.213786 13783 raft_consensus.cc:2393] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 7: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:53.169564 16087 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:53.078914 16276 rpcz_store.cc:276] 0709 13:06:47.306697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.315340 (+  8643us) service_pool.cc:224] Handling call
0709 13:06:47.543522 (+228182us) ts_tablet_manager.cc:934] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533)
0709 13:06:51.365780 (+3822258us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:52.436014 (+1070234us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:52.440250 (+  4236us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:52.947550 (+507300us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:52.947937 (+   387us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:52.948298 (+   361us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:52.948376 (+    78us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":54741,"tablet-copy.queue_time_us":147740,"thread_start_us":319890,"threads_started":2}
I20260709 13:06:53.205627 16065 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:53.246717 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:53.204377 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:06:53.246613 13715 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58552 (request call id 554) took 2312 ms (client timeout 1516 ms). Trace:
I20260709 13:06:53.184674 16408 consensus_queue.cc:1048] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:06:53.208185 16422 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:53.247983 13715 rpcz_store.cc:269] 0709 13:06:50.934073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.944537 (+ 10464us) service_pool.cc:224] Handling call
0709 13:06:53.246419 (+2301882us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b5400153bd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:53.246544 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":982713600}
I20260709 13:06:53.235086 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:53.190363 16376 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:06:53.207616 16418 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:53.237679 16381 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:53.238353 16053 consensus_meta.cc:287] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.775s	user 0.007s	sys 0.003s
I20260709 13:06:53.214869 16425 raft_consensus.cc:3055] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:06:53.241175 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 47680.9us
I20260709 13:06:53.211395 16252 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:53.180034 16449 consensus_queue.cc:260] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:53.248008 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:53.232829 13716 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:53.239514 16476 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.251331 13788 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:06:53.241792 16265 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.241290 16358 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:53.255153 16418 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.257695 14366 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:53.248697 16065 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.243568 16043 raft_consensus.cc:697] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:53.263806 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:53.270624 13786 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:06:53.263257 16485 consensus_queue.cc:1059] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:06:53.266541 16477 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:53.266971 16065 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.272271 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:53.272378 13829 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:53.274461 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:53.256665 16276 tablet_copy_client.cc:806] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:53.256852 16425 raft_consensus.cc:740] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:53.276158 14401 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 6: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:53.275426 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:53.277878 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:53.278447 14394 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.262809 16476 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.280472 14399 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:53.282264 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:53.282845 13788 raft_consensus.cc:2393] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 7: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:53.266824 16482 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 13:06:53.284725 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:53.287891 16449 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.289250 13708 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:06:53.289776 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2254) took 1056 ms. Trace:
I20260709 13:06:53.289805 14394 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:06:53.290156 13708 rpcz_store.cc:276] 0709 13:06:52.233589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.065879 (+832290us) service_pool.cc:224] Handling call
0709 13:06:53.289710 (+223831us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:53.290555 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:53.291181 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:53.292052 13708 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:06:53.296746 16435 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:53.297835 13782 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:53.293105 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:53.301807 13708 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.301715 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:53.300647 16444 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:53.302908 16377 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:53.303591 16490 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:53.305300 16490 raft_consensus.cc:697] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:53.305907 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:53.302456 14400 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:06:53.276348 16414 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:53.310871 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.310813 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:53.265579 16265 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:53.289134 16276 tablet_copy_client.cc:670] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:53.314473 13782 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.306394 16134 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.306306 16490 consensus_queue.cc:237] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:53.316751 16134 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:53.307744 16414 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.320079 16414 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.321877 16134 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:53.324332 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:53.325119 13788 raft_consensus.cc:2393] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 7: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:53.325228 14401 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:53.324297 16043 consensus_queue.cc:237] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:53.330962 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.334272 16484 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:53.336534 16484 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:53.336086 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:53.337384 13788 raft_consensus.cc:2393] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 3: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:53.313617 16425 consensus_queue.cc:260] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:53.324501 16423 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:53.352145 14395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 814) took 1196 ms. Trace:
I20260709 13:06:53.352694 14395 rpcz_store.cc:276] 0709 13:06:52.156136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.157626 (+  1490us) service_pool.cc:224] Handling call
0709 13:06:53.351397 (+1193771us) spinlock_profiling.cc:243] Waited 68.6 ms on lock 0x7b54003f07d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:53.352072 (+   675us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157793664}
I20260709 13:06:53.373584 13785 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:53.400245 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:53.400602 13785 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:06:53.400861 14400 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.401151 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:53.403505 16051 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.403977 16051 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:53.404539 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:53.406219 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 96097.3us
I20260709 13:06:53.406289 16262 raft_consensus.cc:3055] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:53.406848 16262 raft_consensus.cc:740] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:53.412016 16051 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:53.414769 16051 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:53.405769 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:53.429430 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:53.430680 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:53.435268 16423 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.435433 13829 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:53.435935 16423 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:53.437201 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:53.435400 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:53.442631 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:53.443214 13859 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:53.447933 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:53.448791 14398 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
W20260709 13:06:53.495317 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 58158.8us
I20260709 13:06:53.497460 13829 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:53.526750 13708 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:06:53.528543 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:53.529603 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58552 (request call id 573) took 1168 ms. Trace:
I20260709 13:06:53.530052 13708 rpcz_store.cc:276] 0709 13:06:52.361239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.528044 (+1166805us) service_pool.cc:224] Handling call
0709 13:06:53.529532 (+  1488us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:53.573685 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:53.575098 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:06:53.576423 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 79071.2us
I20260709 13:06:53.582355 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:53.583287 13857 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:53.595765 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:53.437228 16445 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:53.397773 16425 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.623907 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:53.469269 16437 consensus_meta.cc:287] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.513s	user 0.005s	sys 0.005s
W20260709 13:06:53.628178 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 94325.3us
I20260709 13:06:53.631891 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:53.633246 14400 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:06:53.634181 13782 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:53.618136 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:53.639955 14395 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.640415 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:53.640431 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:53.641333 13857 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.641470 14400 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.646404 14395 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:53.647382 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:53.648212 14400 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:53.648631 14395 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.649246 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:53.650380 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:53.650698 13857 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:06:53.651880 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:53.484992 16287 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:53.659843 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:53.617285 16360 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.668262 16360 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:53.670545 16360 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:53.663646 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:53.634985 16134 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:06:53.665273 16426 consensus_meta.cc:287] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.613s	user 0.010s	sys 0.000s
I20260709 13:06:53.648077 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:53.617653 16468 leader_election.cc:290] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:53.680564 14395 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:06:53.635165 16421 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:53.571573 16376 consensus_queue.cc:1059] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.141s
I20260709 13:06:53.691802 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:53.443681 16065 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:53.674255 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:53.691340 16421 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.698179 13857 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.771605 14400 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 7: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:06:53.689699 16420 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.458s	user 0.024s	sys 0.033s
I20260709 13:06:53.803548 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:53.768855 16421 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.699745 16134 raft_consensus.cc:697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:06:53.807857 16420 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.579s	user 0.024s	sys 0.034s
I20260709 13:06:53.703117 16435 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:53.657696 16437 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:53.708810 16423 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:53.832090 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 549) took 2918 ms. Trace:
I20260709 13:06:53.840399 13711 rpcz_store.cc:276] 0709 13:06:50.914264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.914591 (+   327us) service_pool.cc:224] Handling call
0709 13:06:50.933082 (+ 18491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.477064 (+1543982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.831015 (+1353951us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54000c3d54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:53.832010 (+   995us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3095307136}
I20260709 13:06:53.767995 16444 raft_consensus.cc:3055] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:53.843681 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:53.844563 13709 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:06:53.691625 16426 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:53.847586 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 269245us
I20260709 13:06:53.847743 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:53.836367 13782 raft_consensus.cc:2955] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:53.850143 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:53.850984 13709 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:06:53.852059 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:53.852591 13709 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:06:53.853262 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:53.854929 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:53.848686 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:53.855532 13711 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:53.861104 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.850502 16433 consensus_meta.cc:287] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.799s	user 0.009s	sys 0.004s
I20260709 13:06:53.869352 13757 leader_election.cc:304] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:53.882283 13856 raft_consensus.cc:2368] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8.
I20260709 13:06:53.889225 13857 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:06:53.889288 13757 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:53.871572 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:53.920938 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:53.924888 13709 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.925393 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 2498) took 1071 ms. Trace:
I20260709 13:06:53.925767 13857 rpcz_store.cc:276] 0709 13:06:52.854245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.920676 (+1066431us) service_pool.cc:224] Handling call
0709 13:06:53.925337 (+  4661us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:53.843765 16444 raft_consensus.cc:740] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:53.847874 16051 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:06:53.870282 16476 consensus_meta.cc:287] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.000s
I20260709 13:06:53.921657 13862 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
W20260709 13:06:53.868454 16449 consensus_meta.cc:287] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.004s
W20260709 13:06:53.934023 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 44840.9us
W20260709 13:06:53.930321 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.934861 13757 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:53.883306 16360 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:53.943311 13709 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:53.944600 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:53.945431 13709 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:53.946484 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:53.947212 13709 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:53.882965 16423 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:53.953857 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:53.951740 16360 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.960748 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:53.939136 16265 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:53.943883 16476 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:53.973600 16465 consensus_meta.cc:287] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.817s	user 0.009s	sys 0.000s
I20260709 13:06:53.951782 16378 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:53.956175 16418 consensus_meta.cc:287] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.680s	user 0.006s	sys 0.017s
I20260709 13:06:53.980711 16444 consensus_queue.cc:260] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:53.973623 14396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 813) took 1817 ms. Trace:
I20260709 13:06:53.958375 16360 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:53.989580 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 548165us
I20260709 13:06:53.986766 16418 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:54.002282 16495 log.cc:927] Time spent T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:06:54.002636 16437 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:54.003907 16476 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:54.004678 13715 raft_consensus.cc:2393] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 5: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:54.004484 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:54.005765 13715 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58552 (request call id 574) took 1581 ms (client timeout 1648 ms). Trace:
W20260709 13:06:54.006130 13715 rpcz_store.cc:269] 0709 13:06:52.424442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.263525 (+839083us) service_pool.cc:224] Handling call
0709 13:06:54.005611 (+742086us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b5400172d54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:54.005716 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1693666688}
I20260709 13:06:54.005790 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:54.007222 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:54.008455 13714 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:54.008749 13715 raft_consensus.cc:2393] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 8: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:53.943161 16051 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:53.938578 16134 consensus_queue.cc:237] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:53.981642 16378 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.051612 13711 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:06:54.053015 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2258) took 1004 ms. Trace:
I20260709 13:06:54.054217 13711 rpcz_store.cc:276] 0709 13:06:53.048418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.841843 (+793425us) service_pool.cc:224] Handling call
0709 13:06:54.052468 (+210625us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:53.958498 16423 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:54.059171 14399 raft_consensus.cc:1240] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:53.982371 16465 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:54.124549 16374 raft_consensus.cc:3055] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:54.161612 14402 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:54.056831 16378 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.161582 16374 raft_consensus.cc:740] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:06:54.162612 16409 consensus_meta.cc:287] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 1.010s	user 0.006s	sys 0.006s
I20260709 13:06:54.162741 16465 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:54.122921 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 593) took 4292 ms. Trace:
I20260709 13:06:54.154258 16426 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:54.163640 13860 rpcz_store.cc:276] 0709 13:06:49.826903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.830394 (+  3491us) service_pool.cc:224] Handling call
0709 13:06:49.830677 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.471451 (+2640774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.119365 (+1647914us) spinlock_profiling.cc:243] Waited 2.59 s on lock 0x7b5400387054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:54.119609 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5966892800}
I20260709 13:06:54.066157 16418 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:54.164726 16423 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:54.083135 13709 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:06:54.163036 16409 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:54.165474 13709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2260) took 1108 ms. Trace:
I20260709 13:06:54.165553 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:54.165975 13709 rpcz_store.cc:276] 0709 13:06:53.057483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.946220 (+888737us) service_pool.cc:224] Handling call
0709 13:06:54.165400 (+219180us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:54.132444 16414 consensus_meta.cc:287] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.812s	user 0.009s	sys 0.002s
I20260709 13:06:54.166242 13708 raft_consensus.cc:2368] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 6. Current term is 7.
I20260709 13:06:54.167124 16414 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:54.168970 16409 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:54.165071 16425 consensus_meta.cc:287] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.002s
I20260709 13:06:54.169395 16414 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:54.134639 14394 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:54.170112 13859 raft_consensus.cc:2410] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:54.101658 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:54.170745 16051 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:54.171582 16351 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:54.173535 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 183089us
I20260709 13:06:54.174360 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 2489) took 1322 ms. Trace:
I20260709 13:06:54.174687 16418 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:54.174746 13861 rpcz_store.cc:276] 0709 13:06:52.851816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.865580 (+ 13764us) service_pool.cc:224] Handling call
0709 13:06:54.174153 (+1308573us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b5400234e54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:54.174245 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472300416}
I20260709 13:06:54.176031 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:54.176703 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 2509) took 1055 ms. Trace:
I20260709 13:06:54.176987 13861 rpcz_store.cc:276] 0709 13:06:53.121788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.175797 (+1054009us) service_pool.cc:224] Handling call
0709 13:06:54.176648 (+   851us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:54.177513 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:54.177800 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:54.178498 13861 raft_consensus.cc:2393] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 7: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:54.178260 16360 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:54.178668 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:54.179708 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:54.180488 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.179261 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:06:54.181296 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 246364us
I20260709 13:06:54.182072 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 2513) took 1038 ms. Trace:
I20260709 13:06:54.182179 13757 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:54.182463 13861 rpcz_store.cc:276] 0709 13:06:53.143615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.179018 (+1035403us) service_pool.cc:224] Handling call
0709 13:06:54.181937 (+  2919us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:54.102572 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 659) took 2912 ms. Trace:
I20260709 13:06:54.183488 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:54.184062 13861 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:06:54.184535 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 2514) took 1038 ms. Trace:
I20260709 13:06:54.184854 13861 rpcz_store.cc:276] 0709 13:06:53.145707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.183167 (+1037460us) service_pool.cc:224] Handling call
0709 13:06:54.184484 (+  1317us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:54.185717 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:54.183301 14393 rpcz_store.cc:276] 0709 13:06:51.190022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.387092 (+197070us) service_pool.cc:224] Handling call
0709 13:06:52.881992 (+1494900us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.935736 (+ 53744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.102341 (+1166605us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400596850. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:54.102486 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3437066112}
I20260709 13:06:54.188566 13857 raft_consensus.cc:2393] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 7: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:54.007436 16065 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:54.166338 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 2496) took 1312 ms. Trace:
I20260709 13:06:54.204726 13860 rpcz_store.cc:276] 0709 13:06:52.853739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.165261 (+1311522us) service_pool.cc:224] Handling call
0709 13:06:54.166285 (+  1024us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:54.202117 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:54.202638 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:54.179190 14399 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:54.149283 16053 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.008s	sys 0.011s
I20260709 13:06:54.210862 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:54.218314 13857 raft_consensus.cc:2410] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:54.218477 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:54.219097 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 2510) took 1091 ms. Trace:
I20260709 13:06:54.203840 13714 raft_consensus.cc:1240] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:54.219491 13857 rpcz_store.cc:276] 0709 13:06:53.127357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.210526 (+1083169us) service_pool.cc:224] Handling call
0709 13:06:54.219043 (+  8517us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:54.219606 14393 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:54.220047 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 558) took 2703 ms. Trace:
I20260709 13:06:54.221589 13857 raft_consensus.cc:1275] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:54.221280 13714 rpcz_store.cc:276] 0709 13:06:51.516990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.191137 (+2674147us) service_pool.cc:224] Handling call
0709 13:06:54.203664 (+ 12527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.219808 (+ 16144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.219996 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:54.222620 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2516) took 1014 ms. Trace:
I20260709 13:06:54.191694 16425 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:54.217640 16053 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.008s	sys 0.014s
I20260709 13:06:54.120069 16043 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.227567 16447 raft_consensus.cc:3055] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:53.987546 14396 rpcz_store.cc:276] 0709 13:06:52.155835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.157476 (+  1641us) service_pool.cc:224] Handling call
0709 13:06:53.973432 (+1815956us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b540044fcd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:53.973554 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2068753792}
W20260709 13:06:54.229832 16483 consensus_meta.cc:287] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 1.037s	user 0.006s	sys 0.006s
W20260709 13:06:54.247282 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 65189.5us
I20260709 13:06:54.235260 16425 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:54.205085 16414 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.201798 16426 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:54.230721 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 564) took 2467 ms. Trace:
I20260709 13:06:54.255030 13714 rpcz_store.cc:276] 0709 13:06:51.763240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.229709 (+2466469us) service_pool.cc:224] Handling call
0709 13:06:54.230031 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.230291 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.230322 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:54.230363 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:54.230418 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.230495 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.230648 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:54.256860 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 67093.2us
I20260709 13:06:54.225145 14368 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:54.202296 16051 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:54.223083 13857 rpcz_store.cc:276] 0709 13:06:53.210523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.221019 (+1010496us) service_pool.cc:224] Handling call
0709 13:06:54.221306 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.222346 (+  1040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.222572 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:54.220602 16465 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:06:54.238811 16447 raft_consensus.cc:740] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:54.220070 16505 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:54.258618 13680 connection.cc:256] RPC call timeout handler was delayed by -1.1589782649999734s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2029s for a response
W20260709 13:06:54.266474 13680 connection.cc:256] RPC call timeout handler was delayed by -1.0546067770001173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18420000000000003s for a response
I20260709 13:06:54.259585 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1581) took 1056 ms. Trace:
I20260709 13:06:54.267634 13782 rpcz_store.cc:276] 0709 13:06:53.202986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.808519 (+605533us) service_pool.cc:224] Handling call
0709 13:06:53.835968 (+ 27449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:53.836233 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:53.942024 (+105791us) log.cc:844] Serialized 14 byte log entry
0709 13:06:54.259171 (+317147us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:54.259235 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:54.259281 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.259345 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.259512 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":316697,"threads_started":2,"wal-append.queue_time_us":208487}
I20260709 13:06:54.269804 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:54.270517 13782 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:54.259835 16426 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:54.273283 16364 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.273785 16364 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:54.276302 16364 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:54.259939 14368 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:54.242753 16043 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:54.281035 13680 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:54.281594 16509 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.281927 13710 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:06:54.260740 16404 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.246512 16483 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:54.255271 14393 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
W20260709 13:06:54.278506 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.163147 16374 consensus_queue.cc:260] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:54.257690 16414 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:54.460768 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.296332 13790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 619) took 2767 ms. Trace:
I20260709 13:06:55.020902 13790 rpcz_store.cc:276] 0709 13:06:51.529305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.824917 (+295612us) service_pool.cc:224] Handling call
0709 13:06:51.861673 (+ 36756us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.999511 (+137838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.999549 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:51.999590 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:51.999628 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.296009 (+2296381us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b5400161a54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:54.296074 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.296255 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316444928}
W20260709 13:06:55.021572 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 738984us
W20260709 13:06:54.605228 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 108778us
I20260709 13:06:54.670018 13782 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
I20260709 13:06:55.034224 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:55.034885 13782 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.466498 14399 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:55.036082 14399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 938) took 1377 ms. Trace:
I20260709 13:06:55.023082 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 943) took 1212 ms. Trace:
I20260709 13:06:54.262249 16467 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:55.036476 14399 rpcz_store.cc:276] 0709 13:06:53.658295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.178441 (+520146us) service_pool.cc:224] Handling call
0709 13:06:55.036026 (+857585us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:54.285269 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:06:55.025195 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 746873us
W20260709 13:06:55.043083 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 219456us
I20260709 13:06:55.043747 14368 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:55.025890 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1573) took 1858 ms. Trace:
I20260709 13:06:54.368348 16053 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.027242 16435 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:55.037016 14393 rpcz_store.cc:276] 0709 13:06:53.810377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.218246 (+407869us) service_pool.cc:224] Handling call
0709 13:06:55.023010 (+804764us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:54.472142 16421 consensus_meta.cc:287] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.656s	user 0.011s	sys 0.000s
W20260709 13:06:55.038282 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.298938 16447 consensus_queue.cc:260] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:55.041726 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:54.271731 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:55.045523 13788 rpcz_store.cc:276] 0709 13:06:53.167283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.337841 (+170558us) service_pool.cc:224] Handling call
0709 13:06:53.532499 (+194658us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:53.532847 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.532889 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:53.533398 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:06:53.986057 (+452659us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:54.188541 (+202484us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.025300 (+836759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.025581 (+   281us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:55.025637 (+    56us) raft_consensus.cc:1685] finished
0709 13:06:55.025655 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.025823 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3087,"prepare.queue_time_us":237790,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":1107,"raft.queue_time_us":94697,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":77422,"spinlock_wait_cycles":15104,"thread_start_us":588464,"threads_started":3,"wal-append.queue_time_us":515228}
I20260709 13:06:54.663668 16508 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:55.050423 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 677) took 1185 ms. Trace:
I20260709 13:06:54.282425 16341 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.052204 13790 raft_consensus.cc:2393] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 7: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:55.042405 16043 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:54.280455 16409 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.060875 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:54.282742 16476 raft_consensus.cc:2764] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:06:55.040971 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:54.282378 16360 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:54.287838 16065 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:54.947901 16425 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:55.057130 14398 rpcz_store.cc:276] 0709 13:06:53.864641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.285034 (+420393us) service_pool.cc:224] Handling call
0709 13:06:55.050338 (+765304us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:55.052024 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:54.263696 16051 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:54.281690 16351 consensus_queue.cc:1048] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.773s
I20260709 13:06:54.282956 16364 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.772s
I20260709 13:06:55.107308 13788 raft_consensus.cc:1240] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:06:55.107818 13789 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 620) took 3578 ms (client timeout 1855 ms). Trace:
I20260709 13:06:55.107982 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1583) took 1869 ms. Trace:
W20260709 13:06:55.108201 13789 rpcz_store.cc:269] 0709 13:06:51.529537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.685420 (+155883us) service_pool.cc:224] Handling call
0709 13:06:55.107624 (+3422204us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b5400371254. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:55.107753 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1786018688}
I20260709 13:06:55.108314 13788 rpcz_store.cc:276] 0709 13:06:53.238971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.061738 (+1822767us) service_pool.cc:224] Handling call
0709 13:06:55.066462 (+  4724us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.107727 (+ 41265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.107929 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:55.108774 13782 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:06:55.049855 16374 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.059590 16447 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.065506 14399 raft_consensus.cc:2393] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 7: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:54.286684 16378 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:55.066962 14398 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:55.039314 16404 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:55.072948 16476 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:55.075870 13787 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2045) took 2205 ms (client timeout 1632 ms). Trace:
W20260709 13:06:55.136859 13787 rpcz_store.cc:269] 0709 13:06:52.870414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.870859 (+   445us) service_pool.cc:224] Handling call
0709 13:06:55.075652 (+2204793us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54000ed3d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:55.075802 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":403396992}
W20260709 13:06:55.077100 13710 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2253) took 3272 ms (client timeout 2075 ms). Trace:
I20260709 13:06:55.079980 14368 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:06:55.080644 13862 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 2501) took 2225 ms (client timeout 1868 ms). Trace:
W20260709 13:06:55.138062 13710 rpcz_store.cc:269] 0709 13:06:51.805187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.835178 (+ 29991us) service_pool.cc:224] Handling call
0709 13:06:55.076886 (+3241708us) spinlock_profiling.cc:243] Waited 2.39 s on lock 0x7b54002e72d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:55.077019 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5493354368}
W20260709 13:06:55.138363 13862 rpcz_store.cc:269] 0709 13:06:52.854953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.302238 (+447285us) service_pool.cc:224] Handling call
0709 13:06:55.080440 (+1778202us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b54000d02d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:55.080562 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1401383296}
W20260709 13:06:55.084510 16402 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.713s	user 0.009s	sys 0.047s
W20260709 13:06:55.092077 13784 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2046) took 2220 ms (client timeout 1634 ms). Trace:
W20260709 13:06:55.140120 13784 rpcz_store.cc:269] 0709 13:06:52.871603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.871721 (+   118us) service_pool.cc:224] Handling call
0709 13:06:55.091901 (+2220180us) spinlock_profiling.cc:243] Waited 89.2 ms on lock 0x7b5400205154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:55.092003 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205179264}
I20260709 13:06:55.061473 16512 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:55.094830 14400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 933) took 1561 ms (client timeout 2075 ms). Trace:
W20260709 13:06:55.143117 14400 rpcz_store.cc:269] 0709 13:06:53.532998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.650168 (+117170us) service_pool.cc:224] Handling call
0709 13:06:55.094653 (+1444485us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54006a1dd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:55.094777 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276502400}
I20260709 13:06:55.095257 13716 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:55.144340 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1794) took 3266 ms. Trace:
I20260709 13:06:55.144665 13716 rpcz_store.cc:276] 0709 13:06:51.877638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.073866 (+3196228us) service_pool.cc:224] Handling call
0709 13:06:55.095088 (+ 21222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.144115 (+ 49027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.144290 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:55.145709 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:55.146466 13716 raft_consensus.cc:2410] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:55.146546 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:55.147157 13787 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.096112 14394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 673) took 1792 ms. Trace:
I20260709 13:06:55.096639 16527 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:55.098265 13755 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:55.101347 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:06:55.102263 13865 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 2499) took 2247 ms (client timeout 1554 ms). Trace:
I20260709 13:06:55.068264 16425 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.065819 16409 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:55.103710 16483 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:55.104650 16051 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:55.104844 16252 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:06:55.105647 13830 connection.cc:256] RPC call timeout handler was delayed by -1.7648755840000376s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
I20260709 13:06:55.110016 13785 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:55.054404 16421 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:55.109629 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:55.171486 13788 raft_consensus.cc:1240] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:55.172261 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1589) took 1308 ms. Trace:
I20260709 13:06:55.172683 13788 rpcz_store.cc:276] 0709 13:06:53.864329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.170859 (+1306530us) service_pool.cc:224] Handling call
0709 13:06:55.171222 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.171984 (+   762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.172198 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:55.109628 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:55.174244 13789 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:06:55.123386 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 939) took 1448 ms. Trace:
I20260709 13:06:55.177426 14398 rpcz_store.cc:276] 0709 13:06:53.674669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.063982 (+1389313us) service_pool.cc:224] Handling call
0709 13:06:55.064260 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.123132 (+ 58872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.123330 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:55.052152 16053 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:55.139192 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:55.141372 13784 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:55.184396 13710 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:06:55.184630 13784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1585) took 1752 ms. Trace:
I20260709 13:06:55.184990 13784 rpcz_store.cc:276] 0709 13:06:53.432545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.140949 (+1708404us) service_pool.cc:224] Handling call
0709 13:06:55.141204 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.184365 (+ 43161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.184577 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:55.185369 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:55.094190 13829 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:06:55.142290 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 62385us
I20260709 13:06:55.147337 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:55.191776 13716 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.110857 16520 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:55.150314 13865 rpcz_store.cc:269] 0709 13:06:52.854450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.939975 (+ 85525us) service_pool.cc:224] Handling call
0709 13:06:55.102074 (+2162099us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b54000d0cd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:55.102184 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91161344}
I20260709 13:06:55.193179 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:55.193969 13865 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:55.147825 14394 rpcz_store.cc:276] 0709 13:06:53.304489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.304607 (+   118us) service_pool.cc:224] Handling call
0709 13:06:53.304953 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.170160 (+865207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.095908 (+925748us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b54000fa854. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:55.096058 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1907450112}
I20260709 13:06:55.196575 14394 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:55.118768 16360 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:55.141757 16402 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.769s	user 0.010s	sys 0.047s
I20260709 13:06:55.060562 16341 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:55.156728 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.156639 13862 raft_consensus.cc:1275] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:55.150359 14400 raft_consensus.cc:2955] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:55.227887 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 615) took 1738 ms. Trace:
I20260709 13:06:55.141737 16071 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:55.136053 16413 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:55.110091 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:55.233860 13782 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:55.140043 16016 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.140023 16476 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:06:55.162062 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 63862.6us
I20260709 13:06:55.239544 13755 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:55.240651 13755 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:55.241729 13755 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:55.156164 13790 raft_consensus.cc:2955] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:06:55.060169 16508 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:55.160202 16518 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:55.180269 16526 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:55.195122 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:55.187234 13784 raft_consensus.cc:1240] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:06:55.209143 14394 raft_consensus.cc:1240] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:06:55.210682 13787 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:06:55.217759 13788 raft_consensus.cc:1240] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:55.221760 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:55.222510 16531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:56558 (request call id 679) took 1340 ms. Trace:
I20260709 13:06:55.223989 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:55.228252 13862 rpcz_store.cc:276] 0709 13:06:53.489406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.139289 (+1649883us) service_pool.cc:224] Handling call
0709 13:06:55.156319 (+ 17030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.227634 (+ 71315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.227835 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:55.146682 16519 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:55.243175 13755 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:55.254850 13755 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:55.210469 16467 raft_consensus.cc:697] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:55.251328 14399 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:55.249965 13784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1592) took 1032 ms. Trace:
I20260709 13:06:55.247304 16016 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:55.257133 16393 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:55.246863 16525 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:55.265058 13784 rpcz_store.cc:276] 0709 13:06:54.217457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.186776 (+969319us) service_pool.cc:224] Handling call
0709 13:06:55.187019 (+   243us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.249593 (+ 62574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.249890 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:55.249315 13865 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:55.257977 13782 raft_consensus.cc:1240] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:55.258291 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:55.270937 13710 raft_consensus.cc:2393] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 4: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:55.157915 16425 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:55.245194 16521 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:55.277040 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 182896us
I20260709 13:06:55.155537 16527 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:55.154001 16512 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:55.247892 16476 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.310045 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:55.257324 16382 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:55.229592 16360 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:55.317804 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:55.318823 13710 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:55.319401 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:55.320084 13862 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:06:55.245541 16413 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:55.311317 13789 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:06:55.356247 13865 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:06:55.366732 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:55.367540 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:55.368400 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:55.370740 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 228553us
I20260709 13:06:55.377435 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:55.378598 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:55.379699 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:55.380663 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:06:55.386654 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 192970us
I20260709 13:06:55.389415 16533 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:55.392406 16533 consensus_queue.cc:1059] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:55.391264 16526 raft_consensus.cc:697] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:55.394152 16526 consensus_queue.cc:237] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:55.391211 16537 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:55.399926 16537 raft_consensus.cc:697] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:55.401305 16537 consensus_queue.cc:237] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:55.344391 16522 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:55.230394 16520 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:55.413484 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:55.414134 13865 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:55.414891 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:55.264496 16519 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:55.415380 13865 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
W20260709 13:06:55.423228 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 110313us
I20260709 13:06:55.423959 13710 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
W20260709 13:06:55.424559 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 169816us
I20260709 13:06:55.425261 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:06:55.425702 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.311715 16521 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:55.419742 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:55.429816 13863 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.430517 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:55.431283 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:55.431506 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:55.432221 13862 raft_consensus.cc:2393] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 5: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:55.426721 13710 raft_consensus.cc:2393] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 8: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:55.256487 16531 rpcz_store.cc:276] 0709 13:06:53.882275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.135837 (+1253562us) service_pool.cc:224] Handling call
0709 13:06:55.222372 (+ 86535us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-copy.queue_time_us":73158,"thread_start_us":72687,"threads_started":1}
I20260709 13:06:55.411180 16414 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:55.428328 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:55.439375 13789 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:55.440225 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:55.440724 13789 raft_consensus.cc:2376] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8. Re-sending same reply.
I20260709 13:06:55.428467 13680 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:55.433954 13788 raft_consensus.cc:2393] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 6: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:55.441397 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:55.441622 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:55.442122 13710 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:06:55.409294 13757 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:55.435483 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:55.437268 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:55.423239 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:55.421234 16065 raft_consensus.cc:697] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:55.412904 16467 consensus_queue.cc:237] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:54.470400 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:55.443950 13710 raft_consensus.cc:1240] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:55.590356 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1797) took 3712 ms. Trace:
I20260709 13:06:55.590718 13710 rpcz_store.cc:276] 0709 13:06:51.878399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.443565 (+3565166us) service_pool.cc:224] Handling call
0709 13:06:55.443807 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.590095 (+146288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.590301 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:55.578262 16426 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:06:55.591557 16534 log.cc:927] Time spent T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.235s	user 0.002s	sys 0.000s
I20260709 13:06:55.592284 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:55.593029 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 636) took 2320 ms. Trace:
I20260709 13:06:55.450949 16544 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.165s
I20260709 13:06:55.593523 13791 rpcz_store.cc:276] 0709 13:06:53.273083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.074953 (+1801870us) service_pool.cc:224] Handling call
0709 13:06:55.075351 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.138886 (+ 63535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.138928 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:55.145091 (+  6163us) log.cc:844] Serialized 26 byte log entry
0709 13:06:55.355881 (+210790us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:55.355937 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.356023 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:55.590911 (+234888us) spinlock_profiling.cc:243] Waited 61.6 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:06:55.592725 (+  1814us) raft_consensus.cc:1685] finished
0709 13:06:55.592745 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.592963 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13138,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":63,"spinlock_wait_cycles":141750144,"thread_start_us":267329,"threads_started":2,"wal-append.queue_time_us":204671}
I20260709 13:06:55.515774 13860 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:55.541986 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.460043 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:06:55.593050 16528 log.cc:927] Time spent T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:06:55.567875 13611 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49436 (request call id 326) took 6463 ms. Trace:
I20260709 13:06:55.451769 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:55.559772 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 818) took 2522 ms. Trace:
W20260709 13:06:55.512527 13859 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 2500) took 2657 ms (client timeout 2239 ms). Trace:
W20260709 13:06:55.555823 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.461005 13863 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:06:55.615388 14368 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:55.601492 13716 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:06:55.612015 14402 rpcz_store.cc:276] 0709 13:06:53.037650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.037755 (+   105us) service_pool.cc:224] Handling call
0709 13:06:53.051255 (+ 13500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.162076 (+1110821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.559395 (+1397319us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54009169d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:55.559695 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2552928128}
W20260709 13:06:55.479187 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 55226.2us
I20260709 13:06:55.510905 13861 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:55.617489 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:55.452099 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:55.514183 13713 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:06:55.514983 13856 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 2490) took 2662 ms (client timeout 1919 ms). Trace:
W20260709 13:06:55.619035 13856 rpcz_store.cc:269] 0709 13:06:52.852091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.855564 (+  3473us) service_pool.cc:224] Handling call
0709 13:06:55.514739 (+2659175us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540004ae54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:55.514908 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2321622912}
I20260709 13:06:55.620355 16410 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:55.620921 16410 raft_consensus.cc:697] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:55.621294 16065 consensus_queue.cc:237] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:55.621790 16410 consensus_queue.cc:237] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:55.516314 16413 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:55.544122 16431 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.480657 16053 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:55.611670 13611 rpcz_store.cc:276] 0709 13:06:49.104272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.116249 (+ 11977us) service_pool.cc:224] Handling call
0709 13:06:55.567794 (+6451545us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:51.543723 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:51.544367 (+   644us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:51.544404 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:06:51.544423 (+    19us) tablet.cc:662] Decoding operations
0709 13:06:51.545066 (+   643us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:51.545132 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:51.545163 (+    31us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:06:51.545617 (+   454us) tablet.cc:701] Row locks acquired
0709 13:06:51.545644 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:06:51.545795 (+   151us) write_op.cc:270] Start()
0709 13:06:51.545923 (+   128us) write_op.cc:276] Timestamp: P: 1783602411545743 usec, L: 0
0709 13:06:51.545952 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:06:51.612298 (+ 66346us) log.cc:844] Serialized 1701 byte log entry
0709 13:06:51.956574 (+344276us) op_driver.cc:464] REPLICATION: finished
0709 13:06:52.295937 (+339363us) write_op.cc:301] APPLY: starting
0709 13:06:52.296029 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:52.296190 (+   161us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:52.347054 (+ 50864us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:52.381984 (+ 34930us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:52.382289 (+   305us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:06:52.382373 (+    84us) write_op.cc:312] APPLY: finished
0709 13:06:52.382719 (+   346us) log.cc:844] Serialized 41 byte log entry
0709 13:06:52.384266 (+  1547us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:52.384392 (+   126us) write_op.cc:454] Released schema lock
0709 13:06:52.384445 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:52.384956 (+   511us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:52.384986 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":500148,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":339058,"apply.run_cpu_time_us":3440,"apply.run_wall_time_us":88993,"num_ops":4,"prepare.queue_time_us":282097,"prepare.run_cpu_time_us":19266,"prepare.run_wall_time_us":341899,"raft.queue_time_us":71620,"raft.run_cpu_time_us":49785,"raft.run_wall_time_us":252286,"replication_time_us":410435,"thread_start_us":556547,"threads_started":4,"wal-append.queue_time_us":253107,"wal-append.run_cpu_time_us":34914,"wal-append.run_wall_time_us":1523108}]]}
I20260709 13:06:55.480445 16360 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:55.500655 16378 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:55.625413 16043 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:55.443962 13784 raft_consensus.cc:2393] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 4: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:55.618963 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 560) took 4101 ms. Trace:
I20260709 13:06:55.617729 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 612) took 2129 ms. Trace:
I20260709 13:06:55.586098 16456 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:55.623934 16426 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:55.481786 16404 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:55.673168 14366 leader_election.cc:336] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.855s (SENT)
I20260709 13:06:55.677127 14366 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:55.677318 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:06:55.595460 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 167066us
I20260709 13:06:55.678040 13856 raft_consensus.cc:2393] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 5: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:55.596441 13782 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:55.589459 16545 log.cc:927] Time spent T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.189s	user 0.000s	sys 0.009s
I20260709 13:06:55.503255 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:55.451900 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:06:55.612226 13859 rpcz_store.cc:269] 0709 13:06:52.854661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.574816 (+720155us) service_pool.cc:224] Handling call
0709 13:06:55.512268 (+1937452us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b54003dbdd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:55.512442 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1362902400}
I20260709 13:06:55.638718 13713 rpcz_store.cc:276] 0709 13:06:51.517588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.093762 (+3576174us) service_pool.cc:224] Handling call
0709 13:06:55.513509 (+419747us) spinlock_profiling.cc:243] Waited 9.29 ms on lock 0x7b5800003398. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:55.513753 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.618741 (+104988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.618913 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21360512}
I20260709 13:06:55.638976 13861 rpcz_store.cc:276] 0709 13:06:53.488460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.100060 (+1611600us) service_pool.cc:224] Handling call
0709 13:06:55.510396 (+410336us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b5800021698. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:55.510580 (+   184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.617437 (+106857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.617665 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29702528}
I20260709 13:06:55.596781 13865 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:06:55.699971 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:55.669745 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:55.672130 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:55.701195 13859 raft_consensus.cc:2410] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:55.674453 13830 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:55.479606 16016 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:55.460604 16414 consensus_queue.cc:1059] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.215s
I20260709 13:06:55.623974 16431 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:55.507844 16508 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:55.443272 13789 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:55.512944 16425 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:55.500133 16543 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:55.687160 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.450817 16533 raft_consensus.cc:3055] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:55.739240 16533 raft_consensus.cc:740] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:55.740128 16533 consensus_queue.cc:260] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:55.740703 16431 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:55.741387 16533 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.743767 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:55.724963 16363 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.748711 16363 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:55.750703 16363 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:55.751538 16518 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:55.721375 16523 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:55.700335 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:55.753531 13865 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:06:55.754926 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 620) took 2102 ms. Trace:
I20260709 13:06:55.755254 13865 rpcz_store.cc:276] 0709 13:06:53.652559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.754198 (+2101639us) service_pool.cc:224] Handling call
0709 13:06:55.754459 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.754618 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.754643 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:55.754686 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:55.754725 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.754779 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.754880 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:55.756593 13865 raft_consensus.cc:1240] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:55.757091 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2520) took 1833 ms. Trace:
I20260709 13:06:55.757362 13865 rpcz_store.cc:276] 0709 13:06:53.923620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.756209 (+1832589us) service_pool.cc:224] Handling call
0709 13:06:55.756445 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.756906 (+   461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.757046 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:55.759589 16016 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:55.759995 16016 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.760319 16016 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:55.762095 13715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 562) took 4072 ms. Trace:
I20260709 13:06:55.762524 13715 rpcz_store.cc:276] 0709 13:06:51.689845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.084634 (+3394789us) service_pool.cc:224] Handling call
0709 13:06:55.761375 (+676741us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b5800003398. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:55.761553 (+   178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.761722 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.761749 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:55.761793 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:55.761855 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.761926 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.762035 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32578944}
I20260709 13:06:55.506569 14396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 676) took 1831 ms. Trace:
I20260709 13:06:55.705061 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:55.515115 16521 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:55.511142 16527 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:55.509727 16519 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:55.511356 16409 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:55.512463 16512 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:55.697388 13862 raft_consensus.cc:2376] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8. Re-sending same reply.
I20260709 13:06:55.432482 16036 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.240s
I20260709 13:06:55.506974 16421 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:55.708833 13710 raft_consensus.cc:1240] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:06:55.820602 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1803) took 3938 ms. Trace:
I20260709 13:06:55.821002 13710 rpcz_store.cc:276] 0709 13:06:51.882026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.708305 (+3826279us) service_pool.cc:224] Handling call
0709 13:06:55.708616 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.820297 (+111681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.820526 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:55.823041 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1805) took 3934 ms. Trace:
I20260709 13:06:55.682665 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:55.711386 16525 raft_consensus.cc:697] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:55.721848 13713 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:55.725041 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:55.502836 16526 consensus_queue.cc:1048] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.203s
W20260709 13:06:55.728505 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 60896.4us
W20260709 13:06:55.729204 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 54873.7us
I20260709 13:06:55.625990 16043 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:55.738502 13782 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:06:55.670742 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:55.765137 14368 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:06:55.841717 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 76661.4us
I20260709 13:06:55.751350 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:55.808439 16016 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:55.722891 16542 consensus_queue.cc:1059] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.132s
W20260709 13:06:55.801553 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 96601us
I20260709 13:06:55.803606 16380 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:55.751103 16476 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:55.824433 16520 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:55.810456 13859 raft_consensus.cc:3055] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:55.877667 13859 raft_consensus.cc:740] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:55.710389 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:55.730230 16543 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.826244 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:55.827277 13710 rpcz_store.cc:276] 0709 13:06:51.889086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.821972 (+3932886us) service_pool.cc:224] Handling call
0709 13:06:55.822395 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.822621 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.822660 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:55.822720 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:55.822775 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.822845 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.822974 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:55.830495 16447 consensus_meta.cc:287] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.695s	user 0.011s	sys 0.000s
I20260709 13:06:55.832093 16525 consensus_queue.cc:237] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:55.833690 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1799) took 3954 ms. Trace:
I20260709 13:06:55.838387 13791 raft_consensus.cc:2393] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 4: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:55.796259 16508 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:55.836750 13829 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:55.846385 13863 raft_consensus.cc:1240] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:06:55.899986 13858 raft_consensus.cc:1275] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:06:55.900400 13858 pending_rounds.cc:85] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 3
W20260709 13:06:55.766925 13756 connection.cc:256] RPC call timeout handler was delayed by -2.1321593119999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20750000000000002s for a response
W20260709 13:06:55.800796 16374 consensus_meta.cc:287] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.678s	user 0.009s	sys 0.000s
W20260709 13:06:55.849926 14400 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.021s	sys 0.033s
W20260709 13:06:55.901613 14400 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.021s	sys 0.033s
W20260709 13:06:55.813177 16393 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.022s	sys 0.027s
I20260709 13:06:55.853600 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:06:55.910914 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 57436.3us
I20260709 13:06:55.912688 13716 raft_consensus.cc:2410] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:55.807711 16547 raft_consensus.cc:3055] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:55.878369 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:55.843940 16043 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:55.878659 13789 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:06:55.880299 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:55.880409 13784 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:55.881985 13713 rpcz_store.cc:276] 0709 13:06:51.878864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.709629 (+3830765us) service_pool.cc:224] Handling call
0709 13:06:55.709906 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.833328 (+123422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.833609 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:55.920660 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:55.848239 16519 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:55.902495 13859 consensus_queue.cc:260] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:55.923453 13863 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:06:55.902436 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 65803.1us
I20260709 13:06:55.904042 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1807) took 4014 ms. Trace:
I20260709 13:06:55.770807 14396 rpcz_store.cc:276] 0709 13:06:53.675486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.105367 (+1429881us) service_pool.cc:224] Handling call
0709 13:06:55.105752 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.106006 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.106040 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:55.106541 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:06:55.434636 (+328095us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:55.440224 (+  5588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.451774 (+ 11550us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:55.506271 (+ 54497us) raft_consensus.cc:1685] finished
0709 13:06:55.506304 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.506493 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":317506,"threads_started":1,"wal-append.queue_time_us":380788}
I20260709 13:06:55.911949 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:55.857085 16380 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:06:55.844028 14397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 819) took 2802 ms (client timeout 1855 ms). Trace:
W20260709 13:06:55.926064 13756 connection.cc:256] RPC call timeout handler was delayed by -1.9319131659999584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
W20260709 13:06:55.926542 13756 connection.cc:256] RPC call timeout handler was delayed by -1.2606352560000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16160000000000002s for a response
I20260709 13:06:55.923519 13859 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:55.900629 13858 pending_rounds.cc:107] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 4.4
W20260709 13:06:55.927016 13756 connection.cc:256] RPC call timeout handler was delayed by -1.1841352559999905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
I20260709 13:06:55.927429 13858 raft_consensus.cc:2889] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:55.910468 16393 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.022s	sys 0.027s
W20260709 13:06:55.962468 13756 leader_election.cc:336] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Timed out: RequestConsensusVote RPC to 127.12.76.129:37533 timed out after 1.832s (SENT)
I20260709 13:06:55.983300 13787 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:55.984252 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:55.882009 16543 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.987052 13791 raft_consensus.cc:1240] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:55.923156 16519 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.917542 16447 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:55.992231 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:55.915867 16409 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:55.959587 16380 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.044404 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:55.918526 16547 raft_consensus.cc:740] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:06:56.008219 13682 leader_election.cc:336] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 1.538s (SENT)
I20260709 13:06:55.960907 16526 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.924371 13710 rpcz_store.cc:276] 0709 13:06:51.889715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.881043 (+3991328us) service_pool.cc:224] Handling call
0709 13:06:55.881391 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.903731 (+ 22340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.903757 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:55.903807 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:55.903837 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.903893 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.903991 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:55.920637 16508 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:55.925529 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:56.025709 13756 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:55.924715 16521 consensus_queue.cc:1059] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
W20260709 13:06:55.959957 14397 rpcz_store.cc:269] 0709 13:06:53.037950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.044421 (+  6471us) service_pool.cc:224] Handling call
0709 13:06:55.831260 (+2786839us) spinlock_profiling.cc:243] Waited 56.3 ms on lock 0x7b540052b054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:55.839090 (+  7830us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129439488}
I20260709 13:06:56.034703 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:56.067103 13863 raft_consensus.cc:2393] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 7: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:56.036546 16519 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.031960 16393 raft_consensus.cc:697] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:56.125396 16393 consensus_queue.cc:237] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:56.127524 16404 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:56.127746 16521 raft_consensus.cc:3055] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:55.994405 16550 consensus_queue.cc:1059] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.091s
W20260709 13:06:56.035384 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 111140us
I20260709 13:06:56.031663 16374 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:56.091492 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:06:56.109498 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 184016us
I20260709 13:06:56.121559 16548 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:56.122327 16551 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:06:56.066792 16447 raft_consensus.cc:697] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 7 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:06:56.099361 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 136911us
I20260709 13:06:56.129571 13829 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:56.149951 13859 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:06:56.206871 13859 pending_rounds.cc:85] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 6
I20260709 13:06:56.070847 13682 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:56.056293 16409 raft_consensus.cc:697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:06:56.092177 16528 log.cc:927] Time spent T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:06:56.154134 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.156261 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:56.208745 13710 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:56.134665 13680 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:56.209151 14402 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
W20260709 13:06:56.209378 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 74782.4us
W20260709 13:06:56.209491 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 79981us
I20260709 13:06:56.207180 13859 pending_rounds.cc:107] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:06:56.210772 13859 raft_consensus.cc:2889] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:56.204912 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:56.211432 13859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 616) took 2721 ms. Trace:
I20260709 13:06:56.128131 16521 raft_consensus.cc:740] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:56.128024 16404 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:56.211760 13859 rpcz_store.cc:276] 0709 13:06:53.489704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.734904 (+2245200us) service_pool.cc:224] Handling call
0709 13:06:55.810290 (+ 75386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.211190 (+400900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.211362 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.214192 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:56.217551 14400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 680) took 2014 ms. Trace:
I20260709 13:06:56.217666 13863 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:56.215188 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:56.214572 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:56.219744 14402 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:56.100718 16526 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:56.207315 16552 log.cc:927] Time spent T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.173s	user 0.003s	sys 0.000s
W20260709 13:06:56.223773 13707 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1801) took 4344 ms (client timeout 1916 ms). Trace:
I20260709 13:06:56.213651 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 568) took 4304 ms. Trace:
I20260709 13:06:56.207628 16016 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:56.230057 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:56.218030 14400 rpcz_store.cc:276] 0709 13:06:54.203616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.149813 (+946197us) service_pool.cc:224] Handling call
0709 13:06:55.150079 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.150259 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:55.237103 (+ 86844us) log.cc:844] Serialized 14 byte log entry
0709 13:06:56.213935 (+976832us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:56.213983 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:56.214020 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.214075 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.217483 (+  3408us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2426,"raft.queue_time_us":14802,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":8024,"thread_start_us":976477,"threads_started":2,"wal-append.queue_time_us":793401}
I20260709 13:06:56.204593 16374 raft_consensus.cc:697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:06:56.252332 16557 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 13:06:56.212571 16363 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:56.229919 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:56.229213 16526 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:56.222157 13680 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:56.259568 13790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1582) took 3049 ms. Trace:
I20260709 13:06:56.377300 13790 rpcz_store.cc:276] 0709 13:06:53.210225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.059448 (+1849223us) service_pool.cc:224] Handling call
0709 13:06:55.066596 (+  7148us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:06:55.089851 (+ 23255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.089877 (+    26us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:06:55.090986 (+  1109us) log.cc:844] Serialized 558 byte log entry
0709 13:06:55.156031 (+ 65045us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:55.354341 (+198310us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.592303 (+237962us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:06:55.987048 (+394745us) log.cc:844] Serialized 14 byte log entry
0709 13:06:56.014429 (+ 27381us) log.cc:844] Serialized 14 byte log entry
0709 13:06:56.229233 (+214804us) spinlock_profiling.cc:243] Waited 7.02 ms on lock 0x7b18003fe8c0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f36bc0a 00007f5238aab219 00007f5232094d70 00007f5232088293 00007f523207dcea 00007f523207e23a 00007f52324e8a2a 00007f52324f80bf 00007f52324f8038
0709 13:06:56.259142 (+ 29909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.259215 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.259253 (+    38us) raft_consensus.cc:1685] finished
0709 13:06:56.259264 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.259404 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43902,"prepare.queue_time_us":112914,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":58048,"raft.run_cpu_time_us":406,"raft.run_wall_time_us":36432,"spinlock_wait_cycles":75109888,"thread_start_us":623999,"threads_started":4,"wal-append.queue_time_us":178885}
I20260709 13:06:56.273914 13863 raft_consensus.cc:2368] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8.
I20260709 13:06:56.261389 16532 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:56.279702 16560 log.cc:927] Time spent T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:06:56.216569 16404 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.215349 16542 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:56.272555 13710 rpcz_store.cc:276] 0709 13:06:51.909160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.072312 (+4163152us) service_pool.cc:224] Handling call
0709 13:06:56.208591 (+136279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.209132 (+   541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.213594 (+  4462us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.273613 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:56.206619 16410 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 13:06:56.272562 13707 rpcz_store.cc:269] 0709 13:06:51.879268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.924356 (+ 45088us) service_pool.cc:224] Handling call
0709 13:06:56.223559 (+4299203us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540010cf54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:56.223685 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2736633600}
I20260709 13:06:56.405124 14400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 828) took 1079 ms. Trace:
I20260709 13:06:56.274631 16470 consensus_queue.cc:1059] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:56.310999 13756 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:06:56.252367 16556 log.cc:927] Time spent T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:06:56.208880 16467 consensus_queue.cc:1059] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:06:56.222878 13757 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
W20260709 13:06:56.310298 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 49906.3us
I20260709 13:06:56.310467 13755 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:56.258781 16476 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:56.221844 16554 consensus_queue.cc:1059] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.179s
I20260709 13:06:56.397504 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:56.415278 13863 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
W20260709 13:06:56.312047 16549 log.cc:927] Time spent T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.203s	user 0.001s	sys 0.001s
I20260709 13:06:56.259763 16513 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:56.405558 14400 rpcz_store.cc:276] 0709 13:06:55.325687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.273347 (+947660us) service_pool.cc:224] Handling call
0709 13:06:56.405061 (+131714us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.376382 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:56.314213 16381 raft_consensus.cc:3055] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:06:56.408579 16566 log.cc:927] Time spent T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:06:56.418484 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 195662us
I20260709 13:06:56.420612 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:56.214639 16547 consensus_queue.cc:260] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:56.421006 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:56.434456 16537 raft_consensus.cc:2764] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:56.224308 16447 consensus_queue.cc:237] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:56.417143 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 106816us
I20260709 13:06:56.409930 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 569) took 4500 ms. Trace:
I20260709 13:06:56.459509 13711 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:56.463088 13710 rpcz_store.cc:276] 0709 13:06:51.909520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.408991 (+4499471us) service_pool.cc:224] Handling call
0709 13:06:56.409336 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.409517 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.409552 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:56.409605 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:56.409665 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.409734 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.409863 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.464104 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:56.464265 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2250) took 4881 ms. Trace:
W20260709 13:06:56.462522 13712 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2242) took 4976 ms (client timeout 1832 ms). Trace:
I20260709 13:06:56.436232 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2062) took 1004 ms. Trace:
I20260709 13:06:56.223207 16521 consensus_queue.cc:260] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:56.444288 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:56.376104 16016 consensus_queue.cc:1059] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.112s
I20260709 13:06:56.451396 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:56.451507 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:56.420065 16532 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.469751 13784 raft_consensus.cc:2376] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6. Re-sending same reply.
W20260709 13:06:56.421976 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 111052us
I20260709 13:06:56.452426 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:56.439026 16381 raft_consensus.cc:740] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:56.408777 16350 consensus_queue.cc:1059] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:06:56.464780 13711 rpcz_store.cc:276] 0709 13:06:51.583249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.447128 (+4863879us) service_pool.cc:224] Handling call
0709 13:06:56.447498 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.463963 (+ 16465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.464201 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.455834 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:56.456950 16558 log.cc:927] Time spent T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.323s	user 0.000s	sys 0.000s
I20260709 13:06:56.457330 16547 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:56.435635 16526 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:56.492367 16526 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:56.492903 16526 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:56.492775 16262 consensus_queue.cc:260] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:56.494012 16262 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.498178 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:56.463622 13863 raft_consensus.cc:2393] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 7: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:06:56.499485 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:56.500233 13863 raft_consensus.cc:2410] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:56.501446 16521 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.503651 16341 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:56.505566 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:56.506322 14394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 827) took 1190 ms. Trace:
I20260709 13:06:56.403077 16409 consensus_queue.cc:237] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:56.506609 14394 rpcz_store.cc:276] 0709 13:06:55.315940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.505330 (+1189390us) service_pool.cc:224] Handling call
0709 13:06:56.506263 (+   933us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.458624 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:56.508002 14396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 832) took 1083 ms. Trace:
I20260709 13:06:56.508365 14396 rpcz_store.cc:276] 0709 13:06:55.424424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.458281 (+1033857us) service_pool.cc:224] Handling call
0709 13:06:56.507944 (+ 49663us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.440321 16513 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:06:56.510638 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2507) took 3652 ms. Trace:
I20260709 13:06:56.467887 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:56.511000 13860 rpcz_store.cc:276] 0709 13:06:52.858546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.216158 (+1357612us) service_pool.cc:224] Handling call
0709 13:06:55.515530 (+1299372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.596172 (+ 80642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.510471 (+914299us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540004ae50. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:56.510586 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2987433216}
I20260709 13:06:56.516508 13860 raft_consensus.cc:1240] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:06:56.517285 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 1878) took 1212 ms. Trace:
I20260709 13:06:56.517665 13860 rpcz_store.cc:276] 0709 13:06:55.305041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.515956 (+1210915us) service_pool.cc:224] Handling call
0709 13:06:56.516249 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.516972 (+   723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.517219 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.495112 14402 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:06:56.519042 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 826) took 1208 ms. Trace:
I20260709 13:06:56.519488 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:56.465488 13788 rpcz_store.cc:276] 0709 13:06:55.431302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.441703 (+ 10401us) service_pool.cc:224] Handling call
0709 13:06:55.442122 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.442527 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.442552 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:55.480391 (+ 37839us) log.cc:844] Serialized 26 byte log entry
0709 13:06:55.711077 (+230686us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:55.711117 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.711176 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.423162 (+711986us) raft_consensus.cc:1685] finished
0709 13:06:56.423180 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.436171 (+ 12991us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7168,"raft.queue_time_us":439,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":11300,"thread_start_us":230312,"threads_started":1,"wal-append.queue_time_us":359821}
I20260709 13:06:56.439810 16520 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:56.521355 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:56.487881 16380 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:56.489928 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:56.435477 16542 raft_consensus.cc:697] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:56.440062 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 829) took 1069 ms. Trace:
I20260709 13:06:56.522083 14394 raft_consensus.cc:2393] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 7: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:56.519356 14402 rpcz_store.cc:276] 0709 13:06:55.310440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.214343 (+903903us) service_pool.cc:224] Handling call
0709 13:06:56.518990 (+304647us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.449744 16476 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:56.461908 16550 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.408354 16374 consensus_queue.cc:237] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:56.481019 16470 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:56.523356 16533 consensus_meta.cc:287] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.782s	user 0.012s	sys 0.000s
I20260709 13:06:56.513145 16469 raft_consensus.cc:3055] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:06:56.528784 16555 log.cc:927] Time spent T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:06:56.531632 16363 raft_consensus.cc:697] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:56.468870 16043 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:56.511288 16532 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:56.465215 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2255) took 4207 ms. Trace:
W20260709 13:06:56.465094 13712 rpcz_store.cc:269] 0709 13:06:51.485655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.674614 (+188959us) service_pool.cc:224] Handling call
0709 13:06:56.462330 (+4787716us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54002e8bd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:56.462461 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2979523328}
I20260709 13:06:56.524159 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 1879) took 1213 ms. Trace:
I20260709 13:06:56.471865 13756 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:06:56.560099 14393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.004s	sys 0.014s
W20260709 13:06:56.659896 14393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.005s	sys 0.014s
W20260709 13:06:56.660101 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 188235us
W20260709 13:06:56.648666 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 426306us
I20260709 13:06:56.529911 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 1872) took 1324 ms. Trace:
I20260709 13:06:56.663911 13862 rpcz_store.cc:276] 0709 13:06:55.205174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.820249 (+615075us) service_pool.cc:224] Handling call
0709 13:06:55.848758 (+ 28509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.849095 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.849122 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:55.856617 (+  7495us) log.cc:844] Serialized 26 byte log entry
0709 13:06:56.069285 (+212668us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:56.069346 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.069450 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.529665 (+460215us) raft_consensus.cc:1685] finished
0709 13:06:56.529690 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.529846 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3011,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":20589,"thread_start_us":158338,"threads_started":1,"wal-append.queue_time_us":334206}
W20260709 13:06:56.650951 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 642590us
I20260709 13:06:56.667024 13829 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:56.651889 13710 rpcz_store.cc:276] 0709 13:06:52.257995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.464474 (+4206479us) service_pool.cc:224] Handling call
0709 13:06:56.464708 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.464938 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.464962 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:56.465002 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:56.465033 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.465079 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.465170 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48088,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":32449}
I20260709 13:06:56.673177 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 1881) took 1307 ms. Trace:
I20260709 13:06:56.673722 13862 rpcz_store.cc:276] 0709 13:06:55.365602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.667061 (+1301459us) service_pool.cc:224] Handling call
0709 13:06:56.671847 (+  4786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.672629 (+   782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.672685 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:56.672761 (+    76us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:56.672799 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.672910 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.673078 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.654631 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 572) took 4360 ms. Trace:
I20260709 13:06:56.662858 13788 raft_consensus.cc:1240] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:06:56.675400 13712 rpcz_store.cc:276] 0709 13:06:52.293900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.652977 (+4359077us) service_pool.cc:224] Handling call
0709 13:06:56.653569 (+   592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.654009 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.654072 (+    63us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:56.654153 (+    81us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:56.654209 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.654300 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.654448 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.676900 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:56.677949 13712 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 7: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:56.679036 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:56.655697 13714 raft_consensus.cc:1240] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:56.657841 13860 rpcz_store.cc:276] 0709 13:06:55.311026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.518511 (+1207485us) service_pool.cc:224] Handling call
0709 13:06:56.519106 (+   595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.523921 (+  4815us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:56.523940 (+    19us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:56.523969 (+    29us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:56.523994 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.524035 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.524119 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4410,"raft.queue_time_us":10029,"spinlock_wait_cycles":3651328}
I20260709 13:06:56.656893 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:56.682824 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:56.683692 13784 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 7: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:56.685189 13784 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:56.674845 13829 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:56.679721 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:56.686710 13784 raft_consensus.cc:1240] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:56.673802 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:56.687342 13788 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:06:56.688482 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:56.688889 13788 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:56.689246 13710 raft_consensus.cc:2376] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7. Re-sending same reply.
I20260709 13:06:56.690488 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:56.691521 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:56.703800 13788 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:56.693215 13682 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 2.898s (SENT) [suppressed 42 similar messages]
W20260709 13:06:56.706246 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.534456 14397 rpcz_store.cc:276] 0709 13:06:55.366038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.205816 (+839778us) service_pool.cc:224] Handling call
0709 13:06:56.435741 (+229925us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.708317 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:56.568255 16381 consensus_queue.cc:260] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:56.709437 14400 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:06:56.710188 14400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 947) took 1174 ms. Trace:
I20260709 13:06:56.710565 14400 rpcz_store.cc:276] 0709 13:06:55.536209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.562911 (+1026702us) service_pool.cc:224] Handling call
0709 13:06:56.710049 (+147138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.711011 16381 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.562668 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:56.713223 14402 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:06:56.696600 13860 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:56.714541 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:56.715899 16205 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:56.716459 16368 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.573931 16363 consensus_queue.cc:237] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:56.717339 16368 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:56.720121 16368 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:56.720939 16368 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:56.722189 16368 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:56.716581 13860 raft_consensus.cc:1240] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:56.725571 13860 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:06:56.725762 16368 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:56.726531 16368 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:56.711138 16043 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:56.728226 16043 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.729125 16043 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:56.718176 16205 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:06:56.695400 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:56.691174 13710 raft_consensus.cc:2376] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6. Re-sending same reply.
I20260709 13:06:56.709077 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:56.568871 16350 raft_consensus.cc:3055] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:56.726024 13860 pending_rounds.cc:85] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 5
I20260709 13:06:56.735957 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:56.738724 13709 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:06:56.739663 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.697463 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:56.734910 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:56.740721 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1824) took 1248 ms. Trace:
I20260709 13:06:56.741019 13711 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:06:56.741690 16380 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:56.741727 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1580) took 3544 ms. Trace:
I20260709 13:06:56.741573 16043 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:56.696273 13862 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:56.745677 16374 consensus_queue.cc:1059] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:56.696388 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:06:56.607015 16382 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.263s	user 0.010s	sys 0.010s
I20260709 13:06:56.568222 16470 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:56.793864 16382 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.465s	user 0.010s	sys 0.011s
I20260709 13:06:56.794183 16382 raft_consensus.cc:697] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:56.794874 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:56.757545 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:56.765806 14395 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:06:56.768509 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 628) took 1536 ms. Trace:
I20260709 13:06:56.770531 13786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1588) took 3335 ms. Trace:
W20260709 13:06:56.771011 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 63859.4us
I20260709 13:06:56.773444 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:56.774621 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 936) took 3138 ms. Trace:
I20260709 13:06:56.770465 16349 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.776549 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:56.778368 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:56.780448 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.781172 13864 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 2504) took 3923 ms (client timeout 1531 ms). Trace:
I20260709 13:06:56.782791 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 642) took 1024 ms. Trace:
I20260709 13:06:56.793134 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 630) took 1226 ms. Trace:
I20260709 13:06:56.800817 13862 rpcz_store.cc:276] 0709 13:06:55.566775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.675044 (+1108269us) service_pool.cc:224] Handling call
0709 13:06:56.695680 (+ 20636us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.792354 (+ 96674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.793044 (+   690us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.793247 16432 consensus_queue.cc:1059] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:56.746450 16368 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:56.809120 16578 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.810719 16368 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:56.812698 16432 raft_consensus.cc:3055] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:56.813202 16432 raft_consensus.cc:740] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:56.813310 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2517) took 3600 ms. Trace:
I20260709 13:06:56.796303 13709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 561) took 5272 ms. Trace:
I20260709 13:06:56.815649 13709 rpcz_store.cc:276] 0709 13:06:51.517875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.079470 (+3561595us) service_pool.cc:224] Handling call
0709 13:06:56.737602 (+1658132us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b5800003398. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:06:56.738081 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.789381 (+ 51300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.790534 (+  1153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48122624}
I20260709 13:06:56.816507 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:56.816864 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:56.817510 13709 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:56.817812 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:56.790839 13711 pending_rounds.cc:85] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 6
I20260709 13:06:56.790653 13716 rpcz_store.cc:276] 0709 13:06:55.491876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.669412 (+177536us) service_pool.cc:224] Handling call
0709 13:06:56.740225 (+1070813us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54001540d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:56.740498 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486534528}
I20260709 13:06:56.795753 16382 consensus_queue.cc:237] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:56.580292 16476 raft_consensus.cc:697] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:06:56.802253 16350 raft_consensus.cc:740] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:06:56.581981 16541 log.cc:927] Time spent T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 1.194s	user 0.007s	sys 0.000s
W20260709 13:06:56.800459 13864 rpcz_store.cc:269] 0709 13:06:52.857418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.930191 (+ 72773us) service_pool.cc:224] Handling call
0709 13:06:56.780565 (+3850374us) spinlock_profiling.cc:243] Waited 3.24 s on lock 0x7b540004a454. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:56.780828 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7449804544}
I20260709 13:06:56.803007 13861 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 6: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:56.610718 16542 consensus_queue.cc:237] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:56.804091 16447 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:56.804026 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:56.818506 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:56.789206 13860 pending_rounds.cc:107] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:06:56.805080 14397 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 7: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:56.800534 13782 rpcz_store.cc:276] 0709 13:06:55.758063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.848421 (+ 90358us) service_pool.cc:224] Handling call
0709 13:06:56.782328 (+933907us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b5400371254. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:56.782566 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1709826304}
I20260709 13:06:56.562387 16469 raft_consensus.cc:740] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:56.806694 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:56.613549 16567 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:06:56.807811 16374 raft_consensus.cc:3055] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:56.807991 13787 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:56.828576 13788 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:06:56.832209 13711 pending_rounds.cc:107] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:06:56.818536 14400 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:06:56.835754 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1870) took 1673 ms. Trace:
I20260709 13:06:56.792176 13785 rpcz_store.cc:276] 0709 13:06:53.197623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.401342 (+203719us) service_pool.cc:224] Handling call
0709 13:06:55.109838 (+1708496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.159492 (+ 49654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.741334 (+1581842us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400371250. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:56.741532 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3707363584}
I20260709 13:06:56.837811 13860 raft_consensus.cc:2889] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:56.814585 16432 consensus_queue.cc:260] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:56.795838 14402 raft_consensus.cc:2376] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10. Re-sending same reply.
I20260709 13:06:56.813942 13857 rpcz_store.cc:276] 0709 13:06:53.213023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.262777 (+1049754us) service_pool.cc:224] Handling call
0709 13:06:54.262994 (+   217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.279719 (+ 16725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.279748 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:54.279785 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:54.279813 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.812609 (+2532796us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b54002d87d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:56.812703 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.813038 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38052224}
I20260709 13:06:56.842888 13711 raft_consensus.cc:2889] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:56.844834 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.844981 13789 raft_consensus.cc:1240] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:56.845503 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2518) took 3606 ms. Trace:
W20260709 13:06:56.846089 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.846015 13858 rpcz_store.cc:276] 0709 13:06:53.238971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.043916 (+1804945us) service_pool.cc:224] Handling call
0709 13:06:55.044174 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.960518 (+916344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.836823 (+876305us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b5400235354. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:56.845314 (+  8491us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1962501504}
I20260709 13:06:56.847635 16349 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:56.848929 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 152777us
I20260709 13:06:56.849529 14394 raft_consensus.cc:1275] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:56.850224 14394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 833) took 1423 ms. Trace:
I20260709 13:06:56.850910 16533 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:56.851050 16483 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.851686 16578 consensus_queue.cc:1059] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:56.853562 16533 raft_consensus.cc:3055] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:56.853994 16533 raft_consensus.cc:740] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:56.854333 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1808) took 4964 ms. Trace:
W20260709 13:06:56.854432 13708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2262) took 3785 ms (client timeout 1701 ms). Trace:
I20260709 13:06:56.854902 13784 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.855873 13783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 638) took 3547 ms. Trace:
I20260709 13:06:56.854785 13713 rpcz_store.cc:276] 0709 13:06:51.889950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.920967 (+4031017us) service_pool.cc:224] Handling call
0709 13:06:55.921268 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.921485 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.921509 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:55.921955 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:06:56.069684 (+147729us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:56.069730 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.069811 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.853863 (+784052us) raft_consensus.cc:1685] finished
0709 13:06:56.853900 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.854107 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":147444,"threads_started":1,"wal-append.queue_time_us":547144}
I20260709 13:06:56.856268 13783 rpcz_store.cc:276] 0709 13:06:53.307836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.081798 (+1773962us) service_pool.cc:224] Handling call
0709 13:06:55.082173 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.137807 (+ 55634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.137862 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:55.138473 (+   611us) log.cc:844] Serialized 26 byte log entry
0709 13:06:55.388554 (+250081us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:55.388598 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.388676 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.581273 (+1192597us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:06:56.855304 (+274031us) raft_consensus.cc:1685] finished
0709 13:06:56.855340 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.855672 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6522,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":67152128,"thread_start_us":294552,"threads_started":2,"wal-append.queue_time_us":242829}
I20260709 13:06:56.859319 13756 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:56.860378 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:56.861119 13712 raft_consensus.cc:2376] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2. Re-sending same reply.
I20260709 13:06:56.861305 13756 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:56.862112 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:56.862286 16548 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:56.861876 16476 consensus_queue.cc:237] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:56.862890 13712 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:06:56.863058 16548 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:56.863636 16548 raft_consensus.cc:697] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:56.864756 16548 consensus_queue.cc:237] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:56.865978 13787 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:56.860536 16469 consensus_queue.cc:260] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:56.843680 16374 raft_consensus.cc:740] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:06:56.580118 16568 log.cc:927] Time spent T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:06:56.867918 16374 consensus_queue.cc:260] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:56.869558 16374 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.614823 16532 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:56.872037 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:56.575917 16526 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:56.820456 16508 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:56.580735 16565 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:06:56.873297 13755 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:56.851614 16483 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:56.874469 16526 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:56.875011 13715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1804) took 4992 ms. Trace:
I20260709 13:06:56.875635 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:56.842474 13861 rpcz_store.cc:276] 0709 13:06:55.160882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.699453 (+538571us) service_pool.cc:224] Handling call
0709 13:06:56.757123 (+1057670us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b5800021698. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:06:56.834723 (+ 77600us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4763520}
I20260709 13:06:56.568547 16550 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:56.850559 14394 rpcz_store.cc:276] 0709 13:06:55.427071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.843540 (+1416469us) service_pool.cc:224] Handling call
0709 13:06:56.849069 (+  5529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.849940 (+   871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.850148 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.797712 14393 rpcz_store.cc:276] 0709 13:06:53.635901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.053795 (+1417894us) service_pool.cc:224] Handling call
0709 13:06:55.835441 (+781646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.835703 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:55.993118 (+157415us) log.cc:844] Serialized 14 byte log entry
0709 13:06:56.660880 (+667762us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:56.661012 (+   132us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:56.661174 (+   162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.661316 (+   142us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.774399 (+113083us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b540052b050. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:56.774535 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":202871,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":9914,"raft.queue_time_us":55035,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":340,"spinlock_wait_cycles":1796781952,"thread_start_us":823894,"threads_started":2,"wal-append.queue_time_us":615564}
I20260709 13:06:56.875403 13715 rpcz_store.cc:276] 0709 13:06:51.882235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.767803 (+3885568us) service_pool.cc:224] Handling call
0709 13:06:55.818614 (+ 50811us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.824462 (+  5848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.824494 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:55.845617 (+ 21123us) log.cc:844] Serialized 26 byte log entry
0709 13:06:56.061536 (+215919us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:56.061596 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.061694 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.874663 (+812969us) raft_consensus.cc:1685] finished
0709 13:06:56.874698 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.874846 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5454,"raft.queue_time_us":6076,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":11029,"thread_start_us":176118,"threads_started":1,"wal-append.queue_time_us":501148}
I20260709 13:06:56.856949 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:56.882299 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:56.883040 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:56.883564 13682 leader_election.cc:336] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 1.634s (SENT)
I20260709 13:06:56.796726 13863 rpcz_store.cc:276] 0709 13:06:55.231733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.500705 (+1268972us) service_pool.cc:224] Handling call
0709 13:06:56.501004 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.514138 (+ 13134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.514172 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:56.514613 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:06:56.754176 (+239563us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:56.754260 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.754387 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.768103 (+ 13716us) raft_consensus.cc:1685] finished
0709 13:06:56.768121 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.768312 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12773,"raft.queue_time_us":20878,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":26597,"thread_start_us":85916,"threads_started":1,"wal-append.queue_time_us":85566}
I20260709 13:06:56.797037 13786 rpcz_store.cc:276] 0709 13:06:53.434877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.149869 (+1714992us) service_pool.cc:224] Handling call
0709 13:06:55.150094 (+   225us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.366703 (+216609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.366744 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:55.373240 (+  6496us) log.cc:844] Serialized 26 byte log entry
0709 13:06:55.710327 (+337087us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:55.710363 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.769851 (+1059488us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54003df254. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:56.769923 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.770026 (+   103us) raft_consensus.cc:1685] finished
0709 13:06:56.770039 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.770324 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":60206,"raft.run_cpu_time_us":58,"raft.run_wall_time_us":59,"spinlock_wait_cycles":416997632,"thread_start_us":338355,"threads_started":2,"wal-append.queue_time_us":525027}
W20260709 13:06:56.879552 13708 rpcz_store.cc:269] 0709 13:06:53.068777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.623564 (+554787us) service_pool.cc:224] Handling call
0709 13:06:56.853972 (+3230408us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b540036f954. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:56.854224 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1212731264}
I20260709 13:06:56.890132 13784 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:56.896489 16377 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.897199 16404 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:56.897359 16377 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:56.891384 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:56.867910 16469 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.906157 13710 raft_consensus.cc:2376] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4. Re-sending same reply.
I20260709 13:06:56.909097 14394 raft_consensus.cc:1275] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:56.909808 14394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 945) took 1374 ms. Trace:
I20260709 13:06:56.911330 14394 rpcz_store.cc:276] 0709 13:06:55.535365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.895550 (+1360185us) service_pool.cc:224] Handling call
0709 13:06:56.908674 (+ 13124us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.909526 (+   852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.909731 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.912835 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:56.913638 14394 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:56.902872 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:56.915975 13708 raft_consensus.cc:2376] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9. Re-sending same reply.
I20260709 13:06:56.910805 16404 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:56.919456 16444 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.907310 13785 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:56.923631 14366 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:56.855160 16533 consensus_queue.cc:260] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:56.925175 16526 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:06:57.186996 16543 consensus_meta.cc:287] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 1.129s	user 0.004s	sys 0.009s
W20260709 13:06:57.184056 16521 consensus_meta.cc:287] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.682s	user 0.009s	sys 0.004s
W20260709 13:06:56.992381 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 133708us
W20260709 13:06:57.188323 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 263316us
I20260709 13:06:56.966907 16377 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:57.060025 13707 raft_consensus.cc:1240] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:57.122736 14402 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:06:57.193022 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 319789us
I20260709 13:06:57.039816 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:57.155260 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 571) took 4862 ms. Trace:
I20260709 13:06:56.975945 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:56.990453 13712 raft_consensus.cc:1240] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:56.932083 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 229264us
W20260709 13:06:57.199239 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 282194us
I20260709 13:06:56.925051 16365 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:56.965385 13713 raft_consensus.cc:2393] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 4: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:06:56.965811 16559 log.cc:927] Time spent T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.519s	user 0.002s	sys 0.000s
I20260709 13:06:57.203989 13711 rpcz_store.cc:276] 0709 13:06:52.292840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.474144 (+4181304us) service_pool.cc:224] Handling call
0709 13:06:56.740442 (+266298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.900531 (+160089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.154947 (+254416us) spinlock_profiling.cc:243] Waited 87.5 ms on lock 0x7b54001540d0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:57.155173 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201253120}
I20260709 13:06:57.089323 16415 raft_consensus.cc:3055] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:57.215049 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2257) took 4834 ms. Trace:
I20260709 13:06:57.218252 16537 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:57.219190 16537 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:57.222185 16537 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:56.966454 16513 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:56.996735 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:57.207522 16543 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:57.224627 13713 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:06:57.225047 16543 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:57.225317 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1811) took 2118 ms. Trace:
I20260709 13:06:57.225698 13713 rpcz_store.cc:276] 0709 13:06:55.106438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.223985 (+2117547us) service_pool.cc:224] Handling call
0709 13:06:57.224411 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.225039 (+   628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.225231 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:57.227444 13713 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:57.228952 13713 raft_consensus.cc:1275] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:06:57.231542 14367 connection.cc:256] RPC call timeout handler was delayed by -2.6641383690000566s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
W20260709 13:06:57.232161 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.233703 16456 raft_consensus.cc:3055] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:57.234004 16540 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.234151 16456 raft_consensus.cc:740] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:57.234581 16540 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:57.236905 16540 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:57.235113 16456 consensus_queue.cc:260] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:57.238055 16519 consensus_meta.cc:287] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 1.115s	user 0.011s	sys 0.005s
I20260709 13:06:57.238453 16456 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.244169 13861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:06:57.245137 13861 raft_consensus.cc:606] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:06:57.245523 13861 raft_consensus.cc:614] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:57.245860 16262 consensus_queue.cc:1059] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:06:57.247529 16262 raft_consensus.cc:3055] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:57.247959 16262 raft_consensus.cc:740] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:57.249161 16262 consensus_queue.cc:260] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:57.250978 16262 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.262768 14366 leader_election.cc:304] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:06:57.280345 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.063189 16470 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:57.297063 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 82643.4us
I20260709 13:06:57.215996 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:56.929816 16550 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:57.238749 16519 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:57.308320 13755 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:57.306595 14400 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
W20260709 13:06:57.310832 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.307858 13712 rpcz_store.cc:276] 0709 13:06:52.376722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.892609 (+4515887us) service_pool.cc:224] Handling call
0709 13:06:56.990159 (+ 97550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.210648 (+220489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.210903 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:57.217753 16415 raft_consensus.cc:740] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:57.338699 14402 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:57.306334 16365 raft_consensus.cc:697] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:57.311918 16540 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.092093 16350 consensus_queue.cc:260] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:57.438371 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.438653 16087 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:57.439431 16548 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.439698 16483 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:57.440079 16548 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:57.442322 16548 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:57.431851 16550 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:57.443797 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 135619us
I20260709 13:06:57.444213 16537 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:57.444568 14399 raft_consensus.cc:2393] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 4: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:57.444748 16537 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:57.445297 16537 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:57.447685 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 185062us
I20260709 13:06:57.447722 16513 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:57.449667 14366 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:57.450784 16483 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:57.451346 16483 raft_consensus.cc:697] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:06:57.451275 16540 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:57.440425 14401 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
W20260709 13:06:57.451478 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.453394 13710 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:06:57.453801 13710 pending_rounds.cc:85] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 4
I20260709 13:06:57.454252 13710 pending_rounds.cc:107] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:06:57.454579 13710 raft_consensus.cc:2889] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:57.451932 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 152924us
W20260709 13:06:57.457064 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 144619us
W20260709 13:06:57.504971 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 53624.4us
I20260709 13:06:57.529985 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 1871) took 2368 ms. Trace:
I20260709 13:06:57.530435 13865 rpcz_store.cc:276] 0709 13:06:55.161171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.757992 (+596821us) service_pool.cc:224] Handling call
0709 13:06:55.758249 (+   257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.758442 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.758466 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:55.758917 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:06:55.997486 (+238569us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:55.997521 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.997581 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.928974 (+931393us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:06:57.529491 (+600517us) raft_consensus.cc:1685] finished
0709 13:06:57.529511 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.529789 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6578944,"thread_start_us":238264,"threads_started":1,"wal-append.queue_time_us":477673}
I20260709 13:06:57.531472 16465 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:57.531914 16465 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:57.438342 13715 raft_consensus.cc:2955] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:06:57.532317 16465 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.443922 16550 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:57.537642 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 576) took 4593 ms. Trace:
I20260709 13:06:57.541246 13710 rpcz_store.cc:276] 0709 13:06:52.943898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.206837 (+4262939us) service_pool.cc:224] Handling call
0709 13:06:57.309640 (+102803us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.537348 (+227708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.537575 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:57.543814 14367 connection.cc:256] RPC call timeout handler was delayed by -2.3510652270000492s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23490000000000003s for a response
W20260709 13:06:57.544329 14367 connection.cc:256] RPC call timeout handler was delayed by -1.9276591500000677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
W20260709 13:06:57.544845 14367 connection.cc:256] RPC call timeout handler was delayed by -1.8697715790000302s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
W20260709 13:06:57.545356 14367 connection.cc:256] RPC call timeout handler was delayed by -1.8655560570000489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21610000000000001s for a response
I20260709 13:06:57.448096 16543 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:06:57.525166 16350 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.554538 13711 raft_consensus.cc:1240] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:57.556732 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1815) took 2420 ms. Trace:
I20260709 13:06:57.559648 13711 rpcz_store.cc:276] 0709 13:06:55.136522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.331547 (+2195025us) service_pool.cc:224] Handling call
0709 13:06:57.536209 (+204662us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.556452 (+ 20243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.556676 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:57.570353 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:57.572796 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 51374.6us
I20260709 13:06:57.581151 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:57.583957 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:57.586009 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 83888.6us
I20260709 13:06:57.591950 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:57.596807 13757 leader_election.cc:336] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 1.919s (SENT)
I20260709 13:06:57.597033 13861 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:57.597571 14367 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:57.598745 13786 raft_consensus.cc:2393] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 10: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:06:57.607903 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 111003us
I20260709 13:06:57.605495 13790 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:06:57.617039 13863 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:57.572512 16377 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 13:06:57.623435 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 55826.3us
I20260709 13:06:57.624116 16377 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:57.624724 16595 log.cc:927] Time spent T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:06:57.624811 16377 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:57.625557 16377 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:57.626600 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:57.627305 13860 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:06:57.625509 14367 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:57.629434 14367 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:06:57.631695 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 1.79349e+06us
I20260709 13:06:57.582465 16483 consensus_queue.cc:237] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:57.632668 13830 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:57.576989 16365 consensus_queue.cc:237] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:57.572628 16087 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:06:57.650108 13680 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:57.639722 16444 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:57.619582 16262 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:06:57.586771 16470 consensus_queue.cc:1059] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:06:57.662849 16444 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:57.693094 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:57.694517 16542 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:57.678071 16519 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:57.698096 16360 raft_consensus.cc:3055] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:57.698047 16518 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:57.698832 16351 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:57.699286 16554 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:57.703634 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 71026.9us
I20260709 13:06:57.704761 13755 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:57.704933 16262 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:57.706382 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:57.708144 16432 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.709641 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:06:57.710402 14395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 941) took 4011 ms (client timeout 1616 ms). Trace:
I20260709 13:06:57.696440 16533 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:57.729202 14395 rpcz_store.cc:269] 0709 13:06:53.698802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.833568 (+134766us) service_pool.cc:224] Handling call
0709 13:06:57.710119 (+3876551us) spinlock_profiling.cc:243] Waited 2.91 s on lock 0x7b54005145d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:57.710286 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6685374848}
I20260709 13:06:57.724128 16360 raft_consensus.cc:740] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:57.685946 16599 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:57.718284 16444 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.734815 14400 raft_consensus.cc:2393] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 5: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:57.738404 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:57.739372 13861 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:06:57.739744 16571 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:57.762948 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 80422.7us
I20260709 13:06:57.762840 13830 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:57.735859 16599 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:57.742726 16548 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:57.764977 16548 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.769773 16548 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:57.774344 14401 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 944) took 3934 ms (client timeout 1755 ms). Trace:
W20260709 13:06:57.774775 14401 rpcz_store.cc:269] 0709 13:06:53.840154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.191633 (+351479us) service_pool.cc:224] Handling call
0709 13:06:57.774136 (+3582503us) spinlock_profiling.cc:243] Waited 3.04 s on lock 0x7b5400684554. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:57.774263 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6984918400}
I20260709 13:06:57.779662 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:57.780226 16540 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:57.781281 13708 raft_consensus.cc:1275] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:57.781876 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2269) took 4525 ms. Trace:
I20260709 13:06:57.782181 13708 rpcz_store.cc:276] 0709 13:06:53.256131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.780595 (+4524464us) service_pool.cc:224] Handling call
0709 13:06:57.780920 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.781632 (+   712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.781823 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:57.785969 16351 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.786648 16465 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:57.780284 14395 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
W20260709 13:06:57.786785 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.791330 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 565) took 6005 ms. Trace:
W20260709 13:06:57.793572 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 161103us
I20260709 13:06:57.786772 16351 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:57.797883 13755 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:57.791707 13714 rpcz_store.cc:276] 0709 13:06:51.763546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.256141 (+2492595us) service_pool.cc:224] Handling call
0709 13:06:56.462478 (+2206337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.680296 (+217818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.318352 (+638056us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54002e8bd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:57.768442 (+450090us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b54002e8bd0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:57.768614 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5515993344}
I20260709 13:06:57.804468 14394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 838) took 1126 ms. Trace:
I20260709 13:06:57.751631 16513 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:06:57.766178 16599 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.805032 14394 rpcz_store.cc:276] 0709 13:06:56.674114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.969951 (+295837us) service_pool.cc:224] Handling call
0709 13:06:57.189702 (+219751us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.190093 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:06:57.549059 (+358966us) log.cc:844] Serialized 14 byte log entry
0709 13:06:57.800271 (+251212us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:57.800361 (+    90us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:57.800409 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.800504 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.800674 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":342525,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":52017,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":16046,"thread_start_us":569333,"threads_started":3,"wal-append.queue_time_us":163959}
W20260709 13:06:57.816324 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.816788 13757 leader_election.cc:336] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 2.184s (SENT)
I20260709 13:06:57.817301 16360 consensus_queue.cc:260] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:57.818066 13757 leader_election.cc:336] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 2.239s (SENT)
I20260709 13:06:57.818778 16360 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:57.819453 16594 log.cc:927] Time spent T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:06:57.819722 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:57.820832 16351 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:57.820869 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 58124.2us
I20260709 13:06:57.826740 16522 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:57.802174 16456 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:57.826148 16470 consensus_queue.cc:1059] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:57.802696 14396 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:06:57.847749 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.849848 13756 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:57.857127 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:57.857939 13710 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:57.861184 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:57.856472 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:57.862515 13712 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.865330 13829 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:57.866582 14400 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:57.846525 16522 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.871321 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:57.875865 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:57.879093 13711 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:06:57.880426 13830 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:57.869064 16445 raft_consensus.cc:3055] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:57.884760 13707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1810) took 5639 ms. Trace:
I20260709 13:06:57.872234 16514 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:57.873427 16522 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:57.886238 13783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 656) took 1176 ms. Trace:
I20260709 13:06:57.892287 13710 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:06:57.891600 13783 rpcz_store.cc:276] 0709 13:06:56.704584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.864475 (+159891us) service_pool.cc:224] Handling call
0709 13:06:56.864830 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.883588 (+ 18758us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.883625 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:56.884149 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.304467 (+420318us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:57.304509 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.304588 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:57.881043 (+576455us) raft_consensus.cc:1685] finished
0709 13:06:57.881062 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.881170 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20011,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":38221,"thread_start_us":419884,"threads_started":1,"wal-append.queue_time_us":883776}
I20260709 13:06:57.893671 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:57.894127 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:57.895287 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:57.896411 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:57.896315 16570 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:57.897099 13713 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.898082 16570 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:57.898548 16276 tablet_copy_client.cc:538] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:57.888620 16554 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:57.889298 16377 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:57.902606 16377 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:57.903162 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 43589us
I20260709 13:06:57.904006 13829 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:57.905407 16465 leader_election.cc:290] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:57.907920 16432 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:57.908275 16470 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.908799 16470 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:57.908982 16349 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:57.885754 16445 raft_consensus.cc:740] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:57.910890 16470 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:57.910852 16445 consensus_queue.cc:260] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:57.911931 13709 raft_consensus.cc:2410] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:57.912364 16445 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:57.912562 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 68935.6us
I20260709 13:06:57.913365 13756 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:57.914335 13756 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:57.915624 16513 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:57.916090 16513 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:57.916509 16513 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:57.918005 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 68412.5us
I20260709 13:06:57.919468 13680 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:57.919587 16543 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:57.888082 16578 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:57.924137 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:57.925660 13829 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:57.922669 16548 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:57.894272 13710 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.886056 13707 rpcz_store.cc:276] 0709 13:06:52.245137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.405510 (+4160373us) service_pool.cc:224] Handling call
0709 13:06:56.859345 (+453835us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.215858 (+356513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.884097 (+668239us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b540036f954. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:57.884565 (+   468us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b540036f950. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:57.884710 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1375427072}
I20260709 13:06:57.933101 16554 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:57.933549 16554 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:57.933800 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 658) took 1228 ms. Trace:
I20260709 13:06:57.933907 16554 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.935230 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:57.934201 13782 rpcz_store.cc:276] 0709 13:06:56.705503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.866273 (+160770us) service_pool.cc:224] Handling call
0709 13:06:56.866605 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.137851 (+271246us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:57.138230 (+   379us) log.cc:844] Serialized 14 byte log entry
0709 13:06:57.427327 (+289097us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:57.427387 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:57.427452 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.933595 (+506143us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54002f9c54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:57.933637 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.933749 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19906,"prepare.queue_time_us":667,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":105346,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":6686,"spinlock_wait_cycles":631915776,"thread_start_us":183689,"threads_started":1,"wal-append.queue_time_us":556774}
I20260709 13:06:57.945715 13786 raft_consensus.cc:1240] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:57.940639 16470 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:57.952243 13785 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:06:57.952265 13756 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:57.891124 16526 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:06:57.942095 16351 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:57.957690 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:57.952637 13858 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:57.956131 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:57.954404 13712 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
W20260709 13:06:57.963521 16469 consensus_meta.cc:287] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 1.058s	user 0.013s	sys 0.000s
I20260709 13:06:57.943388 16578 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:57.972193 13707 raft_consensus.cc:2393] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 5: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:57.941891 16350 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:06:57.960368 16351 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.968119 16612 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.985922 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:57.966950 16382 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:57.990944 13680 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:06:57.992771 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 115102us
I20260709 13:06:57.993675 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:57.995448 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:57.996466 14402 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:06:57.992264 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 63845.6us
I20260709 13:06:57.997753 13756 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
W20260709 13:06:57.979751 16537 consensus_meta.cc:287] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.001s
I20260709 13:06:57.998700 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:57.996297 13712 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:06:58.000778 13707 raft_consensus.cc:2410] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:57.985314 16351 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.986630 16514 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.999070 16360 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.998813 16469 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.011879 14367 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:58.024971 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:58.005921 16571 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:57.992244 16612 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:58.007259 16514 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:58.026306 16540 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:58.039369 16550 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:58.039984 16550 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:58.041448 16522 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:58.025517 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 47505.9us
W20260709 13:06:58.031463 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 297344us
I20260709 13:06:58.031584 16548 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:58.032312 16561 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 1.824s	user 0.000s	sys 0.016s
W20260709 13:06:58.033555 16596 log.cc:927] Time spent T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.338s	user 0.000s	sys 0.002s
I20260709 13:06:58.001945 16537 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:58.048117 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.056545 16612 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:58.056567 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 47853.5us
I20260709 13:06:58.058779 14367 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:58.058939 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:06:58.059682 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 64767.3us
I20260709 13:06:58.062924 13860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:06:58.063640 13860 raft_consensus.cc:606] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 7 LEADER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:06:58.027787 16571 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.067240 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:58.069310 14402 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.057152 16624 consensus_queue.cc:1059] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:06:58.057466 16514 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:58.025341 16360 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:58.080983 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:58.009760 16600 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.125s
I20260709 13:06:58.090292 13713 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
W20260709 13:06:58.091553 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 84942.4us
I20260709 13:06:58.089143 14400 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:06:58.091738 13713 raft_consensus.cc:1240] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:58.091399 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 93798.6us
I20260709 13:06:58.028527 16469 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:58.073931 16571 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.065022 16470 consensus_queue.cc:1059] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:06:58.072721 16612 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:58.099488 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:58.100231 14395 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:58.100409 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.073074 16522 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:58.101919 14368 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:58.115957 14395 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:06:58.092203 16618 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:58.100832 16612 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.109325 13713 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:58.107895 16418 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:06:58.117384 14368 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:58.101292 13756 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:06:58.122313 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.118055 13755 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:58.124565 16611 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:58.124696 16547 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.124974 13713 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:58.125007 16611 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:58.125576 16611 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.125260 16547 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:58.130074 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:58.092872 16554 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:58.132781 13716 raft_consensus.cc:1240] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:58.133363 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2264) took 5021 ms. Trace:
I20260709 13:06:58.133740 16554 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:58.133644 13716 rpcz_store.cc:276] 0709 13:06:53.111855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.132307 (+5020452us) service_pool.cc:224] Handling call
0709 13:06:58.132609 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.133155 (+   546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.133313 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:58.120051 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 239712us
I20260709 13:06:58.131336 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:58.067373 16444 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:58.093973 16382 raft_consensus.cc:697] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:58.140451 13710 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:06:58.188341 13710 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:06:58.152166 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.190941 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 72953.1us
I20260709 13:06:58.194535 13715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1812) took 3087 ms. Trace:
I20260709 13:06:58.198980 13715 rpcz_store.cc:276] 0709 13:06:55.106708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.303367 (+2196659us) service_pool.cc:224] Handling call
0709 13:06:57.426915 (+123548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.438113 (+ 11198us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:57.848308 (+410195us) log.cc:844] Serialized 14 byte log entry
0709 13:06:58.194126 (+345818us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:58.194195 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:58.194263 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.194343 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.194470 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":47265,"thread_start_us":324564,"threads_started":2,"wal-append.queue_time_us":178309}
W20260709 13:06:58.244308 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.258581 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:06:58.265786 13709 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2273) took 1611 ms (client timeout 1883 ms). Trace:
W20260709 13:06:58.266472 13709 rpcz_store.cc:269] 0709 13:06:56.654505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.818196 (+163691us) service_pool.cc:224] Handling call
0709 13:06:58.187611 (+1369415us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000c5b54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:58.265692 (+ 78081us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2466433408}
I20260709 13:06:58.259014 13755 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:06:58.269750 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 77933.4us
I20260709 13:06:58.135444 16612 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.093649 16514 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:06:58.185725 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:58.292542 13786 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:06:58.280135 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:58.280839 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:06:58.284301 16623 log.cc:927] Time spent T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 13:06:58.284386 16276 tablet_bootstrap.cc:492] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:06:58.290827 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:58.307880 13788 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:06:58.119315 16540 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.141s
I20260709 13:06:58.293470 13830 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:58.272485 13861 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:06:58.300000 14402 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:06:58.292872 16382 consensus_queue.cc:237] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:58.302126 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.316921 13755 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:06:58.190814 16618 raft_consensus.cc:697] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:58.294353 13857 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:58.309128 13829 leader_election.cc:336] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Timed out: RequestConsensusVote RPC to 127.12.76.132:43039 timed out after 1.657s (SENT)
I20260709 13:06:58.101681 16351 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:58.127338 16547 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:58.310384 13682 leader_election.cc:336] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 1.632s (SENT)
W20260709 13:06:58.309340 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 208603us
I20260709 13:06:58.318495 13682 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:58.318766 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:58.309610 16522 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:58.323899 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:58.330926 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:58.334234 16626 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:58.316256 16518 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:58.326226 16514 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:58.359988 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 258792us
I20260709 13:06:58.329043 16522 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.362361 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:58.293198 16611 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:58.366572 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 73212.9us
I20260709 13:06:58.565783 13709 raft_consensus.cc:1240] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:58.349263 16537 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:58.365255 16522 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.567770 13709 raft_consensus.cc:1275] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:58.569756 13614 catalog_manager.cc:5697] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index 4 to 6, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:58.330056 16599 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:58.572052 14394 raft_consensus.cc:1240] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:58.573246 16599 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:06:58.452798 16592 log.cc:927] Time spent T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.887s	user 0.000s	sys 0.012s
I20260709 13:06:58.576447 16360 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:58.577044 16087 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:06:58.577690 16087 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:58.576488 13614 catalog_manager.cc:5697] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 4 to 5, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 5 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:58.582911 16518 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:06:58.583436 16518 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:58.585620 16613 log.cc:927] Time spent T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.579s	user 0.006s	sys 0.004s
I20260709 13:06:58.587057 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 635) took 1005 ms. Trace:
W20260709 13:06:58.520678 16533 consensus_meta.cc:287] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.786s	user 0.013s	sys 0.001s
I20260709 13:06:58.521791 16571 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:58.293852 16415 consensus_queue.cc:260] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:58.522338 13857 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:06:58.522756 16351 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:58.524247 16627 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:58.524562 16469 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:58.524822 16629 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:58.527688 16547 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.665165 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:58.665400 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:58.528088 16611 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:58.539690 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 274698us
I20260709 13:06:58.548512 16444 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:58.375876 13756 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:58.415882 16618 consensus_queue.cc:237] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:58.353331 16445 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:06:58.557962 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 256548us
W20260709 13:06:58.559680 16621 log.cc:927] Time spent T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.211s	user 0.001s	sys 0.004s
I20260709 13:06:58.560298 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:06:58.562542 16513 consensus_meta.cc:287] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.646s	user 0.012s	sys 0.002s
I20260709 13:06:58.563699 16276 tablet_bootstrap.cc:700] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58: Time spent opening tablet: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:06:58.565268 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:06:58.565503 14399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 684) took 2114 ms (client timeout 1657 ms). Trace:
I20260709 13:06:58.565639 14393 raft_consensus.cc:1240] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:58.389441 13856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 618) took 4741 ms. Trace:
I20260709 13:06:58.601722 13865 raft_consensus.cc:2410] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:58.587452 13864 rpcz_store.cc:276] 0709 13:06:57.581651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.676043 (+ 94392us) service_pool.cc:224] Handling call
0709 13:06:57.686107 (+ 10064us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:57.695741 (+  9634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.695778 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:57.696558 (+   780us) log.cc:844] Serialized 52 byte log entry
0709 13:06:57.850431 (+153873us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:57.850477 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.850550 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.585014 (+734464us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:06:58.586723 (+  1709us) raft_consensus.cc:1685] finished
0709 13:06:58.586742 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.586975 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1585,"raft.queue_time_us":1858,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"spinlock_wait_cycles":4450176,"thread_start_us":153391,"threads_started":1,"wal-append.queue_time_us":277628}
I20260709 13:06:58.528069 16612 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:58.388758 16631 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:58.673036 13712 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:58.582886 16087 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:58.675176 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:58.676898 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:06:59.018250 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.018393 13682 leader_election.cc:336] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 1.643s (SENT)
I20260709 13:06:58.820515 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:59.017963 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:58.629052 16432 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:58.821866 13829 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:58.581261 13614 catalog_manager.cc:5697] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index -1 to 4, term changed from 5 to 6, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131), NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added, no longer has a pending config: VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129), VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130), VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131), NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 6 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:58.732694 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.028952 14394 raft_consensus.cc:1240] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:59.028496 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 662710us
W20260709 13:06:59.022945 14399 rpcz_store.cc:269] 0709 13:06:56.450711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.497866 (+ 47155us) service_pool.cc:224] Handling call
0709 13:06:58.565242 (+2067376us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b54005c1054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:58.565424 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2155368192}
W20260709 13:06:58.750952 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 74202us
W20260709 13:06:59.030498 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 208750us
I20260709 13:06:58.842218 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:58.833784 13830 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:58.816552 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:58.751799 14402 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:58.829017 13782 raft_consensus.cc:1240] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:59.031364 13829 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:06:59.032670 13709 raft_consensus.cc:2393] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 4: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:06:59.039368 13756 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:59.042788 13708 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.662744 16626 raft_consensus.cc:697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:58.673969 16627 raft_consensus.cc:697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:58.676280 16647 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:59.052523 13786 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
W20260709 13:06:59.056593 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 321299us
I20260709 13:06:58.822819 16537 raft_consensus.cc:2764] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:06:59.051589 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:58.734696 16351 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:59.038348 14397 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.017984 16445 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:06:58.822238 16360 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:06:59.023237 13856 rpcz_store.cc:276] 0709 13:06:53.589307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.744947 (+2155640us) service_pool.cc:224] Handling call
0709 13:06:55.745328 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.807867 (+ 62539us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:55.807902 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:55.808388 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:06:55.882906 (+ 74518us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:55.882969 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.883065 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:57.946698 (+2063633us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:06:58.294625 (+347927us) raft_consensus.cc:1685] finished
0709 13:06:58.294646 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.330840 (+ 36194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62071,"raft.queue_time_us":65796,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":10966,"spinlock_wait_cycles":42975616,"thread_start_us":74182,"threads_started":1,"wal-append.queue_time_us":281690}
W20260709 13:06:59.053414 13861 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.006s	sys 0.009s
I20260709 13:06:59.041606 16533 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:58.888725 16548 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.065840 13614 catalog_manager.cc:5697] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 5 to 6, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 6 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:59.076624 13861 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.006s	sys 0.009s
W20260709 13:06:59.044818 16350 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.004s	sys 0.013s
I20260709 13:06:58.823069 16620 raft_consensus.cc:3055] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:59.082749 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:58.677573 16469 consensus_queue.cc:1059] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.385s
W20260709 13:06:59.039970 13680 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.001s	sys 0.017s
I20260709 13:06:59.056375 16542 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:59.103178 13860 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.989837 16522 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:59.061981 16554 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:59.108209 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:58.831925 16640 consensus_queue.cc:1059] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.255s
I20260709 13:06:59.075378 16445 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:59.076151 16543 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:59.130875 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2291) took 1323 ms. Trace:
I20260709 13:06:59.036706 16513 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:59.084192 16533 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.124686 13614 catalog_manager.cc:5697] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 5 to 6, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 6 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:59.121734 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 91119.1us
I20260709 13:06:59.117803 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:59.132479 13830 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:06:59.112677 16542 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.058508 16631 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:59.107749 16526 consensus_queue.cc:1059] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:06:59.143080 16533 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:59.148326 13756 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:59.132730 13714 rpcz_store.cc:276] 0709 13:06:57.807523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.824652 (+ 17129us) service_pool.cc:224] Handling call
0709 13:06:57.843331 (+ 18679us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.863581 (+ 20250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.863626 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.873874 (+ 10248us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.090325 (+216451us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:58.322474 (+232149us) log.cc:844] Serialized 14 byte log entry
0709 13:06:58.653101 (+330627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.653308 (+   207us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.130475 (+477167us) raft_consensus.cc:1685] finished
0709 13:06:59.130541 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.130795 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39866,"prepare.queue_time_us":433358,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":304763,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":35410,"thread_start_us":703113,"threads_started":3,"wal-append.queue_time_us":385769}
I20260709 13:06:59.156147 13789 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:59.107694 16578 consensus_queue.cc:1059] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:06:59.088845 16360 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:59.155911 13614 catalog_manager.cc:5697] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 5 to 8, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 8 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:59.083798 16518 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:59.173574 13857 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.174405 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:06:59.175578 13680 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.003s	sys 0.018s
I20260709 13:06:59.149848 16542 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.153466 16640 raft_consensus.cc:3055] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:59.117607 16655 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
W20260709 13:06:59.184100 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 865308us
W20260709 13:06:59.185009 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 165889us
I20260709 13:06:59.173291 13614 catalog_manager.cc:5697] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 4 to 7, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 7 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:59.185940 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 77748us
I20260709 13:06:59.153909 16571 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:59.189079 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 47395.9us
W20260709 13:06:59.176105 16350 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.008s	sys 0.014s
I20260709 13:06:59.187811 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:59.165755 16641 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.195828 13756 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:06:59.108031 16647 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:59.116528 16548 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:58.823238 16547 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:59.182740 16526 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:59.184515 16554 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:59.234959 13860 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
W20260709 13:06:59.237181 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 49449.8us
W20260709 13:06:59.196789 13682 leader_election.cc:336] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 1.698s (SENT)
I20260709 13:06:59.211757 13857 raft_consensus.cc:2410] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:59.212393 13614 catalog_manager.cc:5697] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 3 to 4, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 4 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:59.179749 16620 raft_consensus.cc:740] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:59.242007 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:59.245048 13856 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.226465 16629 raft_consensus.cc:2764] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:06:59.214797 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 952) took 3356 ms. Trace:
I20260709 13:06:59.228811 16612 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:59.183161 16640 raft_consensus.cc:740] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:59.229995 16543 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:06:59.230887 16653 log.cc:927] Time spent T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:06:59.232023 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:59.118300 16626 consensus_queue.cc:237] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:59.242707 13830 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:06:59.255594 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 58818.8us
I20260709 13:06:59.258823 14393 rpcz_store.cc:276] 0709 13:06:55.844949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.925547 (+1080598us) service_pool.cc:224] Handling call
0709 13:06:58.565400 (+1639853us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:59.022593 (+457193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.201289 (+178696us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54005c1050. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:59.201478 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3770119936}
I20260709 13:06:59.316159 16543 raft_consensus.cc:697] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:59.317211 16543 consensus_queue.cc:237] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:59.299763 16554 raft_consensus.cc:697] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 5 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:59.318912 16554 consensus_queue.cc:237] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:59.213794 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 496677us
I20260709 13:06:59.162457 16627 consensus_queue.cc:237] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:59.301054 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 63191.3us
I20260709 13:06:59.336858 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:06:59.244282 16526 raft_consensus.cc:697] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:06:59.302366 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:06:59.343991 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 154242us
I20260709 13:06:59.346791 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2298) took 1492 ms. Trace:
I20260709 13:06:59.341214 13614 catalog_manager.cc:5697] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 3 to 4, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 4 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:59.348269 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 105648us
I20260709 13:06:59.347191 13712 rpcz_store.cc:276] 0709 13:06:57.854551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.065446 (+210895us) service_pool.cc:224] Handling call
0709 13:06:58.087710 (+ 22264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.019101 (+931391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.346576 (+327475us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b5400260554. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:59.346735 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1345665280}
I20260709 13:06:59.350250 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:59.351027 14395 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 6: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:59.354097 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:59.354228 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:59.212522 16641 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:59.358457 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:59.441624 13860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:57574
W20260709 13:06:59.458837 16651 log.cc:927] Time spent T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
W20260709 13:06:59.458966 16652 log.cc:927] Time spent T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:06:59.459896 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:59.456228 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:06:59.439985 16648 log.cc:927] Time spent T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
W20260709 13:06:59.463744 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 356322us
W20260709 13:06:59.471397 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.440754 16548 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:59.456869 16513 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:59.465442 16640 consensus_queue.cc:260] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:06:59.577263 16483 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.930s	user 0.022s	sys 0.043s
W20260709 13:06:59.567261 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 231819us
I20260709 13:06:59.594024 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:59.582037 14400 raft_consensus.cc:2393] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 8: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:06:59.597231 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.567729 16087 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.568625 13756 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:06:59.569047 13708 consensus_meta.cc:287] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.523s	user 0.011s	sys 0.019s
I20260709 13:06:59.602430 14399 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:59.602689 13708 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:06:59.458339 16526 consensus_queue.cc:237] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:59.569648 16522 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:59.575374 13714 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.325079 16470 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:59.580240 13856 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
W20260709 13:06:59.579332 13829 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.013s	sys 0.014s
W20260709 13:06:59.605435 13829 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.013s	sys 0.014s
W20260709 13:06:59.605783 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 535752us
I20260709 13:06:59.584515 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 650) took 1256 ms. Trace:
I20260709 13:06:59.584918 14395 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:59.588922 14401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 967) took 1594 ms. Trace:
I20260709 13:06:59.581213 13614 catalog_manager.cc:5697] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 2 to 3, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 3 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:59.590976 13716 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.006s	sys 0.021s
I20260709 13:06:59.576572 16445 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:59.609323 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58552 (request call id 601) took 1056 ms. Trace:
I20260709 13:06:59.609895 13708 rpcz_store.cc:276] 0709 13:06:58.546884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.565000 (+ 18116us) service_pool.cc:224] Handling call
0709 13:06:59.603083 (+1038083us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:59.610751 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 649) took 1285 ms. Trace:
W20260709 13:06:59.585050 16643 log.cc:927] Time spent T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.338s	user 0.003s	sys 0.003s
I20260709 13:06:59.607613 14401 rpcz_store.cc:276] 0709 13:06:57.994735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.995588 (+   853us) service_pool.cc:224] Handling call
0709 13:06:57.995973 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.002035 (+  6062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.002080 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.008449 (+  6369us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.312830 (+304381us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:58.312894 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.313095 (+   201us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.588698 (+1275603us) raft_consensus.cc:1685] finished
0709 13:06:59.588727 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.588848 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2715,"raft.queue_time_us":7337,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":1212,"thread_start_us":265149,"threads_started":1,"wal-append.queue_time_us":1151834}
I20260709 13:06:59.479537 16620 consensus_queue.cc:260] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:06:59.594295 16483 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.950s	user 0.022s	sys 0.043s
W20260709 13:06:59.608131 13716 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.007s	sys 0.021s
I20260709 13:06:59.615324 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:59.579275 16646 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.016s	sys 0.011s
W20260709 13:06:59.593565 16514 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.073s	user 0.003s	sys 0.018s
I20260709 13:06:59.607621 13863 rpcz_store.cc:276] 0709 13:06:58.327732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.328103 (+   371us) service_pool.cc:224] Handling call
0709 13:06:58.338398 (+ 10295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.364521 (+ 26123us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.364554 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.372504 (+  7950us) log.cc:844] Serialized 26 byte log entry
0709 13:06:59.037662 (+665158us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:59.037716 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.037799 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.584054 (+546255us) raft_consensus.cc:1685] finished
0709 13:06:59.584106 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.584338 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17668,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":20805,"thread_start_us":480383,"threads_started":1,"wal-append.queue_time_us":575329}
W20260709 13:06:59.568161 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 220053us
I20260709 13:06:59.589434 16571 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.577925 16444 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:06:59.646082 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.662343 13789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1609) took 1732 ms. Trace:
W20260709 13:06:59.663516 16633 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 1.107s	user 0.005s	sys 0.008s
W20260709 13:06:59.614849 16650 log.cc:927] Time spent T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.278s	user 0.001s	sys 0.004s
I20260709 13:06:59.676292 16444 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:59.678048 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:06:59.649128 16514 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.129s	user 0.003s	sys 0.025s
I20260709 13:06:59.684376 14401 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:59.685333 14395 raft_consensus.cc:1240] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:59.685520 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 340539us
I20260709 13:06:59.685927 16662 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.620682 16631 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:06:59.687480 16640 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:59.688596 16533 consensus_meta.cc:287] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.518s	user 0.005s	sys 0.004s
I20260709 13:06:59.688766 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:59.749207 14394 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.689595 13782 raft_consensus.cc:1275] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:59.690194 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:59.658761 16469 consensus_queue.cc:1059] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:59.645015 16548 consensus_queue.cc:1048] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:06:59.692171 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 2542) took 1160 ms. Trace:
I20260709 13:06:59.755975 13857 rpcz_store.cc:276] 0709 13:06:58.597976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.676895 (+ 78919us) service_pool.cc:224] Handling call
0709 13:06:59.691977 (+1015082us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b540004b854. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:06:59.692109 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326800256}
I20260709 13:06:59.689608 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:59.693965 16661 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.694711 16445 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:59.695043 13682 leader_election.cc:336] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 1.813s (SENT)
I20260709 13:06:59.696158 13858 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:59.697741 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 644) took 1568 ms. Trace:
I20260709 13:06:59.664564 16470 consensus_queue.cc:1059] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:59.611151 13861 rpcz_store.cc:276] 0709 13:06:58.325149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.325359 (+   210us) service_pool.cc:224] Handling call
0709 13:06:58.333843 (+  8484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.551098 (+217255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.551129 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.551597 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:06:59.086034 (+534437us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:59.086088 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.086175 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.610500 (+524325us) raft_consensus.cc:1685] finished
0709 13:06:59.610530 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.610682 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30033,"raft.queue_time_us":36002,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":6173,"thread_start_us":533796,"threads_started":1,"wal-append.queue_time_us":648277}
I20260709 13:06:59.699977 13864 raft_consensus.cc:1240] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:59.701871 13680 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:59.703531 13714 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
W20260709 13:06:59.715931 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.612403 16518 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:06:59.645623 16646 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.022s	sys 0.013s
I20260709 13:06:59.683571 16456 raft_consensus.cc:3055] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:59.734223 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:59.611783 16360 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:59.721966 13789 rpcz_store.cc:276] 0709 13:06:57.929770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.929979 (+   209us) service_pool.cc:224] Handling call
0709 13:06:57.933344 (+  3365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.157578 (+1224234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.662104 (+504526us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54000b1b54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:59.662282 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2806882176}
I20260709 13:06:59.765930 13862 rpcz_store.cc:276] 0709 13:06:58.128891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.131551 (+  2660us) service_pool.cc:224] Handling call
0709 13:06:58.131899 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.555357 (+423458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.555424 (+    67us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.556027 (+   603us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.876652 (+320625us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:59.214957 (+338305us) log.cc:844] Serialized 14 byte log entry
0709 13:06:59.217416 (+  2459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.355132 (+137716us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b54001ad1d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:06:59.355172 (+    40us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.697478 (+342306us) raft_consensus.cc:1685] finished
0709 13:06:59.697572 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.697687 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1875,"prepare.queue_time_us":731864,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":21003,"raft.queue_time_us":5701,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":11718,"spinlock_wait_cycles":972683008,"thread_start_us":504930,"threads_started":2,"wal-append.queue_time_us":652001}
I20260709 13:06:59.736727 13790 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 6: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:59.686040 13830 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:59.695065 16415 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.746820 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:59.747921 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 592) took 1803 ms. Trace:
W20260709 13:06:59.792145 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 208090us
W20260709 13:06:59.739276 16643 log.cc:927] Time spent T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:06:59.757896 14402 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 6: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:06:59.751693 16533 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:59.761081 13783 raft_consensus.cc:2393] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 4: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:59.764051 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:59.765839 16547 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:59.698589 16571 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:59.739228 16620 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.771400 16647 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:06:59.771879 16628 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 1.389s	user 0.005s	sys 0.002s
I20260709 13:06:59.767285 16661 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:59.774801 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:59.615900 16087 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:59.766245 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2536) took 1236 ms. Trace:
I20260709 13:06:59.780912 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2534) took 1251 ms. Trace:
I20260709 13:06:59.811302 13858 rpcz_store.cc:276] 0709 13:06:58.529826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.695572 (+1165746us) service_pool.cc:224] Handling call
0709 13:06:59.695842 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.765877 (+ 70035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.766174 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:59.787997 13857 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:06:59.793105 13713 rpcz_store.cc:276] 0709 13:06:57.944207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.125679 (+181472us) service_pool.cc:224] Handling call
0709 13:06:58.125999 (+   320us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:58.315958 (+189959us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.315986 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:58.323736 (+  7750us) log.cc:844] Serialized 52 byte log entry
0709 13:06:58.560157 (+236421us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:58.560194 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.560262 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.747699 (+1187437us) raft_consensus.cc:1685] finished
0709 13:06:59.747718 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.747854 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":188731,"raft.queue_time_us":211268,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":31827,"thread_start_us":219114,"threads_started":1,"wal-append.queue_time_us":411441}
I20260709 13:06:59.731941 16554 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:59.799562 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 97731.1us
I20260709 13:06:59.787982 16456 raft_consensus.cc:740] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:59.802307 13861 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:06:59.803587 13862 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:59.805331 13785 raft_consensus.cc:2368] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7.
W20260709 13:06:59.806907 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 120961us
I20260709 13:06:59.791152 16445 raft_consensus.cc:3055] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:59.807758 13782 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:59.812518 13857 pending_rounds.cc:85] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 5
I20260709 13:06:59.821363 13857 pending_rounds.cc:107] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:06:59.821712 13857 raft_consensus.cc:2889] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:59.809849 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:59.811441 13864 rpcz_store.cc:276] 0709 13:06:58.529324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.691047 (+1161723us) service_pool.cc:224] Handling call
0709 13:06:59.691329 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.780677 (+ 89348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.780851 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:59.787055 14394 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
W20260709 13:06:59.798702 14397 consensus_meta.cc:287] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.697s	user 0.010s	sys 0.002s
I20260709 13:06:59.815351 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:06:59.817690 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2544) took 1146 ms. Trace:
I20260709 13:06:59.822826 13789 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:59.823669 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 175483us
I20260709 13:06:59.852387 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:06:59.856052 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 45187.7us
W20260709 13:06:59.857468 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.817281 13861 pending_rounds.cc:85] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 4
I20260709 13:06:59.863353 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:59.857504 13712 raft_consensus.cc:2410] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:59.857821 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2540) took 1326 ms. Trace:
I20260709 13:06:59.856735 13862 rpcz_store.cc:276] 0709 13:06:58.671266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.791753 (+1120487us) service_pool.cc:224] Handling call
0709 13:06:59.803213 (+ 11460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.817391 (+ 14178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.817628 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:59.868813 13861 pending_rounds.cc:107] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:06:59.870528 13861 raft_consensus.cc:2889] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:59.805130 14396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 969) took 1734 ms. Trace:
I20260709 13:06:59.806721 16547 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:59.869843 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:06:59.870296 13857 rpcz_store.cc:276] 0709 13:06:58.530955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.758628 (+1227673us) service_pool.cc:224] Handling call
0709 13:06:59.781134 (+ 22506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.857566 (+ 76432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.857760 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:59.869248 13708 raft_consensus.cc:2376] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7. Re-sending same reply.
I20260709 13:06:59.875921 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:06:59.795511 16514 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
W20260709 13:06:59.882287 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 240052us
I20260709 13:06:59.862200 14367 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:06:59.897853 13714 raft_consensus.cc:2376] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5. Re-sending same reply.
I20260709 13:06:59.898037 13713 raft_consensus.cc:2393] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 7: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:06:59.879751 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 73166.8us
W20260709 13:06:59.898252 13682 leader_election.cc:336] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 1.649s (SENT)
I20260709 13:06:59.825649 13680 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:59.885473 13756 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:59.931526 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2541) took 1400 ms. Trace:
I20260709 13:06:59.937845 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:06:59.938768 13782 raft_consensus.cc:2393] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 7: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:06:59.814304 16351 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:59.941418 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 79342.8us
I20260709 13:06:59.945109 13682 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:06:59.855269 14397 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
I20260709 13:06:59.945710 13785 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:59.946861 14402 raft_consensus.cc:1240] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:06:59.819875 16445 raft_consensus.cc:740] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:06:59.935487 13861 rpcz_store.cc:276] 0709 13:06:58.531241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.768091 (+1236850us) service_pool.cc:224] Handling call
0709 13:06:59.796896 (+ 28805us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.931172 (+134276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.931456 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:59.953763 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 68453.2us
W20260709 13:06:59.934816 16656 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.344s	user 0.000s	sys 0.001s
I20260709 13:06:59.933393 13757 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:59.818620 16554 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:06:59.816859 16526 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.129s
I20260709 13:06:59.957585 13756 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:06:59.974234 13756 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:06:59.965144 16676 log.cc:927] Time spent T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:07:00.034858 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 60695.8us
I20260709 13:07:00.039583 13756 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:06:59.977097 13782 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:00.037792 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:06:59.960391 16547 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:00.041926 14393 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.958395 16444 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:06:59.965708 16637 raft_consensus.cc:3055] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:00.053542 16637 raft_consensus.cc:740] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:00.056906 16661 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:00.057734 16661 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:00.058223 16661 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:59.964641 16672 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:07:00.039614 16351 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:59.958124 16518 consensus_queue.cc:1059] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:07:00.048954 16445 consensus_queue.cc:260] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:06:59.966135 16483 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
W20260709 13:07:00.049999 16667 log.cc:927] Time spent T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.243s	user 0.000s	sys 0.000s
W20260709 13:07:00.050616 16649 log.cc:927] Time spent T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.260s	user 0.000s	sys 0.000s
I20260709 13:06:59.969301 16654 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:00.089581 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:06:59.875880 14396 rpcz_store.cc:276] 0709 13:06:58.068792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.072587 (+  3795us) service_pool.cc:224] Handling call
0709 13:06:58.110368 (+ 37781us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.110725 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.110753 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.111275 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.322289 (+211014us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:58.325701 (+  3412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.332561 (+  6860us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.662877 (+1330316us) spinlock_profiling.cc:243] Waited 7.16 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:06:59.759859 (+ 96982us) raft_consensus.cc:1685] finished
0709 13:06:59.764217 (+  4358us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.802908 (+ 38691us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":979,"raft.queue_time_us":3442,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":6234,"spinlock_wait_cycles":16470912,"thread_start_us":197330,"threads_started":1,"wal-append.queue_time_us":255555}
W20260709 13:07:00.052963 16664 log.cc:927] Time spent T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 13:07:00.094112 16087 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:00.095463 16445 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.052879 16663 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:00.049330 16665 log.cc:927] Time spent T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.258s	user 0.000s	sys 0.000s
W20260709 13:07:00.015482 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 189888us
W20260709 13:07:00.061983 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 184686us
I20260709 13:07:00.061446 13785 raft_consensus.cc:1275] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:59.946223 16671 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:07:00.063092 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 88323.1us
I20260709 13:07:00.059926 16533 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:00.044991 16674 log.cc:927] Time spent T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:07:00.033928 16514 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:00.071352 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 173107us
I20260709 13:07:00.073091 13756 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:00.121305 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:06:59.962462 16647 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:00.050721 13859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 643) took 1829 ms. Trace:
I20260709 13:07:00.046821 16655 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.123492 16351 consensus_queue.cc:1059] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:07:00.133541 16655 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.133944 16655 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.135007 16432 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.135536 16432 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:00.103708 16637 consensus_queue.cc:260] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:00.137530 16637 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.140130 13860 raft_consensus.cc:606] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:07:00.140487 13860 raft_consensus.cc:614] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:59.962025 16669 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:00.050945 16542 consensus_meta.cc:287] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.860s	user 0.010s	sys 0.000s
I20260709 13:07:00.050621 16571 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:00.045868 16641 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:06:59.961300 16262 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.122s
I20260709 13:07:00.096771 13715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 597) took 1976 ms. Trace:
I20260709 13:06:59.963201 16456 consensus_queue.cc:260] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:00.099187 14393 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:07:00.099751 13789 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
W20260709 13:07:00.152647 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.109163 13757 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:00.109676 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:00.060828 16547 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:00.121915 13861 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.127991 16533 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:00.164918 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 55832.4us
I20260709 13:07:00.166530 13757 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:00.130209 16415 consensus_queue.cc:1059] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:07:00.130937 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 57907.8us
I20260709 13:07:00.132108 16647 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:00.132498 13682 leader_election.cc:336] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 1.837s (SENT)
I20260709 13:07:00.180533 13682 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:00.098601 16663 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:00.149446 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:00.182055 13785 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
W20260709 13:07:00.154001 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 195300us
I20260709 13:07:00.152202 13715 rpcz_store.cc:276] 0709 13:06:58.119934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.267602 (+147668us) service_pool.cc:224] Handling call
0709 13:06:58.313058 (+ 45456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.342016 (+ 28958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.342066 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.350500 (+  8434us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.654341 (+303841us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:58.654379 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.654458 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:00.096542 (+1442084us) raft_consensus.cc:1685] finished
0709 13:07:00.096572 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.096716 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24282,"raft.queue_time_us":85125,"raft.run_cpu_time_us":58,"raft.run_wall_time_us":58,"thread_start_us":128571,"threads_started":1,"wal-append.queue_time_us":1264426}
I20260709 13:07:00.159423 14398 raft_consensus.cc:1240] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:00.185724 16671 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.160760 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:00.171115 16382 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:00.123713 13859 rpcz_store.cc:276] 0709 13:06:58.128544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.131524 (+  2980us) service_pool.cc:224] Handling call
0709 13:06:58.131833 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.320578 (+188745us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:58.328434 (+  7856us) log.cc:844] Serialized 14 byte log entry
0709 13:06:58.578143 (+249709us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b18000ba640. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f1557 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
0709 13:06:58.674974 (+ 96831us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.877509 (+202535us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.877683 (+   174us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:58.877731 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.877825 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.948356 (+1070531us) raft_consensus.cc:1685] finished
0709 13:06:59.957904 (+  9548us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.958093 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":231711,"prepare.queue_time_us":2856,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":186335,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":66457,"spinlock_wait_cycles":5432576,"thread_start_us":308758,"threads_started":1,"wal-append.queue_time_us":855621}
I20260709 13:07:00.163209 13788 raft_consensus.cc:1240] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:00.169561 14402 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:00.170055 16456 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.170742 13791 raft_consensus.cc:1240] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:00.171248 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:00.119552 16680 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:00.124657 16514 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:00.171603 16537 consensus_queue.cc:1059] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:00.172322 16554 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:00.173156 16644 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.173281 16526 consensus_queue.cc:1059] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:00.174532 16629 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:00.187330 13789 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:00.139736 16350 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.187875 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 593) took 2230 ms. Trace:
I20260709 13:07:00.180320 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:00.187839 16663 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:00.196681 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 85477.3us
I20260709 13:07:00.117694 16654 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:07:00.146755 16542 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:00.217417 13787 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:07:00.216493 13716 rpcz_store.cc:276] 0709 13:06:57.957024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.134483 (+177459us) service_pool.cc:224] Handling call
0709 13:06:58.265356 (+130873us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.650438 (+385082us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.650504 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.666426 (+ 15922us) log.cc:844] Serialized 26 byte log entry
0709 13:06:59.620723 (+954297us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:59.620783 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.620891 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:00.187678 (+566787us) raft_consensus.cc:1685] finished
0709 13:07:00.187703 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.187819 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57998,"raft.queue_time_us":130716,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":137,"thread_start_us":1114909,"threads_started":2,"wal-append.queue_time_us":1005034}
W20260709 13:07:00.243129 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 121659us
I20260709 13:07:00.192704 14367 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:00.182682 16533 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:00.246642 13861 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:07:00.191210 16647 raft_consensus.cc:697] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:00.232587 13865 raft_consensus.cc:2410] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:00.232563 16547 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:00.202208 16514 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.233455 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:00.271709 16626 consensus_queue.cc:1048] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:00.272531 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:00.273348 13859 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:07:00.274559 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:00.234145 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:00.272570 16673 raft_consensus.cc:3055] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:00.275938 16673 raft_consensus.cc:740] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:00.276702 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:00.276780 16673 consensus_queue.cc:260] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:00.278208 16673 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.278502 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:00.201936 16518 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:07:00.220569 13680 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:00.281518 16629 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:00.282260 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 61771.4us
I20260709 13:07:00.284300 13680 leader_election.cc:400] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7.
I20260709 13:07:00.285229 16351 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:00.247226 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 60893.5us
I20260709 13:07:00.207064 16680 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:00.209841 16661 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:00.295493 16662 consensus_meta.cc:287] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.000s
I20260709 13:07:00.296083 16662 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.297080 13862 raft_consensus.cc:1240] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:00.216958 16641 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:00.298106 16542 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:00.257874 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:00.258884 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 66256.1us
I20260709 13:07:00.259023 16612 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:00.190009 16669 consensus_queue.cc:1059] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:07:00.266126 16647 consensus_queue.cc:237] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:00.293260 13755 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:07:00.543582 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 250413us
W20260709 13:07:00.544113 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.249723 13682 leader_election.cc:336] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 1.884s (SENT)
I20260709 13:07:00.688686 13682 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:07:00.689775 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 445727us
W20260709 13:07:00.690341 13682 leader_election.cc:336] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 2.101s (SENT)
I20260709 13:07:00.690703 13682 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:00.275259 13859 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:07:00.351693 14367 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:07:00.691780 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 340182us
I20260709 13:07:00.691977 16036 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:00.692251 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:00.692641 16036 raft_consensus.cc:697] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:00.692886 14367 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:00.245258 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 55095us
W20260709 13:07:00.311951 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.360667 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:00.227805 16350 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:00.246100 16382 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.137s
W20260709 13:07:00.402827 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 465973us
I20260709 13:07:00.227957 16644 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:00.351301 16627 consensus_queue.cc:1059] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:07:00.394773 16612 raft_consensus.cc:697] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:00.383177 16662 consensus_queue.cc:1059] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:07:00.427587 16629 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:00.436642 16533 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:00.437443 16680 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:00.441821 16655 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:00.420950 16695 raft_consensus.cc:3055] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:00.456184 16663 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:00.457558 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 651) took 1933 ms. Trace:
I20260709 13:07:00.459924 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57574 (request call id 18) took 1638 ms. Trace:
I20260709 13:07:00.284652 13680 leader_election.cc:403] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:00.468544 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:00.469024 13861 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
W20260709 13:07:00.484720 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.726002 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 441806us
I20260709 13:07:00.725637 13860 rpcz_store.cc:276] 0709 13:06:58.821413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.347451 (+526038us) service_pool.cc:224] Handling call
0709 13:07:00.459701 (+1112250us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54001accd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324d8853 00007f52374a660a 00007f5230a2c7d4 00007f5230a2c762 00007f5230a2c691 00007f5230a2c60c 00007f5230a2b8c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:00.459824 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1290170112}
I20260709 13:07:00.491107 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:00.491990 16571 raft_consensus.cc:3055] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:00.495184 16276 tablet_bootstrap.cc:492] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:00.540333 16351 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:00.545431 16543 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:00.476892 16514 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:00.735373 16647 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:00.735690 16543 raft_consensus.cc:697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:00.735966 16647 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:00.736615 16543 consensus_queue.cc:237] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:00.737259 16514 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:00.558727 16697 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:00.738055 16647 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:00.737875 16641 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:00.739136 16662 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.739681 16662 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:00.739974 16629 consensus_queue.cc:1048] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:00.740402 16644 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:00.740916 16693 consensus_queue.cc:1059] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:07:00.741652 16693 consensus_queue.cc:1243] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer 35ecb005831740438d7537dd4b840e03 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:00.742022 16662 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:00.742173 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:00.743221 16350 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:00.743800 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:00.744516 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:00.745157 13715 raft_consensus.cc:1240] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:00.745028 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:00.745332 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:00.591045 14402 raft_consensus.cc:1240] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:00.583724 16470 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.001s	sys 0.011s
I20260709 13:07:00.594420 14393 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:07:00.603920 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 418515us
W20260709 13:07:00.624974 13856 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 2539) took 2094 ms (client timeout 2377 ms). Trace:
W20260709 13:07:00.746950 13856 rpcz_store.cc:269] 0709 13:06:58.530675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.156273 (+625598us) service_pool.cc:224] Handling call
0709 13:07:00.624756 (+1468483us) spinlock_profiling.cc:243] Waited 69.9 ms on lock 0x7b540004a954. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:00.624903 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160732544}
I20260709 13:07:00.748131 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:07:00.628182 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.629612 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.748835 13782 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.636804 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 2545) took 1965 ms. Trace:
I20260709 13:07:00.749598 16637 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:07:00.751462 16627 consensus_queue.cc:1059] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:07:00.751614 13865 rpcz_store.cc:276] 0709 13:06:58.671634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.302052 (+630418us) service_pool.cc:224] Handling call
0709 13:07:00.636611 (+1334559us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b54002fadd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:00.636752 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2052406528}
W20260709 13:07:00.752734 16685 log.cc:927] Time spent T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.620s	user 0.004s	sys 0.000s
I20260709 13:07:00.752903 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:00.753751 13865 raft_consensus.cc:2393] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 8: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:07:00.754314 13757 connection.cc:256] RPC call timeout handler was delayed by -1.3649912509998785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2377s for a response
I20260709 13:07:00.754621 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:00.632773 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 699) took 1591 ms. Trace:
I20260709 13:07:00.755595 14398 rpcz_store.cc:276] 0709 13:06:59.041361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.972331 (+930970us) service_pool.cc:224] Handling call
0709 13:07:00.153737 (+181406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.184618 (+ 30881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.632544 (+447926us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54004c18d0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:00.632709 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248449408}
I20260709 13:07:00.638795 16686 raft_consensus.cc:3055] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:00.756767 16686 raft_consensus.cc:740] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:00.757606 16686 consensus_queue.cc:260] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:00.758337 16686 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.737927 16514 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:00.759085 16514 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:00.759742 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:00.761472 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:00.760907 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:00.762899 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:00.763370 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:00.763594 13716 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:00.764397 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:00.764667 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:00.765383 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:00.692894 13859 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:07:00.765892 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:00.766219 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:00.766923 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:00.767407 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:00.767884 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:00.768059 13707 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.709654 13829 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:07:00.768882 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 59346.7us
I20260709 13:07:00.769114 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:00.769969 13857 raft_consensus.cc:2393] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 5: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:00.770637 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:00.771524 13783 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 6: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:00.771765 16689 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:00.747128 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:00.772289 16689 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.772730 16689 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:00.773054 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:00.773340 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:00.774343 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:00.775179 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:00.775282 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:00.776013 13785 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 6: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:00.776749 13783 raft_consensus.cc:1275] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:00.765945 13789 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
W20260709 13:07:00.708292 13682 leader_election.cc:336] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 2.115s (SENT)
I20260709 13:07:00.729687 13864 raft_consensus.cc:2410] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 13:07:00.730862 13784 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.023s	sys 0.035s
I20260709 13:07:00.727182 16654 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7.
I20260709 13:07:00.731830 16696 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.716101 16631 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.732821 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:00.715569 16638 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.719192 16518 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.724746 13863 rpcz_store.cc:276] 0709 13:06:58.524335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.645868 (+1121533us) service_pool.cc:224] Handling call
0709 13:06:59.694749 (+ 48881us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:59.939745 (+244996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.939774 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:59.968792 (+ 29018us) log.cc:844] Serialized 52 byte log entry
0709 13:07:00.228064 (+259272us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:00.228119 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.457086 (+228967us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b540006ed54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:00.457142 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:00.457197 (+    55us) raft_consensus.cc:1685] finished
0709 13:07:00.457214 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.457488 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":157855,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":126,"spinlock_wait_cycles":389147008,"thread_start_us":230064,"threads_started":2,"wal-append.queue_time_us":365402}
I20260709 13:07:00.748238 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:00.750931 16700 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:07:00.746675 16470 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.002s	sys 0.012s
I20260709 13:07:00.674687 16432 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:00.693524 16036 consensus_queue.cc:237] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:00.767972 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:00.699262 13858 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:07:00.719296 16710 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.722146 16618 consensus_queue.cc:1059] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.122s
I20260709 13:07:00.916724 16415 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.724378 16612 consensus_queue.cc:237] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:02.044353 16415 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:02.044940 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:02.045893 13863 raft_consensus.cc:2368] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7.
W20260709 13:07:02.046528 13863 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1907) took 1784 ms (client timeout 2170 ms). Trace:
W20260709 13:07:02.047026 13863 rpcz_store.cc:269] 0709 13:07:00.261647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.044665 (+1783018us) service_pool.cc:224] Handling call
0709 13:07:02.046415 (+  1750us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.047559 16415 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:00.732533 16571 raft_consensus.cc:740] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:02.048480 13859 raft_consensus.cc:2393] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 5: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:00.863904 16626 consensus_queue.cc:1059] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 1.185s
W20260709 13:07:02.099573 14396 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.002s	sys 0.009s
I20260709 13:07:02.049631 13856 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
W20260709 13:07:02.107591 13856 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1895) took 1850 ms (client timeout 1813 ms). Trace:
W20260709 13:07:02.108237 13856 rpcz_store.cc:269] 0709 13:07:00.257544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.747976 (+490432us) service_pool.cc:224] Handling call
0709 13:07:02.107526 (+1359550us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.050774 16710 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:00.742219 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:00.765370 13716 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
W20260709 13:07:01.315348 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.723569 16695 raft_consensus.cc:740] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:02.110982 16571 consensus_queue.cc:260] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:02.113422 16686 consensus_meta.cc:287] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 1.355s	user 0.013s	sys 0.000s
I20260709 13:07:02.113196 16695 consensus_queue.cc:260] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:00.868551 16697 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 1.192s
I20260709 13:07:02.114261 16695 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.869172 13785 raft_consensus.cc:1240] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:02.115295 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 681) took 1357 ms. Trace:
I20260709 13:07:02.115665 13785 rpcz_store.cc:276] 0709 13:07:00.758009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.777315 (+ 19306us) service_pool.cc:224] Handling call
0709 13:07:00.868974 (+ 91659us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.115047 (+1246073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.115245 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:01.207935 16456 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:07:01.103756 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.095820 16469 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:02.117918 16469 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:00.869549 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:02.118678 14366 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:02.119068 14394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 708) took 1268 ms (client timeout 1504 ms). Trace:
W20260709 13:07:02.119499 14394 rpcz_store.cc:269] 0709 13:07:00.851103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.851269 (+   166us) service_pool.cc:224] Handling call
0709 13:07:02.119011 (+1267742us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:00.868806 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:02.062991 14399 raft_consensus.cc:2393] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 5: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:02.063169 16631 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:02.063699 16696 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:02.040984 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 1.31566e+06us
I20260709 13:07:00.778116 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:01.095508 16533 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.031730 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:01.335625 16276 tablet_bootstrap.cc:492] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:07:00.764709 16514 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:02.040588 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:07:02.066296 13784 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.927s	user 0.031s	sys 0.047s
I20260709 13:07:00.926268 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:01.015522 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:07:02.121524 16721 log.cc:927] Time spent T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:07:02.135890 13783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 687) took 1283 ms. Trace:
I20260709 13:07:01.495338 16669 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.139858 16514 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.139930 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2304) took 1409 ms. Trace:
I20260709 13:07:02.140153 16669 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:02.140532 16514 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:02.141723 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 707) took 1295 ms. Trace:
I20260709 13:07:02.142297 16669 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:02.142606 16514 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:00.844156 16547 consensus_queue.cc:1048] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 1.227s
W20260709 13:07:02.071795 13858 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1903) took 1811 ms (client timeout 1687 ms). Trace:
W20260709 13:07:02.152797 13858 rpcz_store.cc:269] 0709 13:07:00.260331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.298440 (+ 38109us) service_pool.cc:224] Handling call
0709 13:07:02.071724 (+1773284us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:02.041513 14368 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 1.865s (SENT) [suppressed 27 similar messages]
I20260709 13:07:01.943818 16655 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:02.079600 13787 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.335s	user 0.001s	sys 0.025s
I20260709 13:07:02.043125 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:07:02.052657 13715 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.005s	sys 0.012s
W20260709 13:07:00.765955 16659 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 1.176s	user 0.004s	sys 0.000s
I20260709 13:07:02.091676 13682 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:01.092025 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:07:02.171855 13715 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.008s	sys 0.015s
W20260709 13:07:02.154376 13787 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.410s	user 0.001s	sys 0.025s
W20260709 13:07:02.093886 13864 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1904) took 1833 ms (client timeout 1742 ms). Trace:
W20260709 13:07:02.172700 13864 rpcz_store.cc:269] 0709 13:07:00.260665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.487346 (+226681us) service_pool.cc:224] Handling call
0709 13:07:02.093793 (+1606447us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:01.271066 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.096979 13828 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.002s	sys 0.011s
W20260709 13:07:02.174297 13828 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.002s	sys 0.011s
W20260709 13:07:01.258847 13782 consensus_meta.cc:287] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.000s
I20260709 13:07:02.175851 13782 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:07:02.176360 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 672) took 1438 ms. Trace:
I20260709 13:07:02.176647 13782 rpcz_store.cc:276] 0709 13:07:00.737768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.747836 (+ 10068us) service_pool.cc:224] Handling call
0709 13:07:02.176306 (+1428470us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:01.582828 16087 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.000s	sys 0.015s
W20260709 13:07:01.603293 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.051118 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 1.31823e+06us
I20260709 13:07:02.178323 13680 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:00.869006 16542 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:02.105811 13865 consensus_meta.cc:287] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 1.339s	user 0.010s	sys 0.000s
W20260709 13:07:02.106474 13859 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1914) took 1721 ms (client timeout 1952 ms). Trace:
I20260709 13:07:02.106703 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:02.107005 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 670) took 1369 ms. Trace:
I20260709 13:07:02.183640 13865 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
W20260709 13:07:02.183651 13859 rpcz_store.cc:269] 0709 13:07:00.385423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.767736 (+382313us) service_pool.cc:224] Handling call
0709 13:07:02.106410 (+1338674us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:02.184684 13865 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1896) took 1926 ms (client timeout 1884 ms). Trace:
W20260709 13:07:02.185262 13865 rpcz_store.cc:269] 0709 13:07:00.258001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.765691 (+507690us) service_pool.cc:224] Handling call
0709 13:07:02.184571 (+1418880us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:00.826751 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:00.779258 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:02.105298 16689 consensus_meta.cc:287] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 1.332s	user 0.011s	sys 0.003s
I20260709 13:07:02.143397 16469 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:02.109778 16699 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:07:02.142815 16669 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:07:02.042047 14365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.012s	sys 0.009s
I20260709 13:07:02.119993 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:02.247380 14365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.012s	sys 0.010s
W20260709 13:07:02.247766 13856 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 2557) took 1417 ms (client timeout 1792 ms). Trace:
W20260709 13:07:02.248097 13856 rpcz_store.cc:269] 0709 13:07:00.831534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.109077 (+1277543us) service_pool.cc:224] Handling call
0709 13:07:02.247713 (+138636us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:02.107321 14396 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.002s	sys 0.010s
W20260709 13:07:02.121101 13716 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1836) took 1359 ms (client timeout 1561 ms). Trace:
I20260709 13:07:02.120519 14366 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:01.237510 13707 raft_consensus.cc:2410] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:02.129246 13714 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
W20260709 13:07:02.249289 13716 rpcz_store.cc:269] 0709 13:07:00.761293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.764419 (+  3126us) service_pool.cc:224] Handling call
0709 13:07:02.121042 (+1356623us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:02.249846 13714 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2305) took 1521 ms (client timeout 2002 ms). Trace:
W20260709 13:07:02.250353 13714 rpcz_store.cc:269] 0709 13:07:00.728141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.730025 (+  1884us) service_pool.cc:224] Handling call
0709 13:07:02.249771 (+1519746us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:00.863533 14402 raft_consensus.cc:1240] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:02.133175 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 704) took 1355 ms. Trace:
I20260709 13:07:02.251749 14398 rpcz_store.cc:276] 0709 13:07:00.777167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.778362 (+  1195us) service_pool.cc:224] Handling call
0709 13:07:02.132554 (+1354192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.133860 13862 raft_consensus.cc:2410] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:02.133193 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 705) took 1355 ms. Trace:
W20260709 13:07:02.180060 16087 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.433s	user 0.001s	sys 0.018s
I20260709 13:07:02.136389 13783 rpcz_store.cc:276] 0709 13:07:00.849166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.875595 (+ 26429us) service_pool.cc:224] Handling call
0709 13:07:02.132757 (+1257162us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:02.256253 13707 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1829) took 1506 ms (client timeout 1615 ms). Trace:
W20260709 13:07:02.256927 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.256996 13707 rpcz_store.cc:269] 0709 13:07:00.749880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.767180 (+ 17300us) service_pool.cc:224] Handling call
0709 13:07:02.256167 (+1488987us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.129942 16631 raft_consensus.cc:697] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:02.136574 16276 ts_tablet_manager.cc:1403] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 3.853s	user 0.047s	sys 0.070s
W20260709 13:07:02.149559 13786 consensus_meta.cc:287] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 1.850s	user 0.027s	sys 0.029s
I20260709 13:07:02.129779 16456 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:02.152182 16710 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:02.188038 13857 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1897) took 1929 ms (client timeout 2115 ms). Trace:
W20260709 13:07:02.276368 13857 rpcz_store.cc:269] 0709 13:07:00.258351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.778989 (+520638us) service_pool.cc:224] Handling call
0709 13:07:02.187962 (+1408973us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.277659 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:02.278631 13857 raft_consensus.cc:2393] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 5: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:02.236029 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:02.236172 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:02.236187 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:02.280853 13712 raft_consensus.cc:2410] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:07:02.183872 13863 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:07:02.137101 16533 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:02.173293 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 667) took 1437 ms. Trace:
I20260709 13:07:02.241215 13784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2088) took 2103 ms. Trace:
I20260709 13:07:02.113631 16571 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:02.142098 14397 rpcz_store.cc:276] 0709 13:07:00.846430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.849191 (+  2761us) service_pool.cc:224] Handling call
0709 13:07:02.141656 (+1292465us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.245710 14395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 706) took 1419 ms. Trace:
I20260709 13:07:02.315593 14395 rpcz_store.cc:276] 0709 13:07:00.826142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.826375 (+   233us) service_pool.cc:224] Handling call
0709 13:07:02.245641 (+1419266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.129557 16724 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:02.252857 14393 rpcz_store.cc:276] 0709 13:07:00.777476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.777897 (+   421us) service_pool.cc:224] Handling call
0709 13:07:02.133105 (+1355208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.132225 14401 raft_consensus.cc:2376] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7. Re-sending same reply.
W20260709 13:07:02.323967 14401 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 709) took 1461 ms (client timeout 1622 ms). Trace:
W20260709 13:07:02.324247 14401 rpcz_store.cc:269] 0709 13:07:00.863055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.863187 (+   132us) service_pool.cc:224] Handling call
0709 13:07:02.323911 (+1460724us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:02.253777 13789 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 686) took 1494 ms (client timeout 1991 ms). Trace:
I20260709 13:07:02.254632 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 989) took 1473 ms. Trace:
W20260709 13:07:02.324829 13789 rpcz_store.cc:269] 0709 13:07:00.778887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.779088 (+   201us) service_pool.cc:224] Handling call
0709 13:07:02.253692 (+1474604us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:02.255823 13862 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1898) took 1997 ms (client timeout 2124 ms). Trace:
W20260709 13:07:02.325575 13862 rpcz_store.cc:269] 0709 13:07:00.258704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.864922 (+606218us) service_pool.cc:224] Handling call
0709 13:07:02.255761 (+1390839us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.324908 14402 rpcz_store.cc:276] 0709 13:07:00.781156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.781659 (+   503us) service_pool.cc:224] Handling call
0709 13:07:00.863188 (+ 81529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.251714 (+1388526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.254553 (+  2839us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.327924 13865 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:07:02.326548 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:02.329152 13862 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 9: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:02.259815 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:02.260434 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 218938us
I20260709 13:07:02.330080 13856 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:07:02.255538 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:02.270845 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:02.330523 13856 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 2550) took 1573 ms (client timeout 2010 ms). Trace:
I20260709 13:07:02.330621 13859 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:02.271382 13786 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:07:02.273893 13860 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
W20260709 13:07:02.330899 13856 rpcz_store.cc:269] 0709 13:07:00.756827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.259617 (+1502790us) service_pool.cc:224] Handling call
0709 13:07:02.330452 (+ 70835us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:02.331584 13860 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1901) took 2072 ms (client timeout 2152 ms). Trace:
W20260709 13:07:02.332026 13860 rpcz_store.cc:269] 0709 13:07:00.259642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.873588 (+613946us) service_pool.cc:224] Handling call
0709 13:07:02.331530 (+1457942us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.221449 14394 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:02.330731 13864 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
W20260709 13:07:02.334537 13864 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 2554) took 1576 ms (client timeout 1939 ms). Trace:
I20260709 13:07:02.334669 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:07:02.335031 13864 rpcz_store.cc:269] 0709 13:07:00.757771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.237227 (+1479456us) service_pool.cc:224] Handling call
0709 13:07:02.334460 (+ 97233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.247056 16654 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:02.281463 13863 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1900) took 2022 ms (client timeout 2190 ms). Trace:
I20260709 13:07:02.245453 16542 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:02.246783 16638 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:02.243707 16723 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:02.285288 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:02.285995 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2306) took 1557 ms. Trace:
I20260709 13:07:02.340517 13712 rpcz_store.cc:276] 0709 13:07:00.728365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.235971 (+1507606us) service_pool.cc:224] Handling call
0709 13:07:02.285934 (+ 49963us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.340832 13716 raft_consensus.cc:2393] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 7: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:02.293964 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:07:02.297286 16533 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:02.245262 16689 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:02.270722 16469 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.256652 16669 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:02.303860 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 609) took 2450 ms. Trace:
W20260709 13:07:02.305262 13861 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1892) took 2074 ms (client timeout 1632 ms). Trace:
W20260709 13:07:02.344204 13861 rpcz_store.cc:269] 0709 13:07:00.230944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.257525 (+ 26581us) service_pool.cc:224] Handling call
0709 13:07:02.305098 (+2047573us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54003755d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:02.305196 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268867968}
I20260709 13:07:02.343864 13711 rpcz_store.cc:276] 0709 13:06:59.853699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.853866 (+   167us) service_pool.cc:224] Handling call
0709 13:06:59.898957 (+ 45091us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.963848 (+ 64891us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.963900 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:59.963958 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:59.964000 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.303645 (+2339645us) spinlock_profiling.cc:243] Waited 64.4 ms on lock 0x7b540008e154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:02.303687 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.303804 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148014848}
W20260709 13:07:02.345804 13716 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1837) took 1584 ms (client timeout 1723 ms). Trace:
W20260709 13:07:02.346240 13716 rpcz_store.cc:269] 0709 13:07:00.761629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.271811 (+1510182us) service_pool.cc:224] Handling call
0709 13:07:02.345747 (+ 73936us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.336984 16724 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:02.347195 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:02.347604 16550 raft_consensus.cc:3055] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:02.347790 16542 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:02.347976 16550 raft_consensus.cc:740] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:02.327463 16518 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.349268 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:02.312076 16631 consensus_queue.cc:237] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:02.285017 13784 rpcz_store.cc:276] 0709 13:07:00.137991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.138133 (+   142us) service_pool.cc:224] Handling call
0709 13:07:00.138548 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.138819 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:02.132320 (+1993501us) log.cc:844] Serialized 14 byte log entry
0709 13:07:02.240775 (+108455us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:02.240844 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:02.240903 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.240987 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.241141 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":283467,"prepare.run_cpu_time_us":237,"prepare.run_wall_time_us":14049,"raft.queue_time_us":66078,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":6177,"thread_start_us":2027533,"threads_started":2,"wal-append.queue_time_us":31037}
I20260709 13:07:02.329720 13858 raft_consensus.cc:2410] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:02.270313 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:07:02.328425 13865 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 2548) took 1572 ms (client timeout 2002 ms). Trace:
I20260709 13:07:02.335449 13860 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 6: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:02.279122 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 2555) took 1521 ms. Trace:
W20260709 13:07:02.336525 13863 rpcz_store.cc:269] 0709 13:07:00.259272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.106410 (+1847138us) service_pool.cc:224] Handling call
0709 13:07:02.281391 (+174981us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:02.353156 13865 rpcz_store.cc:269] 0709 13:07:00.756328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.235838 (+1479510us) service_pool.cc:224] Handling call
0709 13:07:02.328371 (+ 92533us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.353874 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:02.354635 13863 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:07:02.184091 13788 rpcz_store.cc:276] 0709 13:07:00.737192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.100662 (+1363470us) service_pool.cc:224] Handling call
0709 13:07:02.106666 (+  6004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.106809 (+   143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.106824 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:02.106850 (+    26us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:02.106872 (+    22us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.106903 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.106965 (+    62us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.284634 13787 rpcz_store.cc:276] 0709 13:07:00.736253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.743309 (+  7056us) service_pool.cc:224] Handling call
0709 13:07:00.743685 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.744028 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.744067 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:00.744544 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:07:02.172939 (+1428395us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:02.172978 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.173046 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.173085 (+    39us) raft_consensus.cc:1685] finished
0709 13:07:02.173095 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.173239 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":112,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":1427626,"threads_started":1,"wal-append.queue_time_us":1335007}
I20260709 13:07:02.355129 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:02.355705 13857 rpcz_store.cc:276] 0709 13:07:00.757999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.277317 (+1519318us) service_pool.cc:224] Handling call
0709 13:07:02.279052 (+  1735us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:02.338828 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.356957 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1905) took 2096 ms. Trace:
W20260709 13:07:02.357388 16728 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:07:02.357327 13860 rpcz_store.cc:276] 0709 13:07:00.260980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.332793 (+2071813us) service_pool.cc:224] Handling call
0709 13:07:02.356878 (+ 24085us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.358274 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:02.358855 13711 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:02.339286 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1913) took 2035 ms. Trace:
W20260709 13:07:02.359047 13714 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1834) took 1607 ms (client timeout 1622 ms). Trace:
I20260709 13:07:02.287060 16725 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:02.366603 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:02.349968 13712 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 6: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:02.290848 16276 raft_consensus.cc:359] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
W20260709 13:07:02.409232 13712 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1828) took 1659 ms (client timeout 1916 ms). Trace:
W20260709 13:07:02.409674 13712 rpcz_store.cc:269] 0709 13:07:00.749568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.349057 (+1599489us) service_pool.cc:224] Handling call
0709 13:07:02.409168 (+ 60111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.410868 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:02.355962 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1916) took 1903 ms. Trace:
I20260709 13:07:02.413371 13861 rpcz_store.cc:276] 0709 13:07:00.452178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.345421 (+1893243us) service_pool.cc:224] Handling call
0709 13:07:02.355894 (+ 10473us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.336972 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:02.355140 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1912) took 2092 ms. Trace:
I20260709 13:07:02.414667 13863 rpcz_store.cc:276] 0709 13:07:00.263269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.353638 (+2090369us) service_pool.cc:224] Handling call
0709 13:07:02.355090 (+  1452us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.416227 13863 raft_consensus.cc:1240] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:07:02.359622 13714 rpcz_store.cc:269] 0709 13:07:00.751205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.251328 (+1500123us) service_pool.cc:224] Handling call
0709 13:07:02.358992 (+107664us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.359299 13862 rpcz_store.cc:276] 0709 13:07:00.299169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.326254 (+2027085us) service_pool.cc:224] Handling call
0709 13:07:02.334365 (+  8111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.364696 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:02.366014 13860 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:02.418529 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 1910) took 2156 ms. Trace:
I20260709 13:07:02.418977 13860 rpcz_store.cc:276] 0709 13:07:00.262637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.358042 (+2095405us) service_pool.cc:224] Handling call
0709 13:07:02.365711 (+  7669us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.418223 (+ 52512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.418464 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.412480 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:02.326538 16731 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:02.348595 16518 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:02.458184 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 100628us
I20260709 13:07:02.461298 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2551) took 1659 ms. Trace:
I20260709 13:07:02.465138 13863 rpcz_store.cc:276] 0709 13:07:00.757061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.415504 (+1658443us) service_pool.cc:224] Handling call
0709 13:07:02.415903 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:02.416684 (+   781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.416926 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.466567 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1919) took 2013 ms. Trace:
W20260709 13:07:02.461591 13856 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1890) took 2231 ms (client timeout 2905 ms). Trace:
I20260709 13:07:02.466948 13864 rpcz_store.cc:276] 0709 13:07:00.453158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.350772 (+1897614us) service_pool.cc:224] Handling call
0709 13:07:02.466505 (+115733us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:02.467442 13856 rpcz_store.cc:269] 0709 13:07:00.230311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.336726 (+2106415us) service_pool.cc:224] Handling call
0709 13:07:02.461528 (+124802us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.462261 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 2549) took 1705 ms. Trace:
I20260709 13:07:02.470078 13865 rpcz_store.cc:276] 0709 13:07:00.756593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.364313 (+1607720us) service_pool.cc:224] Handling call
0709 13:07:02.462118 (+ 97805us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:02.462533 13712 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1832) took 1711 ms (client timeout 2176 ms). Trace:
W20260709 13:07:02.471688 13712 rpcz_store.cc:269] 0709 13:07:00.750663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.410518 (+1659855us) service_pool.cc:224] Handling call
0709 13:07:02.462476 (+ 51958us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.462813 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:02.474642 13860 raft_consensus.cc:1275] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:02.475287 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2553) took 1717 ms. Trace:
I20260709 13:07:02.477048 13860 rpcz_store.cc:276] 0709 13:07:00.757523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.419912 (+1662389us) service_pool.cc:224] Handling call
0709 13:07:02.474280 (+ 54368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.475044 (+   764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.475236 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.478332 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1844) took 1415 ms. Trace:
I20260709 13:07:02.478746 13714 rpcz_store.cc:276] 0709 13:07:01.062901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.423223 (+1360322us) service_pool.cc:224] Handling call
0709 13:07:02.478270 (+ 55047us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.479843 13861 raft_consensus.cc:1275] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:02.480439 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2547) took 1730 ms. Trace:
I20260709 13:07:02.480754 13861 rpcz_store.cc:276] 0709 13:07:00.749799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.414269 (+1664470us) service_pool.cc:224] Handling call
0709 13:07:02.476484 (+ 62215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.480216 (+  3732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.480389 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.339803 16654 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:02.483278 13862 raft_consensus.cc:1240] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:07:02.484201 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:02.483392 14368 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:02.506552 13864 raft_consensus.cc:1240] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:02.348860 16550 consensus_queue.cc:260] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:02.508664 13712 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:07:02.519886 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1845) took 1265 ms. Trace:
I20260709 13:07:02.520268 13712 rpcz_store.cc:276] 0709 13:07:01.255463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.474259 (+1218796us) service_pool.cc:224] Handling call
0709 13:07:02.519827 (+ 45568us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.424402 16276 raft_consensus.cc:740] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:07:02.509517 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2552) took 1752 ms. Trace:
I20260709 13:07:02.521471 13862 rpcz_store.cc:276] 0709 13:07:00.757301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.417841 (+1660540us) service_pool.cc:224] Handling call
0709 13:07:02.479457 (+ 61616us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:02.509171 (+ 29714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.509442 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.351393 16469 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:02.510918 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:02.505733 14368 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:02.512934 16746 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:02.513866 16745 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:02.513885 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 1.81147e+06us
I20260709 13:07:02.349313 16723 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:02.512970 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 334686us
I20260709 13:07:02.525942 14368 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:02.523023 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:02.525250 13714 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:07:02.473781 16456 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:02.349542 16638 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:02.529716 13682 leader_election.cc:336] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 2.124s (SENT)
I20260709 13:07:02.508409 16733 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:02.422674 16732 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.106s
I20260709 13:07:02.536262 13682 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:02.535257 14402 raft_consensus.cc:1240] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:07:02.535753 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:02.514676 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 394155us
I20260709 13:07:02.546382 14366 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:02.528929 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.548125 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.548372 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:02.553221 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.556419 13712 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:07:02.557507 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:02.561038 13757 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:02.562307 13757 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:02.529363 16735 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.529337 16745 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:02.578295 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:02.576740 13712 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
W20260709 13:07:02.577661 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 168001us
I20260709 13:07:02.467797 16725 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:02.580272 13829 leader_election.cc:336] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Timed out: RequestConsensusVote RPC to 127.12.76.132:43039 timed out after 1.622s (SENT)
W20260709 13:07:02.581913 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 52226.5us
I20260709 13:07:02.552557 16456 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:02.556063 16744 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:02.585078 13714 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:02.582290 13757 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:02.583267 13756 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:02.532919 16743 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:02.587216 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:02.589874 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:02.571928 16533 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.596021 13712 raft_consensus.cc:2410] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:02.592366 14402 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:07:02.575901 16655 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.472872 16731 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:02.578456 16550 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:02.642503 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:02.643747 13714 raft_consensus.cc:2410] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:02.582486 16514 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:02.644192 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1830) took 1894 ms. Trace:
I20260709 13:07:02.644624 13712 rpcz_store.cc:276] 0709 13:07:00.750138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.586954 (+1836816us) service_pool.cc:224] Handling call
0709 13:07:02.644115 (+ 57161us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:02.650599 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.549943 16746 consensus_queue.cc:1059] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:07:02.581326 16745 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:02.592006 16700 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:02.751844 16700 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:02.751892 13711 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:02.752421 16700 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:02.752750 13711 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1839) took 1990 ms (client timeout 2092 ms). Trace:
W20260709 13:07:02.753105 13711 rpcz_store.cc:269] 0709 13:07:00.762224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.349874 (+1587650us) service_pool.cc:224] Handling call
0709 13:07:02.752688 (+402814us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.754032 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:02.755527 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:02.756171 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1841) took 1993 ms. Trace:
I20260709 13:07:02.756312 13830 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:02.756492 13711 rpcz_store.cc:276] 0709 13:07:00.762947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.755272 (+1992325us) service_pool.cc:224] Handling call
0709 13:07:02.756122 (+   850us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.757483 13830 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:02.655944 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1840) took 1893 ms. Trace:
I20260709 13:07:02.759454 13714 rpcz_store.cc:276] 0709 13:07:00.762628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.592511 (+1829883us) service_pool.cc:224] Handling call
0709 13:07:02.655857 (+ 63346us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.760697 13714 raft_consensus.cc:1240] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:02.761283 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1838) took 1999 ms. Trace:
I20260709 13:07:02.761669 13714 rpcz_store.cc:276] 0709 13:07:00.761941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.760250 (+1998309us) service_pool.cc:224] Handling call
0709 13:07:02.760540 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.761044 (+   504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.761212 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.581588 16696 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:02.591797 16743 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:02.731681 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:02.724658 16415 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:02.790901 16415 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:02.603852 16734 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:02.638947 16542 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:02.604188 16533 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:02.595470 16456 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:02.735807 16626 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.654721 16514 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:02.737779 16518 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:02.563274 16276 consensus_queue.cc:260] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:02.742792 13716 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:07:02.725020 16710 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.748780 13859 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
W20260709 13:07:02.773413 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.776937 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 229293us
I20260709 13:07:02.790337 16743 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:02.785668 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1833) took 2034 ms. Trace:
I20260709 13:07:02.582244 16735 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:02.642776 16655 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:03.044593 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 461491us
I20260709 13:07:03.367000 14366 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:07:02.934386 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 352130us
W20260709 13:07:03.368100 13716 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2311) took 2269 ms (client timeout 1778 ms). Trace:
W20260709 13:07:03.368505 13716 rpcz_store.cc:269] 0709 13:07:01.098704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.346936 (+1248232us) service_pool.cc:224] Handling call
0709 13:07:03.368038 (+1021102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.864008 13711 raft_consensus.cc:1275] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:07:03.369225 13711 pending_rounds.cc:85] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 5
I20260709 13:07:03.369455 13711 pending_rounds.cc:107] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:07:03.369829 13711 raft_consensus.cc:2889] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:03.369684 13712 rpcz_store.cc:276] 0709 13:07:00.750946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.731342 (+1980396us) service_pool.cc:224] Handling call
0709 13:07:02.785592 (+ 54250us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:02.958694 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 375467us
I20260709 13:07:02.785086 16673 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.372836 13756 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:02.933565 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 376597us
W20260709 13:07:03.418449 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 45706.3us
I20260709 13:07:03.419588 13756 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:07:03.308797 13680 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.003s	sys 0.020s
I20260709 13:07:02.786770 16733 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:03.366133 13859 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1915) took 2958 ms (client timeout 2347 ms). Trace:
I20260709 13:07:03.586745 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:03.586925 13859 rpcz_store.cc:269] 0709 13:07:00.407861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.184758 (+1776897us) service_pool.cc:224] Handling call
0709 13:07:03.366053 (+1181295us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:03.584969 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 216229us
I20260709 13:07:03.587989 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:03.588585 13757 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:03.589105 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:03.591334 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2312) took 2492 ms. Trace:
W20260709 13:07:03.036908 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 279478us
I20260709 13:07:03.365423 16725 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:03.596781 14368 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:03.412835 14396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.114s	user 0.011s	sys 0.016s
W20260709 13:07:03.363591 16748 log.cc:927] Time spent T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
I20260709 13:07:03.414512 16754 consensus_queue.cc:1059] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:07:03.416042 16746 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.003s	sys 0.006s
I20260709 13:07:02.820348 16470 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:02.761305 16550 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:02.827145 16686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.011s	sys 0.008s
W20260709 13:07:03.417342 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 50778.6us
W20260709 13:07:03.729182 13682 leader_election.cc:336] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 2.190s (SENT)
I20260709 13:07:03.729686 13682 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:03.420822 13680 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.004s	sys 0.020s
W20260709 13:07:03.730753 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 1.19499e+06us
W20260709 13:07:02.957422 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 369422us
W20260709 13:07:03.414542 13863 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.001s	sys 0.008s
I20260709 13:07:03.585661 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1831) took 2835 ms. Trace:
I20260709 13:07:03.586109 13712 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:03.733793 13863 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.253s	user 0.001s	sys 0.009s
I20260709 13:07:03.593889 13830 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:03.733841 13711 rpcz_store.cc:276] 0709 13:07:00.750387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.757112 (+2006725us) service_pool.cc:224] Handling call
0709 13:07:02.863549 (+106437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.585323 (+721774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.585547 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:03.741511 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 322054us
I20260709 13:07:03.741801 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1843) took 2978 ms. Trace:
I20260709 13:07:03.742223 13712 rpcz_store.cc:276] 0709 13:07:00.793788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.585482 (+2791694us) service_pool.cc:224] Handling call
0709 13:07:03.585897 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.741503 (+155606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.741738 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:03.352306 16654 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:03.747104 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 153307us
W20260709 13:07:03.664642 16746 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.005s	sys 0.006s
W20260709 13:07:03.584316 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 217364us
W20260709 13:07:03.413707 14393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.005s	sys 0.008s
W20260709 13:07:03.792052 14393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.153s	user 0.005s	sys 0.008s
W20260709 13:07:03.038542 16571 consensus_meta.cc:287] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.675s	user 0.004s	sys 0.005s
I20260709 13:07:02.820003 16696 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:02.793241 16729 raft_consensus.cc:2764] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:07:02.835711 16669 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:03.630435 13714 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.010s	sys 0.000s
W20260709 13:07:03.609563 13785 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.088s	user 0.000s	sys 0.010s
I20260709 13:07:03.592682 13716 rpcz_store.cc:276] 0709 13:07:01.099011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.590352 (+2491341us) service_pool.cc:224] Handling call
0709 13:07:03.590703 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.590924 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.590959 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:03.591014 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:03.591066 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.591144 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.591271 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:03.061132 16415 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:03.212723 16744 raft_consensus.cc:697] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:03.053010 16469 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:03.047350 16689 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:03.601045 14396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.302s	user 0.011s	sys 0.016s
I20260709 13:07:03.417783 16514 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:03.417361 16723 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:03.772636 13680 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:07:03.849860 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 77333.8us
I20260709 13:07:03.595793 16735 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:03.728653 16686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.453s	user 0.019s	sys 0.010s
I20260709 13:07:02.836059 16542 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:03.814553 13830 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:03.584753 16710 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:03.819778 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1846) took 2285 ms. Trace:
W20260709 13:07:03.821451 13714 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.058s	user 0.015s	sys 0.000s
I20260709 13:07:03.858682 13856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2560) took 1745 ms. Trace:
I20260709 13:07:03.859118 13856 rpcz_store.cc:276] 0709 13:07:02.113355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.468205 (+354850us) service_pool.cc:224] Handling call
0709 13:07:02.468594 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:02.469086 (+   492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.469126 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:02.469688 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 13:07:02.574842 (+105154us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:03.048612 (+473770us) log.cc:844] Serialized 14 byte log entry
0709 13:07:03.048857 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.049075 (+   218us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:03.858490 (+809415us) raft_consensus.cc:1685] finished
0709 13:07:03.858508 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.858625 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":840041,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":369549,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":4592,"thread_start_us":522807,"threads_started":2,"wal-append.queue_time_us":249071}
W20260709 13:07:03.821570 13785 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.300s	user 0.000s	sys 0.011s
W20260709 13:07:03.823272 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 94152.6us
W20260709 13:07:03.828639 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 240117us
I20260709 13:07:03.597733 16673 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:02.831678 16734 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:03.835772 16741 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:03.837982 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 46148.9us
I20260709 13:07:03.867858 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 657) took 3093 ms. Trace:
I20260709 13:07:03.838132 16761 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:03.868221 13863 rpcz_store.cc:276] 0709 13:07:00.774491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.466128 (+1691637us) service_pool.cc:224] Handling call
0709 13:07:02.466420 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.466637 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:03.734212 (+1267575us) log.cc:844] Serialized 14 byte log entry
0709 13:07:03.867540 (+133328us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:03.867587 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:03.867627 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.867685 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.867794 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6027,"prepare.queue_time_us":948024,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"thread_start_us":1380283,"threads_started":2}
W20260709 13:07:03.839334 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 236836us
I20260709 13:07:03.840061 14367 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:03.841018 16756 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:03.790771 16631 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:03.791318 16760 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:03.844310 16571 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.791548 16638 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:03.830755 16745 consensus_meta.cc:287] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 1.082s	user 0.010s	sys 0.000s
I20260709 13:07:03.850689 13680 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:03.819363 16550 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:03.925845 14402 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:03.857756 13711 rpcz_store.cc:276] 0709 13:07:01.506367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.735188 (+2228821us) service_pool.cc:224] Handling call
0709 13:07:03.790751 (+ 55563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.790948 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.790974 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:03.791018 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:03.791064 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.791116 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.791240 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:03.865918 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 97997.3us
I20260709 13:07:03.927486 13830 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:03.928916 13830 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:03.819232 16757 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:03.873914 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 688) took 2777 ms. Trace:
I20260709 13:07:03.865314 16470 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:03.865523 16696 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:03.879112 16768 log.cc:927] Time spent T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:07:03.888032 16744 consensus_queue.cc:237] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:03.873885 16741 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.891606 16673 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:03.892174 16533 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:03.893361 16456 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:03.895140 14366 leader_election.cc:304] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:03.845888 16731 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:03.900449 16771 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.925400 16550 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:07:03.919633 13682 connection.cc:256] RPC call timeout handler was delayed by -3.9766254319998779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23690000000000003s for a response
W20260709 13:07:03.931840 13857 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.000s	sys 0.007s
W20260709 13:07:03.934017 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 83431.8us
W20260709 13:07:03.878144 16767 log.cc:927] Time spent T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:07:03.930502 13830 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:03.912155 14368 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:03.858122 16770 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:03.960369 14402 raft_consensus.cc:1240] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:03.933156 13785 rpcz_store.cc:276] 0709 13:07:01.096621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.116611 (+1019990us) service_pool.cc:224] Handling call
0709 13:07:02.116943 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.117145 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:02.521689 (+404544us) log.cc:844] Serialized 14 byte log entry
0709 13:07:03.873495 (+1351806us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:03.873561 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:03.873623 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.873716 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.873849 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11620,"prepare.queue_time_us":400125,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"thread_start_us":1743982,"threads_started":2}
W20260709 13:07:03.932291 16036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.097s	user 0.002s	sys 0.008s
I20260709 13:07:03.903324 16735 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.903263 16763 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.985376 16754 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:03.819690 16654 consensus_queue.cc:1059] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:07:03.925655 16571 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:03.987270 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 147297us
W20260709 13:07:04.016647 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 121582us
W20260709 13:07:04.039669 13682 leader_election.cc:336] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 1.952s (SENT)
W20260709 13:07:04.040035 13857 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.000s	sys 0.009s
W20260709 13:07:04.040405 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 109986us
I20260709 13:07:03.942343 16689 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:03.932835 16745 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:04.056536 16036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.237s	user 0.009s	sys 0.013s
I20260709 13:07:03.964414 16696 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.960693 16638 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:04.104019 16655 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:04.043272 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 309737us
I20260709 13:07:04.104821 16276 ts_tablet_manager.cc:1434] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 1.825s	user 0.025s	sys 0.051s
W20260709 13:07:04.105155 16276 ts_tablet_manager.cc:1467] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58: Tablet startup took 1843ms
I20260709 13:07:04.100841 13682 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:04.045437 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 133394us
I20260709 13:07:03.974313 16729 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:04.072837 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1842) took 3309 ms. Trace:
I20260709 13:07:04.045871 16550 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:04.061249 16700 consensus_meta.cc:287] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 1.308s	user 0.007s	sys 0.004s
W20260709 13:07:04.044598 13680 connection.cc:256] RPC call timeout handler was delayed by -3.1697343250000358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
W20260709 13:07:04.113400 13680 connection.cc:256] RPC call timeout handler was delayed by -2.7620343250000587s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21520000000000003s for a response
I20260709 13:07:04.105962 13755 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:07:04.061080 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.101981 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2556) took 3343 ms. Trace:
I20260709 13:07:04.043504 16470 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:04.106767 14368 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:07:04.108579 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 68959.1us
I20260709 13:07:04.106988 13714 rpcz_store.cc:276] 0709 13:07:00.763210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.762528 (+1999318us) service_pool.cc:224] Handling call
0709 13:07:02.762878 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.763101 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:03.858409 (+1095308us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.072011 (+213602us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.072068 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:04.072115 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.072181 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.072534 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":935,"prepare.queue_time_us":1136503,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":15029,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":1225191,"threads_started":2}
I20260709 13:07:03.977326 16741 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:04.104013 16638 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.013576 16548 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.115902 16470 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:04.012617 16784 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:04.103588 13830 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:04.102267 16731 raft_consensus.cc:3055] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:04.075094 16781 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:04.113898 13680 connection.cc:256] RPC call timeout handler was delayed by -2.21483432499997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27599999999999997s for a response
I20260709 13:07:04.010967 16778 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.073895 16770 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:04.133216 16793 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.073463 16780 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.134202 16571 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:04.136025 13682 leader_election.cc:336] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 1.990s (SENT)
I20260709 13:07:04.154393 13682 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:04.113824 16787 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.079893 16763 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:04.167394 13682 leader_election.cc:336] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 2.898s (SENT)
I20260709 13:07:04.167922 13682 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:04.064296 16735 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:04.115228 13857 rpcz_store.cc:276] 0709 13:07:00.758244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.461907 (+1703663us) service_pool.cc:224] Handling call
0709 13:07:02.479727 (+ 17820us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:02.480093 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.480124 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:02.480568 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:07:02.957895 (+477327us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:04.101184 (+1143289us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.101488 (+   304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.101732 (+   244us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.101777 (+    45us) raft_consensus.cc:1685] finished
0709 13:07:04.101788 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.101924 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1331,"prepare.queue_time_us":457186,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":6409,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":29086,"thread_start_us":1330728,"threads_started":2,"wal-append.queue_time_us":903537}
I20260709 13:07:04.071820 16757 raft_consensus.cc:697] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:04.115741 16654 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.134096 16791 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.073244 14396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 990) took 3291 ms. Trace:
I20260709 13:07:04.155490 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:07:04.156044 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 49356.6us
I20260709 13:07:04.154173 16729 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:04.147784 16731 raft_consensus.cc:740] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:04.150336 16470 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:04.163374 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 48550.9us
I20260709 13:07:04.207909 16734 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:04.074836 16777 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.170162 16542 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:04.140275 16638 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.140002 16548 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:04.216280 13715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2310) took 3487 ms. Trace:
I20260709 13:07:04.102792 16543 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:07:04.144186 13680 connection.cc:256] RPC call timeout handler was delayed by -2.1770343250000224s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2802s for a response
I20260709 13:07:04.217096 13680 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:04.057845 16771 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:04.218852 16743 consensus_meta.cc:287] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.622s	user 0.010s	sys 0.000s
I20260709 13:07:04.114082 16696 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:04.219342 16771 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:04.219631 16710 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:04.220201 16782 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:07:04.220355 16771 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:04.221711 16745 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:04.197369 14402 raft_consensus.cc:1240] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:04.153651 16781 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:04.222740 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 612) took 1893 ms. Trace:
I20260709 13:07:04.223659 16789 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:04.223876 16781 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:04.166224 16793 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:04.198688 16791 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:04.230080 16791 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:04.166312 16787 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:04.199617 16547 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.201653 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:04.204921 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 614) took 1869 ms. Trace:
I20260709 13:07:04.106364 16754 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:04.213419 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:04.214412 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 47041.2us
I20260709 13:07:04.224189 16789 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:04.207839 16765 log.cc:927] Time spent T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:07:04.117274 16700 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:04.216660 13715 rpcz_store.cc:276] 0709 13:07:00.729126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.746059 (+ 16933us) service_pool.cc:224] Handling call
0709 13:07:00.746358 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.746720 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.746747 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:00.848959 (+102212us) log.cc:844] Serialized 26 byte log entry
0709 13:07:04.207042 (+3358083us) spinlock_profiling.cc:243] Waited 71.4 ms on lock 0x7b540004f220. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232448090 00007f52324556b8 00007f52324de92b 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c
0709 13:07:04.207103 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:04.207161 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.207227 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.207280 (+    53us) raft_consensus.cc:1685] finished
0709 13:07:04.207293 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.216219 (+  8926us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":866,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":164162944,"thread_start_us":942234,"threads_started":1,"wal-append.queue_time_us":952367,"wal-append.run_cpu_time_us":3044,"wal-append.run_wall_time_us":1261743}
I20260709 13:07:04.223124 13712 rpcz_store.cc:276] 0709 13:07:02.329402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.742932 (+1413530us) service_pool.cc:224] Handling call
0709 13:07:03.743239 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.826178 (+ 82939us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:03.826226 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.843822 (+ 17596us) log.cc:844] Serialized 26 byte log entry
0709 13:07:04.041491 (+197669us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:04.041531 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.041593 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.222537 (+180944us) raft_consensus.cc:1685] finished
0709 13:07:04.222556 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.222672 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25926,"raft.queue_time_us":61538,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":20031,"thread_start_us":193314,"threads_started":1,"wal-append.queue_time_us":268087}
I20260709 13:07:04.223825 16762 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:04.243172 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.190212 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:04.166788 16746 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:04.231243 16733 consensus_meta.cc:287] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.633s	user 0.005s	sys 0.004s
I20260709 13:07:04.243564 13716 rpcz_store.cc:276] 0709 13:07:02.335910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.822420 (+1486510us) service_pool.cc:224] Handling call
0709 13:07:03.822778 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.875795 (+ 53017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.875892 (+    97us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.881929 (+  6037us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.960100 (+ 78171us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:03.960151 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.960246 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.204676 (+244430us) raft_consensus.cc:1685] finished
0709 13:07:04.204702 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.204852 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7604,"raft.queue_time_us":28831,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":11429,"thread_start_us":106203,"threads_started":2,"wal-append.queue_time_us":318672}
I20260709 13:07:04.219247 16743 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:04.246109 16789 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.215870 16631 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:04.233300 16543 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:04.212018 16729 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:04.105484 16276 ts_tablet_manager.cc:1469] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58: Trace:
0709 13:06:47.306697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.315340 (+  8643us) service_pool.cc:224] Handling call
0709 13:06:47.543522 (+228182us) ts_tablet_manager.cc:934] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533)
0709 13:06:51.365780 (+3822258us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:52.436014 (+1070234us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:52.440250 (+  4236us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:52.947550 (+507300us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:52.947937 (+   387us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:52.948298 (+   361us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:52.948376 (+    78us) inbound_call.cc:177] Queueing success response
0709 13:06:58.283832 (+5335456us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:07:02.283663 (+3999831us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:07:02.287641 (+  3978us) tablet_replica.cc:261] Starting instrumentation
0709 13:07:02.288500 (+   859us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":54741,"mutex_wait_us":208115,"raft.queue_time_us":419251,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"tablet-copy.queue_time_us":147740,"tablet-download-pool.queue_time_us":2370,"tablet-download-pool.run_cpu_time_us":2064,"tablet-download-pool.run_wall_time_us":4576885,"thread_start_us":489259,"threads_started":3}
I20260709 13:07:04.256867 14368 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:07:04.259034 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 107501us
W20260709 13:07:04.259562 13682 connection.cc:256] RPC call timeout handler was delayed by -3.3353002559999823s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2802s for a response
I20260709 13:07:04.264848 13680 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:04.221941 16771 consensus_queue.cc:1059] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:07:04.256384 16745 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:07:04.279628 13682 connection.cc:256] RPC call timeout handler was delayed by -2.948300255999925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32320000000000004s for a response
I20260709 13:07:04.285791 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:04.307778 13682 connection.cc:256] RPC call timeout handler was delayed by -2.5974900929999194s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
I20260709 13:07:04.285225 13714 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:04.308137 13682 connection.cc:256] RPC call timeout handler was delayed by -2.5056900929999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
W20260709 13:07:04.308466 13682 connection.cc:256] RPC call timeout handler was delayed by -1.9116900929999474s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23470000000000002s for a response
W20260709 13:07:04.308766 13682 connection.cc:256] RPC call timeout handler was delayed by -1.5183900929999936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2784s for a response
W20260709 13:07:04.309077 13682 connection.cc:256] RPC call timeout handler was delayed by -1.4094900929999312s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2905s for a response
I20260709 13:07:04.163489 16778 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:04.232951 16787 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:04.286062 16729 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:04.290021 16761 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:04.290318 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:04.292804 14395 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:04.288290 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:04.296136 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:04.314250 13856 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:07:04.315459 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:04.297602 13865 raft_consensus.cc:3055] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:04.316421 13865 raft_consensus.cc:740] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:04.298219 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:04.275813 16762 raft_consensus.cc:697] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:07:04.321799 16626 consensus_meta.cc:287] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.737s	user 0.008s	sys 0.003s
I20260709 13:07:04.322336 16626 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.275233 16733 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:04.322917 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 596) took 6249 ms. Trace:
I20260709 13:07:04.322652 16762 consensus_queue.cc:237] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:04.323625 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 615) took 1985 ms. Trace:
I20260709 13:07:04.323992 13711 rpcz_store.cc:276] 0709 13:07:02.337756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.926906 (+1589150us) service_pool.cc:224] Handling call
0709 13:07:03.971262 (+ 44356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.972442 (+  1180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.972485 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.973097 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 13:07:04.151385 (+178288us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:04.151461 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.151559 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.323405 (+171846us) raft_consensus.cc:1685] finished
0709 13:07:04.323445 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.323575 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":912,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":8769,"thread_start_us":140516,"threads_started":1,"wal-append.queue_time_us":243491}
I20260709 13:07:04.325875 13711 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:04.326443 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 617) took 1986 ms. Trace:
W20260709 13:07:04.299047 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 90730.6us
I20260709 13:07:04.299810 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:04.157034 16770 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:05.851727 16749 raft_consensus.cc:3055] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:05.852185 16749 raft_consensus.cc:740] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:05.852731 16770 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:05.852942 16749 consensus_queue.cc:260] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:05.854492 16749 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:04.278968 13756 connection.cc:256] RPC call timeout handler was delayed by -1.0452312650000977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
I20260709 13:07:05.858992 13756 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:07:05.861264 13858 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1909) took 5599 ms (client timeout 2369 ms). Trace:
W20260709 13:07:05.861774 13858 rpcz_store.cc:269] 0709 13:07:00.262288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.153530 (+1891242us) service_pool.cc:224] Handling call
0709 13:07:05.860998 (+3707468us) spinlock_profiling.cc:243] Waited 43.7 ms on lock 0x7b54000d16d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:05.861201 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100598016}
I20260709 13:07:05.863878 16776 raft_consensus.cc:3055] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:05.864409 16776 raft_consensus.cc:740] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:05.865453 16776 consensus_queue.cc:260] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:05.866881 16776 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.293318 16746 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.867865 16746 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:05.870581 16746 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:04.334229 13711 rpcz_store.cc:276] 0709 13:07:02.340285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.325311 (+1985026us) service_pool.cc:224] Handling call
0709 13:07:04.325711 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.326237 (+   526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.326394 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.323309 13710 rpcz_store.cc:276] 0709 13:06:58.073632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.189151 (+115519us) service_pool.cc:224] Handling call
0709 13:06:58.286272 (+ 97121us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:58.653753 (+367481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.653821 (+    68us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:58.683881 (+ 30060us) log.cc:844] Serialized 52 byte log entry
0709 13:06:59.195990 (+512109us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:59.196029 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.196092 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:00.765175 (+1569083us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:07:04.322443 (+3557268us) raft_consensus.cc:1685] finished
0709 13:07:04.322470 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.322807 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37086,"raft.queue_time_us":111550,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":11613952,"thread_start_us":494949,"threads_started":2,"wal-append.queue_time_us":280507,"wal-append.run_cpu_time_us":55908,"wal-append.run_wall_time_us":4004562}
I20260709 13:07:05.875398 13716 raft_consensus.cc:1240] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:05.878937 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 618) took 3535 ms. Trace:
I20260709 13:07:04.275650 16654 consensus_queue.cc:1059] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:07:06.063581 16646 raft_consensus.cc:3055] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:06.064179 16646 raft_consensus.cc:740] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:07:06.065743 14368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.773s	user 0.013s	sys 0.017s
I20260709 13:07:06.065220 16646 consensus_queue.cc:260] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:06.066439 14368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.773s	user 0.013s	sys 0.017s
I20260709 13:07:06.066977 16646 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.352052 16790 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.284570 16731 consensus_queue.cc:260] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:04.308694 16757 consensus_queue.cc:237] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:04.356998 16694 raft_consensus.cc:3055] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:04.339046 16761 raft_consensus.cc:697] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:04.331941 16772 consensus_queue.cc:1059] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:07:02.140745 13708 rpcz_store.cc:276] 0709 13:07:00.727886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.131062 (+1403176us) service_pool.cc:224] Handling call
0709 13:07:02.131392 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.136925 (+  5533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.136959 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:02.137005 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:02.137052 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.137140 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.137284 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5287}
I20260709 13:07:04.432492 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:04.433219 13787 raft_consensus.cc:1240] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:04.431314 16735 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:04.361053 13714 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:07:04.404244 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:04.904857 13680 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.011s	sys 0.014s
W20260709 13:07:04.428092 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 109209us
W20260709 13:07:06.084721 13680 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.779s	user 0.011s	sys 0.014s
W20260709 13:07:06.085064 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 1.77952e+06us
W20260709 13:07:06.086840 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.355136 16763 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:04.992340 16774 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.000s	sys 0.009s
I20260709 13:07:04.499017 16741 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:04.428792 16793 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:04.363482 16743 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:05.421923 16784 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.051s	user 0.021s	sys 0.027s
W20260709 13:07:05.352840 13812 debug-util.cc:398] Leaking SignalData structure 0x7b0800363780 after lost signal to thread 12597
I20260709 13:07:04.384666 16778 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:04.399946 16696 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:05.463161 14398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 715) took 1298 ms (client timeout 1534 ms). Trace:
W20260709 13:07:06.110648 14398 rpcz_store.cc:269] 0709 13:07:04.164461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.273803 (+109342us) service_pool.cc:224] Handling call
0709 13:07:05.463067 (+1189264us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:05.552629 13713 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2301) took 4825 ms (client timeout 3244 ms). Trace:
I20260709 13:07:04.993891 16700 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:05.568315 16729 consensus_meta.cc:287] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 1.236s	user 0.008s	sys 0.004s
W20260709 13:07:05.579375 16747 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.004s	sys 0.014s
W20260709 13:07:05.590365 16789 consensus_meta.cc:287] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 1.305s	user 0.004s	sys 0.008s
I20260709 13:07:05.622040 13707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 616) took 3284 ms. Trace:
W20260709 13:07:05.807552 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.819242 16548 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:05.833868 16672 raft_consensus.cc:3055] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:04.317443 13865 consensus_queue.cc:260] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:05.876477 13711 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:05.877578 13710 raft_consensus.cc:1240] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:04.306396 16631 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:05.863268 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:05.885785 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 994) took 3331 ms. Trace:
I20260709 13:07:05.887483 13716 rpcz_store.cc:276] 0709 13:07:02.343983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.874741 (+3530758us) service_pool.cc:224] Handling call
0709 13:07:05.875171 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.878636 (+  3465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.878861 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.899596 13715 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:05.899996 16771 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.900653 16762 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.902894 16699 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.903344 16795 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.903703 13726 tablet_copy_service.cc:342] P b9d194f45e044e0988d5de1a99e5cd02: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-ac05b1933cb74e488759c38bd76d8d00 received from {username='slave'} at 127.0.0.1:58552
I20260709 13:07:05.906589 16770 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:05.906513 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 47649.5us
W20260709 13:07:05.910953 16769 log.cc:927] Time spent T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 2.093s	user 0.003s	sys 0.012s
I20260709 13:07:05.915868 16808 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.195546 14396 rpcz_store.cc:276] 0709 13:07:00.781480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.849152 (+ 67672us) service_pool.cc:224] Handling call
0709 13:07:01.261478 (+412326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:02.275485 (+1014007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.277062 (+  1577us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:02.298368 (+ 21306us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.863629 (+1565261us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:03.868872 (+  5243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.901013 (+ 32141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.073006 (+171993us) raft_consensus.cc:1685] finished
0709 13:07:04.073033 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.073183 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":65829,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":2250800,"threads_started":2,"wal-append.queue_time_us":1114580}
I20260709 13:07:05.918836 14394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 710) took 4816 ms. Trace:
W20260709 13:07:05.922201 14399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 986) took 5178 ms (client timeout 1778 ms). Trace:
W20260709 13:07:05.944548 14397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 714) took 1780 ms (client timeout 1590 ms). Trace:
I20260709 13:07:05.947621 16776 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:05.949810 13830 connection.cc:256] RPC call timeout handler was delayed by -1.5847513080000226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4305s for a response
I20260709 13:07:05.951390 16809 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:05.951653 16640 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.952873 13789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2098) took 1259 ms. Trace:
I20260709 13:07:05.953136 16816 consensus_queue.cc:1059] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:05.965422 16618 raft_consensus.cc:3055] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:05.966569 13790 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 5.787s	user 0.032s	sys 0.050s
I20260709 13:07:05.982839 16663 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:05.987003 16697 raft_consensus.cc:3055] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:05.989374 16716 log.cc:927] Time spent T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 4.890s	user 0.018s	sys 0.045s
I20260709 13:07:05.986327 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 711) took 1851 ms. Trace:
I20260709 13:07:06.010377 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:06.021428 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 95191.4us
I20260709 13:07:06.021694 16815 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:06.024019 16470 consensus_meta.cc:287] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 1.816s	user 0.018s	sys 0.009s
W20260709 13:07:06.041463 16514 consensus_meta.cc:287] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 2.176s	user 0.021s	sys 0.011s
I20260709 13:07:06.048820 13709 raft_consensus.cc:1240] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:04.307595 16777 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:06.075631 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 622) took 2706 ms. Trace:
I20260709 13:07:06.081422 16731 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:06.073843 16790 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.081002 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2095) took 1649 ms. Trace:
I20260709 13:07:06.082960 16694 raft_consensus.cc:740] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:06.087283 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 659) took 1793 ms. Trace:
W20260709 13:07:06.092612 13861 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1922) took 1792 ms (client timeout 1742 ms). Trace:
W20260709 13:07:06.090776 16774 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.725s	user 0.001s	sys 0.009s
I20260709 13:07:06.106070 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:06.108203 13682 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:07:06.111567 13713 rpcz_store.cc:269] 0709 13:07:00.727008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.552246 (+4825238us) service_pool.cc:211] Skipping call since client already timed out
0709 13:07:05.552494 (+   248us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:07:06.101549 16784 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.770s	user 0.022s	sys 0.027s
I20260709 13:07:06.115898 13707 rpcz_store.cc:276] 0709 13:07:02.338045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.308077 (+1970032us) service_pool.cc:224] Handling call
0709 13:07:04.319032 (+ 10955us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.641993 (+322961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.642050 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.919322 (+277272us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.563360 (+644038us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:05.563434 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.563510 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.621772 (+ 58262us) raft_consensus.cc:1685] finished
0709 13:07:05.621800 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.621963 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13804,"raft.queue_time_us":485960,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":128848,"thread_start_us":309836,"threads_started":1,"wal-append.queue_time_us":526084}
I20260709 13:07:06.087882 16036 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:07:06.120994 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.121779 13865 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:06.122303 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 620) took 3769 ms. Trace:
I20260709 13:07:06.121950 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 619) took 3770 ms. Trace:
I20260709 13:07:06.102880 16763 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:06.126559 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:07:06.130193 13755 leader_election.cc:336] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Timed out: RequestConsensusVote RPC to 127.12.76.132:43039 timed out after 1.778s (SENT)
W20260709 13:07:06.124529 16747 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.762s	user 0.004s	sys 0.015s
I20260709 13:07:06.121480 16672 raft_consensus.cc:740] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:06.142395 16696 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:06.081089 16761 consensus_queue.cc:237] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.116772 16743 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:06.132778 16741 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:06.145393 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2096) took 1713 ms. Trace:
I20260709 13:07:06.116413 16729 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:06.121934 16789 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.131356 16543 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:06.174135 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 623) took 2752 ms. Trace:
W20260709 13:07:06.179137 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 101782us
I20260709 13:07:06.198274 16830 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:07:06.200724 16550 consensus_meta.cc:287] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 2.088s	user 0.025s	sys 0.058s
W20260709 13:07:06.186946 16638 consensus_meta.cc:287] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 1.954s	user 0.039s	sys 0.061s
I20260709 13:07:06.208022 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:06.212455 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.258308 14368 leader_election.cc:336] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 1.865s (SENT)
W20260709 13:07:06.262687 13812 debug-util.cc:398] Leaking SignalData structure 0x7b08001c0140 after lost signal to thread 13648
I20260709 13:07:06.268537 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:06.271929 13864 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1928) took 1957 ms (client timeout 1759 ms). Trace:
W20260709 13:07:06.280215 13786 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2078) took 6544 ms (client timeout 1699 ms). Trace:
I20260709 13:07:06.421801 13710 rpcz_store.cc:276] 0709 13:07:02.352882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.876998 (+3524116us) service_pool.cc:224] Handling call
0709 13:07:05.877380 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.122124 (+244744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.122263 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.256706 16547 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.296375 14395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 996) took 3712 ms. Trace:
W20260709 13:07:06.384020 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.437107 14395 rpcz_store.cc:276] 0709 13:07:02.578837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.578975 (+   138us) service_pool.cc:224] Handling call
0709 13:07:02.579265 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.313710 (+1734445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.291186 (+1977476us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b54007ba7d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:06.291375 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3926260608}
W20260709 13:07:06.438297 13790 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 6.259s	user 0.034s	sys 0.052s
W20260709 13:07:06.439937 13784 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2097) took 1747 ms (client timeout 1813 ms). Trace:
I20260709 13:07:06.423483 13711 rpcz_store.cc:276] 0709 13:07:02.351909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.875883 (+3523974us) service_pool.cc:224] Handling call
0709 13:07:05.876273 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.121702 (+245429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.121899 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.379380 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:06.428495 13863 rpcz_store.cc:276] 0709 13:07:04.293918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.295774 (+  1856us) service_pool.cc:224] Handling call
0709 13:07:04.296057 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.296226 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:04.320593 (+ 24367us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.049166 (+1728573us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b18003e6140. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e23a 00007f52324e8a2a
0709 13:07:06.086870 (+ 37704us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.086936 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:06.086996 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.087075 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.087215 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23814,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":2328,"raft.queue_time_us":1375,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":8818,"spinlock_wait_cycles":3971600640,"thread_start_us":37463,"threads_started":1,"wal-append.queue_time_us":1794775}
W20260709 13:07:06.436180 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 306008us
I20260709 13:07:06.438535 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:06.444948 13857 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 6: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
W20260709 13:07:06.423869 13864 rpcz_store.cc:269] 0709 13:07:04.314214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.271689 (+1957475us) service_pool.cc:211] Skipping call since client already timed out
0709 13:07:06.271831 (+   142us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:07:06.422994 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 164716us
W20260709 13:07:06.440771 13784 rpcz_store.cc:269] 0709 13:07:04.692872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.693022 (+   150us) service_pool.cc:224] Handling call
0709 13:07:06.207862 (+1514840us) spinlock_profiling.cc:243] Waited 94.8 ms on lock 0x7b580001c598. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:07:06.439878 (+232016us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218060032}
I20260709 13:07:06.283336 13859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 660) took 1987 ms. Trace:
I20260709 13:07:06.424824 14398 raft_consensus.cc:2393] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 5: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:06.425459 13715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1849) took 3949 ms. Trace:
I20260709 13:07:06.452932 13715 rpcz_store.cc:276] 0709 13:07:02.476211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.898861 (+3422650us) service_pool.cc:224] Handling call
0709 13:07:05.899211 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.425230 (+526019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.425409 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.454361 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:06.313669 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 663) took 2016 ms. Trace:
W20260709 13:07:06.424357 14399 rpcz_store.cc:269] 0709 13:07:00.743847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.746867 (+  3020us) service_pool.cc:224] Handling call
0709 13:07:05.921975 (+5175108us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54009169d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:05.922115 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2966716288}
I20260709 13:07:06.425771 13708 rpcz_store.cc:276] 0709 13:07:03.421747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.081564 (+2659817us) service_pool.cc:224] Handling call
0709 13:07:06.082472 (+   908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.083136 (+   664us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:06.083640 (+   504us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.173704 (+ 90064us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.173779 (+    75us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:06.173844 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.173931 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.174047 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":212,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":48,"raft.queue_time_us":36455,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"thread_start_us":89579,"threads_started":2,"wal-append.queue_time_us":39180}
W20260709 13:07:06.426818 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 318658us
I20260709 13:07:06.423249 14393 rpcz_store.cc:276] 0709 13:07:02.554600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.554770 (+   170us) service_pool.cc:224] Handling call
0709 13:07:02.555166 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:02.594925 (+ 39759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.594966 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:02.602249 (+  7283us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.792435 (+1190186us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:03.792482 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.885341 (+2092859us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b54006b5154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:05.885401 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.885455 (+    54us) raft_consensus.cc:1685] finished
0709 13:07:05.885470 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.885717 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":116482,"raft.queue_time_us":252568,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":80953,"spinlock_wait_cycles":53403008,"thread_start_us":1153417,"threads_started":1,"wal-append.queue_time_us":792296,"wal-append.run_cpu_time_us":3376,"wal-append.run_wall_time_us":1640793}
W20260709 13:07:06.456748 13858 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1921) took 2157 ms (client timeout 1768 ms). Trace:
I20260709 13:07:06.427294 13712 rpcz_store.cc:276] 0709 13:07:03.367694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.955471 (+2587777us) service_pool.cc:224] Handling call
0709 13:07:05.955800 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.956023 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:06.042244 (+ 86221us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.073200 (+ 30956us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.073268 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:06.073334 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.073421 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.073604 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":86246,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":718,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":9190,"spinlock_wait_cycles":12160,"thread_start_us":116509,"threads_started":2,"wal-append.queue_time_us":64706}
I20260709 13:07:06.424418 14394 rpcz_store.cc:276] 0709 13:07:01.102772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.129774 (+1027002us) service_pool.cc:224] Handling call
0709 13:07:02.130095 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.333371 (+203276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.918589 (+3585218us) spinlock_profiling.cc:243] Waited 91 ms on lock 0x7b54005e7ed4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:05.918777 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209371520}
W20260709 13:07:06.457165 13858 rpcz_store.cc:269] 0709 13:07:04.299722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.862905 (+1563183us) service_pool.cc:224] Handling call
0709 13:07:06.456676 (+593771us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.428696 13787 rpcz_store.cc:276] 0709 13:07:04.431312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.432715 (+  1403us) service_pool.cc:224] Handling call
0709 13:07:04.432999 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.080646 (+1647647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.080924 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.315970 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:06.431618 13786 rpcz_store.cc:269] 0709 13:06:59.733749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.733916 (+   167us) service_pool.cc:224] Handling call
0709 13:07:06.278127 (+6544211us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b5400161f54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:06.278270 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1174406016}
I20260709 13:07:06.458047 13682 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:06.458679 13865 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:06.459378 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 664) took 2162 ms. Trace:
I20260709 13:07:06.424938 13788 rpcz_store.cc:276] 0709 13:07:04.431678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.994308 (+562630us) service_pool.cc:224] Handling call
0709 13:07:06.022318 (+1028010us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b580001c598. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:07:06.022531 (+   213us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:06.022949 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.022978 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:06.023519 (+   541us) log.cc:844] Serialized 52 byte log entry
0709 13:07:06.072976 (+ 49457us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:06.073015 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.073097 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.145081 (+ 71984us) raft_consensus.cc:1685] finished
0709 13:07:06.145103 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.145328 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4666,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":114,"spinlock_wait_cycles":456619776,"thread_start_us":49034,"threads_started":1,"wal-append.queue_time_us":113213}
I20260709 13:07:06.459714 13865 rpcz_store.cc:276] 0709 13:07:04.297161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.297273 (+   112us) service_pool.cc:224] Handling call
0709 13:07:04.297499 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.459144 (+2161645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.459331 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:06.432447 13812 debug-util.cc:398] Leaking SignalData structure 0x7b08003dbcc0 after lost signal to thread 13740
I20260709 13:07:06.434243 13709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2308) took 5705 ms. Trace:
W20260709 13:07:06.460536 13812 debug-util.cc:398] Leaking SignalData structure 0x7b08003db8e0 after lost signal to thread 13741
I20260709 13:07:06.460573 13709 rpcz_store.cc:276] 0709 13:07:00.728685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.048257 (+5319572us) service_pool.cc:224] Handling call
0709 13:07:06.048598 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.434031 (+385433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.434190 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.434634 14402 rpcz_store.cc:276] 0709 13:07:04.135083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.135201 (+   118us) service_pool.cc:224] Handling call
0709 13:07:04.135526 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.222372 (+ 86846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.986053 (+1763681us) spinlock_profiling.cc:243] Waited 61.6 ms on lock 0x7b5400383954. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:05.986261 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141647104}
I20260709 13:07:06.461925 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:06.435249 13861 rpcz_store.cc:269] 0709 13:07:04.300054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.403826 (+103772us) service_pool.cc:224] Handling call
0709 13:07:06.092504 (+1688678us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.421092 13789 rpcz_store.cc:276] 0709 13:07:04.693352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.693471 (+   119us) service_pool.cc:224] Handling call
0709 13:07:05.549529 (+856058us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:05.905173 (+355644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.905201 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:05.905902 (+   701us) log.cc:844] Serialized 52 byte log entry
0709 13:07:05.925556 (+ 19654us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:05.952303 (+ 26747us) log.cc:844] Serialized 14 byte log entry
0709 13:07:05.952526 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.952607 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.952649 (+    42us) raft_consensus.cc:1685] finished
0709 13:07:05.952661 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.952815 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":354135,"prepare.queue_time_us":26759,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":354699,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":202,"thread_start_us":45639,"threads_started":2,"wal-append.queue_time_us":17593}
I20260709 13:07:06.440057 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2100) took 1520 ms. Trace:
W20260709 13:07:06.463143 13863 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1925) took 2143 ms (client timeout 1813 ms). Trace:
I20260709 13:07:06.376950 13614 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49444 (request call id 319) took 10868 ms. Trace:
W20260709 13:07:06.463510 13863 rpcz_store.cc:269] 0709 13:07:04.300967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.443786 (+2142819us) service_pool.cc:211] Skipping call since client already timed out
0709 13:07:06.443860 (+    74us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:07:06.462970 13782 rpcz_store.cc:276] 0709 13:07:04.919749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.922418 (+  2669us) service_pool.cc:224] Handling call
0709 13:07:06.010226 (+1087808us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b580001c598. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:07:06.439965 (+429739us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":457392512}
I20260709 13:07:06.455554 13860 rpcz_store.cc:276] 0709 13:07:04.296840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.296965 (+   125us) service_pool.cc:224] Handling call
0709 13:07:05.991197 (+1694232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.991508 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:06.040767 (+ 49259us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.045140 (+  4373us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.051675 (+  6535us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.051735 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:06.051785 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.051842 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.313446 (+261604us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54000d16d0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:06.313592 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6235,"prepare.queue_time_us":76896,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":6715,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":185,"spinlock_wait_cycles":3895467776,"thread_start_us":51488,"threads_started":2,"wal-append.queue_time_us":4615}
I20260709 13:07:06.455076 13715 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 2.
I20260709 13:07:06.469695 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:06.469816 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:06.470602 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:06.467222 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:06.468011 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:06.468084 13856 raft_consensus.cc:2368] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 5. Current term is 6.
W20260709 13:07:06.466785 13812 debug-util.cc:398] Leaking SignalData structure 0x7b0800320fa0 after lost signal to thread 13815
I20260709 13:07:06.471688 13715 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:06.308964 16526 raft_consensus.cc:3055] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:06.483752 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:06.484371 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:06.520429 13716 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:06.484890 16637 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.486836 16747 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.486922 16733 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.445405 16815 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.536252 16733 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.537892 16087 raft_consensus.cc:3055] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:06.538311 16087 raft_consensus.cc:740] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:06.538460 16733 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:06.538841 16815 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:06.487579 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:06.487895 16790 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:06.444716 16809 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.539187 16087 consensus_queue.cc:260] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:06.539857 13782 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2102) took 1619 ms (client timeout 1978 ms). Trace:
I20260709 13:07:06.540434 16087 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:06.487346 16741 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.541339 16741 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.541725 16809 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:06.539871 16637 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.427328 16618 raft_consensus.cc:740] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:06.446101 16795 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:06.464564 13859 rpcz_store.cc:276] 0709 13:07:04.295930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.296054 (+   124us) service_pool.cc:224] Handling call
0709 13:07:04.296327 (+   273us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:04.302207 (+  5880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.302253 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:06.252484 (+1950231us) log.cc:844] Serialized 52 byte log entry
0709 13:07:06.276261 (+ 23777us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:06.276998 (+   737us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.277501 (+   503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.277608 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.283034 (+  5426us) raft_consensus.cc:1685] finished
0709 13:07:06.283061 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.283258 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2119,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":40,"raft.queue_time_us":6275,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":12658,"thread_start_us":22943,"threads_started":1,"wal-append.queue_time_us":22730}
I20260709 13:07:06.446389 16830 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.426781 16697 raft_consensus.cc:740] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:06.439504 16550 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:06.435796 14397 rpcz_store.cc:269] 0709 13:07:04.164124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.290043 (+125919us) service_pool.cc:224] Handling call
0709 13:07:05.944425 (+1654382us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.445612 16743 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.492502 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:06.445473 16640 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.458751 16631 raft_consensus.cc:697] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:06.544201 16637 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:06.493880 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:06.480506 16646 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:06.494495 16758 consensus_queue.cc:1059] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:07:06.579012 13755 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:48914 dropped due to backpressure: service queue is full with 50 items
I20260709 13:07:06.495003 16547 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:06.495335 16537 consensus_queue.cc:1059] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:06.495573 16757 consensus_queue.cc:1059] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:06.464807 16763 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.333283 16751 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:06.464811 13726 tablet_copy_service.cc:434] P b9d194f45e044e0988d5de1a99e5cd02: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-ac05b1933cb74e488759c38bd76d8d00 on tablet ac05b1933cb74e488759c38bd76d8d00 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:06.422482 16542 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.465078 16762 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.445839 16036 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.498656 16360 raft_consensus.cc:3055] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:06.590662 16360 raft_consensus.cc:740] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:06.591760 16360 consensus_queue.cc:260] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.593014 16360 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.437475 16746 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:06.437280 16654 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.499923 16672 consensus_queue.cc:260] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.501092 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:06.463991 13614 rpcz_store.cc:276] 0709 13:06:55.508462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.511088 (+  2626us) service_pool.cc:224] Handling call
0709 13:07:06.376839 (+10865751us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:00.084566 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:00.085175 (+   609us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:00.085232 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:07:00.085270 (+    38us) tablet.cc:662] Decoding operations
0709 13:07:00.153540 (+ 68270us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:00.164115 (+ 10575us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:00.180041 (+ 15926us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:07:00.235234 (+ 55193us) tablet.cc:701] Row locks acquired
0709 13:07:00.235269 (+    35us) write_op.cc:260] PREPARE: finished
0709 13:07:00.235476 (+   207us) write_op.cc:270] Start()
0709 13:07:00.235640 (+   164us) write_op.cc:276] Timestamp: P: 1783602420235365 usec, L: 0
0709 13:07:00.235667 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:07:00.236459 (+   792us) log.cc:844] Serialized 4130 byte log entry
0709 13:07:00.612652 (+376193us) op_driver.cc:464] REPLICATION: finished
0709 13:07:00.635771 (+ 23119us) write_op.cc:301] APPLY: starting
0709 13:07:00.635860 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:00.636119 (+   259us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:00.636261 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:00.637544 (+  1283us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:00.637881 (+   337us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:07:00.637930 (+    49us) write_op.cc:312] APPLY: finished
0709 13:07:00.638292 (+   362us) log.cc:844] Serialized 77 byte log entry
0709 13:07:00.648914 (+ 10622us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:00.649064 (+   150us) write_op.cc:454] Released schema lock
0709 13:07:00.649146 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:00.650863 (+  1717us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:00.650924 (+    61us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":52709,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":17852,"apply.run_cpu_time_us":3479,"apply.run_wall_time_us":15073,"num_ops":10,"prepare.queue_time_us":257420,"prepare.run_cpu_time_us":53517,"prepare.run_wall_time_us":370623,"raft.queue_time_us":127968,"raft.run_cpu_time_us":6084,"raft.run_wall_time_us":24296,"replication_time_us":375492,"thread_start_us":480769,"threads_started":4,"wal-append.queue_time_us":243195,"wal-append.run_cpu_time_us":10587,"wal-append.run_wall_time_us":1159385}]]}
I20260709 13:07:06.445544 16514 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.445745 16699 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:06.445217 16638 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:06.597128 13790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2089) took 6438 ms. Trace:
I20260709 13:07:06.499552 13715 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:07:06.458046 16776 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:06.505272 16789 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:06.505614 16671 consensus_queue.cc:1048] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:06.474521 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:06.507047 16382 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.469249 16696 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:06.444583 16771 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.509855 16754 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:06.509917 16791 consensus_queue.cc:1048] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:06.305914 16812 raft_consensus.cc:3055] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:06.523897 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:06.525730 13863 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:07:06.589473 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:06.424340 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.531178 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:06.613057 13860 raft_consensus.cc:2368] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7.
I20260709 13:07:06.516635 16526 raft_consensus.cc:740] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:06.615399 16526 consensus_queue.cc:260] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:06.579301 13755 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:48914 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2105)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1628)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1642)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1636)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1640)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1633)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1641)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2107)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1626)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1629)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1627)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 691)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1630)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 699)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2106)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1635)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2116)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2111)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2110)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2101)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2112)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2108)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2113)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 702)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1643)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1645)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2114)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 689)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 693)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 692)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2117)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1638)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1624)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2103)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1631)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1632)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1634)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1637)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1639)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 690)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 694)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 695)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 696)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 697)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 698)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 700)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 701)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2109)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2115)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 703)
I20260709 13:07:06.616850 16526 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.618501 13785 raft_consensus.cc:2393] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 5: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:06.535118 16747 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.596402 16746 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:06.437076 16470 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:06.546821 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.625667 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.543715 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:06.544957 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:06.626664 14395 raft_consensus.cc:2393] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 8: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:06.546113 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:06.585723 16542 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:06.562894 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 104909us
I20260709 13:07:06.563715 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:06.629125 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:06.629698 14400 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
W20260709 13:07:06.566570 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.630703 13829 connection.cc:256] RPC call timeout handler was delayed by -3.0915781330000982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2943s for a response
W20260709 13:07:06.631038 13829 connection.cc:256] RPC call timeout handler was delayed by -3.0915781330000982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2943s for a response
I20260709 13:07:06.543386 16741 leader_election.cc:290] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:06.632881 13682 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:06.633214 16830 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:06.633399 16514 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:06.634876 16640 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:06.635538 13858 raft_consensus.cc:2376] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4. Re-sending same reply.
I20260709 13:07:06.635696 16542 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:06.608562 16382 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.636590 16036 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:06.638358 16776 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:06.638550 16382 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:06.589284 16751 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.639660 16743 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:06.640625 16747 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:06.640777 16751 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:06.451536 16777 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.586608 13791 raft_consensus.cc:1240] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:06.586233 13716 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:06.611433 16812 raft_consensus.cc:740] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:06.454990 16808 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:06.597023 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 147966us
I20260709 13:07:06.503010 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:06.705513 13861 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:07:06.577438 16655 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:06.602573 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:06.706979 13715 raft_consensus.cc:2393] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 6: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:06.707861 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:06.708513 13715 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.571590 16749 consensus_queue.cc:1059] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:07:06.597627 13790 rpcz_store.cc:276] 0709 13:07:00.138360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.140987 (+  2627us) service_pool.cc:224] Handling call
0709 13:07:00.142498 (+  1511us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.142736 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:06.446007 (+6303271us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.570619 (+124612us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.576859 (+  6240us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:06.576906 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.576970 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.577083 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":289513,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":2362,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":3790,"thread_start_us":6380981,"threads_started":2}
I20260709 13:07:06.603560 13865 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:07:06.713979 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1926) took 2412 ms. Trace:
I20260709 13:07:06.714102 13757 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:06.714341 13865 rpcz_store.cc:276] 0709 13:07:04.301747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.460456 (+2158709us) service_pool.cc:224] Handling call
0709 13:07:06.713924 (+253468us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.715209 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:06.716236 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:06.717128 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:06.717610 13865 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:07:06.718277 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:06.718735 13715 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:07:06.606662 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:06.719475 14394 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:07:06.610801 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:06.720299 13863 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:07:06.606894 16654 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:06.611230 16795 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:06.614526 16547 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:06.536432 16725 consensus_queue.cc:1059] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:06.621158 16710 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.733410 16550 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:06.733166 16710 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:06.735381 16710 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:06.627092 13859 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:06.727099 16761 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:07:06.722878 16729 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:06.540293 13782 rpcz_store.cc:269] 0709 13:07:04.920387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.481371 (+1560984us) service_pool.cc:224] Handling call
0709 13:07:06.539792 (+ 58421us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.583884 16646 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:06.739391 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.631349 13829 connection.cc:256] RPC call timeout handler was delayed by -2.817772376999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
W20260709 13:07:06.739984 13829 connection.cc:256] RPC call timeout handler was delayed by -2.7727723770000239s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
I20260709 13:07:06.740028 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:06.740377 13829 connection.cc:256] RPC call timeout handler was delayed by -2.7295542089999572s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
I20260709 13:07:06.632309 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:06.636385 16542 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:06.480607 16770 raft_consensus.cc:697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:06.578020 13864 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:06.602802 16759 consensus_queue.cc:1059] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:07:06.750936 13859 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:06.640885 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:06.628042 16746 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:06.643016 16470 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:06.690970 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.701474 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:06.587831 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:06.703992 13812 debug-util.cc:398] Leaking SignalData structure 0x7b08003ddec0 after lost signal to thread 13889
W20260709 13:07:06.757823 13812 debug-util.cc:398] Leaking SignalData structure 0x7b08003ddf40 after lost signal to thread 13890
I20260709 13:07:06.712527 16655 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:06.545346 16618 consensus_queue.cc:260] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:06.721136 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:06.762712 13863 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:06.470961 13789 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:06.721192 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:06.749734 16847 raft_consensus.cc:3055] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:06.726861 13757 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:06.664005 16763 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:06.729507 16547 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.706581 16790 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:06.731699 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:06.773029 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:06.773536 13861 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:07:06.731057 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:06.627543 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:07:06.774256 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 47452.5us
I20260709 13:07:06.774550 14394 raft_consensus.cc:2410] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:06.775128 13757 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:07:06.740515 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 111115us
W20260709 13:07:06.740716 13829 connection.cc:256] RPC call timeout handler was delayed by -2.7295542089999572s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
I20260709 13:07:06.730424 16548 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:06.742295 16762 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:06.740696 13715 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:07:06.788807 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:06.788873 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:06.789414 13715 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:06.743392 13708 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:07:06.791219 13682 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:06.792986 13682 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:06.793426 13789 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
W20260709 13:07:06.793944 13789 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2104) took 1873 ms (client timeout 1795 ms). Trace:
W20260709 13:07:06.794286 13789 rpcz_store.cc:269] 0709 13:07:04.920930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.469374 (+1548444us) service_pool.cc:224] Handling call
0709 13:07:06.793880 (+324506us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.772789 16470 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.749563 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:06.758941 13812 debug-util.cc:398] Leaking SignalData structure 0x7b0800350a60 after lost signal to thread 14426
I20260709 13:07:06.762578 16710 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.798695 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:06.758021 14368 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:06.718808 13865 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
I20260709 13:07:06.800807 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:06.801379 13865 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
I20260709 13:07:06.802100 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:06.802572 13865 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:06.737154 16808 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:06.747797 16638 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:06.880743 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 122794us
I20260709 13:07:06.763577 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:06.882885 13859 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
W20260709 13:07:06.883736 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 66747.3us
I20260709 13:07:06.764307 14398 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 8: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:06.723459 14402 raft_consensus.cc:2410] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:07:06.750552 16761 raft_consensus.cc:3055] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:07:06.766965 13857 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42104 (request call id 658) took 2473 ms (client timeout 1865 ms). Trace:
I20260709 13:07:06.767521 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:06.769215 13856 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1924) took 2468 ms (client timeout 1740 ms). Trace:
I20260709 13:07:06.787863 16550 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:06.750242 16771 leader_election.cc:290] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:06.776671 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:06.759007 16729 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:06.756986 16699 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:06.786962 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:06.787125 13829 connection.cc:256] RPC call timeout handler was delayed by -2.5503227500000776s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
W20260709 13:07:06.914937 13829 connection.cc:256] RPC call timeout handler was delayed by -2.351572377000025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
I20260709 13:07:06.787616 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:07:06.915321 13829 connection.cc:256] RPC call timeout handler was delayed by -2.351572377000025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
W20260709 13:07:06.915681 13829 connection.cc:256] RPC call timeout handler was delayed by -2.3193795800000316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
W20260709 13:07:06.748560 13864 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1927) took 2434 ms (client timeout 3085 ms). Trace:
I20260709 13:07:06.734228 16812 consensus_queue.cc:260] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.749783 16542 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.813182 13757 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:07:06.814648 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.831197 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.770280 16847 raft_consensus.cc:740] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:06.879902 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:06.880057 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:06.885942 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:06.925104 13707 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:07:06.773869 16618 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:06.701167 16631 consensus_queue.cc:237] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:06.931978 16841 log.cc:927] Time spent T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:06.896613 16550 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.933318 16550 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.891355 13865 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:07:06.935479 16526 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:06.935603 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:06.896672 16762 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:06.936179 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:06.936532 16762 raft_consensus.cc:697] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:06.936935 13710 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 8: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:06.937170 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:06.937697 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:06.937466 16762 consensus_queue.cc:237] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.938730 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:06.789947 16671 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:06.939618 16671 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:06.939990 16671 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.895877 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:06.786844 16548 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:07:06.897151 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 104202us
I20260709 13:07:06.942147 16548 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.942946 13682 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:06.943282 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:06.944077 13715 raft_consensus.cc:2393] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 5: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:06.944782 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:06.945461 13715 raft_consensus.cc:2410] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:07:06.891839 13857 rpcz_store.cc:269] 0709 13:07:04.293615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.293747 (+   132us) service_pool.cc:224] Handling call
0709 13:07:06.766753 (+2473006us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b540024f754. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:06.766882 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1369865600}
W20260709 13:07:06.898543 13714 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2314) took 2783 ms (client timeout 2034 ms). Trace:
I20260709 13:07:06.777406 16790 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:06.800521 16763 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:06.901028 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:06.901580 16547 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:06.805863 16470 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:06.902890 16646 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:06.902484 16694 consensus_queue.cc:260] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.903484 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:06.964080 13711 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:07:06.906859 16638 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:06.805887 16710 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:06.911638 16843 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:06.915951 13829 connection.cc:256] RPC call timeout handler was delayed by -2.2740991430000577s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
W20260709 13:07:06.978849 13829 connection.cc:256] RPC call timeout handler was delayed by -1.8657781330000489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4305s for a response
W20260709 13:07:06.979233 13829 connection.cc:256] RPC call timeout handler was delayed by -1.3633577790000118s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3144s for a response
W20260709 13:07:06.979557 13829 connection.cc:256] RPC call timeout handler was delayed by -1.3633577790000118s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3144s for a response
I20260709 13:07:06.893451 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:06.980531 13711 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:07:06.980782 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:06.981377 14398 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:07:06.982250 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:06.916091 13864 rpcz_store.cc:269] 0709 13:07:04.313942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.459767 (+2145825us) service_pool.cc:224] Handling call
0709 13:07:06.748493 (+288726us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:06.921798 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 108718us
W20260709 13:07:06.984462 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.985126 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.804638 16844 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:06.926383 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:06.926752 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:06.986774 13713 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:06.986976 14400 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.927232 16695 raft_consensus.cc:3055] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:06.928604 16777 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:06.800293 16828 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
I20260709 13:07:06.929402 16542 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:06.896311 16770 consensus_queue.cc:237] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.917685 16729 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.935937 16526 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:06.892179 13712 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
W20260709 13:07:06.995790 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 74621.1us
I20260709 13:07:07.001291 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:06.891733 16761 raft_consensus.cc:740] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:06.965498 16547 consensus_queue.cc:1048] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 13:07:06.945987 13714 rpcz_store.cc:269] 0709 13:07:04.114826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.137000 (+ 22174us) service_pool.cc:224] Handling call
0709 13:07:06.898369 (+2761369us) spinlock_profiling.cc:243] Waited 89.3 ms on lock 0x7b54001c48d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:06.898468 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205315968}
I20260709 13:07:06.953315 13682 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:06.956106 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:06.957717 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:06.960296 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:07.007556 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:07.007980 13715 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.990260 16695 raft_consensus.cc:740] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:06.965372 13716 raft_consensus.cc:2376] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9. Re-sending same reply.
I20260709 13:07:06.965773 14394 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:07:07.011729 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:06.956996 16790 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:06.954211 16731 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:06.991645 13829 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:06.985999 13757 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:06.994220 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:06.994509 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:07.021456 13862 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 3.
I20260709 13:07:06.996547 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:07.003368 16526 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.000114 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:06.892352 13856 rpcz_store.cc:269] 0709 13:07:04.300683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.315155 (+ 14472us) service_pool.cc:224] Handling call
0709 13:07:06.769036 (+2453881us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b54001accd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:06.769155 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4948636928}
I20260709 13:07:07.025507 13711 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
I20260709 13:07:07.004287 13712 raft_consensus.cc:2410] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:07.025859 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:07.003507 13830 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:07.008195 13714 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:07:06.997673 16844 raft_consensus.cc:697] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:06.963171 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:07.029052 13856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1931) took 1116 ms. Trace:
I20260709 13:07:07.029300 13857 raft_consensus.cc:2393] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 6: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:07.029474 13856 rpcz_store.cc:276] 0709 13:07:05.912450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.025618 (+1113168us) service_pool.cc:224] Handling call
0709 13:07:07.028991 (+  3373us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.030689 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:07.009915 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 56668.1us
I20260709 13:07:07.032577 13682 leader_election.cc:400] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7.
I20260709 13:07:07.033617 13682 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:07.013659 13680 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:07.013909 13861 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:07:06.979389 16638 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:06.998471 16694 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.014816 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:07.016093 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:07.016963 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.021404 13859 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:07:07.022377 13713 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:07:06.998849 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:07.045177 14398 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:07:06.929422 16847 consensus_queue.cc:260] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:07.022886 13715 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:07:07.024003 13863 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
I20260709 13:07:07.051246 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:07.052063 13863 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:07:07.053125 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:07.027827 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:07.055928 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:07.056974 13710 raft_consensus.cc:2410] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:07.031340 13856 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:07:06.989951 16843 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:07.042026 16638 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:07.042604 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 56697us
I20260709 13:07:07.062059 13757 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:07.046322 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:06.999498 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:07.019640 16763 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:07.048032 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.049113 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:07.065883 13707 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:07:07.062141 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:07.063282 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:07.043236 16791 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:07.067904 13862 raft_consensus.cc:2410] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:07:07.064445 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:07.070111 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:07.164767 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 150957us
I20260709 13:07:07.165798 13710 raft_consensus.cc:2410] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:07:07.166661 13680 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.132:43039 timed out after 3.085s (SENT) [suppressed 44 similar messages]
I20260709 13:07:07.168862 13710 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:07:07.168450 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:07.169346 13710 pending_rounds.cc:85] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 9
W20260709 13:07:07.169628 13682 connection.cc:256] RPC call timeout handler was delayed by -1.5749831760000461s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
I20260709 13:07:07.067831 13757 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:07.067135 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:07.171347 13707 raft_consensus.cc:1275] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:07:07.171667 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 103754us
W20260709 13:07:07.172199 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.172297 13707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2317) took 3056 ms. Trace:
I20260709 13:07:07.172966 13757 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:07.172891 13707 rpcz_store.cc:276] 0709 13:07:04.115627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.170165 (+3054538us) service_pool.cc:224] Handling call
0709 13:07:07.170775 (+   610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.171943 (+  1168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.172199 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.173826 13713 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:07.174686 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 626) took 3056 ms. Trace:
W20260709 13:07:07.170258 13682 connection.cc:256] RPC call timeout handler was delayed by -1.2041831760001287s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21520000000000003s for a response
I20260709 13:07:07.176543 13757 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:07.177693 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:07.177992 13757 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:07.178882 13711 raft_consensus.cc:2410] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:07:07.182569 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 179012us
I20260709 13:07:07.183005 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:07.175103 13713 rpcz_store.cc:276] 0709 13:07:04.118249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.172670 (+3054421us) service_pool.cc:224] Handling call
0709 13:07:07.173201 (+   531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.174316 (+  1115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.174571 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.068949 13863 raft_consensus.cc:2410] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 8 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:07:07.188683 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.189874 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 198202us
I20260709 13:07:07.071158 13856 raft_consensus.cc:2393] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 9: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:07.069754 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:07.191601 13863 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:07.192750 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 666) took 2895 ms. Trace:
I20260709 13:07:07.192977 13713 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:07.193182 13863 rpcz_store.cc:276] 0709 13:07:04.297744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.190224 (+2892480us) service_pool.cc:224] Handling call
0709 13:07:07.190971 (+   747us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.192340 (+  1369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.192644 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.193701 13857 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:07.194603 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 1923) took 2894 ms. Trace:
I20260709 13:07:07.169728 13710 pending_rounds.cc:107] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 10.10
W20260709 13:07:07.081067 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.196007 13710 raft_consensus.cc:2889] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:07.196774 13856 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:07.081012 13862 raft_consensus.cc:1240] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:07.074507 13864 raft_consensus.cc:2410] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:07.198904 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 665) took 2901 ms. Trace:
I20260709 13:07:07.109566 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:07.200966 13757 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:07.201792 13856 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:07.068436 14398 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEARNER]: Advancing to term 6
I20260709 13:07:07.098873 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 862) took 1029 ms. Trace:
I20260709 13:07:07.204319 16638 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:07.205056 16638 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.205427 16631 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:07.097877 16470 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:07.067798 16542 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:07.206305 16646 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.071631 16618 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:07.106369 14401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1005) took 1051 ms. Trace:
W20260709 13:07:07.116097 16360 consensus_meta.cc:287] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.523s	user 0.012s	sys 0.000s
I20260709 13:07:07.204452 16514 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:07.207269 16646 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:07.208280 16514 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.089287 14400 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:07:07.209632 16514 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.119390 16547 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:07.211575 16547 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.212218 16547 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.212932 16646 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:07.213374 14400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 857) took 1145 ms. Trace:
I20260709 13:07:07.213995 16646 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:07.114692 16550 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:07.213907 14400 rpcz_store.cc:276] 0709 13:07:06.068312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.211529 (+1143217us) service_pool.cc:224] Handling call
0709 13:07:07.212214 (+   685us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.212699 (+   485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.212734 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.212831 (+    97us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:07.212886 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.212986 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.213109 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.214751 16646 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.118619 16548 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:07.135278 16671 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:07.205781 16382 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:07.217727 16382 raft_consensus.cc:697] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:07.218454 16548 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:07.207653 16618 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.207181 16640 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:07.210376 13865 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:07:07.206152 16631 raft_consensus.cc:697] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:07.219655 16618 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.199366 13862 rpcz_store.cc:276] 0709 13:07:04.297472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.079763 (+2782291us) service_pool.cc:224] Handling call
0709 13:07:07.080744 (+   981us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.198337 (+117593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.198688 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.221493 16631 consensus_queue.cc:237] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:07.222538 16671 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:07.205579 16638 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.223592 16382 consensus_queue.cc:237] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:07.207846 14401 rpcz_store.cc:276] 0709 13:07:06.076572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.105616 (+1029044us) service_pool.cc:224] Handling call
0709 13:07:07.105917 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.106077 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.106100 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.106137 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:07.106168 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.106219 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.106316 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.230271 14401 raft_consensus.cc:1240] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:07.230994 14401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1006) took 1141 ms. Trace:
I20260709 13:07:07.204548 14402 rpcz_store.cc:276] 0709 13:07:06.069859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.461697 (+391838us) service_pool.cc:224] Handling call
0709 13:07:07.098676 (+636979us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b540044fcd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:07.098808 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":599547776}
I20260709 13:07:07.231352 14401 rpcz_store.cc:276] 0709 13:07:06.089511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.229184 (+1139673us) service_pool.cc:224] Handling call
0709 13:07:07.229851 (+   667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.230733 (+   882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.230947 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.232656 13714 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:07.232969 14401 raft_consensus.cc:1240] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:07.233774 14401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1012) took 1100 ms. Trace:
I20260709 13:07:07.234205 14401 rpcz_store.cc:276] 0709 13:07:06.133132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.232234 (+1099102us) service_pool.cc:224] Handling call
0709 13:07:07.232693 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.233482 (+   789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.233717 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.234890 13714 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:07.123631 16526 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:07.236495 16550 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:07.238807 16526 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:07.195027 13857 rpcz_store.cc:276] 0709 13:07:04.300374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.192638 (+2892264us) service_pool.cc:224] Handling call
0709 13:07:07.193182 (+   544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.194278 (+  1096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.194525 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.240424 14400 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:07:07.241149 14400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 858) took 1172 ms. Trace:
I20260709 13:07:07.241519 13857 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:07.241871 13830 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:07.242722 16548 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:07.243052 16360 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:06.581643 13756 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45134 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2105)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1628)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1642)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1636)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1640)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1633)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1641)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2107)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1626)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1629)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1627)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 691)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1630)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 699)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2106)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1635)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2116)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2111)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2110)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2101)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2112)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2108)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2113)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 702)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1643)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1645)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2114)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 689)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 693)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 692)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2117)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1638)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1624)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2103)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1631)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1632)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1634)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1637)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1639)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 690)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 694)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 695)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 696)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 697)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 698)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 700)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 701)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2109)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2115)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 703)
I20260709 13:07:07.232810 14402 raft_consensus.cc:1240] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:07.242182 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2574) took 1007 ms. Trace:
I20260709 13:07:07.246591 13862 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:07.104806 16672 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.068055 16695 consensus_queue.cc:260] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:07.090152 16710 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:07.123924 16729 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:07.280316 14401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1013) took 1146 ms. Trace:
I20260709 13:07:07.112320 16746 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:07.280858 14401 rpcz_store.cc:276] 0709 13:07:06.133401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.235157 (+1101756us) service_pool.cc:224] Handling call
0709 13:07:07.274781 (+ 39624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.279872 (+  5091us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.279906 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.279964 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:07.280013 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.280074 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.280223 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.282923 14401 raft_consensus.cc:1240] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:07.078199 16761 consensus_queue.cc:260] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:07.284817 16761 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.285729 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:07.136731 16790 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:07.070318 16791 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.250082 13857 rpcz_store.cc:276] 0709 13:07:06.234828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.240660 (+1005832us) service_pool.cc:224] Handling call
0709 13:07:07.241080 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.241940 (+   860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.242118 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.104041 16843 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:07.096256 16844 consensus_queue.cc:237] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:07.322556 16514 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:07.324229 13785 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2094) took 2893 ms (client timeout 1740 ms). Trace:
W20260709 13:07:07.324783 13785 rpcz_store.cc:269] 0709 13:07:04.430946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.431505 (+   559us) service_pool.cc:224] Handling call
0709 13:07:07.323608 (+2892103us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b54000ec9d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:07.323861 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1235114368}
I20260709 13:07:07.325577 16514 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:07.076516 16847 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:07.043859 16851 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:07:07.329939 13829 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:07.241530 14400 rpcz_store.cc:276] 0709 13:07:06.068662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.215385 (+1146723us) service_pool.cc:224] Handling call
0709 13:07:07.239912 (+ 24527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.240843 (+   931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.241065 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:07.331981 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.195515 13863 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:07:07.333426 13863 pending_rounds.cc:85] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 6
I20260709 13:07:07.332923 16851 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:07.333845 13863 pending_rounds.cc:107] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:07:07.333899 16851 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.334184 13863 raft_consensus.cc:2889] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:07.334335 16851 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.335565 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2561) took 1104 ms. Trace:
I20260709 13:07:07.335935 13863 rpcz_store.cc:276] 0709 13:07:06.231640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.194318 (+962678us) service_pool.cc:224] Handling call
0709 13:07:07.194784 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.335263 (+140479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.335480 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.337102 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:07.337747 13863 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.258656 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1011) took 1125 ms. Trace:
I20260709 13:07:07.339761 14402 rpcz_store.cc:276] 0709 13:07:06.132844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.232010 (+1099166us) service_pool.cc:224] Handling call
0709 13:07:07.232458 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.256802 (+ 24344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.258584 (+  1782us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.244953 13830 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:07.251214 16646 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:07.340997 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 96312.1us
W20260709 13:07:07.268186 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 85385.9us
I20260709 13:07:07.243692 16360 raft_consensus.cc:697] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:07.243615 16548 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.256599 16640 raft_consensus.cc:697] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 8 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:07.277951 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:07.278836 16695 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.281608 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:07.277815 16744 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.349766 16744 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:07.332912 16790 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:07.291265 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:07.351718 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:07.243353 13755 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:48928 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1636)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1640)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1633)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1641)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2107)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1626)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1629)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1627)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 691)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1630)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 699)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2106)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1635)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2116)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2111)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2110)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2101)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2112)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2108)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2113)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 702)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1643)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1645)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2114)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 689)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 693)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 692)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2117)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1638)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1624)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2103)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1631)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1632)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1634)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1637)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1639)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 690)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 694)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 695)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 696)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 697)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 698)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 700)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 701)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2109)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2115)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 703)
I20260709 13:07:07.352375 13714 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:07:07.352494 13861 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.353456 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:07.354498 13714 raft_consensus.cc:2393] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 6: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:07.275005 16550 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.346596 16548 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:07.359640 16514 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:07.300968 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2316) took 3183 ms. Trace:
I20260709 13:07:07.360607 16640 consensus_queue.cc:237] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:07.361073 13710 rpcz_store.cc:276] 0709 13:07:04.115350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.167231 (+3051881us) service_pool.cc:224] Handling call
0709 13:07:07.168142 (+   911us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.290614 (+122472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.298261 (+  7647us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.300217 16746 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:07.318643 16694 consensus_queue.cc:1059] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:07:07.362872 16694 consensus_queue.cc:1243] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer b5029654a4384e43a68eb67b794949b7 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:07.363518 16694 raft_consensus.cc:3055] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:07.363889 16694 raft_consensus.cc:740] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:07.365063 16694 consensus_queue.cc:260] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:07.260849 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2573) took 1022 ms. Trace:
I20260709 13:07:07.366102 13862 rpcz_store.cc:276] 0709 13:07:06.234559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.221384 (+986825us) service_pool.cc:224] Handling call
0709 13:07:07.221900 (+   516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.250244 (+ 28344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.256750 (+  6506us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.366644 16694 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:07.340049 16791 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.367174 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:07.367383 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:07.368057 13862 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.341904 13830 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:07.344619 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:07.371179 13711 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:07:07.371886 13830 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:07.372135 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:07.372605 16843 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:07.373028 16843 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.373085 13830 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:07.343195 16526 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:07.348171 16360 consensus_queue.cc:237] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:07.374123 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:07.375217 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:07.375732 16710 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:07.301405 13682 leader_election.cc:336] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 2.152s (SENT)
I20260709 13:07:07.365561 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:07.375051 16542 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:07.365010 13708 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
I20260709 13:07:07.348928 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:07.353554 16744 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:07.373409 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:07.331269 13829 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:07.389736 16542 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.373476 16843 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.392689 13708 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:07.437163 13860 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.438506 13857 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.391382 16729 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:07.450436 13711 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:07:07.391908 16542 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.457813 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:07.471915 13714 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:07:07.472427 13714 pending_rounds.cc:85] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 6
I20260709 13:07:07.472724 13714 pending_rounds.cc:107] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:07:07.472988 13714 raft_consensus.cc:2889] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:07.481837 16840 log.cc:927] Time spent T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.744s	user 0.007s	sys 0.000s
I20260709 13:07:07.483723 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2319) took 1035 ms. Trace:
I20260709 13:07:07.484162 13714 rpcz_store.cc:276] 0709 13:07:06.447827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.355339 (+907512us) service_pool.cc:224] Handling call
0709 13:07:07.441073 (+ 85734us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.478292 (+ 37219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.483629 (+  5337us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.484849 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1858) took 1051 ms. Trace:
I20260709 13:07:07.485270 13716 rpcz_store.cc:276] 0709 13:07:06.433394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.765265 (+331871us) service_pool.cc:224] Handling call
0709 13:07:07.484552 (+719287us) spinlock_profiling.cc:243] Waited 68.4 ms on lock 0x7b54000c6a54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:07.484693 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157431040}
I20260709 13:07:07.486986 13716 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:07:07.488816 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 115894us
W20260709 13:07:07.489261 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 217108us
I20260709 13:07:07.490729 13830 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:07.491353 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 222432us
I20260709 13:07:07.452895 16710 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:07.505286 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 174172us
I20260709 13:07:07.487802 16729 raft_consensus.cc:697] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:07.521028 13830 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:07.521759 13716 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:07.523844 14399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1002) took 1469 ms. Trace:
I20260709 13:07:07.524266 14399 rpcz_store.cc:276] 0709 13:07:06.054153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.091385 (+1037232us) service_pool.cc:224] Handling call
0709 13:07:07.091911 (+   526us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.092373 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.092413 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:07.093197 (+   784us) log.cc:844] Serialized 26 byte log entry
0709 13:07:07.391447 (+298250us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:07.391535 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.391629 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:07.523478 (+131849us) raft_consensus.cc:1685] finished
0709 13:07:07.523499 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.523641 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":927,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":959,"spinlock_wait_cycles":1535360,"thread_start_us":294723,"threads_started":1,"wal-append.queue_time_us":408841}
I20260709 13:07:07.525178 16646 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:07.526510 14393 raft_consensus.cc:1240] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:07:07.528513 16710 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:07.528327 16618 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:07.529054 16710 raft_consensus.cc:697] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:07.530164 16710 consensus_queue.cc:237] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:07.530704 16618 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:07.532878 14394 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
W20260709 13:07:07.534710 13829 leader_election.cc:336] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.504s (SENT)
I20260709 13:07:07.537627 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:07.524289 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:07.541715 16470 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:07.542071 13712 raft_consensus.cc:1240] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:07.542168 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:07.542914 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2332) took 1044 ms. Trace:
I20260709 13:07:07.543371 13712 rpcz_store.cc:276] 0709 13:07:06.498477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.407230 (+908753us) service_pool.cc:224] Handling call
0709 13:07:07.436926 (+ 29696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.542650 (+105724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.542850 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.544734 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:07.546000 13709 raft_consensus.cc:1240] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:07.547933 13680 leader_election.cc:336] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:48928 dropped due to backpressure: service queue is full with 50 items
I20260709 13:07:07.548465 14401 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:07.547374 13860 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:07:07.578384 16547 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:07.579444 16631 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.579537 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 856) took 1512 ms. Trace:
W20260709 13:07:07.580760 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.581537 16729 consensus_queue.cc:237] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:07.582963 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:07.587505 13863 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:07:07.589905 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:07.590636 16470 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:07.592574 13611 catalog_manager.cc:5697] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 4 to 6, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 6 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:07:07.594158 16861 log.cc:927] Time spent T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 13:07:07.595474 13715 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:07.598320 13790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2105) took 2677 ms (client timeout 2177 ms). Trace:
I20260709 13:07:07.599561 13708 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:07.628026 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2333) took 1129 ms. Trace:
I20260709 13:07:07.627898 13857 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:07:07.600039 16638 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:07.600275 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:07.601440 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 669) took 6864 ms. Trace:
W20260709 13:07:07.602785 13783 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2099) took 2909 ms (client timeout 2228 ms). Trace:
W20260709 13:07:07.603559 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.603698 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.603998 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.603883 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 2570) took 1370 ms. Trace:
W20260709 13:07:07.604260 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 152678us
I20260709 13:07:07.604343 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:07.606945 16646 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:07.627652 13790 rpcz_store.cc:269] 0709 13:07:04.921212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.597994 (+2676782us) service_pool.cc:211] Skipping call since client already timed out
0709 13:07:07.598137 (+   143us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:07:07.607504 16855 consensus_queue.cc:1059] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 13:07:07.607138 13862 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
W20260709 13:07:07.611651 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 63750.9us
I20260709 13:07:07.642695 13707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 628) took 1211 ms. Trace:
I20260709 13:07:07.628515 13708 rpcz_store.cc:276] 0709 13:07:06.498698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.449957 (+951259us) service_pool.cc:224] Handling call
0709 13:07:07.516144 (+ 66187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.627772 (+111628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.627969 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.637050 13864 rpcz_store.cc:276] 0709 13:07:06.233781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.983336 (+749555us) service_pool.cc:224] Handling call
0709 13:07:07.603554 (+620218us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b540004b854. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:07.603713 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24691072}
I20260709 13:07:07.634537 13709 raft_consensus.cc:2376] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10. Re-sending same reply.
I20260709 13:07:07.611366 14393 rpcz_store.cc:276] 0709 13:07:06.067266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.202300 (+1135034us) service_pool.cc:224] Handling call
0709 13:07:07.526079 (+323779us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.526899 (+   820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.579122 (+ 52223us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b5400147150. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:07.579339 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":742391168}
I20260709 13:07:07.648522 16654 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:07.651755 13859 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:07.651911 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.634667 13791 rpcz_store.cc:276] 0709 13:07:00.736827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.495259 (+758432us) service_pool.cc:224] Handling call
0709 13:07:06.278272 (+4783013us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.703664 (+425392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.919728 (+216064us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b5400161f54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:07.601057 (+681329us) spinlock_profiling.cc:243] Waited 4.78 s on lock 0x7b5400161f50. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:07.601249 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11707246336}
W20260709 13:07:07.635530 13783 rpcz_store.cc:269] 0709 13:07:04.693635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.693740 (+   105us) service_pool.cc:224] Handling call
0709 13:07:06.315778 (+1622038us) spinlock_profiling.cc:243] Waited 94.7 ms on lock 0x7b580001c598. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:07:07.602446 (+1286668us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b5400371754. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:07.602615 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1881406592}
I20260709 13:07:07.662820 13863 raft_consensus.cc:1240] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:07.645408 13707 rpcz_store.cc:276] 0709 13:07:06.423844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.174686 (+750842us) service_pool.cc:224] Handling call
0709 13:07:07.175281 (+   595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.182653 (+  7372us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:07.403139 (+220486us) log.cc:844] Serialized 14 byte log entry
0709 13:07:07.635045 (+231906us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.635094 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:07.635138 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.635199 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.635303 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":109711,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":6128,"raft.queue_time_us":30930,"thread_start_us":334446,"threads_started":2}
W20260709 13:07:07.664319 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.665980 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 671) took 1150 ms. Trace:
I20260709 13:07:07.666419 13863 rpcz_store.cc:276] 0709 13:07:06.512648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.652285 (+1139637us) service_pool.cc:224] Handling call
0709 13:07:07.662617 (+ 10332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.663260 (+   643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.663448 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.667315 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:07.667814 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 140789us
I20260709 13:07:07.666147 14399 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:07:07.671790 13785 raft_consensus.cc:2410] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:07:07.672744 13858 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1929) took 3352 ms (client timeout 2152 ms). Trace:
W20260709 13:07:07.673291 13858 rpcz_store.cc:269] 0709 13:07:04.319702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.457845 (+2138143us) service_pool.cc:224] Handling call
0709 13:07:07.665431 (+1207586us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b54003dc7d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:07.672509 (+  7078us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58582272}
I20260709 13:07:07.673805 13611 catalog_manager.cc:5697] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:07.675459 13789 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1642) took 1618 ms (client timeout 1504 ms). Trace:
I20260709 13:07:07.675575 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:07.675964 13789 rpcz_store.cc:269] 0709 13:07:06.057185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.675014 (+1617829us) service_pool.cc:211] Skipping call since client already timed out
0709 13:07:07.675193 (+   179us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:07:07.676978 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:07.677623 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2578) took 1173 ms. Trace:
I20260709 13:07:07.658787 16547 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:07.678005 13864 rpcz_store.cc:276] 0709 13:07:06.504022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.653374 (+1149352us) service_pool.cc:224] Handling call
0709 13:07:07.677062 (+ 23688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.677239 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.677289 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.677341 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:07.677380 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.677448 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.677545 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.679275 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:07.677953 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:07.666042 13788 raft_consensus.cc:2376] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4. Re-sending same reply.
I20260709 13:07:07.687435 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 631) took 1250 ms. Trace:
W20260709 13:07:07.690816 13785 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1641) took 1624 ms (client timeout 1642 ms). Trace:
I20260709 13:07:07.640378 16791 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:07.693416 13788 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2107) took 1592 ms (client timeout 1699 ms). Trace:
W20260709 13:07:07.691282 13785 rpcz_store.cc:269] 0709 13:07:06.056867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.627247 (+1570380us) service_pool.cc:224] Handling call
0709 13:07:07.681434 (+ 54187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.698702 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 670) took 1217 ms. Trace:
I20260709 13:07:07.699081 13862 rpcz_store.cc:276] 0709 13:07:06.481343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.652108 (+1170765us) service_pool.cc:224] Handling call
0709 13:07:07.670955 (+ 18847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.698382 (+ 27427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.698411 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.698453 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:07.698489 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.698546 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.698652 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:07.696749 13788 rpcz_store.cc:269] 0709 13:07:06.092002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.508576 (+1416574us) service_pool.cc:224] Handling call
0709 13:07:07.683807 (+175231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.695173 14397 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:07:07.688056 13713 rpcz_store.cc:276] 0709 13:07:06.437018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.194205 (+757187us) service_pool.cc:224] Handling call
0709 13:07:07.194760 (+   555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.195319 (+   559us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:07.535248 (+339929us) log.cc:844] Serialized 14 byte log entry
0709 13:07:07.669868 (+134620us) log.cc:844] Serialized 14 byte log entry
0709 13:07:07.686964 (+ 17096us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.687026 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:07.687104 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.687190 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.687334 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":80441,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":93,"thread_start_us":285469,"threads_started":2}
W20260709 13:07:07.725729 13786 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1636) took 1638 ms (client timeout 1594 ms). Trace:
I20260709 13:07:07.706555 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:07.658744 16631 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:07.729082 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.729147 13757 leader_election.cc:304] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:07.729664 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:07.707872 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:07.726351 13786 rpcz_store.cc:269] 0709 13:07:06.043597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.666745 (+1623148us) service_pool.cc:211] Skipping call since client already timed out
0709 13:07:07.682384 (+ 15639us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:07:07.688817 16640 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.734315 13784 raft_consensus.cc:2393] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 9: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
W20260709 13:07:07.735350 13783 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1629) took 1786 ms (client timeout 1993 ms). Trace:
W20260709 13:07:07.736953 13783 rpcz_store.cc:269] 0709 13:07:05.948790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.657701 (+1708911us) service_pool.cc:224] Handling call
0709 13:07:07.735288 (+ 77587us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.738055 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:07.738956 13785 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:07:06.622881 13754 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:48914 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1628)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1642)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1636)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1640)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1633)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1641)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2107)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1626)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1629)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1627)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 691)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1630)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 699)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2106)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1635)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2116)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2111)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2110)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2101)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2112)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2108)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2113)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 702)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1643)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1645)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2114)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 689)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 693)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 692)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2117)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1638)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1624)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2103)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1631)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1632)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1634)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1637)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1639)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 690)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 694)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 695)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 696)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 697)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 698)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 700)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 701)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2109)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2115)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 703)
I20260709 13:07:07.738133 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:07.763904 13863 raft_consensus.cc:1240] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:07.748562 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 65404.8us
I20260709 13:07:07.776381 13861 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
I20260709 13:07:07.744050 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:07:07.739589 13785 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1630) took 1701 ms (client timeout 2053 ms). Trace:
W20260709 13:07:07.778354 13785 rpcz_store.cc:269] 0709 13:07:06.038145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.704084 (+1665939us) service_pool.cc:224] Handling call
0709 13:07:07.739492 (+ 35408us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.759781 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:07.767107 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:07:07.764228 13790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1626) took 1816 ms (client timeout 1899 ms). Trace:
W20260709 13:07:07.779875 13790 rpcz_store.cc:269] 0709 13:07:05.948051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.656676 (+1708625us) service_pool.cc:224] Handling call
0709 13:07:07.764167 (+107491us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.743502 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:07.780836 13858 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:07.776492 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 675) took 1231 ms. Trace:
I20260709 13:07:07.781476 13863 rpcz_store.cc:276] 0709 13:07:06.545053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.714224 (+1169171us) service_pool.cc:224] Handling call
0709 13:07:07.763706 (+ 49482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.776262 (+ 12556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.776439 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.782717 13715 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:07:07.748833 13611 catalog_manager.cc:5697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 3 to 4, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 4 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:07.758193 16646 consensus_queue.cc:1059] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:07:07.739317 16791 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:07.785920 13791 raft_consensus.cc:2393] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 5: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
W20260709 13:07:07.786429 13791 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 691) took 1304 ms (client timeout 1569 ms). Trace:
W20260709 13:07:07.786794 13791 rpcz_store.cc:269] 0709 13:07:06.482039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.695518 (+1213479us) service_pool.cc:224] Handling call
0709 13:07:07.786363 (+ 90845us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.787492 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:07.787945 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:07.788048 16550 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:07.788384 13783 raft_consensus.cc:2393] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 7: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:07.788617 13791 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:07.788872 13783 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1635) took 1749 ms (client timeout 2112 ms). Trace:
W20260709 13:07:07.789215 13783 rpcz_store.cc:269] 0709 13:07:06.043245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.775146 (+1731901us) service_pool.cc:224] Handling call
0709 13:07:07.788821 (+ 13675us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.790143 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:07.751813 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:07.791103 13783 raft_consensus.cc:2393] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 7: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:07.761487 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:07.791489 16618 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.754216 16655 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:07.791450 13786 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 5: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:07.799902 13859 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:07:07.786909 13611 catalog_manager.cc:5697] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 3 to 4, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 4 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:07.793978 13757 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:07.758049 14367 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:07.792753 13856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2565) took 1543 ms. Trace:
I20260709 13:07:07.821514 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:07.796955 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:07.822425 13863 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 5: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:07.822768 13710 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:07.765461 16640 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:07.815225 13786 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2106) took 1726 ms (client timeout 2023 ms). Trace:
I20260709 13:07:07.824137 14399 raft_consensus.cc:2393] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 7: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:07.800748 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 667) took 1361 ms. Trace:
I20260709 13:07:07.751734 16514 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:07.746264 16631 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:07.800608 13783 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2101) took 2873 ms (client timeout 3336 ms). Trace:
W20260709 13:07:07.830245 13783 rpcz_store.cc:269] 0709 13:07:04.920118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.789829 (+2869711us) service_pool.cc:224] Handling call
0709 13:07:07.793764 (+  3935us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.795493 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 668) took 1350 ms. Trace:
I20260709 13:07:07.832808 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:07.833573 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:07.824286 13786 rpcz_store.cc:269] 0709 13:07:06.088753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.734506 (+1645753us) service_pool.cc:224] Handling call
0709 13:07:07.814273 (+ 79767us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.824877 13864 raft_consensus.cc:1240] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:07.825071 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:07.825342 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:07.837215 13757 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:07.831156 13857 rpcz_store.cc:276] 0709 13:07:06.445056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.647848 (+1202792us) service_pool.cc:224] Handling call
0709 13:07:07.669189 (+ 21341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.669548 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:07.720293 (+ 50745us) log.cc:844] Serialized 14 byte log entry
0709 13:07:07.795144 (+ 74851us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.795196 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:07.795252 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.795318 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.795440 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":82721,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":23309,"raft.queue_time_us":15252,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":23686,"thread_start_us":78967,"threads_started":2,"wal-append.queue_time_us":96650}
I20260709 13:07:07.821939 13856 rpcz_store.cc:276] 0709 13:07:06.232659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.202997 (+970338us) service_pool.cc:224] Handling call
0709 13:07:07.250422 (+ 47425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.266205 (+ 15783us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.266243 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:07.266999 (+   756us) log.cc:844] Serialized 26 byte log entry
0709 13:07:07.496949 (+229950us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:07.496985 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.497056 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:07.767895 (+270839us) raft_consensus.cc:1685] finished
0709 13:07:07.767917 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.776050 (+  8133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1261,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":191,"thread_start_us":229462,"threads_started":1,"wal-append.queue_time_us":458289}
W20260709 13:07:07.835462 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 147007us
I20260709 13:07:07.914577 13790 raft_consensus.cc:2393] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 5: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
W20260709 13:07:07.918500 13790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2111) took 1421 ms (client timeout 1740 ms). Trace:
W20260709 13:07:07.918912 13790 rpcz_store.cc:269] 0709 13:07:06.497079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.797722 (+1300643us) service_pool.cc:224] Handling call
0709 13:07:07.918439 (+120717us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.919787 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 673) took 1375 ms. Trace:
I20260709 13:07:07.920145 13864 rpcz_store.cc:276] 0709 13:07:06.544454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.688763 (+1144309us) service_pool.cc:224] Handling call
0709 13:07:07.768148 (+ 79385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.914718 (+146570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.919734 (+  5016us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.917546 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:07.779670 16542 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:07.925424 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:07.828075 16514 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.824695 13865 rpcz_store.cc:276] 0709 13:07:06.439003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.608041 (+1169038us) service_pool.cc:224] Handling call
0709 13:07:07.608512 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.608849 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:07.681118 (+ 72269us) log.cc:844] Serialized 14 byte log entry
0709 13:07:07.800166 (+119048us) log.cc:844] Serialized 14 byte log entry
0709 13:07:07.800417 (+   251us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.800466 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:07.800518 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.800583 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.800685 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":144806,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":76,"raft.queue_time_us":2232,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":13137,"spinlock_wait_cycles":38643456,"thread_start_us":146186,"threads_started":2}
I20260709 13:07:07.755752 16851 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:07.927819 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 90679.1us
I20260709 13:07:07.929916 13757 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:07:07.931630 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 173713us
I20260709 13:07:07.942876 16550 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:07.943168 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:07.943950 13861 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:07:07.931344 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:07.949210 13791 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
W20260709 13:07:07.949694 13791 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2110) took 1453 ms (client timeout 1748 ms). Trace:
W20260709 13:07:07.949982 13791 rpcz_store.cc:269] 0709 13:07:06.496764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.787562 (+1290798us) service_pool.cc:224] Handling call
0709 13:07:07.949649 (+162087us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.950636 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:07.923777 16655 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:07.918615 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:07.953433 13864 raft_consensus.cc:2393] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 8: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:07.829028 16618 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:07.955739 13857 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.932845 16514 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:07.943572 16550 raft_consensus.cc:697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:07.958685 13863 raft_consensus.cc:1240] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:07.953428 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:07.959333 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 676) took 1206 ms. Trace:
I20260709 13:07:07.959859 13790 raft_consensus.cc:2410] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:07.959757 13863 rpcz_store.cc:276] 0709 13:07:06.752568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.927609 (+1175041us) service_pool.cc:224] Handling call
0709 13:07:07.958528 (+ 30919us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.959112 (+   584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.959284 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.958447 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:07.964854 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:07.966826 13757 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:07:07.967892 13790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2113) took 1470 ms (client timeout 1813 ms). Trace:
W20260709 13:07:07.968330 13790 rpcz_store.cc:269] 0709 13:07:06.497581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.919569 (+1421988us) service_pool.cc:224] Handling call
0709 13:07:07.967823 (+ 48254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.964444 13783 raft_consensus.cc:2376] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6. Re-sending same reply.
W20260709 13:07:07.969929 13783 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2112) took 1472 ms (client timeout 1795 ms). Trace:
I20260709 13:07:07.970327 13785 raft_consensus.cc:2410] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:07:07.970283 13783 rpcz_store.cc:269] 0709 13:07:06.497337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.918870 (+1421533us) service_pool.cc:224] Handling call
0709 13:07:07.969868 (+ 50998us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.971031 13791 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:07.971881 13680 leader_election.cc:336] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.699s (SENT)
I20260709 13:07:07.969696 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:07.974437 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 716) took 3613 ms. Trace:
I20260709 13:07:07.975754 14393 raft_consensus.cc:1275] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:07.961913 16694 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:07.982381 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 65701us
I20260709 13:07:07.956146 16655 raft_consensus.cc:697] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:07:07.980419 13786 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2108) took 1876 ms (client timeout 2205 ms). Trace:
I20260709 13:07:07.986614 13862 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:07.986629 13786 rpcz_store.cc:269] 0709 13:07:06.103778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.916576 (+1812798us) service_pool.cc:224] Handling call
0709 13:07:07.980358 (+ 63782us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.980532 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:07.974805 14398 rpcz_store.cc:276] 0709 13:07:04.167360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.067977 (+2900617us) service_pool.cc:224] Handling call
0709 13:07:07.068281 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.491539 (+423258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.495443 (+  3904us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:07.528414 (+ 32971us) log.cc:844] Serialized 26 byte log entry
0709 13:07:07.628217 (+ 99803us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:07.698225 (+ 70008us) log.cc:844] Serialized 14 byte log entry
0709 13:07:07.699282 (+  1057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.704254 (+  4972us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:07.767787 (+ 63533us) raft_consensus.cc:1685] finished
0709 13:07:07.767805 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.780653 (+ 12848us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":749,"prepare.queue_time_us":102179,"prepare.run_cpu_time_us":181,"prepare.run_wall_time_us":175,"raft.queue_time_us":4052,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":41247,"spinlock_wait_cycles":1543040,"thread_start_us":125852,"threads_started":2,"wal-append.queue_time_us":133622}
I20260709 13:07:07.981678 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:07.972803 13611 catalog_manager.cc:5697] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:07.992038 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:07.993796 14367 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:07:07.996285 16886 log.cc:927] Time spent T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:07:07.997042 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:08.003357 13713 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.006839 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:08.007864 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:08.011266 13790 raft_consensus.cc:2410] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:07:08.014379 13783 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1645) took 1440 ms (client timeout 1899 ms). Trace:
W20260709 13:07:08.014866 13783 rpcz_store.cc:269] 0709 13:07:06.573666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.982612 (+1408946us) service_pool.cc:224] Handling call
0709 13:07:08.014311 (+ 31699us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:07.994992 16548 consensus_meta.cc:287] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.004s
I20260709 13:07:08.017899 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:08.019241 16697 consensus_queue.cc:260] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:08.021095 16697 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.025583 16631 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:08.025377 13790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1643) took 1512 ms (client timeout 1920 ms). Trace:
W20260709 13:07:08.032250 13790 rpcz_store.cc:269] 0709 13:07:06.512572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.973863 (+1461291us) service_pool.cc:224] Handling call
0709 13:07:08.024447 (+ 50584us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.013592 13611 catalog_manager.cc:5697] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 6 to 7, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 7 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:07.991852 16694 raft_consensus.cc:697] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:07:08.035003 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 65187.2us
W20260709 13:07:08.034938 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 52455.1us
W20260709 13:07:08.036924 13786 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2114) took 1539 ms (client timeout 1978 ms). Trace:
W20260709 13:07:08.046391 13786 rpcz_store.cc:269] 0709 13:07:06.498444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.987576 (+1489132us) service_pool.cc:224] Handling call
0709 13:07:08.036708 (+ 49132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.037254 13863 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 2.
I20260709 13:07:08.041039 16655 consensus_queue.cc:237] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:08.035346 16548 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:08.044209 16640 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:08.047725 16550 consensus_queue.cc:237] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:08.048470 16882 log.cc:927] Time spent T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:07:08.048424 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:08.049011 16761 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:08.049685 13611 catalog_manager.cc:5697] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 1 to 3, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 3 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:08.082221 13713 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:07:09.297113 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2345) took 1300 ms. Trace:
I20260709 13:07:09.297539 13713 rpcz_store.cc:276] 0709 13:07:07.996538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.996704 (+   166us) service_pool.cc:224] Handling call
0709 13:07:09.297012 (+1300308us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.072786 13755 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:08.090721 13757 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:08.099924 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:09.353245 13786 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 693) took 2870 ms (client timeout 2129 ms). Trace:
W20260709 13:07:09.353631 13786 rpcz_store.cc:269] 0709 13:07:06.482599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.056516 (+1573917us) service_pool.cc:224] Handling call
0709 13:07:09.353171 (+1296655us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:09.354624 13786 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2117) took 2794 ms (client timeout 2228 ms). Trace:
I20260709 13:07:08.091944 13788 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
W20260709 13:07:09.357268 13788 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 699) took 2871 ms (client timeout 1619 ms). Trace:
W20260709 13:07:09.357731 13788 rpcz_store.cc:269] 0709 13:07:06.485489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.705254 (+1219765us) service_pool.cc:224] Handling call
0709 13:07:09.357179 (+1651925us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:09.358721 13788 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1638) took 3303 ms (client timeout 3144 ms). Trace:
I20260709 13:07:09.359616 16697 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:08.094204 13787 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1640) took 2037 ms (client timeout 1590 ms). Trace:
W20260709 13:07:08.098464 13790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 689) took 1617 ms (client timeout 2006 ms). Trace:
W20260709 13:07:09.362766 13786 rpcz_store.cc:269] 0709 13:07:06.560132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.354439 (+2794307us) service_pool.cc:211] Skipping call since client already timed out
0709 13:07:09.354552 (+   113us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:07:09.362848 13790 rpcz_store.cc:269] 0709 13:07:06.481417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.048123 (+1566706us) service_pool.cc:224] Handling call
0709 13:07:08.098414 (+ 50291us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:08.089967 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 44211us
I20260709 13:07:08.095162 13857 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:07:09.367139 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1938) took 1452 ms. Trace:
I20260709 13:07:09.367652 13857 rpcz_store.cc:276] 0709 13:07:07.915268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.929976 (+ 14708us) service_pool.cc:224] Handling call
0709 13:07:09.367063 (+1437087us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.368906 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:09.369844 13857 raft_consensus.cc:2393] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 10: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:07:09.370332 13857 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1942) took 1366 ms (client timeout 1813 ms). Trace:
W20260709 13:07:09.370731 13857 rpcz_store.cc:269] 0709 13:07:08.004617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.368594 (+1363977us) service_pool.cc:224] Handling call
0709 13:07:09.370245 (+  1651us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.097883 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:09.372542 13863 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1943) took 1317 ms (client timeout 1567 ms). Trace:
W20260709 13:07:09.372972 13863 rpcz_store.cc:269] 0709 13:07:08.055248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.087850 (+ 32602us) service_pool.cc:224] Handling call
0709 13:07:09.372474 (+1284624us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.373980 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:09.374768 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1945) took 1297 ms. Trace:
I20260709 13:07:09.375042 13863 rpcz_store.cc:276] 0709 13:07:08.076949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.373671 (+1296722us) service_pool.cc:224] Handling call
0709 13:07:09.374720 (+  1049us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.248169 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 672) took 1721 ms. Trace:
W20260709 13:07:08.293008 13785 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2116) took 1762 ms (client timeout 1672 ms). Trace:
I20260709 13:07:08.323102 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 683) took 1556 ms. Trace:
W20260709 13:07:08.338656 13784 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1633) took 2299 ms (client timeout 1644 ms). Trace:
W20260709 13:07:08.183209 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 82354.8us
I20260709 13:07:09.378155 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:08.220932 14368 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:07:09.376938 13784 rpcz_store.cc:269] 0709 13:07:06.039008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.665665 (+1626657us) service_pool.cc:224] Handling call
0709 13:07:08.338389 (+672724us) spinlock_profiling.cc:243] Waited 50.5 ms on lock 0x7b54003bd154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:08.338531 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116241664}
W20260709 13:07:08.194269 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.382293 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.164134 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:08.189582 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:08.076530 16542 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:08.112875 16548 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:08.095360 16640 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.389330 16640 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:09.390357 13863 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.136215 16514 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:09.394224 16514 leader_election.cc:290] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:08.075271 16694 consensus_queue.cc:237] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:08.074133 16761 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:09.400148 16761 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.012068 16791 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:09.408617 16791 raft_consensus.cc:697] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:09.409536 16791 consensus_queue.cc:237] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:08.173623 16812 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:08.045338 16843 consensus_meta.cc:287] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.584s	user 0.010s	sys 0.000s
I20260709 13:07:08.105427 16851 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:08.353767 13756 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:09.417924 16514 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:09.418154 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 1.06437e+06us
I20260709 13:07:09.418996 13756 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:07:08.596454 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.641664 16889 consensus_queue.cc:1059] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:09.122115 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 1.16308e+06us
I20260709 13:07:09.420763 16889 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:09.421301 16889 raft_consensus.cc:697] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:09.421931 16548 raft_consensus.cc:3055] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:09.122321 13611 catalog_manager.cc:5697] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 7 to 10, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 10 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:09.422356 16548 raft_consensus.cc:740] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:09.422287 16889 consensus_queue.cc:237] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:09.425112 13756 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:09.150679 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:09.148590 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:07:09.153641 16887 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 1.144s	user 0.012s	sys 0.000s
I20260709 13:07:09.427716 13715 raft_consensus.cc:2376] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5. Re-sending same reply.
I20260709 13:07:09.428232 13715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2346) took 1429 ms. Trace:
I20260709 13:07:09.428586 13715 rpcz_store.cc:276] 0709 13:07:07.998438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.148292 (+1149854us) service_pool.cc:224] Handling call
0709 13:07:09.428161 (+279869us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.171327 16470 raft_consensus.cc:3055] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:09.429657 16470 raft_consensus.cc:740] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:09.430868 16470 consensus_queue.cc:260] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:09.432301 16470 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:09.181900 13861 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.094s	user 0.012s	sys 0.051s
W20260709 13:07:09.435801 13861 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.348s	user 0.014s	sys 0.052s
I20260709 13:07:09.436805 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2590) took 2246 ms. Trace:
I20260709 13:07:09.437225 13861 rpcz_store.cc:276] 0709 13:07:07.197263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.944684 (+747421us) service_pool.cc:224] Handling call
0709 13:07:07.951734 (+  7050us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.986481 (+ 34747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.986513 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.008732 (+ 22219us) log.cc:844] Serialized 26 byte log entry
0709 13:07:09.436344 (+1427612us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:09.436402 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.436495 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:09.436552 (+    57us) raft_consensus.cc:1685] finished
0709 13:07:09.436570 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.436734 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7887,"raft.queue_time_us":3744,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":4957,"thread_start_us":1348143,"threads_started":1,"wal-append.queue_time_us":147767,"wal-append.run_cpu_time_us":2130,"wal-append.run_wall_time_us":1002138}
I20260709 13:07:09.189360 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:09.205892 16847 raft_consensus.cc:3055] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:09.439769 16847 raft_consensus.cc:740] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:09.439987 13859 raft_consensus.cc:2393] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 9: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:07:09.440562 13859 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 2600) took 1651 ms (client timeout 1880 ms). Trace:
I20260709 13:07:09.440742 16847 consensus_queue.cc:260] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:09.440960 13859 rpcz_store.cc:269] 0709 13:07:07.789169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.828217 (+ 39048us) service_pool.cc:224] Handling call
0709 13:07:09.189215 (+1360998us) spinlock_profiling.cc:243] Waited 6.57 ms on lock 0x7b5800021698. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:07:09.440505 (+251290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15119744}
I20260709 13:07:09.193392 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1933) took 1428 ms. Trace:
I20260709 13:07:09.442205 16847 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.442117 13864 rpcz_store.cc:276] 0709 13:07:07.764762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.925208 (+160446us) service_pool.cc:224] Handling call
0709 13:07:09.193151 (+1267943us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b540004a954. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:09.193320 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60462464}
I20260709 13:07:09.443567 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:09.444569 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1948) took 1366 ms. Trace:
I20260709 13:07:09.444998 13864 rpcz_store.cc:276] 0709 13:07:08.077926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.443234 (+1365308us) service_pool.cc:224] Handling call
0709 13:07:09.444483 (+  1249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.100306 13830 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:09.448925 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 1.35293e+06us
I20260709 13:07:09.449966 13830 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:09.239530 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2321) took 2791 ms. Trace:
I20260709 13:07:09.451568 13710 rpcz_store.cc:276] 0709 13:07:06.448404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.361946 (+913542us) service_pool.cc:224] Handling call
0709 13:07:07.362361 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.823157 (+460796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.239182 (+1416025us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b5400260554. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:09.239440 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1058226944}
I20260709 13:07:09.452227 16729 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:09.452797 16851 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:09.453374 16851 raft_consensus.cc:697] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:09.454355 16851 consensus_queue.cc:237] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:09.244699 16646 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:09.260385 16888 log.cc:927] Time spent T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 1.226s	user 0.003s	sys 0.042s
I20260709 13:07:09.456003 16646 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:09.458487 16646 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:09.280112 13791 consensus_meta.cc:287] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 1.298s	user 0.016s	sys 0.010s
I20260709 13:07:09.282894 13682 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:09.459194 13791 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:09.283733 16830 consensus_queue.cc:1059] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:07:09.459703 13791 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 702) took 2973 ms (client timeout 1903 ms). Trace:
I20260709 13:07:09.460143 16830 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:09.460079 13791 rpcz_store.cc:269] 0709 13:07:06.486195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.950395 (+1464200us) service_pool.cc:224] Handling call
0709 13:07:09.459632 (+1509237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.460623 16830 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:09.460971 16830 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:09.461086 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:09.461851 13791 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 709) took 1712 ms (client timeout 2006 ms). Trace:
W20260709 13:07:09.462163 13791 rpcz_store.cc:269] 0709 13:07:07.749275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.460835 (+1711560us) service_pool.cc:224] Handling call
0709 13:07:09.461796 (+   961us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.319895 16638 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:09.462992 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:09.329435 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 634) took 2553 ms. Trace:
W20260709 13:07:09.459728 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 176968us
I20260709 13:07:09.463691 13711 rpcz_store.cc:276] 0709 13:07:06.776185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.493013 (+716828us) service_pool.cc:224] Handling call
0709 13:07:07.610565 (+117552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.675592 (+ 65027us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:07.675996 (+   404us) log.cc:844] Serialized 14 byte log entry
0709 13:07:09.316224 (+1640228us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b18003357a0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f52320864bc 00007f522f3d448b 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e23a
0709 13:07:09.325909 (+  9685us) log.cc:844] Serialized 14 byte log entry
0709 13:07:09.326213 (+   304us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:09.326266 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:09.326327 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.329222 (+  2895us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.329368 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26230,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"raft.queue_time_us":237,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":165,"spinlock_wait_cycles":39502976,"thread_start_us":42435,"threads_started":2,"wal-append.queue_time_us":155266}
I20260709 13:07:09.330936 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:07:09.334447 13783 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 692) took 2852 ms (client timeout 2208 ms). Trace:
W20260709 13:07:09.335835 13782 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1628) took 3387 ms (client timeout 1504 ms). Trace:
I20260709 13:07:09.465682 13707 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:09.336021 16695 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:09.465850 13782 rpcz_store.cc:269] 0709 13:07:05.948530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.285039 (+1336509us) service_pool.cc:224] Handling call
0709 13:07:09.327266 (+2042227us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b54003bcc54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:09.335740 (+  8474us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":852204416}
I20260709 13:07:09.466658 16695 raft_consensus.cc:697] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:09.467303 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:09.468061 13782 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 710) took 1718 ms (client timeout 2129 ms). Trace:
I20260709 13:07:09.467940 16695 consensus_queue.cc:237] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:09.468436 13782 rpcz_store.cc:269] 0709 13:07:07.749689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.467044 (+1717355us) service_pool.cc:224] Handling call
0709 13:07:09.468009 (+   965us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.469349 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:09.470005 13782 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 712) took 1719 ms (client timeout 2146 ms). Trace:
W20260709 13:07:09.470284 13782 rpcz_store.cc:269] 0709 13:07:07.750497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.469104 (+1718607us) service_pool.cc:224] Handling call
0709 13:07:09.469958 (+   854us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:09.336421 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 1.32343e+06us
I20260709 13:07:09.471086 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:09.348608 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:09.483879 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1873) took 1834 ms. Trace:
I20260709 13:07:09.484184 13708 rpcz_store.cc:276] 0709 13:07:07.649771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.348360 (+1698589us) service_pool.cc:224] Handling call
0709 13:07:09.483797 (+135437us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.350791 16618 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:09.352310 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 1.26156e+06us
I20260709 13:07:09.485246 13757 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:09.485562 13707 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:07:09.486404 13757 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:09.481005 16830 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:09.487564 16618 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:09.488368 16830 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:09.354642 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 674) took 2809 ms. Trace:
W20260709 13:07:09.355473 13886 debug-util.cc:398] Leaking SignalData structure 0x7b080017c4c0 after lost signal to thread 12597
W20260709 13:07:09.362139 13787 rpcz_store.cc:269] 0709 13:07:06.056512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.093814 (+2037302us) service_pool.cc:211] Skipping call since client already timed out
0709 13:07:08.093971 (+   157us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:07:09.488905 13862 rpcz_store.cc:276] 0709 13:07:06.544778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.710327 (+1165549us) service_pool.cc:224] Handling call
0709 13:07:07.739846 (+ 29519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.987085 (+247239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.354418 (+1367333us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54002d7dd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:09.354569 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":561685248}
W20260709 13:07:09.489691 13886 debug-util.cc:398] Leaking SignalData structure 0x7b080005d300 after lost signal to thread 13648
W20260709 13:07:09.359020 13788 rpcz_store.cc:269] 0709 13:07:06.055765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.358544 (+3302779us) service_pool.cc:211] Skipping call since client already timed out
0709 13:07:09.358667 (+   123us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:07:09.490222 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:09.490578 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:07:09.490897 13886 debug-util.cc:398] Leaking SignalData structure 0x7b0800036d80 after lost signal to thread 13740
W20260709 13:07:09.491220 13886 debug-util.cc:398] Leaking SignalData structure 0x7b08000ea140 after lost signal to thread 13741
I20260709 13:07:08.219806 13856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 685) took 1272 ms. Trace:
I20260709 13:07:09.491400 13788 raft_consensus.cc:2410] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:07:09.492059 13886 debug-util.cc:398] Leaking SignalData structure 0x7b08002a5c20 after lost signal to thread 13789
W20260709 13:07:09.375959 13790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 708) took 1627 ms (client timeout 1569 ms). Trace:
I20260709 13:07:09.376469 13858 rpcz_store.cc:276] 0709 13:07:06.526964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.674428 (+1147464us) service_pool.cc:224] Handling call
0709 13:07:07.776949 (+102521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.788819 (+ 11870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.247985 (+459166us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54002d8cd0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:08.248112 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234660608}
I20260709 13:07:09.492691 16631 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:09.492959 13886 debug-util.cc:398] Leaking SignalData structure 0x7b0800376160 after lost signal to thread 13815
W20260709 13:07:09.492182 13788 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1624) took 3544 ms (client timeout 4305 ms). Trace:
I20260709 13:07:09.493327 16631 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:09.376863 13865 rpcz_store.cc:276] 0709 13:07:06.767167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.947397 (+1180230us) service_pool.cc:224] Handling call
0709 13:07:07.981505 (+ 34108us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.994693 (+ 13188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.994724 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.034488 (+ 39764us) log.cc:844] Serialized 26 byte log entry
0709 13:07:08.322687 (+288199us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:08.322733 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.322814 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.322864 (+    50us) raft_consensus.cc:1685] finished
0709 13:07:08.322881 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.323033 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11143,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":4988,"thread_start_us":287777,"threads_started":1,"wal-append.queue_time_us":161138,"wal-append.run_cpu_time_us":1804,"wal-append.run_wall_time_us":1001832}
W20260709 13:07:09.378615 14366 connection.cc:256] RPC call timeout handler was delayed by -1.1986557080000466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
I20260709 13:07:09.493642 13858 raft_consensus.cc:1240] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:07:09.494556 14366 connection.cc:256] RPC call timeout handler was delayed by -1.1530454989999726s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
I20260709 13:07:09.494870 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2597) took 2102 ms. Trace:
W20260709 13:07:09.495093 14366 leader_election.cc:336] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.569s (SENT)
I20260709 13:07:09.496793 14366 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:09.380373 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:09.492147 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:09.498647 13784 raft_consensus.cc:2393] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 8: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:09.376221 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:09.499969 13786 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 713) took 1749 ms (client timeout 1737 ms). Trace:
I20260709 13:07:09.384276 14399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 874) took 1557 ms. Trace:
I20260709 13:07:08.101691 16672 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:09.391638 16640 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:09.504490 16640 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:09.504914 16640 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:09.505301 16640 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.415120 16843 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:09.509068 16843 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:09.509656 16843 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:09.510232 16843 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:09.423369 16548 consensus_queue.cc:260] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:09.512063 16548 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:09.515700 13860 raft_consensus.cc:1240] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:09.518646 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2586) took 2791 ms. Trace:
I20260709 13:07:09.173636 16547 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:07:09.515230 16514 consensus_queue.cc:1175] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ceb06175847b428ea8bd77055fcddf58" responder_term: 7 status { last_received { term: 6 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:09.228770 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:09.521008 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 876) took 1576 ms. Trace:
I20260709 13:07:09.521360 14397 rpcz_store.cc:276] 0709 13:07:07.944817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.228422 (+1283605us) service_pool.cc:224] Handling call
0709 13:07:09.520945 (+292523us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:09.214358 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.522469 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.447494 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:09.530048 13861 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:07:09.530517 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1944) took 1454 ms. Trace:
I20260709 13:07:09.518965 13860 rpcz_store.cc:276] 0709 13:07:06.726792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.754845 (+1028053us) service_pool.cc:224] Handling call
0709 13:07:07.755266 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.516142 (+1760876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.518372 (+  2230us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b54003755d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:09.518581 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4047943040}
I20260709 13:07:09.530802 13861 rpcz_store.cc:276] 0709 13:07:08.076426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.447234 (+1370808us) service_pool.cc:224] Handling call
0709 13:07:09.530464 (+ 83230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.455456 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:09.265360 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:09.532135 14394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 875) took 1610 ms (client timeout 1567 ms). Trace:
W20260709 13:07:09.532460 14394 rpcz_store.cc:269] 0709 13:07:07.922184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.265038 (+1342854us) service_pool.cc:224] Handling call
0709 13:07:09.532044 (+267006us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.336905 16844 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:09.533278 16844 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:09.463563 16638 raft_consensus.cc:3055] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:09.535570 16638 raft_consensus.cc:740] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:09.536512 16843 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:09.537055 13864 raft_consensus.cc:2410] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:09.537541 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1949) took 1459 ms. Trace:
I20260709 13:07:09.536559 16638 consensus_queue.cc:260] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:09.539726 16638 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:09.540310 13791 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 715) took 1788 ms (client timeout 2011 ms). Trace:
W20260709 13:07:09.540726 13791 rpcz_store.cc:269] 0709 13:07:07.771912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.462770 (+1690858us) service_pool.cc:224] Handling call
0709 13:07:09.540246 (+ 77476us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.541793 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:09.542405 13791 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:07:09.542850 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 705) took 1795 ms. Trace:
I20260709 13:07:09.544478 16844 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:09.477156 16542 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:09.545368 16542 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:09.547857 16542 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:09.465698 13783 rpcz_store.cc:269] 0709 13:07:06.482340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.333825 (+2851485us) service_pool.cc:211] Skipping call since client already timed out
0709 13:07:09.334357 (+   532us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:07:09.548978 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:09.549571 13783 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:07:09.550523 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:09.551191 13783 raft_consensus.cc:2393] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 6: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:09.478165 13682 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:07:09.551904 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 73844.8us
I20260709 13:07:09.489518 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:08.096844 13789 raft_consensus.cc:2368] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 5. Current term is 6.
W20260709 13:07:09.494096 13886 debug-util.cc:398] Leaking SignalData structure 0x7b08003ec040 after lost signal to thread 13889
I20260709 13:07:09.552809 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 714) took 1801 ms. Trace:
I20260709 13:07:09.553223 13787 rpcz_store.cc:276] 0709 13:07:07.751164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.489255 (+1738091us) service_pool.cc:224] Handling call
0709 13:07:09.552745 (+ 63490us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:09.553975 13789 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1627) took 3605 ms (client timeout 2026 ms). Trace:
I20260709 13:07:09.554086 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:09.376585 13785 rpcz_store.cc:269] 0709 13:07:06.530652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.779189 (+1248537us) service_pool.cc:224] Handling call
0709 13:07:08.292700 (+513511us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54003bc754. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:08.292896 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309286656}
I20260709 13:07:09.495689 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59764 (request call id 82) took 1973 ms. Trace:
W20260709 13:07:09.554374 13789 rpcz_store.cc:269] 0709 13:07:05.948294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.676675 (+1728381us) service_pool.cc:224] Handling call
0709 13:07:09.553797 (+1877122us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b54001e8054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:09.553918 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":961892608}
I20260709 13:07:08.080205 14367 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:09.491616 13856 rpcz_store.cc:276] 0709 13:07:06.947900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.948126 (+1000226us) service_pool.cc:224] Handling call
0709 13:07:07.961206 (+ 13080us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.976738 (+ 15532us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:07.995216 (+ 18478us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.219358 (+224142us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.219448 (+    90us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:08.219503 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.219573 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.219721 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18329,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":42,"raft.queue_time_us":112,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"thread_start_us":186641,"threads_started":1,"wal-append.queue_time_us":188941,"wal-append.run_cpu_time_us":1112,"wal-append.run_wall_time_us":1001135}
I20260709 13:07:09.480970 16729 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:07:09.500509 13786 rpcz_store.cc:269] 0709 13:07:07.750823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.375933 (+1625110us) service_pool.cc:224] Handling call
0709 13:07:09.499891 (+123958us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.383391 14402 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:09.499219 13784 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 707) took 1750 ms (client timeout 1827 ms). Trace:
I20260709 13:07:09.527956 16631 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:09.500591 14399 rpcz_store.cc:276] 0709 13:07:07.826964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.827224 (+   260us) service_pool.cc:224] Handling call
0709 13:07:08.189356 (+362132us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b5800077d98. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:07:09.384186 (+1194830us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10150272}
W20260709 13:07:09.492858 13790 rpcz_store.cc:269] 0709 13:07:07.748910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.375799 (+1626889us) service_pool.cc:211] Skipping call since client already timed out
0709 13:07:09.375904 (+   105us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:07:09.494000 13788 rpcz_store.cc:269] 0709 13:07:05.947475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.490319 (+3542844us) service_pool.cc:224] Handling call
0709 13:07:09.492075 (+  1756us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.519706 16547 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:09.428121 13756 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:09.495203 13858 rpcz_store.cc:276] 0709 13:07:07.393001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.493128 (+2100127us) service_pool.cc:224] Handling call
0709 13:07:09.493434 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.494591 (+  1157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.494822 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.555351 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:09.573939 16729 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:09.574375 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 146324us
W20260709 13:07:09.552886 13886 debug-util.cc:398] Leaking SignalData structure 0x7b0800389700 after lost signal to thread 14367
I20260709 13:07:09.555145 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:09.575382 13785 raft_consensus.cc:2410] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:07:09.575791 13886 debug-util.cc:398] Leaking SignalData structure 0x7b08003bd000 after lost signal to thread 14426
I20260709 13:07:09.576232 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:09.576961 13784 rpcz_store.cc:269] 0709 13:07:07.748550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.380122 (+1631572us) service_pool.cc:224] Handling call
0709 13:07:09.499148 (+119026us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.554860 13865 rpcz_store.cc:276] 0709 13:07:07.522660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.494427 (+1971767us) service_pool.cc:224] Handling call
0709 13:07:09.495607 (+  1180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.500020 13862 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:09.574572 13789 raft_consensus.cc:2410] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:09.480319 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:09.537887 13864 rpcz_store.cc:276] 0709 13:07:08.078215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.445750 (+1367535us) service_pool.cc:224] Handling call
0709 13:07:09.537481 (+ 91731us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.578207 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2599) took 1800 ms. Trace:
I20260709 13:07:09.578552 13862 rpcz_store.cc:276] 0709 13:07:07.778043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.499516 (+1721473us) service_pool.cc:224] Handling call
0709 13:07:09.499840 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.577971 (+ 78131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.578155 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.579638 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 720) took 1589 ms. Trace:
I20260709 13:07:09.579779 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:09.580021 13785 rpcz_store.cc:276] 0709 13:07:07.990184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.575968 (+1585784us) service_pool.cc:224] Handling call
0709 13:07:09.579577 (+  3609us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.580121 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:09.580981 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:09.579283 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 1.35849e+06us
I20260709 13:07:09.544607 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2601) took 1755 ms. Trace:
I20260709 13:07:09.581450 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:09.582355 13789 raft_consensus.cc:2368] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 5. Current term is 6.
I20260709 13:07:09.582553 13783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 706) took 1834 ms. Trace:
I20260709 13:07:09.583473 13783 rpcz_store.cc:276] 0709 13:07:07.748192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.550294 (+1802102us) service_pool.cc:224] Handling call
0709 13:07:09.582487 (+ 32193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.551942 16901 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:09.581655 16547 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:09.586827 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.587255 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:09.543143 13791 rpcz_store.cc:276] 0709 13:07:07.747791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.541509 (+1793718us) service_pool.cc:224] Handling call
0709 13:07:09.542801 (+  1292us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:09.589290 13857 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1947) took 1511 ms (client timeout 1740 ms). Trace:
W20260709 13:07:09.589798 13857 rpcz_store.cc:269] 0709 13:07:08.077632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.480008 (+1402376us) service_pool.cc:224] Handling call
0709 13:07:09.589216 (+109208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.591895 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 686) took 1366 ms. Trace:
I20260709 13:07:09.592374 13864 rpcz_store.cc:276] 0709 13:07:08.225123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.578469 (+1353346us) service_pool.cc:224] Handling call
0709 13:07:09.578741 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.591505 (+ 12764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.591543 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:09.591585 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:09.591615 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.591695 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.591828 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.594509 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 688) took 1368 ms. Trace:
I20260709 13:07:09.582109 13860 rpcz_store.cc:276] 0709 13:07:07.789477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.543709 (+1754232us) service_pool.cc:224] Handling call
0709 13:07:09.544014 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.544272 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.544301 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:09.544348 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:09.544381 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.544432 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.544534 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.607467 13782 raft_consensus.cc:2393] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 11: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:09.608107 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:09.608372 13782 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 711) took 1858 ms (client timeout 2208 ms). Trace:
W20260709 13:07:09.609014 13782 rpcz_store.cc:269] 0709 13:07:07.750071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.470844 (+1720773us) service_pool.cc:224] Handling call
0709 13:07:09.608253 (+137409us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:09.610546 14368 connection.cc:256] RPC call timeout handler was delayed by -1.2688667680000663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
I20260709 13:07:09.628110 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:09.628216 13858 raft_consensus.cc:1240] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:09.630131 16672 raft_consensus.cc:697] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:07:09.632696 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 145526us
I20260709 13:07:09.634382 16911 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:09.636552 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:09.637408 13784 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.639238 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:09.641275 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 1936) took 1826 ms. Trace:
I20260709 13:07:09.641731 13858 rpcz_store.cc:276] 0709 13:07:07.815202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.577270 (+1762068us) service_pool.cc:224] Handling call
0709 13:07:09.628018 (+ 50748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.641018 (+ 13000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.641220 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:09.652150 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 1.57192e+06us
W20260709 13:07:09.652199 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 75080.8us
I20260709 13:07:09.594930 13864 rpcz_store.cc:276] 0709 13:07:08.225805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.593538 (+1367733us) service_pool.cc:224] Handling call
0709 13:07:09.593920 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.594117 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.594150 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:09.594203 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:09.594251 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.594318 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.594444 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.651196 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:09.654887 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 233723us
W20260709 13:07:09.656231 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.661468 16791 consensus_queue.cc:1059] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:09.566567 16844 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:09.654325 13756 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:09.665028 13791 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:07:09.674926 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:09.680275 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:09.681202 13864 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:09.683497 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 210620us
I20260709 13:07:09.686990 13789 raft_consensus.cc:1240] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:09.677699 16631 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.687661 13789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2103) took 4767 ms. Trace:
I20260709 13:07:09.687865 16631 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:09.688707 16844 raft_consensus.cc:697] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:09.687995 13789 rpcz_store.cc:276] 0709 13:07:04.920645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.653971 (+4733326us) service_pool.cc:224] Handling call
0709 13:07:09.686826 (+ 32855us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.687386 (+   560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.687583 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.677455 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:09.587679 16901 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:07:09.719636 13680 connection.cc:256] RPC call timeout handler was delayed by -1.6536378339999374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
W20260709 13:07:09.720289 13680 connection.cc:256] RPC call timeout handler was delayed by -1.6056194850000338s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
W20260709 13:07:09.720672 13680 connection.cc:256] RPC call timeout handler was delayed by -1.6024549269999397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22050000000000003s for a response
I20260709 13:07:09.636062 16618 raft_consensus.cc:697] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:09.698614 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 687) took 1473 ms. Trace:
I20260709 13:07:09.721822 13857 rpcz_store.cc:276] 0709 13:07:08.225395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.590561 (+1365166us) service_pool.cc:224] Handling call
0709 13:07:09.651464 (+ 60903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.665922 (+ 14458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.665949 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:09.678331 (+ 12382us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:09.698372 (+ 20041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.698440 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.698557 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.695317 13862 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:09.723246 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 689) took 1497 ms. Trace:
I20260709 13:07:09.723631 13863 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:07:09.723657 13862 rpcz_store.cc:276] 0709 13:07:08.226042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.638525 (+1412483us) service_pool.cc:224] Handling call
0709 13:07:09.677630 (+ 39105us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.723013 (+ 45383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.723194 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:09.724346 13863 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 1946) took 1647 ms (client timeout 2111 ms). Trace:
W20260709 13:07:09.724731 13863 rpcz_store.cc:269] 0709 13:07:08.077334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.377908 (+1300574us) service_pool.cc:224] Handling call
0709 13:07:09.724269 (+346361us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.728619 13860 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:09.729460 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 690) took 1503 ms. Trace:
I20260709 13:07:09.729857 13860 rpcz_store.cc:276] 0709 13:07:08.226305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.660067 (+1433762us) service_pool.cc:224] Handling call
0709 13:07:09.690732 (+ 30665us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.729139 (+ 38407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.729394 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.730964 14367 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:09.734370 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:07:09.735596 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 369848us
W20260709 13:07:09.745217 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 50026.3us
I20260709 13:07:09.747929 13863 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.653956 16915 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:09.750308 13786 raft_consensus.cc:1240] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:09.753583 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:09.752885 13865 raft_consensus.cc:1275] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:09.655129 16640 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:09.754256 13680 leader_election.cc:336] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.740s (SENT)
I20260709 13:07:09.757994 13786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1631) took 3713 ms. Trace:
I20260709 13:07:09.754179 13708 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:07:09.758400 13786 rpcz_store.cc:276] 0709 13:07:06.038445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.666206 (+3627761us) service_pool.cc:224] Handling call
0709 13:07:09.748421 (+ 82215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.751824 (+  3403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.752064 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:09.760012 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.721553 16901 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:09.760694 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.769505 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:09.774288 13857 raft_consensus.cc:1240] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:09.774893 13707 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
W20260709 13:07:09.771214 13680 leader_election.cc:336] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.795s (SENT)
I20260709 13:07:09.775919 13787 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
W20260709 13:07:09.777463 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 60275.4us
I20260709 13:07:09.665053 16889 consensus_queue.cc:1059] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 13:07:09.749363 16847 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.773353 13682 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:09.749215 16830 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:09.779225 13789 raft_consensus.cc:1240] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:09.752537 16646 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.781315 13782 raft_consensus.cc:1240] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 4. Current term is 6. Ops: []
I20260709 13:07:09.779815 13791 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:09.781831 13783 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 6: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:09.780076 13858 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:09.784252 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1632) took 3745 ms. Trace:
I20260709 13:07:09.784973 13791 rpcz_store.cc:276] 0709 13:07:06.038723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.718965 (+3680242us) service_pool.cc:224] Handling call
0709 13:07:09.754074 (+ 35109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.783989 (+ 29915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.784193 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.786376 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:09.788592 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1639) took 3732 ms. Trace:
W20260709 13:07:09.788856 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 293757us
I20260709 13:07:09.788986 13782 rpcz_store.cc:276] 0709 13:07:06.056155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.735553 (+3679398us) service_pool.cc:224] Handling call
0709 13:07:09.781168 (+ 45615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.788368 (+  7200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.788540 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.790925 13786 raft_consensus.cc:1240] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:09.760607 16919 raft_consensus.cc:3055] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:09.794694 13789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1637) took 3742 ms. Trace:
I20260709 13:07:09.794111 13790 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:09.795096 13789 rpcz_store.cc:276] 0709 13:07:06.051941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.734149 (+3682208us) service_pool.cc:224] Handling call
0709 13:07:09.778989 (+ 44840us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.789131 (+ 10142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.794639 (+  5508us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.795610 13790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1634) took 3756 ms. Trace:
I20260709 13:07:09.796244 13790 rpcz_store.cc:276] 0709 13:07:06.039258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.748585 (+3709327us) service_pool.cc:224] Handling call
0709 13:07:09.789911 (+ 41326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.795261 (+  5350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.795537 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.798523 13786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 690) took 3316 ms. Trace:
I20260709 13:07:09.799108 13786 rpcz_store.cc:276] 0709 13:07:06.481657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.759135 (+3277478us) service_pool.cc:224] Handling call
0709 13:07:09.790665 (+ 31530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.798220 (+  7555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.798453 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.801831 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 717) took 1880 ms. Trace:
I20260709 13:07:09.802197 13787 rpcz_store.cc:276] 0709 13:07:07.921492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.553838 (+1632346us) service_pool.cc:224] Handling call
0709 13:07:09.801687 (+247849us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54001b71d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:09.801780 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":508809472}
I20260709 13:07:09.760041 16697 raft_consensus.cc:697] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 8 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:09.777227 16915 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.805967 13682 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:09.779752 16917 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:09.823472 13791 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:07:09.823873 13791 pending_rounds.cc:85] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 7
I20260709 13:07:09.824159 13791 pending_rounds.cc:107] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:07:09.824518 13791 raft_consensus.cc:2889] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:09.811841 14366 connection.cc:256] RPC call timeout handler was delayed by -1.0720454989999553s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
I20260709 13:07:09.808344 13865 raft_consensus.cc:1275] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:09.821508 13863 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
W20260709 13:07:09.826560 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.830231 13707 raft_consensus.cc:1240] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:07:09.794767 16919 raft_consensus.cc:740] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:09.812707 16695 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.834172 13782 raft_consensus.cc:1240] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 4. Current term is 6. Ops: [4.7-4.7]
I20260709 13:07:09.834836 13783 raft_consensus.cc:1240] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:09.837049 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 694) took 3354 ms. Trace:
I20260709 13:07:09.839661 13791 rpcz_store.cc:276] 0709 13:07:06.482841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.786038 (+3303197us) service_pool.cc:224] Handling call
0709 13:07:09.818795 (+ 32757us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.836733 (+ 17938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.836974 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:09.840452 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.840199 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 69009.4us
I20260709 13:07:09.760041 16672 consensus_queue.cc:237] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:09.827098 16917 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.819500 16898 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:09.831967 13786 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:09.841712 13790 raft_consensus.cc:1240] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 8 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:09.874071 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 68181.3us
I20260709 13:07:09.843894 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 695) took 3360 ms. Trace:
I20260709 13:07:09.845122 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:09.875308 14395 raft_consensus.cc:2410] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:09.803807 16847 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:09.875872 16759 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.876336 16759 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:09.876765 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 240641us
I20260709 13:07:09.877424 16847 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:09.877948 16847 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:09.807094 16830 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:09.878582 13756 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:09.846879 13783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 701) took 3360 ms. Trace:
I20260709 13:07:09.879739 13783 rpcz_store.cc:276] 0709 13:07:06.485961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.804626 (+3318665us) service_pool.cc:224] Handling call
0709 13:07:09.834582 (+ 29956us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.846649 (+ 12067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.846830 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.881000 13783 raft_consensus.cc:1240] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:09.881579 13783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2115) took 3382 ms. Trace:
I20260709 13:07:09.881875 13783 rpcz_store.cc:276] 0709 13:07:06.498733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.880505 (+3381772us) service_pool.cc:224] Handling call
0709 13:07:09.880846 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.881334 (+   488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.881506 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:09.831545 13601 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f09ef105d67b41dba510b44a6567d790 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b5029654a4384e43a68eb67b794949b7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:07:09.902671 13680 leader_election.cc:336] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.813s (SENT)
I20260709 13:07:09.831831 16914 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:09.903196 13680 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:09.878237 16812 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.874938 13782 rpcz_store.cc:276] 0709 13:07:06.484466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.803556 (+3319090us) service_pool.cc:224] Handling call
0709 13:07:09.833967 (+ 30411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.843647 (+  9680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.843840 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.904201 13790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 697) took 3419 ms. Trace:
I20260709 13:07:09.904644 16470 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.848052 16844 consensus_queue.cc:237] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:09.927732 16470 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:09.826473 16646 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:09.906754 13790 rpcz_store.cc:276] 0709 13:07:06.485005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.797267 (+3312262us) service_pool.cc:224] Handling call
0709 13:07:09.841481 (+ 44214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.884423 (+ 42942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.904148 (+ 19725us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:09.907547 13829 connection.cc:256] RPC call timeout handler was delayed by -1.7732520069999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1716s for a response
I20260709 13:07:09.873775 16917 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:09.916962 14366 leader_election.cc:336] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 2.006s (SENT)
I20260709 13:07:09.942654 14366 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:09.917701 13786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 698) took 3418 ms. Trace:
W20260709 13:07:09.918058 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.848486 16920 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.902244 16631 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:09.905332 16914 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:09.949128 13715 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:09.834172 16761 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:09.959623 13784 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:07:09.961283 13784 raft_consensus.cc:1240] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:09.936838 13829 connection.cc:256] RPC call timeout handler was delayed by -1.7021520069999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
I20260709 13:07:09.936967 13791 raft_consensus.cc:1240] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:09.983994 13829 connection.cc:256] RPC call timeout handler was delayed by -1.6085520069999575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1899s for a response
I20260709 13:07:09.938768 13864 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:07:09.938974 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:09.873317 16898 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.943372 13786 rpcz_store.cc:276] 0709 13:07:06.485245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.800123 (+3314878us) service_pool.cc:224] Handling call
0709 13:07:09.831795 (+ 31672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.882912 (+ 51117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.903881 (+ 20969us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280}
I20260709 13:07:09.818862 16618 consensus_queue.cc:237] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:09.945366 13782 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:10.012905 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 716) took 2185 ms. Trace:
I20260709 13:07:10.012988 13708 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:09.945942 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:09.946890 13682 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:09.948040 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:09.949103 16646 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:09.949669 16919 consensus_queue.cc:260] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:10.020529 13711 raft_consensus.cc:2393] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 9: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:10.021183 16919 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.021615 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:10.022324 13711 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
W20260709 13:07:09.951871 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 49237.6us
W20260709 13:07:10.023641 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 76829.4us
W20260709 13:07:10.024096 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.024695 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.952330 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.845727 16695 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:10.026767 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 325452us
I20260709 13:07:10.027491 13710 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:09.829690 16915 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:09.953790 13709 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:09.953920 13714 raft_consensus.cc:1275] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:10.023226 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:09.954785 13716 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:09.922355 16812 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:09.943539 16911 consensus_queue.cc:1059] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:07:09.962440 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:09.955155 16697 consensus_queue.cc:237] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:09.962456 13712 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:09.963635 16761 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:09.965243 16916 log.cc:927] Time spent T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
W20260709 13:07:09.945348 13601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 157090us
I20260709 13:07:09.967206 16830 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:09.967667 16470 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:09.968014 16640 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:09.968392 16851 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.968849 16547 consensus_queue.cc:1059] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:09.941977 16847 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:10.036516 16646 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:09.955693 16914 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:09.976204 16901 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:09.934340 14402 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
W20260709 13:07:09.984499 13829 connection.cc:256] RPC call timeout handler was delayed by -1.5896520070000406s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
W20260709 13:07:10.060109 14395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 721) took 3496 ms (client timeout 2026 ms). Trace:
I20260709 13:07:10.014441 13784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 719) took 2022 ms. Trace:
I20260709 13:07:10.013495 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2109) took 3488 ms. Trace:
W20260709 13:07:10.062376 13829 connection.cc:256] RPC call timeout handler was delayed by -1.5239520070000481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19930000000000003s for a response
I20260709 13:07:10.013335 13782 rpcz_store.cc:276] 0709 13:07:07.827614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.906369 (+2078755us) service_pool.cc:224] Handling call
0709 13:07:09.942458 (+ 36089us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.012588 (+ 70130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.012844 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25728}
I20260709 13:07:10.017490 16931 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:10.066300 16812 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:10.017822 14368 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:10.026273 13830 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:10.029044 13711 raft_consensus.cc:2393] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 5: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:07:10.029309 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 197268us
I20260709 13:07:10.037700 13715 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
W20260709 13:07:10.068085 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 50370.5us
I20260709 13:07:10.036537 14367 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:07:10.046289 13680 connection.cc:256] RPC call timeout handler was delayed by -1.1532378340000378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
I20260709 13:07:10.014154 16898 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:10.051069 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 271552us
I20260709 13:07:10.052232 13790 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:09.963198 13713 raft_consensus.cc:1240] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:10.069626 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.060415 13786 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:10.060271 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:09.978029 16924 consensus_queue.cc:1059] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.078s
W20260709 13:07:10.063192 13829 connection.cc:256] RPC call timeout handler was delayed by -1.5239520070000481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19930000000000003s for a response
I20260709 13:07:10.062737 13784 rpcz_store.cc:276] 0709 13:07:07.964212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.960663 (+1996451us) service_pool.cc:224] Handling call
0709 13:07:09.961051 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.985841 (+ 24790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.986072 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:10.074218 13829 connection.cc:256] RPC call timeout handler was delayed by -1.494252007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
W20260709 13:07:10.062361 14402 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 877) took 2116 ms (client timeout 2190 ms). Trace:
I20260709 13:07:10.062901 13791 rpcz_store.cc:276] 0709 13:07:06.496237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.840373 (+3344136us) service_pool.cc:224] Handling call
0709 13:07:09.936786 (+ 96413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.984232 (+ 47446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.984555 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:10.075971 13829 connection.cc:256] RPC call timeout handler was delayed by -1.494252007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
I20260709 13:07:10.070883 13714 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
W20260709 13:07:10.070973 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 154044us
I20260709 13:07:10.036708 16638 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 13:07:10.076009 14402 rpcz_store.cc:269] 0709 13:07:07.945659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.163770 (+218111us) service_pool.cc:224] Handling call
0709 13:07:10.062299 (+1898529us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:10.077351 13829 connection.cc:256] RPC call timeout handler was delayed by -1.4699520069999608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2053s for a response
W20260709 13:07:10.078224 13829 connection.cc:256] RPC call timeout handler was delayed by -1.4582520069999418s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2066s for a response
W20260709 13:07:10.078606 13829 connection.cc:256] RPC call timeout handler was delayed by -1.3421520069999815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2195s for a response
W20260709 13:07:10.078876 13829 connection.cc:256] RPC call timeout handler was delayed by -1.23775200700004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2311s for a response
W20260709 13:07:10.062537 14395 rpcz_store.cc:269] 0709 13:07:06.560961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.879664 (+318703us) service_pool.cc:224] Handling call
0709 13:07:10.047103 (+3167439us) spinlock_profiling.cc:243] Waited 2.95 s on lock 0x7b5400594f54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:10.057389 (+ 10286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6784128768}
I20260709 13:07:10.044000 16631 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:07:10.093266 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:10.093638 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:10.099792 16830 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:10.100890 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 64451.5us
W20260709 13:07:10.102101 14366 leader_election.cc:336] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 2.129s (SENT)
I20260709 13:07:10.067224 16646 raft_consensus.cc:697] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:10.068518 16901 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:10.077881 16812 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:10.108196 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 83426.9us
I20260709 13:07:10.106660 13710 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
W20260709 13:07:10.109640 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 83465.6us
W20260709 13:07:10.111598 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.114753 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:10.058902 16851 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:10.117656 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 49529.6us
I20260709 13:07:10.061057 16909 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:07:10.121387 13856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 1935) took 2326 ms. Trace:
I20260709 13:07:10.121727 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:10.122479 13856 rpcz_store.cc:276] 0709 13:07:07.795034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.575196 (+1780162us) service_pool.cc:224] Handling call
0709 13:07:09.575552 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.575822 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.575846 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:09.576358 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 13:07:09.640641 (+ 64283us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:09.812394 (+171753us) log.cc:844] Serialized 14 byte log entry
0709 13:07:09.834649 (+ 22255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.834725 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.121160 (+286435us) raft_consensus.cc:1685] finished
0709 13:07:10.121189 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.121332 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":300569,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":15519,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":6991,"thread_start_us":186751,"threads_started":2,"wal-append.queue_time_us":118365}
I20260709 13:07:10.109908 16931 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:10.177289 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 83667.5us
I20260709 13:07:10.124120 13860 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:07:10.179950 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:10.186060 13863 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
W20260709 13:07:10.180526 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 78455.8us
I20260709 13:07:10.186743 13755 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:10.107569 16889 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.110554 16844 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:07:10.183219 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 67059.4us
W20260709 13:07:10.181135 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 302652us
I20260709 13:07:10.187199 13865 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:10.115847 16812 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:10.195969 16547 raft_consensus.cc:3055] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:10.212430 16547 raft_consensus.cc:740] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:07:10.213215 16927 log.cc:927] Time spent T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:07:10.213487 16547 consensus_queue.cc:260] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:10.215008 16547 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.120352 16940 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:10.215945 16943 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:10.216701 16943 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:10.217160 16943 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:10.218307 16906 log.cc:927] Time spent T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.282s	user 0.003s	sys 0.001s
W20260709 13:07:10.219653 14366 leader_election.cc:336] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 2.208s (SENT)
I20260709 13:07:10.220187 14366 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:10.224990 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.195094 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.199308 13757 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:10.186437 16941 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:07:10.200403 16646 consensus_queue.cc:237] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:10.203490 12599 debug-util.cc:398] Leaking SignalData structure 0x7b0800399c20 after lost signal to thread 13830
I20260709 13:07:10.112848 16830 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:10.195750 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:10.224732 16937 log.cc:927] Time spent T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:07:10.187511 16931 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.183970 16924 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.233884 13790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 718) took 2254 ms. Trace:
W20260709 13:07:10.234957 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 113506us
I20260709 13:07:10.245875 13790 rpcz_store.cc:276] 0709 13:07:07.954745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.936198 (+1981453us) service_pool.cc:224] Handling call
0709 13:07:09.953360 (+ 17162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.069648 (+116288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.207315 (+137667us) spinlock_profiling.cc:243] Waited 95.7 ms on lock 0x7b540026e3d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:10.209123 (+  1808us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220176768}
I20260709 13:07:10.248041 16920 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:10.238050 13859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2596) took 2860 ms. Trace:
I20260709 13:07:10.239090 14367 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:07:10.240298 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 60503.9us
I20260709 13:07:10.225787 16812 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.241695 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:10.255926 13786 raft_consensus.cc:2393] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 9: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:10.242084 13757 leader_election.cc:304] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:10.242195 13756 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:10.242609 16911 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:10.242794 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:10.243155 16830 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:10.243052 16640 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:10.241734 16925 consensus_queue.cc:1059] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:07:10.240366 13858 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:10.243795 16915 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:10.243854 16948 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:10.244459 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:10.249904 16729 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:10.251252 16936 log.cc:927] Time spent T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:07:10.295282 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 53278.6us
W20260709 13:07:10.256902 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 72574.6us
I20260709 13:07:10.203213 16898 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:10.249800 16923 log.cc:927] Time spent T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:10.253672 13859 rpcz_store.cc:276] 0709 13:07:07.377433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.451367 (+2073934us) service_pool.cc:224] Handling call
0709 13:07:09.451767 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.452142 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.452167 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:09.452680 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:07:09.721314 (+268634us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:10.059673 (+338359us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.217759 (+158086us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:07:10.237442 (+ 19683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.237568 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.237628 (+    60us) raft_consensus.cc:1685] finished
0709 13:07:10.237777 (+   149us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.237981 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2298,"prepare.queue_time_us":231336,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":156602,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":204,"spinlock_wait_cycles":5837696,"thread_start_us":738028,"threads_started":3,"wal-append.queue_time_us":388556}
I20260709 13:07:10.298094 13829 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:10.296056 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:10.299481 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:10.253854 16931 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:10.297698 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 55599.4us
I20260709 13:07:10.304239 13790 raft_consensus.cc:2393] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 8: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:10.303224 13680 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:10.304534 13786 raft_consensus.cc:2393] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 9: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:10.239682 16901 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:10.306217 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 59165.5us
I20260709 13:07:10.305603 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:10.307849 16729 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:10.308923 13782 raft_consensus.cc:2410] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:10.295077 16548 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:10.232152 16889 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:10.316357 13708 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:10.295194 16911 raft_consensus.cc:697] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:10.307255 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:10.295671 16948 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.314553 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:10.319109 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 1941) took 2339 ms. Trace:
W20260709 13:07:10.322165 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 203409us
I20260709 13:07:10.306299 16915 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:10.319595 13861 rpcz_store.cc:276] 0709 13:07:07.979687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.611865 (+1632178us) service_pool.cc:224] Handling call
0709 13:07:09.674521 (+ 62656us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.747974 (+ 73453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.748008 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:09.760478 (+ 12470us) log.cc:844] Serialized 26 byte log entry
0709 13:07:10.034631 (+274153us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:10.055969 (+ 21338us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.056228 (+   259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.056347 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.318904 (+262557us) raft_consensus.cc:1685] finished
0709 13:07:10.318924 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.319049 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22268,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":3890,"raft.queue_time_us":15291,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":7488,"spinlock_wait_cycles":3889024,"thread_start_us":240779,"threads_started":1,"wal-append.queue_time_us":291086}
I20260709 13:07:10.255026 16761 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:07:10.250275 16932 raft_consensus.cc:3055] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:10.282539 16924 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:10.282348 16672 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:07:10.326498 13756 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:10.338140 13680 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:10.327898 16851 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:10.328617 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:10.339288 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:10.240697 16844 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:10.250075 16934 consensus_queue.cc:1059] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:07:10.332099 16949 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:10.332307 16759 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:10.313942 16695 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:10.325083 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:10.320792 16920 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:10.322402 16948 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.259330 16942 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 13:07:10.324014 16915 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:10.343644 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 45640.4us
I20260709 13:07:10.329368 16932 raft_consensus.cc:740] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:10.368516 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:10.346158 13680 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:10.357672 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 118619us
I20260709 13:07:10.366729 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:10.370986 13858 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
I20260709 13:07:10.351735 13861 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:10.369146 16932 consensus_queue.cc:260] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:10.377031 16932 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:10.377466 13859 raft_consensus.cc:1240] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:10.369665 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:10.379163 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:10.379881 16928 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:10.380828 16946 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:10.381081 16954 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:10.381624 16954 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.381654 16947 consensus_queue.cc:1059] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:07:10.382994 16947 raft_consensus.cc:3055] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:10.383468 16947 raft_consensus.cc:740] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:10.368345 16640 consensus_queue.cc:1048] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:07:10.384362 16947 consensus_queue.cc:260] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:10.384584 13789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 696) took 3899 ms. Trace:
I20260709 13:07:10.385591 16947 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:10.385500 16911 consensus_queue.cc:237] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:10.386027 13789 rpcz_store.cc:276] 0709 13:07:06.484755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.795970 (+3311215us) service_pool.cc:224] Handling call
0709 13:07:09.832306 (+ 36336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:10.016329 (+184023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.016375 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:10.018607 (+  2232us) log.cc:844] Serialized 26 byte log entry
0709 13:07:10.294536 (+275929us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:10.294571 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.294659 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.384357 (+ 89698us) raft_consensus.cc:1685] finished
0709 13:07:10.384378 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.384510 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107622,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"thread_start_us":391819,"threads_started":2,"wal-append.queue_time_us":298332}
I20260709 13:07:10.390455 16898 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:10.392226 16924 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:10.347295 16851 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:07:10.394032 16928 raft_consensus.cc:697] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:10.395082 16928 consensus_queue.cc:237] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:10.397101 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.382170 16954 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.398257 16847 raft_consensus.cc:3055] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:10.398649 16847 raft_consensus.cc:740] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:10.398778 16889 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:10.399549 16847 consensus_queue.cc:260] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:10.400578 16847 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.401018 16943 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:10.392976 16812 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:10.367650 13829 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:07:10.423307 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 55789us
I20260709 13:07:10.349040 16940 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:10.367081 16915 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:10.428135 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 82074.5us
I20260709 13:07:10.429309 13680 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:10.430644 16942 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:10.431119 16942 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.431226 16924 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:10.431583 16942 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.434173 16948 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:10.436414 16948 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:10.441360 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:10.442050 14394 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
W20260709 13:07:10.442080 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 127990us
I20260709 13:07:10.444375 13830 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:10.423959 16898 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:10.420953 16943 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:10.449921 13830 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:10.453682 13829 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:10.449930 16547 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:10.462142 16547 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:10.462610 16547 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.459867 16949 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:10.454530 16729 consensus_queue.cc:1059] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:07:10.465341 16917 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:10.466648 16954 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:10.439854 16914 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:10.468693 16958 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:10.475775 16898 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.478549 16812 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:10.479334 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.479840 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.488663 13782 raft_consensus.cc:2410] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:10.489353 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:10.491775 16844 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:10.492236 16954 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:10.482007 13830 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:07:10.496306 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 48675.4us
I20260709 13:07:10.505766 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:10.506342 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:10.475955 16958 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:10.511116 16958 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.511445 14398 raft_consensus.cc:3055] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:10.511951 14398 raft_consensus.cc:740] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:10.512681 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:10.513281 14396 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.513137 14398 consensus_queue.cc:260] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:10.514487 14398 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.509347 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:10.515858 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:10.517045 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:10.517822 13710 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:10.480692 16917 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:10.512027 13791 raft_consensus.cc:1275] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:10.478942 16898 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:10.521123 14394 raft_consensus.cc:2393] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 8: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:10.523782 13708 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
W20260709 13:07:10.524727 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.525059 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:10.518940 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:10.529608 14367 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:10.529053 14400 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
W20260709 13:07:10.531913 13680 leader_election.cc:336] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.978s (SENT)
I20260709 13:07:10.532682 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:10.533229 14367 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:10.534240 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:10.534442 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:10.535066 14397 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.535719 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:10.536343 13709 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:07:10.536448 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.539665 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:10.540776 13857 raft_consensus.cc:2410] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:10.540987 16934 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.541500 16934 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:10.543715 14394 raft_consensus.cc:3055] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:10.544065 13707 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
W20260709 13:07:10.544798 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 62859.3us
I20260709 13:07:10.544070 14394 raft_consensus.cc:740] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:10.552654 13791 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:10.552752 13790 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:07:10.553781 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:10.554553 13789 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
W20260709 13:07:10.555397 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.555953 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.556457 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.557229 13757 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:07:10.553841 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 239492us
I20260709 13:07:10.553668 13829 leader_election.cc:400] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 5. Current term is 6.
I20260709 13:07:10.559708 14398 raft_consensus.cc:1275] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:10.565634 13829 leader_election.cc:403] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:07:10.561220 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:10.575803 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:10.576555 13713 raft_consensus.cc:2393] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 5: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:10.576472 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:10.543445 16899 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.551612 16812 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:10.579351 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:10.577140 13789 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:07:10.590085 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:10.583292 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:10.579680 14400 raft_consensus.cc:3055] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:10.583855 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:10.584107 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:10.560021 14394 consensus_queue.cc:260] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:10.581233 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:10.584846 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:10.588658 13682 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:10.584836 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:10.564831 16955 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:10.617722 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.650144 13710 raft_consensus.cc:2410] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:10.651013 13862 raft_consensus.cc:1240] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:10.653548 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:10.649350 14400 raft_consensus.cc:740] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:10.675020 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:10.651181 13830 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:10.565204 16947 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:10.570132 16631 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:10.676415 13708 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
W20260709 13:07:10.676618 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 117311us
I20260709 13:07:10.649890 13711 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:07:10.677573 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:10.691717 13756 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:10.551724 16729 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:10.685974 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:10.686406 14397 raft_consensus.cc:2410] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:07:10.685979 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 103122us
I20260709 13:07:10.689615 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:07:10.699086 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 167215us
I20260709 13:07:10.690164 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:10.696748 13709 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:10.698019 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:10.701330 13790 raft_consensus.cc:2393] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 6: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:10.582643 16909 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:10.702857 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:10.589280 16812 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.702653 14400 consensus_queue.cc:260] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:10.700553 13682 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:10.713528 14394 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.582549 16919 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.117s
I20260709 13:07:10.688414 16934 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:10.722144 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:10.717860 14400 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.689093 16898 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:10.718369 13682 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:10.719028 13791 raft_consensus.cc:1240] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:10.723712 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.591297 16618 consensus_queue.cc:1059] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.129s
I20260709 13:07:10.721740 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:10.703992 16955 raft_consensus.cc:697] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:07:10.751012 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 206607us
I20260709 13:07:10.710850 16914 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:10.741951 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.746745 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 55104.1us
I20260709 13:07:10.748894 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:07:10.749428 13680 leader_election.cc:336] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 2.228s (SENT)
I20260709 13:07:10.746735 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:10.716979 16812 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:10.751006 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:10.700349 16847 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:10.752763 13862 raft_consensus.cc:1275] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:10.706815 16909 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.578282 16931 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:10.717638 16932 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:10.720944 16946 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:10.758615 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.758751 13791 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:07:10.758690 13789 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:07:10.768262 13791 pending_rounds.cc:85] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 4
I20260709 13:07:10.817755 13791 pending_rounds.cc:107] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 7.5
W20260709 13:07:10.818209 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 66239.9us
I20260709 13:07:10.818602 13791 raft_consensus.cc:2889] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:10.778144 13857 raft_consensus.cc:3055] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:10.756995 16898 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.819406 13857 raft_consensus.cc:740] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:10.824980 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:10.825479 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:10.825845 13789 raft_consensus.cc:2410] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:10.770130 16909 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:10.828903 14395 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 7: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:10.770536 16946 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.770211 16940 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.759027 16847 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:10.832175 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:10.837842 13791 raft_consensus.cc:2376] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8. Re-sending same reply.
I20260709 13:07:10.786710 16948 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.761111 16618 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
W20260709 13:07:10.841146 16964 log.cc:927] Time spent T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:07:10.860195 16942 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:10.861436 13829 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:10.862509 16942 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:10.863088 16942 raft_consensus.cc:2764] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:10.863773 16960 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:10.864843 13864 raft_consensus.cc:2393] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 5: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:10.857244 13857 consensus_queue.cc:260] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:10.872515 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:10.886778 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.888150 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:10.888780 13789 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:07:10.873517 13791 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:10.837785 16946 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:10.890641 13857 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:10.840039 16847 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.900707 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:10.864225 16960 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.826550 16898 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:10.933197 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.980473 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.985263 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.999332 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.847097 16958 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:10.865298 16948 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:11.018239 13791 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:07:11.025856 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 112214us
W20260709 13:07:11.027951 13788 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1654) took 1502 ms (client timeout 1795 ms). Trace:
W20260709 13:07:11.028555 13788 rpcz_store.cc:269] 0709 13:07:09.525398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.579526 (+ 54128us) service_pool.cc:224] Handling call
0709 13:07:11.027688 (+1448162us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b54003bd654. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:11.027878 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2126425472}
I20260709 13:07:10.920150 16960 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.887210 16919 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.133s
I20260709 13:07:11.045081 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:11.050647 13784 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.051021 14367 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:11.064319 13829 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:11.065389 16851 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:11.066685 13829 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:11.066830 16851 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.067662 16942 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:11.068730 16975 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:07:11.069114 14396 consensus_meta.cc:287] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.555s	user 0.005s	sys 0.005s
I20260709 13:07:11.069633 14396 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
W20260709 13:07:11.071523 16962 log.cc:927] Time spent T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.350s	user 0.001s	sys 0.000s
I20260709 13:07:11.072824 16694 consensus_queue.cc:1059] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:11.073338 13756 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:11.074380 16911 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:11.074851 16851 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:11.075093 16911 raft_consensus.cc:697] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:11.075631 16933 consensus_queue.cc:1059] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.162s
I20260709 13:07:11.081099 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:11.082083 14367 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:11.077394 16954 raft_consensus.cc:3055] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:10.931813 16547 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:11.085232 13785 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1652) took 1560 ms (client timeout 1993 ms). Trace:
W20260709 13:07:11.090358 13785 rpcz_store.cc:269] 0709 13:07:09.524935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.580765 (+ 55830us) service_pool.cc:224] Handling call
0709 13:07:11.083296 (+1502531us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b54000b2554. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:11.085167 (+  1871us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1673760128}
I20260709 13:07:10.785343 16969 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 5. Current term is 6.
I20260709 13:07:11.088080 13787 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 8 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:11.033155 16922 raft_consensus.cc:3055] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:11.091498 13857 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:11.091993 13756 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:11.095214 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:11.096589 14397 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:11.102818 14393 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.103981 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:11.123157 13784 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:07:11.124382 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:11.129292 13788 raft_consensus.cc:2410] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:11.082892 16954 raft_consensus.cc:740] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:10.901865 16940 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:10.591229 16899 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:11.092948 16761 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:11.101439 16470 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:11.179548 14397 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:07:11.127085 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 475922us
I20260709 13:07:11.136124 14401 raft_consensus.cc:3055] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:11.076987 16911 consensus_queue.cc:237] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:11.186192 16547 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:11.109063 16922 raft_consensus.cc:740] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:11.188043 16922 consensus_queue.cc:260] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:11.189121 16922 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.107944 16924 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.192082 16924 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:11.125094 16943 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:07:11.194893 14400 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:11.183976 14401 raft_consensus.cc:740] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:11.196043 14401 consensus_queue.cc:260] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:11.196810 16899 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:11.197305 14401 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:11.168335 13680 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:11.172255 14368 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:11.178180 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.198786 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.185035 13601 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f09ef105d67b41dba510b44a6567d790 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b5029654a4384e43a68eb67b794949b7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:11.199285 13709 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:11.185992 13716 raft_consensus.cc:1240] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:11.200137 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 96244.3us
I20260709 13:07:10.860046 16955 consensus_queue.cc:237] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:11.219436 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 139549us
I20260709 13:07:11.178212 16969 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:11.199038 16933 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:11.233959 14397 raft_consensus.cc:3055] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:11.236572 14397 raft_consensus.cc:740] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:07:11.238511 14394 consensus_meta.cc:287] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.000s
I20260709 13:07:11.197804 16761 raft_consensus.cc:697] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:07:11.228533 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 60308.2us
I20260709 13:07:11.243187 13857 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:11.248363 13756 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:11.248485 14394 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:11.244854 13830 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:11.245572 16830 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:11.248406 13680 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:07:11.251394 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 1.13129e+06us
I20260709 13:07:11.254042 16646 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.262689 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:11.249421 14397 consensus_queue.cc:260] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:11.267197 13830 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:11.273608 14368 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:11.319034 16976 log.cc:927] Time spent T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:07:11.319824 16898 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:11.320784 16958 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:11.328552 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 53643.7us
I20260709 13:07:11.252061 16934 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:11.277191 16977 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:11.321818 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 239794us
W20260709 13:07:11.295706 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 78462.3us
W20260709 13:07:11.325544 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 77261.5us
I20260709 13:07:11.321223 16847 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:11.328742 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 55264.7us
I20260709 13:07:11.334165 14397 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:11.330725 14393 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:07:11.343182 13829 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:11.315781 16931 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:11.326040 16470 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:11.338259 16898 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:11.338541 16901 raft_consensus.cc:2764] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:11.380131 13755 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:11.327083 16985 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:11.338480 16919 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:11.323772 16830 consensus_queue.cc:1059] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:07:11.352072 16974 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:11.339115 16977 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:11.391938 14397 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:07:11.392351 14397 pending_rounds.cc:85] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 8
I20260709 13:07:11.392671 14397 pending_rounds.cc:107] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:07:11.392973 14397 raft_consensus.cc:2889] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:11.393548 16919 raft_consensus.cc:697] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:11.394546 16919 consensus_queue.cc:237] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:11.395674 16941 raft_consensus.cc:3055] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:11.396066 16941 raft_consensus.cc:740] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:11.396816 16941 consensus_queue.cc:260] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:11.397646 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1668) took 1141 ms. Trace:
I20260709 13:07:11.397868 16941 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.398048 13782 rpcz_store.cc:276] 0709 13:07:10.256025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.328331 (+ 72306us) service_pool.cc:224] Handling call
0709 13:07:11.397450 (+1069119us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54001e6c54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:11.397593 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341822720}
W20260709 13:07:11.399981 16983 log.cc:927] Time spent T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:07:11.401592 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:11.402344 13707 raft_consensus.cc:2393] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 8: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:07:11.403295 16980 log.cc:927] Time spent T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
W20260709 13:07:11.408349 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.403221 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:11.408367 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.397635 13755 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:11.410728 13707 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:11.294479 16954 consensus_queue.cc:260] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:11.379671 16470 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:11.308300 16761 consensus_queue.cc:237] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:11.384677 16898 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.383285 16948 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:11.432368 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.453284 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:11.431339 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.391556 16949 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:11.407492 16899 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:11.444089 16958 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:11.453191 16915 consensus_meta.cc:287] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 1.001s	user 0.013s	sys 0.001s
I20260709 13:07:11.455962 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:11.408169 16977 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:11.435258 16470 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:11.448061 16695 raft_consensus.cc:3055] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:11.503618 16695 raft_consensus.cc:740] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:07:11.504043 16986 log.cc:927] Time spent T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:07:11.504505 16695 consensus_queue.cc:260] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:11.505738 16695 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:11.506153 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.506867 16984 log.cc:927] Time spent T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:07:11.507155 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.399282 14401 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:11.506162 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:11.497359 14368 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:11.454371 13707 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
I20260709 13:07:11.515750 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:11.515892 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:11.517325 13707 raft_consensus.cc:1275] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:07:11.494329 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 231732us
I20260709 13:07:11.450261 16898 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:11.485909 16899 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.521770 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:11.522320 13707 raft_consensus.cc:1240] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:11.522774 13680 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:11.525928 13712 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:11.521679 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 109658us
W20260709 13:07:11.528455 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 191735us
W20260709 13:07:11.523185 13682 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.014s	sys 0.012s
I20260709 13:07:11.462646 16988 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:11.524235 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:11.530967 13713 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
W20260709 13:07:11.531113 13682 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.014s	sys 0.012s
I20260709 13:07:11.524992 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:11.486230 16940 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:11.532678 13790 raft_consensus.cc:2393] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 8: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
W20260709 13:07:11.530404 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 190472us
W20260709 13:07:11.533603 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.458117 16948 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
W20260709 13:07:11.535229 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.522501 16646 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:11.536155 13707 raft_consensus.cc:1275] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:11.537146 13864 raft_consensus.cc:1240] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:11.537276 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:11.529405 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:11.580636 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:11.581460 13711 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 7: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:11.582693 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:11.523658 16830 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:07:11.534837 16988 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.588627 16988 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:11.510249 16958 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:11.595829 16847 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:11.597128 16958 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:11.597635 13858 raft_consensus.cc:1275] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:11.527812 16899 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:11.603111 16812 consensus_meta.cc:287] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.831s	user 0.012s	sys 0.000s
I20260709 13:07:11.603888 16640 consensus_queue.cc:1059] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:11.603783 16812 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:11.606142 16470 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:11.609640 14399 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:11.603786 13716 raft_consensus.cc:1240] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:11.613251 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.613651 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.613967 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.607012 16812 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:11.635187 13712 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:07:11.644030 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:11.644891 13864 raft_consensus.cc:2393] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 6: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:11.645143 13712 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:07:11.645692 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.641501 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 113728us
W20260709 13:07:11.642689 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 123679us
I20260709 13:07:11.514173 16915 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:11.651579 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:11.652617 13784 raft_consensus.cc:2393] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 5: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:11.654742 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:11.658332 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:11.661367 14402 raft_consensus.cc:3055] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:11.661757 14402 raft_consensus.cc:740] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:07:11.664548 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 141813us
I20260709 13:07:11.665932 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:11.665829 13680 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:11.667793 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:11.668534 13788 raft_consensus.cc:2376] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8. Re-sending same reply.
I20260709 13:07:11.662487 14402 consensus_queue.cc:260] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:11.671779 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:11.673985 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 176740us
I20260709 13:07:11.675176 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:11.648582 16917 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:11.648891 16989 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:11.681149 14402 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:11.682304 13680 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:11.682962 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:11.659673 16919 raft_consensus.cc:3055] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:11.684967 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 155646us
I20260709 13:07:11.685261 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:11.685891 13785 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:07:11.685909 13829 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:11.688138 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:11.688912 13680 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:11.690347 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:11.690868 13786 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:11.693962 13829 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:11.662352 16830 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:07:11.680377 16917 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:11.683710 16958 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:11.711495 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.686988 16919 raft_consensus.cc:740] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:11.688557 16940 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:11.688702 16646 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:11.725790 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:07:11.715381 16946 consensus_meta.cc:287] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.802s	user 0.005s	sys 0.004s
I20260709 13:07:11.733397 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:11.734593 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:11.736657 13784 raft_consensus.cc:2410] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:11.734031 13785 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:07:11.701448 13712 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:11.721755 16917 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.750319 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:11.749365 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:11.723531 16547 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:11.693276 16969 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:11.726487 16940 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.726305 16646 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.770376 13712 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:11.750298 14402 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:07:11.771311 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 123091us
I20260709 13:07:11.773978 13829 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:11.770861 16960 consensus_meta.cc:287] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.672s	user 0.001s	sys 0.011s
I20260709 13:07:11.776335 16960 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:11.778385 16960 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:11.778894 16960 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:11.785943 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 734) took 1463 ms. Trace:
I20260709 13:07:11.786567 14402 rpcz_store.cc:276] 0709 13:07:10.308837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.309196 (+   359us) service_pool.cc:224] Handling call
0709 13:07:10.309488 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:11.661276 (+1351788us) spinlock_profiling.cc:243] Waited 62.3 ms on lock 0x7b54009379a0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f5232455dc0 00007f52324e01c0 00007f52324e1231 00007f52324ddd8f 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c
0709 13:07:11.772054 (+110778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.772343 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143345920}
W20260709 13:07:11.775509 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.787554 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 95559.2us
I20260709 13:07:11.726022 16958 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:11.769793 16470 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:11.770256 16940 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.737629 16922 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
W20260709 13:07:11.789767 16759 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:07:11.737488 16946 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:11.773109 16646 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:11.815088 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 95110.1us
I20260709 13:07:11.788566 16911 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.696246 16949 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.111s
I20260709 13:07:11.820777 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:11.798736 16547 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:11.811834 16969 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:11.815600 16922 consensus_queue.cc:1243] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer ceb06175847b428ea8bd77055fcddf58 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:11.828972 13829 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:11.851982 16992 log.cc:927] Time spent T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:07:11.853013 16946 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:11.841888 16915 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:11.854012 16915 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.854475 16915 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:11.856418 16915 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:11.857266 16909 consensus_meta.cc:287] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 1.029s	user 0.008s	sys 0.004s
I20260709 13:07:11.857687 16909 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:11.860074 17001 log.cc:927] Time spent T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:07:11.816891 16978 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:11.871647 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.885192 13714 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:07:11.891396 13782 raft_consensus.cc:2368] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9.
W20260709 13:07:11.891850 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 48858.9us
W20260709 13:07:11.830938 16947 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.115s	user 0.018s	sys 0.025s
I20260709 13:07:11.817015 16812 consensus_queue.cc:1059] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:07:11.829255 16969 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:11.895949 17002 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:11.896368 17000 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.173s
I20260709 13:07:11.827617 17004 consensus_queue.cc:1048] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:07:11.939111 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:11.940114 14393 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:11.904522 17005 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:11.861384 16997 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.249s
I20260709 13:07:11.906222 16996 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:11.861222 16547 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:11.907871 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:11.942312 13858 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:11.910439 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:11.817543 16919 consensus_queue.cc:260] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:11.912700 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:11.941121 16898 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:11.947264 13861 raft_consensus.cc:2393] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 6: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:11.914490 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:11.916522 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:07:11.917048 13741 heartbeater.cc:646] Failed to heartbeat to 127.12.76.190:43389 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.12.76.190:43389 timed out after 15.000s (SENT)
I20260709 13:07:11.947861 13860 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:11.948139 13857 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 7: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:11.948478 13859 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:11.918618 16977 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:11.919612 14399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 735) took 1593 ms. Trace:
I20260709 13:07:11.950178 14399 rpcz_store.cc:276] 0709 13:07:10.326094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.326256 (+   162us) service_pool.cc:224] Handling call
0709 13:07:11.396037 (+1069781us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b5800077d98. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9eee 0000000000375939 00007f523742d1e0 00007f52374f60c4 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:07:11.396228 (+   191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:11.610237 (+214009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.919346 (+309109us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54005942d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:11.919539 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":492685440}
I20260709 13:07:11.827785 16470 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:11.920194 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:11.952247 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:11.925160 13786 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:11.953379 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:11.954118 14394 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 10: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:11.928880 16969 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.931370 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:11.931182 17002 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:11.932104 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:11.932260 16915 raft_consensus.cc:3055] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:11.933465 14402 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:11.934090 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:11.957157 14401 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:11.934644 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:11.959053 13785 raft_consensus.cc:2410] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:11.935021 16909 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:11.935209 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:11.940341 16958 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:11.893658 16947 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.181s	user 0.018s	sys 0.025s
I20260709 13:07:11.945147 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:11.965628 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:11.966256 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:11.966429 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 700) took 5476 ms. Trace:
I20260709 13:07:11.947731 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:11.918138 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:11.824075 16911 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:11.929179 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:11.963351 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:11.923974 16899 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:11.967048 14393 raft_consensus.cc:2393] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 8: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:11.966852 13787 rpcz_store.cc:276] 0709 13:07:06.485731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.802877 (+3317146us) service_pool.cc:224] Handling call
0709 13:07:11.083455 (+1280578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:11.109198 (+ 25743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.962407 (+853209us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54000b2550. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:11.962547 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2878544768}
I20260709 13:07:11.910611 16917 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:12.003909 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:11.902005 16988 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:12.006878 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:12.007822 14402 raft_consensus.cc:2393] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 5: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:11.980454 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:11.975394 16947 raft_consensus.cc:697] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:11.952469 16547 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.984058 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:12.016769 13708 raft_consensus.cc:2393] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 5: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:11.985291 13829 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:11.990526 14368 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:12.018337 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 329480us
I20260709 13:07:12.019840 16844 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:07:12.021925 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.023207 17017 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:12.024297 17017 consensus_queue.cc:1059] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:11.995643 13756 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:11.996663 13860 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:11.997473 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:11.998958 13788 raft_consensus.cc:1240] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:12.031708 13756 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:11.958791 16915 raft_consensus.cc:740] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:11.964965 16919 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.008955 13785 raft_consensus.cc:2393] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 5: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:07:12.009233 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.012363 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:12.031208 13789 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
W20260709 13:07:12.036473 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 44118.6us
I20260709 13:07:12.033353 14368 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:12.034001 13756 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:12.045200 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:12.045831 13708 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:11.992583 16989 raft_consensus.cc:697] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:07:12.051527 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.052871 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:12.052987 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 67793.5us
I20260709 13:07:12.053727 13829 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:12.053908 13680 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:12.054638 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:12.055177 14402 raft_consensus.cc:2376] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6. Re-sending same reply.
W20260709 13:07:12.013432 16928 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.550s	user 0.013s	sys 0.010s
I20260709 13:07:12.057467 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:12.053529 14398 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:07:12.057756 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:12.060689 13756 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:12.064792 13756 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:12.037377 16548 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:12.078986 13829 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:12.079669 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.094336 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.094544 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 321996us
I20260709 13:07:12.048439 16949 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:12.048302 16844 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:12.095978 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:12.091643 16955 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:12.054019 16997 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.095204 13755 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:07:12.107640 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.068971 16470 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:12.096351 13710 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:12.108796 14397 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:12.035552 16547 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:12.059579 16928 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.597s	user 0.013s	sys 0.010s
I20260709 13:07:12.117143 13708 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
I20260709 13:07:12.118302 13680 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:12.123028 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:12.124366 13708 raft_consensus.cc:2393] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 6: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:12.139882 17006 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:12.141558 17004 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.142076 17004 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:12.143188 16932 consensus_queue.cc:1048] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:12.143906 16898 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:12.144172 17004 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:12.144475 16997 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:12.145076 16997 raft_consensus.cc:697] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:12.145658 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:12.110320 16915 consensus_queue.cc:260] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:12.145973 16997 consensus_queue.cc:237] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:12.146786 16915 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:12.146304 13708 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.124836 17010 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.059814 13861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:07:12.148105 16640 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:12.148448 13861 raft_consensus.cc:606] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:07:12.148919 13861 raft_consensus.cc:614] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:12.149320 16928 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:12.149948 13783 raft_consensus.cc:1240] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:12.150281 13861 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:12.123339 16946 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:07:12.152154 16899 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:12.098718 16960 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:12.128924 16547 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:12.132542 16949 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:12.093034 16925 consensus_queue.cc:1048] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:07:12.134954 14397 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:12.135377 13865 raft_consensus.cc:1240] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:12.119128 16958 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:12.166915 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 101480us
I20260709 13:07:12.137952 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:12.138463 17002 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:12.120401 16548 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:12.139281 16955 raft_consensus.cc:697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:12.155583 16830 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:12.125263 17008 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:12.120044 16844 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:12.156248 13680 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:12.157686 16646 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:12.158772 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:12.158890 13708 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:07:12.159086 16911 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:12.188925 13713 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:12.151371 13783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 703) took 5634 ms. Trace:
I20260709 13:07:12.133406 13856 raft_consensus.cc:1240] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:12.135912 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:12.163323 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 84432.5us
I20260709 13:07:12.189849 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:12.190541 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:12.119405 16909 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:12.136726 16977 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:12.168778 16547 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.169776 13830 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:12.169566 16949 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:12.167716 13862 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:07:12.148244 17010 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:12.185360 13858 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
W20260709 13:07:12.221213 13829 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.132:43039 timed out after 1.893s (SENT) [suppressed 42 similar messages]
I20260709 13:07:12.148134 13710 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:07:12.189507 13783 rpcz_store.cc:276] 0709 13:07:06.517449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.882538 (+3365089us) service_pool.cc:224] Handling call
0709 13:07:11.029608 (+1147070us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.149809 (+1120201us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b540007b320. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f5232455dc0 00007f52324e01c0 00007f52324e1231 00007f52324ddd8f 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c
0709 13:07:12.150464 (+   655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.151194 (+   730us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54003bd650. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:12.151322 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2538031744}
I20260709 13:07:12.191675 13865 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:12.225549 13861 raft_consensus.cc:1240] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:12.195473 17018 consensus_queue.cc:1059] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:07:12.161911 16470 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:12.202276 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:12.234845 13716 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:12.203081 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 46949.6us
I20260709 13:07:12.221751 14368 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:12.183852 16548 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.222839 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:12.222880 13858 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:12.187381 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 76526.6us
I20260709 13:07:12.161808 16947 consensus_queue.cc:237] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:12.230618 16970 log.cc:927] Time spent T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 1.205s	user 0.005s	sys 0.000s
I20260709 13:07:12.229992 16940 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:12.220120 16631 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:12.254268 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.244122 16812 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:12.255682 13713 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:12.237347 13680 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:12.292371 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 55081.6us
W20260709 13:07:12.258458 16933 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.010s	sys 0.001s
I20260709 13:07:12.262719 16949 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:12.264608 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 94888.6us
I20260709 13:07:12.240454 16548 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.269425 16917 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:12.272653 13709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 655) took 1513 ms. Trace:
I20260709 13:07:12.259895 16978 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:12.278563 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.192325 16989 consensus_queue.cc:237] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:12.282563 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.241487 16946 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.240692 16470 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:12.304498 13709 rpcz_store.cc:276] 0709 13:07:10.759332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.050057 (+290725us) service_pool.cc:224] Handling call
0709 13:07:11.083120 (+ 33063us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:11.199669 (+116549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.272323 (+1072654us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54001c43d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:12.272573 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233243904}
I20260709 13:07:12.284729 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:12.309623 13863 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:12.285051 16646 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:12.285872 13859 raft_consensus.cc:1240] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:12.286221 16844 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:12.286870 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:12.234750 16977 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:12.316071 14367 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:12.328313 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:12.328929 13859 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:07:12.224056 16547 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:12.272985 17010 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:12.304858 13708 raft_consensus.cc:2393] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 6: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:12.301959 16830 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.305392 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:12.337348 13713 raft_consensus.cc:2393] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 12: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:07:12.300505 16933 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.010s	sys 0.001s
I20260709 13:07:12.317710 13711 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
I20260709 13:07:12.323565 16946 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:12.325675 16470 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:12.326882 13830 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:12.350487 13682 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:12.293642 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:12.283823 16955 consensus_queue.cc:237] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:12.353031 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 59463.6us
I20260709 13:07:12.338714 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:12.301755 16812 raft_consensus.cc:697] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:12.344031 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:12.359426 13859 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:12.348400 13863 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
W20260709 13:07:12.349434 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 232023us
I20260709 13:07:12.352126 13830 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:12.354647 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:12.355114 16996 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:12.355492 16646 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:12.325667 16988 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:12.355654 17017 consensus_queue.cc:1059] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:12.358040 16946 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:12.361159 14368 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:12.362123 13680 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:12.372767 13782 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:12.373605 13680 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:12.373713 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:12.374740 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:12.363835 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:12.365087 13711 raft_consensus.cc:2393] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 3: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:12.364931 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:07:12.366483 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.366592 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:12.377296 13784 raft_consensus.cc:2368] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8.
I20260709 13:07:12.375653 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:12.374302 13785 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:12.380012 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:12.380714 13863 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:07:12.381659 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:12.382266 13863 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.368110 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:12.383211 13709 raft_consensus.cc:2393] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 9: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:12.342550 16933 raft_consensus.cc:697] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:12.367440 14367 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:12.335592 16978 raft_consensus.cc:697] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 7 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:12.305258 16949 consensus_queue.cc:1059] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.054s
W20260709 13:07:12.355894 17026 log.cc:927] Time spent T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:07:12.367278 16844 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:12.400084 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:12.385057 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:12.371296 16646 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.371124 16977 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:12.402185 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:12.369441 16960 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:12.434247 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 61650.3us
I20260709 13:07:12.417804 13863 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:12.369012 16470 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:12.388744 13859 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
W20260709 13:07:12.437944 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 216733us
I20260709 13:07:12.404752 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:12.391918 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:12.384562 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:12.383766 17004 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:12.406631 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:12.410526 13784 raft_consensus.cc:2376] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5. Re-sending same reply.
I20260709 13:07:12.411749 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:12.383615 17019 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.434383 13785 raft_consensus.cc:2410] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:12.433828 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:12.442708 14397 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:07:12.443396 13791 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:07:12.436261 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:12.403776 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:12.438943 13789 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:12.384820 13682 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:12.444386 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:12.445098 13788 raft_consensus.cc:1275] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:12.445394 13791 raft_consensus.cc:2410] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:12.441134 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:12.446403 13863 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:12.433694 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:07:12.423069 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 55718.8us
I20260709 13:07:12.448839 13782 raft_consensus.cc:2410] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:07:12.449684 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 64920.1us
I20260709 13:07:12.449966 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:12.450675 13791 raft_consensus.cc:2393] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 12: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:12.412262 16934 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:12.459025 17028 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:07:12.459385 17032 consensus_queue.cc:1059] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 13:07:12.459761 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:12.389343 16969 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:12.499164 13709 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
W20260709 13:07:12.460317 17030 log.cc:927] Time spent T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:07:12.460441 16547 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:12.436825 16960 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.464527 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:12.465484 16978 consensus_queue.cc:237] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:12.414060 16646 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.468530 16631 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:12.469091 16933 consensus_queue.cc:237] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:12.469950 16812 consensus_queue.cc:237] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:12.470846 17029 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:12.472106 16940 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:12.434214 16844 raft_consensus.cc:697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:12.453261 16470 raft_consensus.cc:697] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:12.478040 13682 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:12.452510 16917 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:07:12.483569 14397 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:07:12.413703 16977 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.492211 13711 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 3: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:12.511258 16547 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.502976 13716 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:07:12.537571 13716 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:12.507071 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:12.539178 13785 raft_consensus.cc:2410] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:12.476692 16946 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:12.508790 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:12.546432 13791 raft_consensus.cc:2393] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 9: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:12.479483 17004 raft_consensus.cc:697] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:07:12.514448 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.515807 13680 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:12.548822 13680 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:12.447888 17017 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:07:12.498785 16932 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.522466 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:12.526208 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 48237.2us
I20260709 13:07:12.478853 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:12.512497 13863 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:07:12.507128 16960 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.440399 17005 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:12.531840 16631 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:12.532104 17019 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:12.535050 16977 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:12.582723 13863 raft_consensus.cc:606] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:12.602495 13863 raft_consensus.cc:614] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:12.531390 14366 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:12.589459 13716 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:12.584110 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:12.592887 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:12.545930 16946 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:12.554818 17010 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:12.560634 16940 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:12.556535 17015 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.591172 16997 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.585592 16922 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.622068 17027 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:07:12.622501 13716 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:12.623606 13857 raft_consensus.cc:1240] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:12.624037 17019 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:12.607743 17044 log.cc:927] Time spent T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.002s
I20260709 13:07:12.607558 17005 raft_consensus.cc:697] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:12.555900 16547 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:12.618063 16946 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:12.620128 16548 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:12.654263 17042 log.cc:927] Time spent T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:07:12.655714 17050 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.656142 16999 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:07:12.642023 16922 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:12.650087 17010 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:07:12.660821 16969 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:12.639249 17015 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:12.663246 13716 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:12.595341 16932 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:12.614055 17037 consensus_queue.cc:1048] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:07:12.697463 16922 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:12.699461 13864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:07:12.614244 16961 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:07:12.715626 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:12.754377 13791 raft_consensus.cc:2410] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:12.671948 17017 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.640827 16997 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:12.753517 13864 raft_consensus.cc:606] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:07:12.691607 16631 raft_consensus.cc:697] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:12.758337 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:12.764068 13864 raft_consensus.cc:614] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:12.764861 14395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 733) took 2467 ms (client timeout 1893 ms). Trace:
I20260709 13:07:12.651731 16844 consensus_queue.cc:237] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:12.652148 16470 consensus_queue.cc:237] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:12.771288 14395 rpcz_store.cc:269] 0709 13:07:10.297722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.298055 (+   333us) service_pool.cc:224] Handling call
0709 13:07:12.731070 (+2433015us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b540060de54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:12.764787 (+ 33717us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1182407936}
I20260709 13:07:12.690147 17050 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:12.675997 17004 consensus_queue.cc:237] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:12.812904 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:12.776895 16940 raft_consensus.cc:697] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:12.841472 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:12.812927 16547 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:12.849455 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 318118us
I20260709 13:07:12.852308 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:12.853461 14395 raft_consensus.cc:2393] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 12: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:07:12.880164 17060 log.cc:927] Time spent T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:07:12.883488 16631 consensus_queue.cc:237] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:12.889303 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.893383 17050 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:12.896394 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:12.900873 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 49905.9us
I20260709 13:07:12.902896 14366 leader_election.cc:304] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:12.831672 16646 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:12.805649 17005 consensus_queue.cc:237] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:12.903213 17046 log.cc:927] Time spent T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 13:07:12.926371 16548 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:12.929311 13863 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 7 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:12.933246 17034 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:12.935029 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:12.936367 14366 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:12.938215 14366 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:12.939608 17061 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.956022 17029 raft_consensus.cc:3055] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:12.956453 17029 raft_consensus.cc:740] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:12.939956 17034 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:12.957300 17029 consensus_queue.cc:260] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:12.958316 17029 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.941304 16940 consensus_queue.cc:237] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:12.942592 14366 leader_election.cc:400] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9.
I20260709 13:07:12.964753 17050 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:12.966394 16977 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:12.970701 16946 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:12.972807 16646 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:12.976300 13863 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:12.938613 17017 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.986152 13709 raft_consensus.cc:1240] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:12.982136 14397 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 6 LEARNER]: Advancing to term 7
W20260709 13:07:12.996057 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 53590.8us
I20260709 13:07:12.951758 16932 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:12.977295 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 176346us
I20260709 13:07:12.947036 16997 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:12.946612 17019 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:13.016875 14397 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEARNER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:12.944862 16960 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:12.988319 16946 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:13.021631 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:13.007166 16958 consensus_queue.cc:1059] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:07:13.006510 16969 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
W20260709 13:07:13.026512 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.024775 13755 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:13.040774 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.041918 14395 raft_consensus.cc:1240] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:13.013859 17017 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.044888 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:13.046139 13863 raft_consensus.cc:1275] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:07:13.020996 16934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.014s	sys 0.023s
I20260709 13:07:13.019972 17032 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.048563 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:13.044020 16997 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:13.042028 17009 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.056217 13857 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:13.056579 13863 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:13.059640 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:13.060460 13829 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:13.050915 16977 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:13.071775 17015 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:13.072429 16960 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:13.047271 16548 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:07:13.074612 16969 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:13.048085 16934 raft_consensus.cc:697] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:13.065299 17009 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:13.083516 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:13.048596 17017 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.089388 17017 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:13.091830 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:13.093428 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:13.095275 17009 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:13.108151 14397 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:07:13.110954 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:13.114039 14397 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:07:13.056025 17032 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.116482 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:13.117991 14397 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 7: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:07:13.119804 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 59420.2us
I20260709 13:07:13.120535 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:13.116582 17017 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.116408 17029 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:13.121490 13829 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:13.125326 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:13.127810 13829 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:13.123638 17017 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.128415 16969 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:13.127348 16934 consensus_queue.cc:237] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.134471 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:13.136524 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:13.137401 14397 raft_consensus.cc:2393] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 8: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:13.138188 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:13.138779 14397 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:13.122170 17071 consensus_queue.cc:1059] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:07:13.140025 14397 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:07:13.140172 17071 consensus_queue.cc:1243] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer b5029654a4384e43a68eb67b794949b7 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:13.140391 14397 pending_rounds.cc:85] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 6
I20260709 13:07:13.140728 14397 pending_rounds.cc:107] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:07:13.140795 17071 raft_consensus.cc:3055] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:13.141099 14397 raft_consensus.cc:2889] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:13.141301 17071 raft_consensus.cc:740] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:13.142285 17071 consensus_queue.cc:260] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.142884 16933 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:13.126438 17029 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.147707 17029 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:13.157058 13709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 665) took 1014 ms. Trace:
I20260709 13:07:13.157526 13709 rpcz_store.cc:276] 0709 13:07:12.142414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.516509 (+374095us) service_pool.cc:224] Handling call
0709 13:07:12.536884 (+ 20375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.994728 (+457844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.156767 (+162039us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b540010cf54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:13.156989 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1032652160}
I20260709 13:07:13.160094 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:13.160801 13709 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
I20260709 13:07:13.161917 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:13.163201 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:13.164443 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:13.165184 13709 raft_consensus.cc:2393] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 8: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:13.166937 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:13.151367 17071 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.168916 13709 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:13.173324 13714 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2353) took 1721 ms (client timeout 1609 ms). Trace:
W20260709 13:07:13.173769 13714 rpcz_store.cc:269] 0709 13:07:11.452279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.455661 (+  3382us) service_pool.cc:224] Handling call
0709 13:07:13.173138 (+1717477us) spinlock_profiling.cc:243] Waited 38.6 ms on lock 0x7b54001c5cd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:13.173255 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88822144}
I20260709 13:07:13.175060 13714 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:13.176612 16969 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:13.176945 13709 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:13.180895 13714 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:13.182956 13714 raft_consensus.cc:1240] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 2. Current term is 3. Ops: []
W20260709 13:07:13.187656 16981 log.cc:927] Time spent T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 1.963s	user 0.000s	sys 0.004s
W20260709 13:07:13.219875 16899 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.004s	sys 0.004s
I20260709 13:07:13.220110 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 666) took 1077 ms. Trace:
W20260709 13:07:13.220346 16899 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.004s	sys 0.004s
I20260709 13:07:13.220593 13711 rpcz_store.cc:276] 0709 13:07:12.142637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.533033 (+390396us) service_pool.cc:224] Handling call
0709 13:07:12.533421 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.533664 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:12.586954 (+ 53290us) log.cc:844] Serialized 14 byte log entry
0709 13:07:13.219724 (+632770us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:13.219792 (+    68us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:13.219852 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.219927 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.220052 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":269527,"prepare.queue_time_us":48983,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"thread_start_us":362796,"threads_started":1,"wal-append.queue_time_us":250738}
I20260709 13:07:13.222468 13711 raft_consensus.cc:1240] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:13.224517 13711 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:13.225754 13711 raft_consensus.cc:1240] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:13.226600 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:13.226897 16940 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.227681 16940 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:13.229786 16940 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:13.229892 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:13.230849 13711 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
I20260709 13:07:13.240995 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:13.241667 13711 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:13.247349 16898 consensus_queue.cc:1059] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:13.248710 16960 raft_consensus.cc:3055] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:13.249212 16960 raft_consensus.cc:740] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:13.250330 16960 consensus_queue.cc:260] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.261822 14393 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:13.267151 13711 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
W20260709 13:07:13.274384 17068 log.cc:927] Time spent T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.214s	user 0.004s	sys 0.000s
I20260709 13:07:13.275568 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:13.320366 13680 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.071s	sys 0.119s
W20260709 13:07:13.320838 13680 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.071s	sys 0.119s
W20260709 13:07:13.321375 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 737374us
I20260709 13:07:13.322058 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:13.322860 17054 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:13.324007 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:13.326138 17054 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:13.327951 13680 leader_election.cc:400] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8.
I20260709 13:07:13.328274 13680 leader_election.cc:403] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:13.329921 17054 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8.
I20260709 13:07:13.331025 13680 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:13.335618 17054 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:13.336035 17054 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:13.336429 17054 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:13.338092 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:13.338706 13716 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:13.340911 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:13.342681 13716 raft_consensus.cc:1240] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:13.345556 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:13.347620 17054 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.351820 17054 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:13.353062 13601 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f09ef105d67b41dba510b44a6567d790 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b5029654a4384e43a68eb67b794949b7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:13.356315 13680 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:13.362635 17057 consensus_queue.cc:1048] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:13.364125 17057 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:13.367558 13680 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:13.368642 17033 raft_consensus.cc:3055] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:13.369168 17033 raft_consensus.cc:740] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:13.369234 17057 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:13.370020 17033 consensus_queue.cc:260] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.371035 17033 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:13.371394 13680 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:13.372679 17054 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:13.375110 16931 raft_consensus.cc:3055] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:13.375674 16931 raft_consensus.cc:740] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:13.376845 16931 consensus_queue.cc:260] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.378415 16931 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.383158 13715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1899) took 2810 ms. Trace:
I20260709 13:07:13.383721 13715 rpcz_store.cc:276] 0709 13:07:10.572227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.765374 (+193147us) service_pool.cc:224] Handling call
0709 13:07:10.817524 (+ 52150us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:10.823244 (+  5720us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.823293 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:10.839689 (+ 16396us) log.cc:844] Serialized 26 byte log entry
0709 13:07:11.051666 (+211977us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:11.051721 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.051803 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.187055 (+2135252us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:07:13.382709 (+195654us) raft_consensus.cc:1685] finished
0709 13:07:13.382753 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.383049 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1989,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":9705,"spinlock_wait_cycles":30255360,"thread_start_us":125436,"threads_started":1,"wal-append.queue_time_us":256736}
I20260709 13:07:13.391750 13715 raft_consensus.cc:1275] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:07:13.392848 17072 log.cc:927] Time spent T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.409s	user 0.003s	sys 0.000s
I20260709 13:07:13.393378 13715 raft_consensus.cc:1240] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:13.394824 13715 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:13.404071 13715 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:13.406191 13715 raft_consensus.cc:1240] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:13.413244 13709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2370) took 1173 ms. Trace:
I20260709 13:07:13.413683 13709 rpcz_store.cc:276] 0709 13:07:12.239526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.177616 (+938090us) service_pool.cc:224] Handling call
0709 13:07:13.177926 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.230431 (+ 52505us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:13.230459 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:13.230917 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 13:07:13.411644 (+180727us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:13.411686 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.411762 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.413013 (+  1251us) raft_consensus.cc:1685] finished
0709 13:07:13.413037 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.413177 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52089,"raft.queue_time_us":52188,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":180369,"threads_started":1,"wal-append.queue_time_us":180565}
I20260709 13:07:13.427373 14393 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:13.429090 14393 pending_rounds.cc:85] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 4
I20260709 13:07:13.429392 14393 pending_rounds.cc:107] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 13:07:13.429708 14393 raft_consensus.cc:2889] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:13.433154 16960 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:13.435585 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.437284 16931 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.437815 16931 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.439821 14394 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:13.439983 17034 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:13.444814 16931 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:13.452932 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1914) took 1125 ms. Trace:
I20260709 13:07:13.453455 13714 rpcz_store.cc:276] 0709 13:07:12.327040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.187106 (+860066us) service_pool.cc:224] Handling call
0709 13:07:13.187450 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.187642 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:13.192890 (+  5248us) log.cc:844] Serialized 14 byte log entry
0709 13:07:13.452507 (+259617us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:13.452563 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:13.452610 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.452674 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.452794 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4236,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"thread_start_us":264250,"threads_started":2,"wal-append.queue_time_us":258227}
I20260709 13:07:13.465577 14393 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:13.466400 17039 log.cc:927] Time spent T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 1.001s	user 0.005s	sys 0.000s
I20260709 13:07:13.469210 14393 raft_consensus.cc:1275] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:07:13.484951 13710 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58552 (request call id 654) took 2908 ms (client timeout 1938 ms). Trace:
W20260709 13:07:13.485586 13710 rpcz_store.cc:269] 0709 13:07:10.576459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.719075 (+142616us) service_pool.cc:224] Handling call
0709 13:07:13.484646 (+2765571us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54000c5654. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:13.484820 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3084410624}
I20260709 13:07:13.516832 17049 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:13.517572 17049 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.520005 17049 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:13.533674 16960 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:13.534479 16960 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.540944 13711 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:07:13.547838 16899 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:13.548556 16899 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:13.558279 16960 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:13.560410 16899 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:13.564968 13680 leader_election.cc:336] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.756s (SENT)
I20260709 13:07:13.565441 13680 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:13.574934 16844 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:13.578150 13858 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:13.579749 13858 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:13.580552 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:13.581121 13858 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:07:13.582002 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:13.593050 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.589068 16899 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.595817 16899 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.597483 16899 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:13.601449 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:13.602082 13710 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:07:13.604377 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2164) took 1095 ms. Trace:
I20260709 13:07:13.604791 13791 rpcz_store.cc:276] 0709 13:07:12.508919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.568424 (+ 59505us) service_pool.cc:224] Handling call
0709 13:07:13.604172 (+1035748us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54000b1b54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:13.604317 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344951040}
I20260709 13:07:13.613258 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:13.619691 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:13.625765 17004 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:13.648792 16899 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.649354 16899 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:13.651566 16899 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:13.659845 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:13.660532 13857 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:07:13.660907 13859 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:13.674304 16924 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:13.677078 13756 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:13.682512 13756 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:13.684190 16618 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:13.702979 16695 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:13.703527 13756 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:13.704540 16695 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:13.705798 13756 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:13.706617 16618 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:13.706974 16618 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.707302 16618 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:13.713275 16989 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.003s	sys 0.005s
W20260709 13:07:13.713714 16989 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.004s	sys 0.006s
I20260709 13:07:13.715677 16948 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:13.719851 13756 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:13.721808 13756 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:13.722911 13756 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:07:13.714756 16915 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.063s	user 0.020s	sys 0.011s
I20260709 13:07:13.724483 13756 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:13.726830 13756 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:13.725380 17035 consensus_queue.cc:1059] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:07:13.724637 16694 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:13.724030 16899 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:13.729025 16694 raft_consensus.cc:697] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:13.729961 16694 consensus_queue.cc:237] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:13.728477 17035 consensus_queue.cc:1243] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer b9d194f45e044e0988d5de1a99e5cd02 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:13.731775 17035 consensus_queue.cc:1059] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:13.732519 17035 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:13.732864 17035 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.733191 17035 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:13.733878 17050 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:13.734352 17050 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.721004 16695 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:13.735534 16695 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.735929 16695 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.737620 13680 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:13.738933 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:13.739969 16924 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:13.740084 17004 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:13.740573 17004 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.740693 16924 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:13.741243 16924 raft_consensus.cc:697] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 12 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:13.742084 16924 consensus_queue.cc:237] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.720891 16948 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:07:13.744858 16618 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.745296 16948 consensus_queue.cc:1059] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:13.745996 16948 consensus_queue.cc:1243] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer b9d194f45e044e0988d5de1a99e5cd02 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:13.746806 16948 consensus_queue.cc:1048] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:13.747200 16618 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:13.747802 13707 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:07:13.748848 16618 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:13.749017 16948 raft_consensus.cc:3055] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:13.749282 16618 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.749504 16948 raft_consensus.cc:740] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:13.750531 16948 consensus_queue.cc:260] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:13.752648 17052 log.cc:927] Time spent T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.978s	user 0.000s	sys 0.003s
I20260709 13:07:13.758548 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:13.758601 16697 raft_consensus.cc:3055] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:13.759757 16697 raft_consensus.cc:740] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:13.760519 16697 consensus_queue.cc:260] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:13.761143 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:13.759186 14397 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:07:13.761715 13859 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.762626 16697 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:13.763775 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.765614 16548 raft_consensus.cc:3055] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:13.765908 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:13.759186 14396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 898) took 1354 ms. Trace:
W20260709 13:07:13.723853 16915 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.073s	user 0.021s	sys 0.011s
I20260709 13:07:13.769452 17004 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.767127 14396 rpcz_store.cc:276] 0709 13:07:12.404977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.409492 (+  4515us) service_pool.cc:224] Handling call
0709 13:07:12.463793 (+ 54301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.540856 (+ 77063us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.540895 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.541478 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.959986 (+418508us) spinlock_profiling.cc:243] Waited 8.16 ms on lock 0x7b180043e160. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f52320864bc 00007f522f3d448b 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e0d1
0709 13:07:12.960140 (+   154us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:12.960185 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.960260 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.752190 (+791930us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:07:13.758954 (+  6764us) raft_consensus.cc:1685] finished
0709 13:07:13.758981 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.759109 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49136,"raft.queue_time_us":138404,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":12791,"spinlock_wait_cycles":27226624,"thread_start_us":119466,"threads_started":2,"wal-append.queue_time_us":170651}
I20260709 13:07:13.765992 16548 raft_consensus.cc:740] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:13.771965 16548 consensus_queue.cc:260] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.752736 16899 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:13.760955 17050 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.773281 17004 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:13.800400 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:13.794898 17019 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.804716 17019 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:13.774232 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:13.779073 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:13.806550 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.799104 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:13.749754 16618 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:13.773137 16548 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.813391 13859 raft_consensus.cc:2410] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:13.781203 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:13.815780 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:13.816110 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:13.826937 13680 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:13.835347 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:13.836045 14401 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:13.838577 14397 raft_consensus.cc:1275] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:13.838521 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:13.793928 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:13.825654 16948 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:13.843896 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:13.844188 13709 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:07:13.845901 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:13.844455 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:13.847353 13711 raft_consensus.cc:2376] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6. Re-sending same reply.
I20260709 13:07:13.849509 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:13.852075 17050 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:13.840224 16899 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:13.852630 17017 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:13.853052 16899 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:13.836992 16924 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:13.856952 16924 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:13.857345 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:13.857513 16924 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.877004 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:13.878229 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:13.879601 13707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2360) took 2386 ms. Trace:
I20260709 13:07:13.880026 13707 rpcz_store.cc:276] 0709 13:07:11.493041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.559748 (+ 66707us) service_pool.cc:224] Handling call
0709 13:07:13.747568 (+2187820us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.748193 (+   625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.879348 (+131155us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b54000c5650. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:13.879532 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5030639872}
I20260709 13:07:13.860154 16899 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:13.881423 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:13.868341 16694 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.883849 16695 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:13.884059 16694 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:13.886797 16946 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.007s	sys 0.003s
W20260709 13:07:13.887179 16946 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.007s	sys 0.003s
I20260709 13:07:13.887405 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:13.888386 13782 raft_consensus.cc:1240] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:13.889636 13785 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:13.889533 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:13.891197 13707 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:07:13.891793 13782 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:13.892210 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:13.892786 13707 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.883291 17038 raft_consensus.cc:3055] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:13.861150 17019 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:13.891248 16695 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:13.896680 16917 consensus_queue.cc:1059] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:07:13.902452 16917 raft_consensus.cc:3055] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:13.902814 16917 raft_consensus.cc:740] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:13.897424 17038 raft_consensus.cc:740] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:13.875353 17035 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:13.896028 17017 consensus_queue.cc:1059] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
W20260709 13:07:13.920699 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.921104 17017 raft_consensus.cc:3055] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:13.921458 17017 raft_consensus.cc:740] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:13.925670 14394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1047) took 1210 ms. Trace:
I20260709 13:07:13.926113 14394 rpcz_store.cc:276] 0709 13:07:12.715743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.715884 (+   141us) service_pool.cc:224] Handling call
0709 13:07:12.765224 (+ 49340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.440260 (+675036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.925444 (+485184us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b54006b5154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:13.925612 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1550953728}
I20260709 13:07:13.914801 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:13.910501 13707 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:07:13.917146 17038 consensus_queue.cc:260] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:13.918387 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.930044 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:13.917961 16917 consensus_queue.cc:260] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.933214 16917 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.936291 13680 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:13.922200 17017 consensus_queue.cc:260] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.940022 17050 consensus_queue.cc:1059] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:13.940666 17017 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.940982 16761 consensus_queue.cc:1059] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:13.941668 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:13.931093 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:13.943267 13707 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:07:13.944113 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:13.945086 13786 raft_consensus.cc:2410] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:13.944442 14367 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:13.947893 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:13.948832 13786 raft_consensus.cc:2410] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:13.947135 17010 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.950517 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:13.949223 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:13.951895 13707 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:13.953430 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:13.932273 16694 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:13.954887 13680 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:13.956957 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:13.957799 13786 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:07:13.958784 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:13.947428 16915 raft_consensus.cc:3055] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:13.959190 13680 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:13.959492 13786 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:07:13.949992 17038 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.956218 17103 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:13.961395 13707 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:07:13.948741 17019 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:13.960110 16960 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.955190 16946 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:13.952672 17047 raft_consensus.cc:3055] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:13.964658 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:13.963610 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:13.954968 16940 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.961447 16914 consensus_queue.cc:1059] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:07:13.967540 17049 consensus_queue.cc:1059] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:13.967697 17050 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:13.962705 16830 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:13.963971 16960 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.958838 16844 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:13.960563 16915 raft_consensus.cc:740] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:13.970999 13787 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 9: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:13.977768 16830 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.977589 16915 consensus_queue.cc:260] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.978238 16830 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.978761 16915 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.950994 17010 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.980857 17010 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:13.982738 13789 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:13.983114 16914 raft_consensus.cc:3055] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:13.983518 16914 raft_consensus.cc:740] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:13.984282 13789 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:07:13.984742 13789 pending_rounds.cc:85] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 6
I20260709 13:07:13.984972 13789 pending_rounds.cc:107] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:07:13.984369 16914 consensus_queue.cc:260] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.976831 13680 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:13.985181 13789 raft_consensus.cc:2889] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:13.985607 16914 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:13.986159 16989 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:13.986577 16989 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.987020 16989 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.983729 16924 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.988508 16960 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:13.990192 17041 log.cc:927] Time spent T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 1.526s	user 0.004s	sys 0.000s
I20260709 13:07:13.991694 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2620) took 1861 ms. Trace:
I20260709 13:07:13.969761 17047 raft_consensus.cc:740] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:07:13.992816 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 865012us
I20260709 13:07:13.992017 13860 rpcz_store.cc:276] 0709 13:07:12.130509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.133702 (+  3193us) service_pool.cc:224] Handling call
0709 13:07:12.133991 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.134330 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:12.224540 (+ 90210us) log.cc:844] Serialized 14 byte log entry
0709 13:07:12.389020 (+164480us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.409417 (+ 20397us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.409545 (+   128us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:12.409574 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.409635 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.989736 (+1580101us) spinlock_profiling.cc:243] Waited 42.5 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:07:13.991360 (+  1624us) raft_consensus.cc:1685] finished
0709 13:07:13.991482 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.991627 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28062,"prepare.queue_time_us":128842,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":21708,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":11010,"spinlock_wait_cycles":97734528,"thread_start_us":212268,"threads_started":2,"wal-append.queue_time_us":223973}
I20260709 13:07:13.993110 17047 consensus_queue.cc:260] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.993575 13829 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:13.994213 13862 raft_consensus.cc:1240] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:13.995621 17077 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:13.996210 17077 raft_consensus.cc:697] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:13.996572 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 701) took 1848 ms. Trace:
I20260709 13:07:13.996945 13862 rpcz_store.cc:276] 0709 13:07:12.147778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.225117 (+ 77339us) service_pool.cc:224] Handling call
0709 13:07:13.994050 (+1768933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.994597 (+   547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.996389 (+  1792us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b5400387550. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:13.996514 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4067390848}
I20260709 13:07:13.997116 17077 consensus_queue.cc:237] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:13.994251 17047 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.998876 17038 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:14.001324 16989 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:14.002173 16924 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:14.002737 17076 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.003227 17076 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:14.005617 17076 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:14.006103 17076 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.006537 17076 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:14.009416 16830 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:14.010562 13860 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:14.010885 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:14.011596 16470 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.012244 16470 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:14.013705 13863 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:14.014356 16470 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:14.016793 13712 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1908) took 2103 ms (client timeout 1614 ms). Trace:
W20260709 13:07:14.017278 13712 rpcz_store.cc:269] 0709 13:07:11.913428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.964670 (+ 51242us) service_pool.cc:224] Handling call
0709 13:07:14.016576 (+2051906us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b540034d5d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:14.016710 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4020756352}
I20260709 13:07:14.016729 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:14.019361 13857 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:07:14.025354 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:13.986538 13789 raft_consensus.cc:1275] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:14.044824 13862 raft_consensus.cc:1240] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:14.015936 16960 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:14.043087 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:14.049563 13789 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.052407 13862 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:14.053179 17019 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:14.053727 17019 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:14.059536 13716 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:14.042061 16830 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:14.070573 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:14.041646 16646 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:14.073144 13862 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:14.074849 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:14.075380 13791 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:07:14.076524 13680 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:14.077543 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:13.974392 16940 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:14.085647 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:14.089468 13862 raft_consensus.cc:2393] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 5: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:14.087757 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:14.069909 17110 log.cc:927] Time spent T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:07:14.049710 17050 consensus_queue.cc:1059] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:07:14.090806 13830 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:14.049510 16844 consensus_queue.cc:1048] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:07:14.093612 13791 raft_consensus.cc:1275] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:07:14.056416 17019 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:14.095845 13791 pending_rounds.cc:85] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 4
I20260709 13:07:14.096167 13791 pending_rounds.cc:107] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:07:14.096449 13791 raft_consensus.cc:2889] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:14.096840 13791 pending_rounds.cc:107] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:07:14.097115 13791 raft_consensus.cc:2889] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:14.098959 16830 consensus_queue.cc:1048] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:14.099284 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:14.099890 13791 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.101214 16940 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:14.089967 16924 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:14.102350 16924 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:14.102752 16924 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.083974 16646 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:14.137672 16646 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:14.128499 16618 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:14.128710 13791 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:14.130537 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2636) took 1275 ms. Trace:
I20260709 13:07:14.150134 13789 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:14.150231 13680 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:14.146768 13861 rpcz_store.cc:276] 0709 13:07:12.855476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.123989 (+268513us) service_pool.cc:224] Handling call
0709 13:07:13.124216 (+   227us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.124797 (+   581us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:13.126278 (+  1481us) log.cc:844] Serialized 14 byte log entry
0709 13:07:13.611403 (+485125us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b18004963c0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f1522 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
0709 13:07:13.636567 (+ 25164us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b18004963c0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e23a 00007f52324e8a2a
0709 13:07:14.043542 (+406975us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.044018 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.044169 (+   151us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:14.044202 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.044262 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.130270 (+ 86008us) raft_consensus.cc:1685] finished
0709 13:07:14.130297 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.130460 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":314755,"prepare.queue_time_us":1409,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":396,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":2488,"spinlock_wait_cycles":12265600,"thread_start_us":66542,"threads_started":1,"wal-append.queue_time_us":593804}
I20260709 13:07:14.153640 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:14.154697 13714 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:14.151822 13680 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:14.157156 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:14.157974 13791 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:14.159390 13791 raft_consensus.cc:1240] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:14.159487 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:14.154968 16618 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:14.166571 13789 raft_consensus.cc:1275] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:14.146330 16989 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:14.155627 16960 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:14.174471 16954 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:14.184974 17035 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:14.166527 17019 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:14.185861 17019 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:14.163775 16646 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:14.195708 13714 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
I20260709 13:07:14.186350 17019 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:14.187395 17111 log.cc:927] Time spent T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:14.198283 16989 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.201674 16960 raft_consensus.cc:697] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:14.169952 16940 consensus_queue.cc:1048] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:07:14.203809 16646 raft_consensus.cc:697] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:14.226338 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:14.231532 16830 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.231523 17047 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.232578 17047 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:14.232474 16830 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:14.234946 17047 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:14.236287 14366 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:14.236469 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:14.236506 16830 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:14.237520 13710 raft_consensus.cc:2410] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:14.247956 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:14.248266 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:14.250703 13862 raft_consensus.cc:2410] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:14.251477 13790 raft_consensus.cc:2410] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:14.214013 16989 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:14.252432 13680 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:07:14.255787 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.264464 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:14.265791 17000 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.265803 17004 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:14.266426 17004 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:14.266389 17000 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:14.266973 17004 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:14.268200 13856 raft_consensus.cc:1240] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:14.269280 14368 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:14.277968 17076 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:14.278539 16844 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:14.280496 14368 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:14.282506 17049 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:14.282548 17103 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:14.283066 17049 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:14.283592 17049 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.286634 16931 raft_consensus.cc:3055] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:14.287070 16931 raft_consensus.cc:740] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:14.297858 17032 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:14.301930 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.303316 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:14.303699 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:14.304675 13784 raft_consensus.cc:3055] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:14.305107 13784 raft_consensus.cc:740] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:14.305976 16960 consensus_queue.cc:237] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:14.306069 13784 consensus_queue.cc:260] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:14.307338 13784 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:14.307627 13861 raft_consensus.cc:1275] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:07:14.307950 13861 pending_rounds.cc:85] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 2
I20260709 13:07:14.308151 13861 pending_rounds.cc:107] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:07:14.308377 13861 raft_consensus.cc:2889] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:14.309636 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:14.310693 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:14.310992 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.313490 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:14.313709 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:14.314287 13857 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:14.314551 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:14.253984 16914 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:14.315635 14366 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:14.316360 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:14.311267 13856 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:07:14.317567 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:14.316926 14394 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:07:14.319022 13785 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:14.325491 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:14.326174 13864 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:14.317910 16954 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:07:14.328887 17004 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:14.328626 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:14.329995 14401 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:14.329926 17037 consensus_queue.cc:1059] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:14.330883 17037 consensus_queue.cc:1243] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer ceb06175847b428ea8bd77055fcddf58 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:14.331352 17037 raft_consensus.cc:3055] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:14.331748 17037 raft_consensus.cc:740] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:14.331796 16924 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:14.332659 17037 consensus_queue.cc:260] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:14.333746 17000 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:14.333817 17037 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:14.273305 16830 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:07:14.273403 16646 consensus_queue.cc:237] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:14.336826 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:14.337630 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.324313 17032 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:14.324004 16988 consensus_queue.cc:1059] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:07:14.339826 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:14.340255 16988 raft_consensus.cc:3055] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:14.317984 17103 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.340463 13710 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 3.
I20260709 13:07:14.340674 16988 raft_consensus.cc:740] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:14.340852 17103 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:14.341747 13714 raft_consensus.cc:1275] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:14.341521 16988 consensus_queue.cc:260] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:14.342659 16988 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:14.329463 13790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2146) took 1965 ms (client timeout 1756 ms). Trace:
W20260709 13:07:14.343088 13790 rpcz_store.cc:269] 0709 13:07:12.364022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.364152 (+   130us) service_pool.cc:224] Handling call
0709 13:07:14.329260 (+1965108us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54000b1654. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:14.329396 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4307860736}
I20260709 13:07:14.346091 13829 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:14.348129 17038 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:14.348894 16697 consensus_queue.cc:1048] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:14.349586 17034 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:07:14.349646 13708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1913) took 2181 ms (client timeout 1980 ms). Trace:
W20260709 13:07:14.350133 13708 rpcz_store.cc:269] 0709 13:07:12.167833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.189531 (+ 21698us) service_pool.cc:224] Handling call
0709 13:07:14.349451 (+2159920us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54001c48d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:14.349583 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262167296}
I20260709 13:07:14.350153 17034 raft_consensus.cc:697] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:07:14.349119 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 258381us
I20260709 13:07:14.351497 17034 consensus_queue.cc:237] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:14.351891 13830 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:14.352548 13713 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:14.352793 16547 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:14.352978 13830 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:14.356495 13830 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:14.357204 16958 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:14.357467 17009 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:14.358104 17009 raft_consensus.cc:697] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:14.337517 13856 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 2.
I20260709 13:07:14.354413 16997 raft_consensus.cc:1064] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:07:14.355276 16931 consensus_queue.cc:260] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:14.354151 16547 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:14.364725 13829 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:07:14.370483 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.358773 13830 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:14.387580 13784 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:07:14.387965 13737 debug-util.cc:398] Leaking SignalData structure 0x7b0800105e20 after lost signal to thread 12597
I20260709 13:07:14.389590 13714 raft_consensus.cc:1240] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:14.402647 13829 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:14.405773 13708 raft_consensus.cc:1275] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:14.331054 16996 raft_consensus.cc:3055] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:14.390487 13864 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:14.405581 13755 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:14.408512 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 49804.8us
I20260709 13:07:14.369975 14401 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
I20260709 13:07:14.414497 13862 raft_consensus.cc:1275] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:07:14.410858 13737 debug-util.cc:398] Leaking SignalData structure 0x7b08001d5580 after lost signal to thread 13648
I20260709 13:07:14.415088 13829 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:14.398357 13857 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
I20260709 13:07:14.416409 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:14.417085 13856 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:14.417456 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 137035us
I20260709 13:07:14.418181 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:14.357595 16958 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:14.376128 16924 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:14.421442 13829 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:14.423363 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:07:14.400014 16997 raft_consensus.cc:1068] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03: Unable to promote non-voter ceb06175847b428ea8bd77055fcddf58: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:14.436988 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:14.437805 13860 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:07:14.439657 14368 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:14.440115 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:14.438822 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:14.445327 13861 raft_consensus.cc:2393] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 9: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:14.446354 13858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:07:14.447028 13858 raft_consensus.cc:606] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:07:14.447484 13858 raft_consensus.cc:614] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:14.450284 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:14.449754 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:14.457736 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.457499 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:14.451115 13782 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:14.458607 13784 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 7: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:14.399367 17050 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:07:14.419863 17076 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:14.425521 16978 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:14.411482 16996 raft_consensus.cc:740] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:14.425889 16931 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:14.424793 17033 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:14.468717 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:14.424484 16974 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:14.471778 13790 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:14.429039 16958 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:14.358934 17009 consensus_queue.cc:237] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:14.407401 17000 consensus_queue.cc:1059] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:07:14.444271 17116 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:14.419476 16695 consensus_queue.cc:1048] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:07:14.489183 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:14.425024 16761 consensus_queue.cc:1059] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:07:14.425215 17035 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:07:14.428416 16618 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:07:14.494746 13857 raft_consensus.cc:1275] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:07:14.512750 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:14.480118 17015 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:14.480749 17076 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.516898 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:14.481069 16955 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:14.501911 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:14.504630 13858 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:07:14.456352 16547 consensus_queue.cc:1059] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:07:14.456930 16915 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 13:07:14.505182 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 76652us
I20260709 13:07:14.488323 17033 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:14.498682 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:14.518503 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:14.524108 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:14.524864 13861 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.524144 13757 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:14.530721 13757 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:14.534384 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:14.535032 13858 raft_consensus.cc:1275] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:14.535094 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:14.535583 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:14.516857 17015 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:14.520437 17076 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:14.533350 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 127878us
I20260709 13:07:14.539016 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:14.546100 13857 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:14.539510 13863 raft_consensus.cc:2393] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 9: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:14.540228 13682 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:14.509197 16963 consensus_queue.cc:1059] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:07:14.526880 17033 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.548642 13682 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:14.532142 16547 consensus_queue.cc:1243] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer 35ecb005831740438d7537dd4b840e03 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:14.557160 13682 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:07:14.558590 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 119034us
I20260709 13:07:14.557516 13861 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:14.556927 16940 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:14.544516 17015 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:14.643550 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 113507us
I20260709 13:07:14.572168 17035 consensus_queue.cc:1059] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:14.583380 13856 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:07:14.556382 17049 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:14.579005 17019 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:14.570976 16954 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:14.644438 13601 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f09ef105d67b41dba510b44a6567d790 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b5029654a4384e43a68eb67b794949b7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:14.569725 17143 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:14.688406 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:14.692559 14398 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:14.690476 14399 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
W20260709 13:07:14.697211 13601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 52844.3us
I20260709 13:07:14.549479 16631 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:14.547721 16470 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:14.647799 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 199263us
I20260709 13:07:14.613176 16963 consensus_queue.cc:1243] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer ceb06175847b428ea8bd77055fcddf58 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:07:14.636685 17136 log.cc:927] Time spent T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:07:14.708283 13737 debug-util.cc:398] Leaking SignalData structure 0x7b0800169280 after lost signal to thread 13740
I20260709 13:07:14.708613 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:14.666450 14402 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:14.668951 13757 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:14.637135 16830 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:14.552449 17004 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:14.699365 14400 raft_consensus.cc:1240] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:14.700717 13680 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:14.704926 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:14.720361 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:14.705149 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:14.722272 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:14.712769 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:14.691318 17035 raft_consensus.cc:3055] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:14.714015 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 45230.7us
I20260709 13:07:14.714048 13857 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:14.688781 16954 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:14.711143 16470 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:14.726744 14395 raft_consensus.cc:2410] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 13:07:14.727681 13737 debug-util.cc:398] Leaking SignalData structure 0x7b08003469c0 after lost signal to thread 13815
W20260709 13:07:14.728119 13737 debug-util.cc:398] Leaking SignalData structure 0x7b080034a880 after lost signal to thread 13816
W20260709 13:07:14.729514 13737 debug-util.cc:398] Leaking SignalData structure 0x7b080014e7a0 after lost signal to thread 13889
W20260709 13:07:14.731647 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.734316 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 177225us
I20260709 13:07:14.736828 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:14.713351 17051 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:14.729009 17134 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:07:14.741657 13682 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:14.742520 14395 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:07:14.743162 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:14.747069 14398 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:14.695107 17138 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:07:14.730805 16917 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:14.771817 16917 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:14.774598 16917 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:14.780524 17049 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:14.730809 16974 consensus_queue.cc:1059] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:07:14.784143 16974 consensus_queue.cc:1243] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer 35ecb005831740438d7537dd4b840e03 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:14.784775 16974 raft_consensus.cc:3055] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:14.785168 16974 raft_consensus.cc:740] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:14.786237 16974 consensus_queue.cc:260] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:14.735877 16958 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:14.789999 16958 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:14.744971 17010 consensus_queue.cc:1048] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:07:14.791153 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:14.731336 16954 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.727958 16913 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:14.729658 16547 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:14.798189 16547 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:14.798635 16547 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:14.740921 17132 log.cc:927] Time spent T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:07:14.733958 16631 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:14.800721 16631 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.801101 16631 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.757198 17004 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:14.757253 13859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:07:14.802709 13859 raft_consensus.cc:606] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:14.763104 16830 consensus_queue.cc:1048] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:14.764492 13682 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:14.804440 16830 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:14.804831 16830 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.805156 13682 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:14.806495 13756 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:14.807772 17004 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:14.807862 17140 consensus_queue.cc:1059] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:14.808537 17004 raft_consensus.cc:697] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:14.808987 17140 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:14.809687 17004 consensus_queue.cc:237] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:14.811175 17135 log.cc:927] Time spent T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:07:14.705755 16940 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:07:14.813900 17019 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:14.732435 17077 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:14.728255 17035 raft_consensus.cc:740] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:14.828871 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2381) took 1227 ms. Trace:
I20260709 13:07:14.829301 13713 rpcz_store.cc:276] 0709 13:07:13.601371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.601485 (+   114us) service_pool.cc:224] Handling call
0709 13:07:14.352392 (+750907us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.352907 (+   515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.828669 (+475762us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b54001c48d0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:14.828813 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1726247808}
I20260709 13:07:14.827379 16977 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:14.841209 17148 log.cc:927] Time spent T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:07:14.842072 16974 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:14.805181 16830 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:14.845041 16978 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:14.845309 16996 consensus_queue.cc:260] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:14.846591 16996 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:14.847831 17035 consensus_queue.cc:260] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:14.848996 17035 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:14.847855 13756 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:14.855154 17103 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:14.826956 17077 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.874204 13756 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:14.875959 13756 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:14.748831 17051 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:14.861841 17142 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.878470 13756 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:14.871917 16694 raft_consensus.cc:2764] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
W20260709 13:07:14.897006 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 170847us
I20260709 13:07:14.873098 17077 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:14.908104 13737 debug-util.cc:398] Leaking SignalData structure 0x7b08001d7840 after lost signal to thread 14426
I20260709 13:07:14.868431 17017 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:07:14.840924 16977 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:14.878813 17150 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:14.877465 17037 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:14.900022 13756 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:14.909126 13861 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:14.898933 16913 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.923491 16913 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:14.924525 16988 consensus_meta.cc:287] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.581s	user 0.013s	sys 0.000s
I20260709 13:07:14.926039 16913 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:14.926235 16977 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:14.919027 16933 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:14.921443 17150 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.897050 17142 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:14.932865 16961 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:14.939193 16933 raft_consensus.cc:697] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:14.939735 17150 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.965193 16913 consensus_queue.cc:1048] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:07:14.977087 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 54121.1us
I20260709 13:07:14.978977 13757 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:14.981942 13858 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:14.980705 16961 raft_consensus.cc:697] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:14.983945 16961 consensus_queue.cc:237] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:14.989025 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 61506.4us
I20260709 13:07:14.971971 16470 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:14.994650 13757 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:14.995886 16913 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:14.997798 17155 log.cc:927] Time spent T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:07:15.007956 17147 log.cc:927] Time spent T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:07:14.992029 17153 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:07:15.009738 16989 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:15.002717 17015 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:15.011560 16695 raft_consensus.cc:3055] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:15.014010 14368 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:15.023844 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:15.017345 16913 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.025280 17037 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:15.061951 16913 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:15.069299 13857 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:07:15.069684 13788 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:15.049887 16695 raft_consensus.cc:740] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:15.020287 16928 consensus_queue.cc:1048] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:07:15.063284 16914 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:15.078459 16914 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:15.033337 17077 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:15.078888 16914 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:15.020131 17140 consensus_queue.cc:1059] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
W20260709 13:07:15.074808 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.034282 16547 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:15.068897 16931 consensus_meta.cc:287] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.584s	user 0.005s	sys 0.006s
I20260709 13:07:15.101679 13859 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:15.102998 13856 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:15.058655 16954 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:15.111227 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:15.109205 16954 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:15.085866 17051 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:15.132653 13865 raft_consensus.cc:1240] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:15.141821 16695 consensus_queue.cc:260] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:15.128563 16470 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.089582 17034 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:15.157193 17015 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:15.058164 16933 consensus_queue.cc:237] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:15.088798 16646 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.161459 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:15.148845 17077 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:15.159199 17033 consensus_meta.cc:287] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.580s	user 0.007s	sys 0.003s
I20260709 13:07:15.171034 16695 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.169699 17034 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:15.161015 17142 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:15.184070 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:07:15.189940 17176 log.cc:927] Time spent T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:07:15.182098 17034 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:15.230142 16631 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:15.233255 16631 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:15.166592 16470 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:15.234215 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2188) took 1045 ms. Trace:
I20260709 13:07:15.235033 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:15.235708 14396 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:15.236109 16470 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:15.237025 14401 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:15.234618 13787 rpcz_store.cc:276] 0709 13:07:14.188489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.207875 (+ 19386us) service_pool.cc:224] Handling call
0709 13:07:14.215013 (+  7138us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.215813 (+   800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.215853 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.218753 (+  2900us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.372315 (+153562us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:14.372366 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.372451 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.233464 (+861013us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b24001141e8. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f2779c4 00007f522f275acb 00007f522f430dc9 00007f522f430a55 00007f522f42ffb0 00007f52320a6488 00007f52320a6be8 00007f523207e398 00007f523207976a 00007f5232078bb6
0709 13:07:15.233916 (+   452us) raft_consensus.cc:1685] finished
0709 13:07:15.233944 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.234160 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":2163,"spinlock_wait_cycles":62310656,"thread_start_us":148217,"threads_started":1,"wal-append.queue_time_us":314077}
W20260709 13:07:15.242729 17129 log.cc:927] Time spent T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.673s	user 0.003s	sys 0.000s
I20260709 13:07:15.244071 17150 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:15.244818 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:15.246001 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:15.246222 17150 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:15.246544 14398 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:15.220453 16954 consensus_queue.cc:1059] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:07:15.176350 17033 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:15.248296 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:15.249859 17033 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:15.258739 13709 raft_consensus.cc:1240] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:15.259764 17153 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.260192 16913 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:15.260318 17153 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:15.261096 13711 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:15.262276 16913 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:15.263168 13863 raft_consensus.cc:1240] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:15.264973 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:15.265547 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:15.265749 13708 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:15.260334 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:15.263451 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.268693 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:15.236300 16547 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:15.272953 13714 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:15.266145 13784 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:07:15.275509 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:15.269450 14397 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
W20260709 13:07:15.277693 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 65042.8us
I20260709 13:07:15.277812 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:15.278560 13757 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:15.279346 13714 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:15.279528 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:15.174924 16646 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:15.280843 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:15.288915 14398 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:15.289918 14395 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:15.300067 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:15.301586 13711 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:07:15.303117 13709 raft_consensus.cc:1240] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:15.303503 14401 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:15.300735 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:15.306173 13865 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:07:15.310912 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:15.313192 14398 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:15.314741 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:15.315146 13788 raft_consensus.cc:1275] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:15.317701 13682 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:15.196877 16914 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:15.352228 17004 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:15.352802 17004 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.353277 17004 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:15.277949 16830 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:15.357533 16830 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:15.358714 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:15.317004 17017 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:07:15.361214 16978 consensus_queue.cc:1059] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:15.361559 13830 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:15.362218 16978 consensus_queue.cc:1059] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:15.363586 16977 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:15.280640 16631 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.362999 16978 consensus_queue.cc:1059] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:15.279181 17142 consensus_queue.cc:1059] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:07:15.335543 17175 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:15.335784 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:15.376461 13713 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:15.335863 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:15.349052 16646 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:15.377336 14401 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:15.332407 13714 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:15.351176 16914 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:15.372038 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:07:15.372359 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 66666us
I20260709 13:07:15.381968 14398 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:15.369915 13830 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:15.386101 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:15.386772 13863 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.392557 13830 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:15.393574 13858 raft_consensus.cc:1240] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:15.380561 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:15.397217 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:15.394678 14397 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 3.
I20260709 13:07:15.398069 13862 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:15.374259 17051 raft_consensus.cc:3055] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:15.412890 13862 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:07:15.371809 16470 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
W20260709 13:07:15.396219 17076 consensus_meta.cc:287] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.840s	user 0.013s	sys 0.000s
I20260709 13:07:15.378695 17153 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:15.395960 16974 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:15.438395 17160 log.cc:927] Time spent T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.458s	user 0.001s	sys 0.000s
I20260709 13:07:15.398486 16547 raft_consensus.cc:3055] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:15.483448 16547 raft_consensus.cc:740] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:15.453161 13787 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:15.375834 17009 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:07:15.460549 16470 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:15.378170 17034 consensus_queue.cc:1059] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:07:15.463161 14398 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:07:15.400795 17169 consensus_queue.cc:1059] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:07:15.470695 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:15.473433 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:15.405364 16978 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:15.477802 13790 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:15.477996 16646 consensus_queue.cc:1059] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:15.481601 16618 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:15.476831 13863 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:07:15.375815 16631 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:15.403791 17146 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:15.488116 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:15.488478 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:15.515722 17146 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:15.415304 17051 raft_consensus.cc:740] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:15.517165 16631 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:15.517602 17051 consensus_queue.cc:260] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:15.518420 17146 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:15.518889 17051 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:15.396610 17150 consensus_queue.cc:1048] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:07:15.519456 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:15.520098 14397 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:07:15.472640 17142 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.520725 17142 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:15.523003 17142 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:15.504587 13786 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:15.473409 16961 raft_consensus.cc:3055] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:15.524103 16961 raft_consensus.cc:740] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:15.525089 16961 consensus_queue.cc:260] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:15.526434 16961 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.476799 16933 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.404449 17175 consensus_queue.cc:1059] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:07:15.488673 16977 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:15.527184 16913 consensus_queue.cc:1059] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:15.484330 16547 consensus_queue.cc:260] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:15.531595 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:15.470775 17076 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:15.514004 16954 raft_consensus.cc:3055] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:15.535509 13755 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:15.514506 16963 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.527693 16933 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:15.547586 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:15.549701 14397 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:15.552620 16963 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:15.529789 16618 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:15.540396 16954 raft_consensus.cc:740] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:15.540539 16547 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:15.566375 13860 raft_consensus.cc:1240] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:15.503275 16470 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:15.538370 16697 raft_consensus.cc:3055] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:15.571513 13786 raft_consensus.cc:1240] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:15.581617 13680 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:15.488961 17037 raft_consensus.cc:697] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 8 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:07:15.587567 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 265394us
W20260709 13:07:15.601951 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.588724 14366 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:15.571249 16646 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:15.615914 13788 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:15.583958 16697 raft_consensus.cc:740] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:15.626317 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:15.611065 17175 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:15.616588 17142 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:15.584673 17153 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:07:15.631160 13757 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:15.586041 16913 consensus_queue.cc:1059] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:07:15.638139 13757 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:15.629108 16989 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:15.617604 17017 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:07:15.633495 16914 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.623466 16646 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:15.647604 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1081) took 1051 ms. Trace:
I20260709 13:07:15.636508 17142 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:15.639658 17077 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.639997 17173 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:15.747440 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 1987) took 1325 ms. Trace:
I20260709 13:07:15.758672 13864 rpcz_store.cc:276] 0709 13:07:14.422022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.423871 (+  1849us) service_pool.cc:224] Handling call
0709 13:07:14.424335 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.424743 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:15.456238 (+1031495us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b1800351040. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f52320864bc 00007f522f3d448b 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3ee455 00007f5235ed63c7 00007f52324e89a7 00007f52324f80bf
0709 13:07:15.456376 (+   138us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.744280 (+287904us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.746961 (+  2681us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:15.747034 (+    73us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:15.747106 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.747200 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.747351 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":270462,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":4478,"raft.queue_time_us":1336,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":143,"spinlock_wait_cycles":3987712,"thread_start_us":513706,"threads_started":2}
I20260709 13:07:15.743901 14393 rpcz_store.cc:276] 0709 13:07:14.596483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.596675 (+   192us) service_pool.cc:224] Handling call
0709 13:07:14.615669 (+ 18994us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.615901 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:14.661497 (+ 45596us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.369393 (+707896us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b1800370d80. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e23a 00007f52324e8a2a
0709 13:07:15.647125 (+277732us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:15.647196 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:15.647265 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.647359 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.647530 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":43653,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"spinlock_wait_cycles":2466560,"thread_start_us":277473,"threads_started":1}
I20260709 13:07:15.767168 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:15.646467 17150 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:15.768551 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 376033us
I20260709 13:07:15.698269 17140 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.744591 17015 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.792717 13830 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:15.765043 16989 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.634443 16954 consensus_queue.cc:260] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:15.761936 17142 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:15.878386 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 85741.2us
I20260709 13:07:15.927732 13713 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:15.928406 16943 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:15.929944 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:15.772022 17116 raft_consensus.cc:3055] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:15.931063 17116 raft_consensus.cc:740] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:07:15.893936 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.917676 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 336121us
I20260709 13:07:15.931882 13710 raft_consensus.cc:1240] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
W20260709 13:07:15.924806 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 306717us
I20260709 13:07:15.857081 16830 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:15.936342 13857 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.026s	sys 0.025s
W20260709 13:07:15.944223 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 177928us
I20260709 13:07:15.657570 16697 consensus_queue.cc:260] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:15.926421 16989 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:15.974010 16989 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:15.974944 16989 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:07:15.771450 17077 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:15.984025 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.919693 16974 raft_consensus.cc:3055] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:15.761945 16914 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:15.921113 17076 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:15.952229 16631 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.697438 17037 consensus_queue.cc:237] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:15.974622 13857 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.028s	sys 0.025s
I20260709 13:07:15.919962 16978 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:16.001745 17184 log.cc:927] Time spent T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.304s	user 0.000s	sys 0.001s
I20260709 13:07:16.003055 16914 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:15.998721 16631 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:16.005923 17185 log.cc:927] Time spent T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.394s	user 0.000s	sys 0.001s
I20260709 13:07:16.007994 16631 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:16.008908 17203 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.009537 17203 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:16.008013 17187 log.cc:927] Time spent T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:07:16.013304 16931 raft_consensus.cc:3055] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:16.013811 16931 raft_consensus.cc:740] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:16.016183 16646 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:15.920183 17015 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:16.017119 16470 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:16.018829 17015 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:15.866291 17140 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:15.998680 16978 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.020057 16978 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:16.021502 17140 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:16.023404 17077 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:16.004166 17182 log.cc:927] Time spent T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 13:07:15.981313 16830 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:15.986276 16963 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:15.992190 16974 raft_consensus.cc:740] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:15.995158 16933 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:16.035432 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.039177 13757 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:16.041256 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:16.042049 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:16.042588 13861 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:16.048889 13858 raft_consensus.cc:1275] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:16.052975 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:16.053745 13708 raft_consensus.cc:2393] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 6: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:16.121399 16914 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:16.122037 16914 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:16.014789 16931 consensus_queue.cc:260] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:16.123204 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:16.124806 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 1993) took 1643 ms. Trace:
I20260709 13:07:16.170784 13860 rpcz_store.cc:276] 0709 13:07:14.481879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.482105 (+   226us) service_pool.cc:224] Handling call
0709 13:07:14.492526 (+ 10421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.573715 (+1081189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.124517 (+550802us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400235854. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:16.124745 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2468962560}
I20260709 13:07:16.125883 13859 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:07:16.138542 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.173357 13865 raft_consensus.cc:1275] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:16.121462 17116 consensus_queue.cc:260] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:16.188812 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:16.191663 16931 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.191323 16974 consensus_queue.cc:260] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:16.192473 17169 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:16.192991 17169 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:16.037839 17076 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:16.025822 17202 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.140s
I20260709 13:07:16.056424 16963 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.199774 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:16.197871 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:16.201928 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:16.202827 13788 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:16.202948 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 147280us
I20260709 13:07:16.203299 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:16.204766 13601 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f09ef105d67b41dba510b44a6567d790 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b5029654a4384e43a68eb67b794949b7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:07:16.206415 17189 log.cc:927] Time spent T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:07:16.206884 13791 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:07:16.207226 13791 pending_rounds.cc:85] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 5
I20260709 13:07:16.207469 13791 pending_rounds.cc:107] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:07:16.207723 13791 raft_consensus.cc:2889] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:16.205926 13861 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:07:16.170140 16830 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:16.210438 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:16.231702 13829 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:16.236248 13829 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:16.199991 17203 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:16.274333 13708 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:07:16.278821 17004 consensus_meta.cc:287] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.925s	user 0.009s	sys 0.000s
I20260709 13:07:16.230899 17150 raft_consensus.cc:697] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:16.228907 17034 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:16.271332 17140 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.294507 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:16.296492 13790 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:16.230685 17009 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:16.287103 16914 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:16.298049 17009 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:16.382475 13788 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:07:16.237277 16963 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:07:16.398986 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 466571us
W20260709 13:07:16.275555 17200 log.cc:927] Time spent T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:07:16.398779 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 127915us
I20260709 13:07:16.283702 17077 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:16.274857 17172 log.cc:927] Time spent T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:07:16.402343 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:16.420523 13788 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:07:16.420297 17077 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:16.421638 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:16.422302 13788 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:07:16.422228 17077 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:16.419364 16963 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:16.202380 17076 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:16.288028 17034 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:16.460888 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:16.461588 14399 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 4.
I20260709 13:07:16.461813 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:16.462466 17034 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:16.463817 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:16.463954 17077 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:16.464494 13789 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:07:16.291074 16978 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:16.467356 16978 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:16.211074 16470 consensus_queue.cc:1059] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.102s
W20260709 13:07:16.412873 16961 consensus_meta.cc:287] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.886s	user 0.014s	sys 0.000s
I20260709 13:07:16.280386 16694 raft_consensus.cc:3055] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:16.292061 17140 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:16.469165 13611 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49428 (request call id 327) took 19605 ms (client timeout 15000 ms). Trace:
I20260709 13:07:16.470824 17140 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:16.279390 17004 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:16.471688 17116 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:16.471752 13614 catalog_manager.cc:5697] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 5 to 6, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 6 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:16.473183 17004 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:16.473428 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:16.370518 16933 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.473925 16933 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:16.474375 13711 raft_consensus.cc:2393] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 4: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:16.475891 16933 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:16.370502 17202 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:16.476688 17202 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:16.476960 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 1935) took 1157 ms. Trace:
I20260709 13:07:16.477440 13711 rpcz_store.cc:276] 0709 13:07:15.319648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.319810 (+   162us) service_pool.cc:224] Handling call
0709 13:07:16.476724 (+1156914us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540008e154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:16.476889 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2522101248}
I20260709 13:07:16.478691 17202 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:16.478183 13614 catalog_manager.cc:5697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 4 to 5, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 5 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:16.479841 17051 consensus_meta.cc:287] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.960s	user 0.014s	sys 0.000s
I20260709 13:07:16.371697 16914 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.288223 17150 consensus_queue.cc:237] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:16.469588 13611 rpcz_store.cc:269] 0709 13:06:56.864172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.864513 (+   341us) service_pool.cc:224] Handling call
0709 13:07:16.469079 (+19604566us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:09.923886 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:09.924600 (+   714us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:09.924661 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:07:09.924693 (+    32us) tablet.cc:662] Decoding operations
0709 13:07:09.925655 (+   962us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:09.925743 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:09.925773 (+    30us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:07:09.926506 (+   733us) tablet.cc:701] Row locks acquired
0709 13:07:09.926550 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:07:09.926714 (+   164us) write_op.cc:270] Start()
0709 13:07:09.926857 (+   143us) write_op.cc:276] Timestamp: P: 1783602429926647 usec, L: 0
0709 13:07:09.926889 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:07:09.975578 (+ 48689us) log.cc:844] Serialized 3218 byte log entry
0709 13:07:10.510386 (+534808us) op_driver.cc:464] REPLICATION: finished
0709 13:07:10.745543 (+235157us) write_op.cc:301] APPLY: starting
0709 13:07:10.757180 (+ 11637us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:10.836577 (+ 79397us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:10.889703 (+ 53126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:11.298682 (+408979us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:11.317768 (+ 19086us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:07:11.317912 (+   144us) write_op.cc:312] APPLY: finished
0709 13:07:11.318533 (+   621us) log.cc:844] Serialized 65 byte log entry
0709 13:07:11.319595 (+  1062us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:11.319817 (+   222us) write_op.cc:454] Released schema lock
0709 13:07:11.320023 (+   206us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:11.320821 (+   798us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:11.320892 (+    71us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":535179,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":209789,"apply.run_cpu_time_us":11057,"apply.run_wall_time_us":600192,"num_ops":8,"prepare.queue_time_us":412479,"prepare.run_cpu_time_us":17825,"prepare.run_wall_time_us":174758,"raft.queue_time_us":201715,"raft.run_cpu_time_us":21060,"raft.run_wall_time_us":137294,"replication_time_us":583337,"thread_start_us":539172,"threads_started":4,"wal-append.queue_time_us":73177,"wal-append.run_cpu_time_us":36150,"wal-append.run_wall_time_us":2273981}]]}
I20260709 13:07:16.482761 13614 catalog_manager.cc:5697] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 5 to 7, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 7 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:16.484740 16547 consensus_meta.cc:287] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.906s	user 0.009s	sys 0.000s
I20260709 13:07:16.484542 13614 catalog_manager.cc:5697] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:16.486132 13614 catalog_manager.cc:5697] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:16.495638 16974 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.496302 16914 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:16.499524 13614 catalog_manager.cc:5697] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 3 to 5, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 5 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:16.501991 13614 catalog_manager.cc:5697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 4 to 6, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 6 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:16.513888 13790 raft_consensus.cc:2410] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:07:16.399897 16988 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.315s	user 0.022s	sys 0.009s
W20260709 13:07:16.429864 13782 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.010s	sys 0.031s
I20260709 13:07:16.286165 17169 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:16.434466 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 157264us
I20260709 13:07:16.445801 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:16.447403 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:16.529690 14402 raft_consensus.cc:2410] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:07:16.529153 13782 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.010s	sys 0.031s
W20260709 13:07:16.456241 13682 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.046s	sys 0.110s
W20260709 13:07:16.531170 13682 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.046s	sys 0.110s
I20260709 13:07:16.531595 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:07:16.531635 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 598754us
I20260709 13:07:16.532332 13708 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:16.468998 16694 raft_consensus.cc:740] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:16.272993 17191 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:16.535652 13713 raft_consensus.cc:1240] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:16.549849 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:16.551627 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:16.552098 13857 raft_consensus.cc:1240] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:16.552214 13859 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:07:16.555387 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:16.555621 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:16.556123 13860 raft_consensus.cc:2393] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 9: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:16.463052 17034 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:07:16.555377 13708 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:07:16.559087 17191 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:16.559705 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:16.560210 16694 consensus_queue.cc:260] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:16.584306 16694 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:16.585227 17191 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:16.586370 13861 raft_consensus.cc:2410] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:16.522588 16830 consensus_queue.cc:1059] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:07:16.562717 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:16.588094 16914 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:16.588488 13856 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
W20260709 13:07:16.549999 17142 consensus_meta.cc:287] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.003s
I20260709 13:07:16.567952 16954 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:16.589150 17142 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:16.588022 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:16.601841 17142 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:16.604964 13715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2400) took 1519 ms. Trace:
I20260709 13:07:16.605458 13715 rpcz_store.cc:276] 0709 13:07:15.085979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.086125 (+   146us) service_pool.cc:224] Handling call
0709 13:07:15.104480 (+ 18355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:15.318703 (+214223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:15.318732 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:15.319142 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 13:07:15.642485 (+323343us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:15.642544 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.604469 (+961925us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54001b8d54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:16.604537 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:16.604599 (+    62us) raft_consensus.cc:1685] finished
0709 13:07:16.604619 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.604892 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1315,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":127,"spinlock_wait_cycles":491890944,"thread_start_us":282845,"threads_started":1,"wal-append.queue_time_us":580697}
I20260709 13:07:16.570680 16618 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:16.507079 13614 catalog_manager.cc:5697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 6 to 11, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 11 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:16.664628 13614 catalog_manager.cc:5697] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:16.581511 16844 raft_consensus.cc:3055] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:16.667740 16844 raft_consensus.cc:740] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:16.668799 16844 consensus_queue.cc:260] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:16.670017 16844 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.582033 13858 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:07:16.526496 16988 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.441s	user 0.023s	sys 0.009s
I20260709 13:07:16.622882 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2195) took 1060 ms. Trace:
I20260709 13:07:16.633026 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:16.637943 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 758) took 1375 ms. Trace:
I20260709 13:07:16.672091 13782 rpcz_store.cc:276] 0709 13:07:15.469979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.470833 (+   854us) service_pool.cc:224] Handling call
0709 13:07:15.471171 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.472043 (+   872us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:15.496680 (+ 24637us) log.cc:844] Serialized 14 byte log entry
0709 13:07:16.530327 (+1033647us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:16.530382 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:16.530431 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.530494 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.530601 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62822,"prepare.queue_time_us":24408,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":94673,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":57802,"thread_start_us":970299,"threads_started":2,"wal-append.queue_time_us":504531}
I20260709 13:07:16.672078 13787 rpcz_store.cc:276] 0709 13:07:15.262525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.267230 (+  4705us) service_pool.cc:224] Handling call
0709 13:07:15.306298 (+ 39068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.485383 (+179085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.637646 (+1152263us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54001e7154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:16.637873 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336746240}
I20260709 13:07:16.655148 16697 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.657955 17076 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:16.666350 13614 catalog_manager.cc:5697] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:16.680840 17009 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:16.681114 13614 catalog_manager.cc:5697] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 2 to 4, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 4 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:16.683467 13614 catalog_manager.cc:5697] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 4 to 5, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 5 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:16.684902 16963 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:16.686110 13614 catalog_manager.cc:5697] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 4 to 6, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 6 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:16.689913 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.700276 14366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.014s	sys 0.032s
W20260709 13:07:16.709923 14366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.014s	sys 0.032s
I20260709 13:07:16.710407 13614 catalog_manager.cc:5697] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 3 to 4, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 4 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:16.719599 13614 catalog_manager.cc:5697] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 6 to 7, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 7 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:16.714375 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 165685us
I20260709 13:07:16.726752 13830 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:16.732887 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:16.733729 13861 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
W20260709 13:07:16.761010 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.762949 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:16.763686 14395 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 3.
I20260709 13:07:16.763707 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:16.761094 14367 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.009s	sys 0.022s
I20260709 13:07:16.765161 14394 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:07:16.766320 14367 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.009s	sys 0.022s
I20260709 13:07:16.761026 13614 catalog_manager.cc:5697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 4 to 7, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 7 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:16.776263 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 143330us
I20260709 13:07:16.778004 13829 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:16.772581 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:16.774339 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:16.774816 13860 raft_consensus.cc:1240] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:16.775135 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:16.781927 14367 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:16.778756 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.771023 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:16.774179 13863 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:16.773460 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:16.770639 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:16.786268 13858 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.786675 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:16.787217 14399 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:16.780603 13865 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
W20260709 13:07:16.788930 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 62271.7us
I20260709 13:07:16.789640 14367 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:16.791297 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:16.790787 14367 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:16.791782 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:16.792995 13708 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 7: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:16.794502 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:16.778720 13785 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:16.795261 13865 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:07:16.764667 17049 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.811029 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:16.812047 13784 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:16.812047 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:16.813228 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:16.813520 13829 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:16.799347 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:16.787803 13614 catalog_manager.cc:5697] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 5 to 7, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 7 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:16.802901 14368 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:16.803197 17142 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.803642 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:16.772244 16989 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.804113 16974 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:16.804147 17175 consensus_queue.cc:1059] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:16.771345 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:16.803170 16977 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.805246 17210 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:16.792269 16547 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:16.834555 14396 raft_consensus.cc:2393] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 9: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:16.834488 16547 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:16.806116 13858 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:07:16.814630 14402 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:16.809631 16996 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:16.807061 17212 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:16.818292 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:07:16.804028 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 78434.9us
I20260709 13:07:16.819387 13829 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:16.820906 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.821507 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.845006 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.820361 13756 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:16.772580 17213 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.826668 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:16.827065 17033 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:16.775996 17191 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.829460 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:16.773568 16844 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:16.772753 17004 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:16.788403 17076 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:16.832175 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.825230 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:16.833274 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:16.801059 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:16.793099 17009 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:16.823464 13614 catalog_manager.cc:5697] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 3 to 4, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 4 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:16.876421 13614 catalog_manager.cc:5697] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 6 to 7, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 7 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:16.810058 17188 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.804052 17116 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:16.849951 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 47123.5us
I20260709 13:07:16.843345 13757 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:16.769966 17198 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.816804 17138 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:16.826903 16978 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:07:16.839241 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 45748.2us
I20260709 13:07:16.857656 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:16.855006 13783 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
W20260709 13:07:16.835487 16946 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.019s	sys 0.015s
I20260709 13:07:16.856891 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:16.804268 17056 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:16.877050 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:16.878836 13614 catalog_manager.cc:5697] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 1 to 2, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 2 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:16.838613 16996 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:16.823230 17049 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:16.839676 16974 raft_consensus.cc:697] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:16.898545 14368 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:16.906364 14368 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:16.859656 17223 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:16.907222 14368 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:16.908634 14368 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:16.909723 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:16.910387 14394 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:16.835654 16977 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:16.900790 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 43980.8us
I20260709 13:07:16.856084 16914 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:16.829797 16989 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:16.900336 16946 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.019s	sys 0.015s
I20260709 13:07:16.904691 17051 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:16.923642 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 80412us
I20260709 13:07:16.904546 17056 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:16.905068 17224 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:16.905282 16996 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:16.903378 17116 raft_consensus.cc:697] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:16.860087 17033 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:16.941212 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:16.942006 13786 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:16.912802 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:16.903942 13614 catalog_manager.cc:5697] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 5 to 7, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 7 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:16.911998 17203 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:16.898957 14367 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:16.859756 17197 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:16.917914 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:16.927651 13783 raft_consensus.cc:1240] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:16.912891 17223 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:16.931229 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:16.932477 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:16.932643 13829 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:16.914496 17210 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:16.935730 14396 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:07:16.888834 17004 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:16.926281 17207 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.944145 13614 catalog_manager.cc:5697] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:16.913724 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:16.875954 17191 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:16.917946 16470 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:16.948799 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:16.949102 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 128849us
I20260709 13:07:16.949156 13757 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:16.856663 17212 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:16.914749 16931 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:16.953011 13791 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:16.950882 14397 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
W20260709 13:07:16.953752 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 54870.7us
I20260709 13:07:16.892135 17076 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:16.898840 17188 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:16.957074 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:16.914749 17017 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:16.974098 14398 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
W20260709 13:07:17.049119 13709 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.110s	user 0.009s	sys 0.050s
W20260709 13:07:17.049587 13709 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.114s	user 0.009s	sys 0.050s
I20260709 13:07:16.948490 17033 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.957060 16997 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.933873 17175 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:16.973316 13614 catalog_manager.cc:5697] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 8 to 9, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 9 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:16.900193 17138 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:16.903184 17009 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:16.903856 16978 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:16.863168 17213 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:16.890447 16844 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:17.035753 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 86643.7us
I20260709 13:07:17.096010 13757 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:16.956442 17223 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.035761 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:17.097179 14397 raft_consensus.cc:2410] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:16.914805 17206 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:07:17.106642 13757 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:07:17.039620 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 100291us
I20260709 13:07:16.955026 17051 raft_consensus.cc:697] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:17.005859 17077 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:16.897459 17198 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:17.064106 17017 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.078573 17217 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:17.084445 13614 catalog_manager.cc:5697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 2 to 5, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 5 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:17.099306 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:17.012970 16931 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:17.110891 13861 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:07:17.148190 13861 pending_rounds.cc:85] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 5
I20260709 13:07:17.148542 13861 pending_rounds.cc:107] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:07:17.148823 13861 raft_consensus.cc:2889] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:17.111111 14366 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:17.065521 17000 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:17.113171 17197 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.105218 17056 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:16.944183 17224 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:17.130316 13784 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:07:17.058584 14399 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:07:17.132551 14394 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:07:17.092855 16697 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.126700 13614 catalog_manager.cc:5697] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 5 to 6, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 6 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:17.154229 13865 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:17.113363 16618 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.113044 16694 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:17.118877 17077 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.074709 17175 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.024811 16470 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:17.158967 17000 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:17.178424 17056 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:17.197994 13710 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.004s	user 0.031s	sys 0.065s
W20260709 13:07:17.214352 13710 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.031s	sys 0.065s
I20260709 13:07:17.183224 17077 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:17.124276 17017 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.120903 16948 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:17.125571 16547 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:17.176628 13714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.237s	user 0.034s	sys 0.072s
W20260709 13:07:17.243062 13714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.308s	user 0.034s	sys 0.072s
I20260709 13:07:17.153214 16931 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:17.147895 16933 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:17.121904 16914 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:07:17.009254 17207 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:17.121357 16997 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:07:17.075949 16974 consensus_queue.cc:237] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:17.161496 17202 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:07:17.120639 17037 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.014s	sys 0.054s
I20260709 13:07:17.181735 17004 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:17.122558 17116 consensus_queue.cc:237] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:17.187700 17175 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.241654 16977 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:17.167878 13864 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.228s	user 0.070s	sys 0.107s
I20260709 13:07:17.177977 17217 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:07:17.182789 16618 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:17.168972 17178 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:07:17.196449 17000 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.195292 17049 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:17.170147 17197 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:17.367321 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.219163 17056 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:17.345894 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.246490 16948 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:07:17.346730 13864 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.407s	user 0.072s	sys 0.107s
W20260709 13:07:17.266304 17037 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.014s	sys 0.055s
W20260709 13:07:17.343575 17173 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.349s	user 0.035s	sys 0.035s
I20260709 13:07:17.260648 16997 consensus_queue.cc:1243] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer b5029654a4384e43a68eb67b794949b7 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:17.217799 17051 consensus_queue.cc:237] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:17.180341 16697 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:17.428215 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.435377 13680 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.010s	sys 0.038s
W20260709 13:07:17.286571 16646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.007s	sys 0.015s
W20260709 13:07:17.434911 17173 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.511s	user 0.035s	sys 0.035s
I20260709 13:07:17.432425 16948 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.426730 17212 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:17.284480 17215 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:17.444199 13858 pending_rounds.cc:85] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 3
W20260709 13:07:17.444903 13790 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.008s	sys 0.028s
W20260709 13:07:17.454825 13856 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.033s	sys 0.019s
W20260709 13:07:17.348423 16830 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.001s	sys 0.029s
W20260709 13:07:17.411109 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.254215 16933 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:17.461464 13857 raft_consensus.cc:1275] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:17.347682 16547 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.436594 17188 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:17.443486 13863 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.016s	sys 0.018s
I20260709 13:07:17.432809 17056 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:17.483125 13863 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.016s	sys 0.019s
I20260709 13:07:17.363090 17178 consensus_queue.cc:1243] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer b5029654a4384e43a68eb67b794949b7 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:17.471787 13858 pending_rounds.cc:107] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 8.4
W20260709 13:07:17.472275 13856 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.033s	sys 0.019s
I20260709 13:07:17.488499 13858 raft_consensus.cc:2889] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:17.458891 16646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.007s	sys 0.026s
W20260709 13:07:17.455353 17150 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.030s	sys 0.085s
I20260709 13:07:17.282702 17202 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:17.454922 17076 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:17.459290 17037 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:17.489764 17150 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.030s	sys 0.085s
I20260709 13:07:17.442436 16844 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:17.460525 17191 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:17.479385 16830 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.001s	sys 0.030s
I20260709 13:07:17.459591 17173 raft_consensus.cc:697] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:17.475068 17009 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:17.497357 14395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.019s	sys 0.043s
W20260709 13:07:17.508445 14395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.020s	sys 0.044s
W20260709 13:07:17.491930 16946 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.011s	sys 0.025s
W20260709 13:07:17.502266 17229 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:07:17.493317 17034 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:17.519047 16946 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.012s	sys 0.025s
I20260709 13:07:17.493156 16547 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:17.494962 17213 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:17.488665 17215 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
W20260709 13:07:17.528695 17219 log.cc:927] Time spent T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.337s	user 0.001s	sys 0.000s
I20260709 13:07:17.524605 17138 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:17.525283 17224 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:17.500285 17037 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:17.525640 17210 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.010s	sys 0.006s
I20260709 13:07:17.549703 17173 consensus_queue.cc:237] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:17.557775 17210 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.011s	sys 0.007s
I20260709 13:07:17.569505 17207 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:17.556289 17202 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:17.576148 17210 raft_consensus.cc:697] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:17.600162 17037 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:17.604115 17210 consensus_queue.cc:237] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:17.622969 17215 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:17.572615 17198 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:17.630049 17034 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:17.630753 17034 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.631716 17208 raft_consensus.cc:3055] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:17.632225 17208 raft_consensus.cc:740] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:17.633312 17208 consensus_queue.cc:260] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:17.635743 17208 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:17.648810 17226 log.cc:927] Time spent T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.113s	user 0.000s	sys 0.002s
W20260709 13:07:17.651782 17245 log.cc:927] Time spent T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.052s	user 0.002s	sys 0.000s
W20260709 13:07:17.670877 17223 consensus_meta.cc:287] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.547s	user 0.007s	sys 0.004s
I20260709 13:07:17.672006 17197 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:17.673492 17077 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:17.677712 17175 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:17.679569 17223 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:17.682339 17223 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:17.462414 13679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.000s	sys 0.012s
W20260709 13:07:17.722985 13679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.000s	sys 0.013s
W20260709 13:07:17.724066 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.458971 13680 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.010s	sys 0.038s
I20260709 13:07:17.733410 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:17.735265 13712 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:17.735733 13682 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.026s	sys 0.029s
W20260709 13:07:17.736369 13682 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.970s	user 0.026s	sys 0.029s
W20260709 13:07:17.736837 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 1.20399e+06us
I20260709 13:07:17.737246 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:17.739667 13709 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.018s	sys 0.044s
W20260709 13:07:17.740085 13709 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.019s	sys 0.045s
I20260709 13:07:17.742492 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:17.465313 13715 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.007s	sys 0.005s
W20260709 13:07:17.743911 13715 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.007s	sys 0.005s
I20260709 13:07:17.744095 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:17.745838 13680 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:17.746556 13708 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:17.748159 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1944) took 1697 ms. Trace:
I20260709 13:07:17.748777 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:17.750138 13711 raft_consensus.cc:2393] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 6: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:17.748752 13710 rpcz_store.cc:276] 0709 13:07:16.050561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.050754 (+   193us) service_pool.cc:224] Handling call
0709 13:07:16.136431 (+ 85677us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.136830 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.136874 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.137469 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.214812 (+1077343us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:17.214874 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.214975 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.747614 (+532639us) raft_consensus.cc:1685] finished
0709 13:07:17.747646 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.747921 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":24064,"thread_start_us":1020668,"threads_started":1,"wal-append.queue_time_us":1297736}
I20260709 13:07:17.751621 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:17.752635 13713 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:17.754674 13756 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.006s	sys 0.007s
W20260709 13:07:17.755110 13756 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.006s	sys 0.007s
W20260709 13:07:17.755627 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 653373us
I20260709 13:07:17.748127 13680 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:07:17.768821 13782 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.004s	sys 0.009s
I20260709 13:07:17.768486 13682 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:07:17.769955 13782 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.005s	sys 0.009s
W20260709 13:07:17.773891 13787 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.000s	sys 0.013s
W20260709 13:07:17.774360 13787 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.000s	sys 0.013s
W20260709 13:07:17.471915 13790 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.008s	sys 0.028s
I20260709 13:07:17.776528 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:17.777236 13789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1705) took 1293 ms. Trace:
I20260709 13:07:17.777680 13789 rpcz_store.cc:276] 0709 13:07:16.483738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.487531 (+  3793us) service_pool.cc:224] Handling call
0709 13:07:16.487893 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.690425 (+202532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.690472 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.691150 (+   678us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.124440 (+433290us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:17.124494 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.124601 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.776644 (+652043us) raft_consensus.cc:1685] finished
0709 13:07:17.776701 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.777008 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":246363,"raft.queue_time_us":211606,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":3197,"thread_start_us":432877,"threads_started":1,"wal-append.queue_time_us":749574}
W20260709 13:07:17.479599 13829 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.009s	sys 0.042s
W20260709 13:07:17.780525 13829 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.010s	sys 0.043s
W20260709 13:07:17.782475 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 849864us
I20260709 13:07:17.784420 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:17.787940 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:17.788787 13829 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:17.788954 13707 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
I20260709 13:07:17.790906 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:17.792559 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:17.793634 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:17.799398 13830 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:17.800863 13707 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:07:17.804842 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:17.828097 13711 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:07:17.806006 13856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 729) took 1035 ms. Trace:
I20260709 13:07:17.829133 13856 rpcz_store.cc:276] 0709 13:07:16.770840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.771603 (+   763us) service_pool.cc:224] Handling call
0709 13:07:16.771935 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.801896 (+ 29961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.801928 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.802449 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.488670 (+686221us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:17.488712 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.488789 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.805483 (+316694us) raft_consensus.cc:1685] finished
0709 13:07:17.805527 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.805779 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29598,"raft.queue_time_us":30735,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":685874,"threads_started":1,"wal-append.queue_time_us":815517}
I20260709 13:07:17.833907 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:17.836139 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:17.836979 13710 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:17.838464 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:17.809504 13830 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:07:17.810226 13861 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.010s	sys 0.013s
W20260709 13:07:17.810833 14365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.010s	sys 0.005s
W20260709 13:07:17.839841 13861 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.010s	sys 0.014s
W20260709 13:07:17.839890 14365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.010s	sys 0.005s
W20260709 13:07:17.811362 14366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.005s	sys 0.009s
W20260709 13:07:17.843693 14366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.006s	sys 0.009s
I20260709 13:07:17.843771 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:07:17.844107 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 691101us
I20260709 13:07:17.844715 13710 raft_consensus.cc:2393] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 6: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:17.845155 14366 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:07:17.811830 14367 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.008s	sys 0.008s
W20260709 13:07:17.847635 14367 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.008s	sys 0.008s
W20260709 13:07:17.848053 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 809922us
I20260709 13:07:17.812958 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42104 (request call id 738) took 1011 ms. Trace:
I20260709 13:07:17.851733 13865 rpcz_store.cc:276] 0709 13:07:16.801376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.824933 (+ 23557us) service_pool.cc:224] Handling call
0709 13:07:17.812536 (+987603us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b540024f754. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:17.812719 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":641252736}
W20260709 13:07:17.816870 14402 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.004s	sys 0.012s
W20260709 13:07:17.853152 14402 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.005s	sys 0.012s
I20260709 13:07:17.818275 14398 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:17.819121 14401 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.022s	sys 0.025s
W20260709 13:07:17.825296 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.847034 14366 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:17.857610 13713 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:07:17.972870 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:17.974673 14401 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.050s	user 0.023s	sys 0.026s
I20260709 13:07:17.981540 13708 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
W20260709 13:07:17.986342 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 139524us
W20260709 13:07:18.005741 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 266432us
I20260709 13:07:18.005637 17206 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:18.006084 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 211229us
I20260709 13:07:18.006341 16618 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:18.010754 16695 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.012589 16695 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:18.010412 16646 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:18.016152 17215 consensus_queue.cc:1059] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:18.016330 16646 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.018512 16697 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:18.018970 16646 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:18.019140 16977 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.020066 16977 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:18.020593 17231 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:18.021075 17230 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:18.021595 17230 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:18.022028 17230 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.022194 17239 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:18.022910 16977 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:18.024693 16946 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:18.020089 17232 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:07:18.027725 16695 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:18.031788 17223 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:18.032642 17223 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:18.033828 16830 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.033463 17223 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:18.034353 16830 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:18.035326 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 225961us
I20260709 13:07:18.035952 17223 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:18.036897 17223 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:18.037025 17203 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:18.037443 17223 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.037568 13830 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:18.037817 17009 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:18.033454 17232 consensus_queue.cc:1059] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:07:18.038872 17232 consensus_queue.cc:1243] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer b5029654a4384e43a68eb67b794949b7 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:18.038703 17009 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:18.039101 13830 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:18.039613 17232 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:18.040700 16646 raft_consensus.cc:3055] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:18.041133 17009 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:18.041972 17009 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:18.042342 17009 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.042649 17009 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:18.044476 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.045506 13713 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
I20260709 13:07:18.047026 17169 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.041096 16646 raft_consensus.cc:740] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:18.047391 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.048787 17077 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:18.048532 16646 consensus_queue.cc:260] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:18.049654 17077 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:18.050141 17077 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.050235 16646 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:18.047669 17169 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:18.050879 17077 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.051565 16844 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.052217 16844 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.053309 17169 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:18.054510 16844 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:18.037880 17223 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.055342 17197 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:18.047844 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.057711 16933 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:17.524099 16470 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:18.067821 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.072415 13830 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:07:18.061334 13756 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.129:37533 timed out after 2.097s (SENT) [suppressed 7 similar messages]
I20260709 13:07:18.009624 17206 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.079493 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:18.071364 14366 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:18.005926 17214 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.036899 16830 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:18.119055 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:18.126255 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 360365us
I20260709 13:07:18.129016 13708 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:07:18.085358 16977 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:18.136337 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.090361 17203 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:07:18.137109 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 128735us
I20260709 13:07:18.095134 17197 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:18.092850 17206 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:18.157168 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.134531 16977 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.167027 13711 raft_consensus.cc:2393] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 4: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:18.167352 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1099) took 1240 ms. Trace:
W20260709 13:07:18.175026 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 166337us
W20260709 13:07:18.172700 13858 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.019s	sys 0.003s
W20260709 13:07:18.176373 13858 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.019s	sys 0.004s
I20260709 13:07:18.176206 17159 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:18.173321 14398 rpcz_store.cc:276] 0709 13:07:16.923166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.049526 (+126360us) service_pool.cc:224] Handling call
0709 13:07:17.049842 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.912631 (+862789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.134875 (+222244us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b54000fa854. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:18.163015 (+ 28140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1765913344}
W20260709 13:07:18.179394 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.133301 17230 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.174396 16977 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:18.188005 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 160611us
W20260709 13:07:18.194440 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 99260.4us
W20260709 13:07:18.184405 13863 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.008s	sys 0.017s
W20260709 13:07:18.180598 17142 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.001s	sys 0.001s
W20260709 13:07:18.180717 13614 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.003s	sys 0.031s
I20260709 13:07:18.184288 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:18.184378 16974 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.000s	sys 0.012s
W20260709 13:07:18.184481 17051 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.005s	sys 0.015s
W20260709 13:07:18.204296 13614 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.004s	sys 0.032s
W20260709 13:07:18.203713 16974 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.000s	sys 0.013s
W20260709 13:07:18.206797 17051 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.006s	sys 0.015s
I20260709 13:07:18.210891 16547 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:18.211406 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2672) took 2436 ms. Trace:
W20260709 13:07:18.211573 17210 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.006s	sys 0.016s
W20260709 13:07:18.212154 17210 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.006s	sys 0.016s
W20260709 13:07:18.214170 17116 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.013s	sys 0.026s
I20260709 13:07:18.214637 17230 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:18.214810 16943 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:18.217484 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:18.184779 17203 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:18.204540 13863 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.009s	sys 0.017s
I20260709 13:07:18.218894 13860 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
W20260709 13:07:18.221015 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 149084us
I20260709 13:07:18.221659 14393 raft_consensus.cc:1240] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:18.207379 13714 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.018s	sys 0.014s
I20260709 13:07:18.199615 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:18.239511 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:18.240476 13860 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:07:18.241648 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:18.245535 17203 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:18.214668 17116 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.014s	sys 0.027s
I20260709 13:07:18.245786 17227 consensus_queue.cc:1048] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:18.220122 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:18.247790 13862 raft_consensus.cc:2410] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:07:18.249348 13862 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:18.249402 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:18.250582 17244 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:18.211876 13864 rpcz_store.cc:276] 0709 13:07:15.762488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.769234 (+  6746us) service_pool.cc:224] Handling call
0709 13:07:15.769576 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:15.773780 (+  4204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:15.773827 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:15.824870 (+ 51043us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.428315 (+1603445us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:17.811040 (+382725us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.153770 (+342730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.174394 (+ 20624us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.178606 (+  4212us) raft_consensus.cc:1685] finished
0709 13:07:18.178624 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.199175 (+ 20551us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":184508,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":225940,"raft.run_cpu_time_us":462,"raft.run_wall_time_us":6310,"thread_start_us":2176798,"threads_started":3,"wal-append.queue_time_us":1582448}
I20260709 13:07:18.252090 13755 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:18.253717 13755 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:18.243090 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:18.255863 13860 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:07:18.255640 17159 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:18.256690 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.257501 13713 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:07:18.258884 17159 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:18.259851 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.261142 13715 raft_consensus.cc:2393] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 7: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:18.262348 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.263564 17188 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:18.184864 17212 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:18.264288 17188 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.264855 17212 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:18.266486 17004 raft_consensus.cc:3055] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:18.266887 17004 raft_consensus.cc:740] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:07:18.272081 13714 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.021s	user 0.020s	sys 0.014s
I20260709 13:07:18.273221 16695 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:18.273711 16695 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:18.274145 16695 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:18.274523 17211 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.004s	sys 0.020s
W20260709 13:07:18.274933 17211 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.004s	sys 0.020s
W20260709 13:07:18.211658 17173 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.004s	sys 0.020s
W20260709 13:07:18.275584 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 77525.2us
I20260709 13:07:18.224560 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.274014 16989 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:18.297821 17244 raft_consensus.cc:697] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:18.307803 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 736) took 1521 ms. Trace:
I20260709 13:07:18.308338 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:18.308956 17244 consensus_queue.cc:237] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.310169 16697 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:18.310062 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.311969 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.312767 13715 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 8: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:18.199540 17076 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.236s
I20260709 13:07:18.310619 16697 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.324446 13708 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
W20260709 13:07:18.314810 13712 consensus_meta.cc:287] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.578s	user 0.013s	sys 0.003s
I20260709 13:07:18.201586 17214 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.320470 14396 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:18.325903 13712 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:07:18.259888 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:18.199717 17198 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:18.291226 17231 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:18.355808 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.356208 13864 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:07:18.322073 17173 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.004s	sys 0.022s
I20260709 13:07:18.342747 13859 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:07:18.360054 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.361315 16914 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:18.362125 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.368213 17175 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:18.369109 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1103) took 1410 ms. Trace:
W20260709 13:07:18.342453 13601 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f09ef105d67b41dba510b44a6567d790 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b5029654a4384e43a68eb67b794949b7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:18.342684 14401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1097) took 1420 ms. Trace:
I20260709 13:07:18.327154 16697 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:18.343850 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2689) took 1187 ms. Trace:
I20260709 13:07:18.371775 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:18.347657 13757 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:18.224897 17197 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.351769 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:18.352600 17213 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.353272 13715 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:18.353657 16989 consensus_queue.cc:1048] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:18.369560 14393 rpcz_store.cc:276] 0709 13:07:16.958656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.070563 (+111907us) service_pool.cc:224] Handling call
0709 13:07:17.071039 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.277508 (+1206469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.368795 (+ 91287us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54005c1054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:18.369049 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2644827904}
W20260709 13:07:18.374398 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 74863.6us
I20260709 13:07:18.360661 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1939) took 2433 ms. Trace:
I20260709 13:07:18.346778 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 770) took 1451 ms. Trace:
I20260709 13:07:18.357023 17223 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.370908 14401 rpcz_store.cc:276] 0709 13:07:16.922498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.923350 (+   852us) service_pool.cc:224] Handling call
0709 13:07:16.923705 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.923936 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:18.067067 (+1143131us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.341866 (+274799us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.341964 (+    98us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:18.342273 (+   309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.342456 (+   183us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.342622 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5216,"prepare.queue_time_us":688383,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":21642,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":231,"thread_start_us":1217446,"threads_started":2}
W20260709 13:07:18.389791 17208 consensus_meta.cc:287] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.692s	user 0.009s	sys 0.005s
I20260709 13:07:18.393990 16695 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:18.395002 17017 consensus_meta.cc:287] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 1.140s	user 0.012s	sys 0.005s
I20260709 13:07:18.396994 17273 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.400167 13715 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:18.308419 13863 rpcz_store.cc:276] 0709 13:07:16.786279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.789597 (+  3318us) service_pool.cc:224] Handling call
0709 13:07:16.789894 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.790074 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:17.483965 (+693891us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.290747 (+806782us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.307094 (+ 16347us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:18.307219 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.307318 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.307586 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":776530,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":7088,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":136,"thread_start_us":1413480,"threads_started":2}
I20260709 13:07:18.401368 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.399729 17153 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.343209 17251 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:18.405092 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 82029.9us
I20260709 13:07:18.413913 17188 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:18.414628 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:18.415359 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:18.418105 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 250013us
I20260709 13:07:18.419551 17017 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.426549 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.427526 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:18.427836 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:18.428141 13863 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:18.428385 13716 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:18.429513 16931 consensus_meta.cc:287] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 1.175s	user 0.009s	sys 0.007s
I20260709 13:07:18.429860 16695 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:18.429945 16931 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.431692 17138 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:18.432425 17138 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.384773 17212 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:18.373211 13861 rpcz_store.cc:276] 0709 13:07:17.156847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.157186 (+   339us) service_pool.cc:224] Handling call
0709 13:07:17.157585 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.157859 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:17.840719 (+682860us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.276987 (+436268us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.298336 (+ 21349us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.318940 (+ 20604us) spinlock_profiling.cc:243] Waited 6.96 ms on lock 0x7b18004961e0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f13f3 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
0709 13:07:18.322050 (+  3110us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:18.343304 (+ 21254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.343560 (+   256us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.343734 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13259,"prepare.queue_time_us":523381,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":8523,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":35513,"spinlock_wait_cycles":16007552,"thread_start_us":961761,"threads_started":2,"wal-append.queue_time_us":357001}
I20260709 13:07:18.379940 13714 rpcz_store.cc:276] 0709 13:07:15.926745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.928405 (+  1660us) service_pool.cc:224] Handling call
0709 13:07:15.928681 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.243579 (+1314898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.243627 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.250530 (+  6903us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.272695 (+1022165us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:18.272781 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.272890 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.360283 (+ 87393us) raft_consensus.cc:1685] finished
0709 13:07:18.360305 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.360470 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5920,"raft.queue_time_us":45603,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":2330127,"threads_started":2,"wal-append.queue_time_us":1107397}
I20260709 13:07:18.419889 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:18.381508 14402 rpcz_store.cc:276] 0709 13:07:16.895638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.910234 (+ 14596us) service_pool.cc:224] Handling call
0709 13:07:16.910542 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.853764 (+943222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.853818 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.854587 (+   769us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.194696 (+340109us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:18.194748 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.204323 (+  9575us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.346552 (+142229us) raft_consensus.cc:1685] finished
0709 13:07:18.346583 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.346728 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":129363,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":8085,"thread_start_us":1151912,"threads_started":2,"wal-append.queue_time_us":489567}
I20260709 13:07:18.425487 13757 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:18.418233 17233 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:18.424723 13682 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:18.441490 13789 raft_consensus.cc:2393] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 6: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
W20260709 13:07:18.415253 16996 consensus_meta.cc:287] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 1.458s	user 0.015s	sys 0.001s
I20260709 13:07:18.444566 14400 raft_consensus.cc:2368] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 7. Current term is 8.
I20260709 13:07:18.446291 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:07:18.447103 17056 consensus_meta.cc:287] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.950s	user 0.014s	sys 0.000s
I20260709 13:07:18.447207 13783 raft_consensus.cc:2368] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7.
I20260709 13:07:18.450116 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:18.449565 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.456595 13715 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:18.457000 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.460003 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:18.460635 13680 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:18.401196 17213 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:18.448616 17153 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:18.463534 16913 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:18.463907 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:18.464308 17000 consensus_meta.cc:287] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.956s	user 0.010s	sys 0.001s
I20260709 13:07:18.463928 17191 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:18.464720 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:18.475880 13712 raft_consensus.cc:2376] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4. Re-sending same reply.
I20260709 13:07:18.476830 13783 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:18.475472 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:18.452977 17175 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:18.463946 13714 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:07:18.474040 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:18.471797 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:18.475505 17004 consensus_queue.cc:260] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:18.465291 17251 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.487960 13785 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
W20260709 13:07:18.478087 17034 consensus_meta.cc:287] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.847s	user 0.013s	sys 0.000s
I20260709 13:07:18.488986 17034 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.489419 17251 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:18.490137 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:18.468799 16913 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.473199 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:18.486702 13789 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:07:18.497864 13860 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:18.487250 13786 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:18.469043 16989 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:18.473531 17212 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:18.474952 17138 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:18.499123 14395 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
W20260709 13:07:18.479305 16948 consensus_meta.cc:287] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 1.001s	user 0.015s	sys 0.000s
I20260709 13:07:18.513567 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:18.523943 14399 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:18.525215 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:18.515264 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:18.526836 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:18.473552 17017 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:18.508926 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:18.509693 13861 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.508829 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:18.457842 17056 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.513650 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:18.453899 17273 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.497642 16913 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.529382 16989 raft_consensus.cc:697] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:18.514338 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:18.495712 17000 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:18.522990 16948 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:18.527382 13863 raft_consensus.cc:2393] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 4: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:18.486212 17175 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.544334 17175 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.545082 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:18.545835 13711 raft_consensus.cc:2393] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 6: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:18.546792 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.539963 17212 raft_consensus.cc:697] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:18.549471 17212 consensus_queue.cc:237] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.549955 17231 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:18.550206 16948 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:18.550494 17231 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.512701 17153 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:18.552806 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:18.554093 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:18.554488 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.554651 13708 raft_consensus.cc:2376] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6. Re-sending same reply.
W20260709 13:07:18.507758 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 55086.2us
I20260709 13:07:18.555617 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.555919 13680 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:18.455092 16996 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.533754 13716 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:07:18.540997 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.543620 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:18.552965 17056 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:18.528683 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:18.556860 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.540158 14402 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
W20260709 13:07:18.563558 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 241942us
I20260709 13:07:18.547325 13711 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:07:18.565898 13710 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:18.568467 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.569449 13708 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:18.557109 16844 raft_consensus.cc:2764] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:07:18.573190 13714 raft_consensus.cc:2393] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 5: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:18.573808 14397 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:18.574386 13716 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:18.574479 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:18.575135 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:18.576831 13757 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:18.508004 17214 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:18.559324 13756 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:18.583745 13861 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:18.580883 14399 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:07:18.584858 17017 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.585510 13716 raft_consensus.cc:1240] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:18.585506 17017 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:18.592336 17033 consensus_meta.cc:287] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 1.513s	user 0.008s	sys 0.007s
I20260709 13:07:18.592720 17000 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:18.592875 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:18.594105 17178 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:18.594483 16954 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:18.594673 17178 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.595182 16954 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.596895 17138 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:18.597116 17178 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:18.597609 17138 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:18.600087 17138 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:18.601125 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:18.602089 13862 raft_consensus.cc:2393] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 6: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:18.602917 16943 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:18.603566 17076 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.604158 17076 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.605839 14368 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:07:18.596992 17259 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.210s	user 0.000s	sys 0.002s
W20260709 13:07:18.608209 17282 log.cc:927] Time spent T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:07:18.608875 17273 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:18.609712 13715 raft_consensus.cc:1275] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:18.610775 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:18.649501 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:18.608920 16954 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:18.506763 17208 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:07:18.631816 14401 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
W20260709 13:07:18.648523 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 71765.8us
W20260709 13:07:18.658232 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 85199.7us
I20260709 13:07:18.572039 16931 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:18.662653 13711 raft_consensus.cc:1240] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:18.607784 17251 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:18.665992 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:18.609925 17017 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:18.667729 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:18.667944 13861 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:07:18.670517 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:18.671541 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:18.672425 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:18.559140 16977 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:18.655035 17211 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:18.680527 14394 raft_consensus.cc:2393] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 7: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:18.677354 13757 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:18.676891 13864 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:07:18.682770 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:18.591316 17231 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.664148 17223 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:18.685364 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:18.661985 17271 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:18.664068 17198 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:18.686065 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 126815us
I20260709 13:07:18.592773 17033 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:18.691026 13861 raft_consensus.cc:2368] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 8. Current term is 9.
I20260709 13:07:18.691697 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:18.668114 17034 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:18.696662 13864 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:07:18.699456 14368 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:18.679078 17211 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.701279 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:18.702230 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 45458.9us
I20260709 13:07:18.703784 17150 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:18.704227 17150 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.704625 17150 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.705741 17138 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:18.706248 17138 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.706750 17138 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:18.712057 17278 log.cc:927] Time spent T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:07:18.714118 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:18.714843 13857 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:18.682850 17251 raft_consensus.cc:697] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:07:18.720387 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 59274.9us
I20260709 13:07:18.721968 13680 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:18.723558 16844 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:18.723963 16844 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:18.724331 16844 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:18.726223 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.726917 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.730803 13757 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:18.700053 14394 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:18.665459 16943 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:18.745635 13682 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:18.750483 17076 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:18.752081 16844 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.752846 16977 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:18.753686 16954 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:18.754125 16954 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:07:18.754500 17283 log.cc:927] Time spent T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:07:18.736040 17271 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:18.689890 17227 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:07:18.685832 16697 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.703491 17211 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:18.762923 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 63557.8us
I20260709 13:07:18.769040 13864 raft_consensus.cc:2410] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:07:18.761439 17206 consensus_meta.cc:287] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.565s	user 0.012s	sys 0.000s
I20260709 13:07:18.754558 16954 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:18.782038 13680 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:18.719282 17251 consensus_queue.cc:237] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.786033 16844 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:18.789881 16697 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:18.791044 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:18.791790 13791 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
I20260709 13:07:18.792688 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.794561 17153 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:18.795077 17153 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:18.797430 17153 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.800288 17213 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:18.802187 14400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 774) took 1873 ms (client timeout 1922 ms). Trace:
W20260709 13:07:18.802713 14400 rpcz_store.cc:269] 0709 13:07:16.929150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.953580 (+ 24430us) service_pool.cc:224] Handling call
0709 13:07:18.801909 (+1848329us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54006883d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:18.802098 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3209976704}
I20260709 13:07:18.808990 16946 raft_consensus.cc:3055] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:18.809542 16946 raft_consensus.cc:740] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:18.775147 17188 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:18.811733 17188 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.812158 17188 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.816432 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:18.787050 17206 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.818854 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:18.820770 17206 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:18.795625 17142 consensus_queue.cc:1059] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:18.821899 17142 raft_consensus.cc:3055] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:18.822326 17142 raft_consensus.cc:740] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:18.823362 17142 consensus_queue.cc:260] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.796929 17159 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.826607 13710 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:18.826388 17159 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.828734 17159 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:18.828775 13707 raft_consensus.cc:1240] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:18.829943 14398 raft_consensus.cc:2393] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 13: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:18.830659 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:18.795974 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 92844.7us
I20260709 13:07:18.832443 13756 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:18.834216 13756 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:18.832558 16978 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:18.836876 17033 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:18.841936 17197 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:18.843286 17271 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:18.843588 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.846321 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:18.846990 14401 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:18.847988 17218 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.848644 17218 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.849510 14367 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:18.850754 17218 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:18.802338 17077 consensus_meta.cc:287] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.736s	user 0.005s	sys 0.008s
I20260709 13:07:18.851665 17077 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.881085 13858 raft_consensus.cc:2393] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 6: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:18.881986 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:18.882215 17077 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:18.848091 16996 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:18.858536 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:18.884214 16943 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:18.885062 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:18.817947 17037 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:18.885701 13784 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.889567 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:18.896242 13713 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.865412 13682 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:18.866169 17231 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:18.886278 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:18.867673 13755 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:18.868341 17203 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:18.903743 17203 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.903504 17037 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:18.904093 17203 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.905133 17271 consensus_queue.cc:1059] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:18.865437 17218 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:18.905680 17037 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:18.905943 17009 consensus_meta.cc:287] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.863s	user 0.009s	sys 0.005s
I20260709 13:07:18.906103 17218 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.906616 17009 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:18.907568 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:18.908300 13861 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:07:18.908393 17218 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:18.686568 16989 consensus_queue.cc:237] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.909150 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:18.909835 13861 raft_consensus.cc:2393] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 6: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:18.910416 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:18.911834 17218 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:18.912428 17218 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.869580 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:18.810464 16946 consensus_queue.cc:260] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.871690 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:18.869065 17056 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:18.874022 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.919163 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:18.874614 17000 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:18.876730 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:18.877059 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:18.877252 17173 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.893816 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:18.900482 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 49110.5us
W20260709 13:07:18.866859 17248 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.479s	user 0.002s	sys 0.001s
I20260709 13:07:18.885850 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:18.913597 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 137671us
I20260709 13:07:18.909152 13707 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.914578 14401 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
W20260709 13:07:19.000099 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 138281us
I20260709 13:07:19.002668 13862 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.002830 13710 raft_consensus.cc:2393] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 5: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:07:19.004096 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 149566us
I20260709 13:07:19.006251 13715 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:07:18.955767 13711 raft_consensus.cc:2393] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 8: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:07:19.000095 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 165928us
I20260709 13:07:18.916144 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:19.012384 13861 raft_consensus.cc:2393] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 6: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:19.016475 13713 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:07:19.003329 13682 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:18.851074 16913 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:19.021097 14394 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:19.022548 13856 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 11. Current term is 12. Ops: [9.5-11.6]
I20260709 13:07:19.023377 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:18.918365 16646 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:19.093649 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:19.094583 13713 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:19.032998 14367 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:18.955744 17142 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:19.097862 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 494604us
I20260709 13:07:19.039978 16963 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.100128 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 69768.1us
I20260709 13:07:19.041397 13709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 1941) took 3114 ms. Trace:
I20260709 13:07:19.043704 16988 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:19.049749 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:19.104827 13861 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:07:18.916743 16943 consensus_queue.cc:1059] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.116s
I20260709 13:07:19.020119 17271 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:19.053020 13707 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:19.003630 17213 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:19.066417 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:19.065598 13784 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
W20260709 13:07:19.070171 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 66965.1us
I20260709 13:07:19.070369 16924 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:19.070737 17153 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:19.071120 16954 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:19.071302 17208 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.004s
W20260709 13:07:19.077658 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.031543 17175 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:19.037025 17056 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:19.081034 17009 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:19.082093 16913 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:19.084539 17218 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:19.089335 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:19.077541 17188 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:18.956313 17077 raft_consensus.cc:3055] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:19.098897 13865 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:07:19.149734 16924 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.100579 13756 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:19.102907 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 76212.6us
I20260709 13:07:19.100711 13709 rpcz_store.cc:276] 0709 13:07:15.927444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.928967 (+  1523us) service_pool.cc:224] Handling call
0709 13:07:15.929349 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.049868 (+1120519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.049909 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.050363 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.740806 (+690443us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:17.741059 (+   253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.741174 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.866213 (+1125039us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:07:19.041139 (+174926us) raft_consensus.cc:1685] finished
0709 13:07:19.041160 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.041343 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5541,"raft.queue_time_us":45088,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":51,"spinlock_wait_cycles":52228864,"thread_start_us":1804295,"threads_started":2,"wal-append.queue_time_us":1336833}
W20260709 13:07:19.134661 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.092618 16646 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.160279 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:19.109010 17251 raft_consensus.cc:2764] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:07:19.039885 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:19.180912 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:19.198658 13858 raft_consensus.cc:2368] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6.
I20260709 13:07:19.182121 13682 leader_election.cc:400] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 8. Current term is 9.
I20260709 13:07:19.199601 13682 leader_election.cc:403] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:19.184983 13782 raft_consensus.cc:2393] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 7: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:19.153944 17213 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:19.187192 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 86725.6us
I20260709 13:07:19.107620 16695 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:07:19.197232 13713 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:07:19.179550 17077 raft_consensus.cc:740] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:07:19.210726 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 59419.5us
I20260709 13:07:19.106578 16963 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:19.185072 16924 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:19.207307 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.208587 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:19.206753 16913 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.176628 17271 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:19.199523 16646 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.181907 17211 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:19.213027 17239 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.228430 14394 raft_consensus.cc:2393] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 4: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:19.211978 14368 leader_election.cc:400] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6.
I20260709 13:07:19.260640 14368 leader_election.cc:403] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:07:19.226214 13830 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:19.211571 17213 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:19.262101 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.269200 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 57951.2us
I20260709 13:07:19.272148 14367 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:19.272572 17274 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.273276 17274 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:19.275137 17077 consensus_queue.cc:260] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:19.276273 17294 log.cc:927] Time spent T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:07:19.276551 17077 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:19.279317 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 53173.7us
I20260709 13:07:19.281577 13711 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:19.283015 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 73285.1us
W20260709 13:07:19.285410 17296 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:07:19.285578 17191 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:19.269884 17223 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:19.294678 14367 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:19.310804 13756 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:07:19.292374 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 261780us
I20260709 13:07:19.327069 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:19.292277 17206 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.304212 17244 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:19.335191 17295 log.cc:927] Time spent T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:07:19.361964 13757 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:19.323285 17000 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.365746 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 184927us
I20260709 13:07:19.350088 14367 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:19.328295 17274 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:19.318006 17191 raft_consensus.cc:697] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:07:19.411162 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 49272.7us
I20260709 13:07:19.393445 13755 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:07:19.395113 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 45181.1us
I20260709 13:07:19.329844 17246 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:19.345865 17056 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:19.412842 17150 consensus_meta.cc:287] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.708s	user 0.011s	sys 0.003s
I20260709 13:07:19.459544 16946 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.442765 13757 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:19.463704 17138 consensus_meta.cc:287] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.756s	user 0.011s	sys 0.002s
W20260709 13:07:19.465521 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.466473 13856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2693) took 1256 ms. Trace:
I20260709 13:07:19.538803 13856 rpcz_store.cc:276] 0709 13:07:18.210449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.271512 (+ 61063us) service_pool.cc:224] Handling call
0709 13:07:18.271908 (+   396us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:19.068154 (+796246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.466187 (+398033us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b54003dc2d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:19.466403 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1725308288}
I20260709 13:07:19.447938 17208 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:19.467779 13784 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:19.441448 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:19.440615 16963 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:19.471858 16974 raft_consensus.cc:3055] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:19.305214 17197 consensus_queue.cc:1059] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:07:19.554041 16974 raft_consensus.cc:740] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:19.452935 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1720) took 1005 ms. Trace:
I20260709 13:07:19.554628 13782 rpcz_store.cc:276] 0709 13:07:18.447007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.463621 (+ 16614us) service_pool.cc:224] Handling call
0709 13:07:19.452733 (+989112us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b5400205654. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:19.452855 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1643397376}
I20260709 13:07:19.449934 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:19.555213 16974 consensus_queue.cc:260] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:19.455286 13864 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:19.453426 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:19.558614 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:19.316826 17251 consensus_queue.cc:1059] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:07:19.356323 17159 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:19.504487 17213 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:19.505260 16913 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:19.506734 13862 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:07:19.366439 17153 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:19.351711 17244 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.394685 16954 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:19.448345 17000 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:19.448930 17191 consensus_queue.cc:237] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:19.511624 13680 connection.cc:256] RPC call timeout handler was delayed by -1.0118549000001167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
W20260709 13:07:19.512208 17203 consensus_meta.cc:287] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.608s	user 0.007s	sys 0.003s
I20260709 13:07:19.520484 13715 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:19.326812 17218 consensus_queue.cc:1059] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
W20260709 13:07:19.454187 17297 log.cc:927] Time spent T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:07:19.448154 17211 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:19.595901 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:19.533113 13829 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:07:19.439918 17302 log.cc:927] Time spent T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
W20260709 13:07:19.537094 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 94410.4us
I20260709 13:07:19.410924 17178 raft_consensus.cc:2764] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:19.451799 17017 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:19.614656 13714 raft_consensus.cc:2368] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6.
I20260709 13:07:19.575635 17244 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.617630 13757 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:19.618527 13757 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:19.535722 17150 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:19.622313 17142 consensus_meta.cc:287] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.518s	user 0.003s	sys 0.005s
I20260709 13:07:19.622879 17142 raft_consensus.cc:3055] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:19.624214 17017 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:19.624630 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:19.625268 13862 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:07:19.626216 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:19.627702 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:19.626992 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:19.629769 14401 raft_consensus.cc:2368] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7.
I20260709 13:07:19.631111 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:19.631724 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:19.632159 14400 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:07:19.633190 13861 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:19.633680 14400 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:19.634263 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:19.634850 13863 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:19.636653 16646 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:19.637817 13712 raft_consensus.cc:2393] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 6: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:19.542876 17271 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:19.543571 17210 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.638728 16646 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:19.638679 17210 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:19.640600 17173 consensus_meta.cc:287] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.614s	user 0.006s	sys 0.003s
I20260709 13:07:19.640975 17173 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:19.641486 17210 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:19.548421 17004 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.362011 17188 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:19.642282 17239 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 8. Current term is 9.
I20260709 13:07:19.623241 17150 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:19.552093 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:19.552675 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:19.644300 13865 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.553211 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:19.645197 13710 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:19.553330 16988 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:19.438576 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 141966us
I20260709 13:07:19.556695 16974 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:19.560506 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 167114us
I20260709 13:07:19.646538 13830 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:19.566064 14367 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:19.365689 17175 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:19.580889 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:19.580996 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:19.582782 17000 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:19.559540 17208 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:19.366587 16695 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:19.591810 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:19.572690 16618 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:19.606151 17206 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6.
I20260709 13:07:19.575240 17159 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:19.613032 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 80028us
I20260709 13:07:19.562386 17138 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:19.536932 17056 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.648484 13859 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:07:19.646852 13757 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:19.623219 17142 raft_consensus.cc:740] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:19.663164 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:19.613302 17223 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:19.663600 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:19.668015 13863 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:07:19.647631 16954 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.651875 16963 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:19.687079 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 121125us
I20260709 13:07:19.655347 17208 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:19.691869 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 45094.3us
I20260709 13:07:19.596673 17203 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:19.692227 14367 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:19.696277 13791 raft_consensus.cc:1240] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:19.665267 17150 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:19.698310 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.667951 16695 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:19.700331 17000 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:19.702071 16695 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:19.686312 16924 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:19.704967 16924 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:19.650887 17188 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:07:19.708155 17142 consensus_queue.cc:260] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:19.709801 17142 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.681862 17033 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:19.717048 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:19.720978 17138 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:19.684681 17223 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:19.721766 17223 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.699599 17210 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.722359 17159 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:19.668807 16618 raft_consensus.cc:697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 13 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:19.723644 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:19.724387 14398 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 10: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:19.723937 16618 consensus_queue.cc:237] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:19.724959 17033 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:19.725386 17033 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:19.728719 17203 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:19.733768 17213 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:19.738910 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 46759.2us
I20260709 13:07:19.743253 13865 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
W20260709 13:07:19.745882 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.744776 14368 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:19.751365 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:19.753265 13713 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:19.755820 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:19.758621 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 106033us
I20260709 13:07:19.759366 13756 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:19.752331 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:19.763016 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:19.763590 13710 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:19.764796 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:19.765511 14394 raft_consensus.cc:2393] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 10: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:19.692204 16963 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:19.765457 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:19.771827 13712 raft_consensus.cc:2393] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 6: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:19.767210 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:19.783540 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:19.783242 13713 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:07:19.785447 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:19.767373 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:19.787869 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:19.788426 13707 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.790058 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:19.768343 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:07:19.788928 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 52595.2us
I20260709 13:07:19.794708 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:19.795893 13708 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:19.796739 13715 raft_consensus.cc:2368] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6.
I20260709 13:07:19.795360 13709 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:07:19.783071 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:19.799729 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:19.750905 17000 raft_consensus.cc:697] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:19.810410 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:19.810539 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 51243.5us
I20260709 13:07:19.751591 17206 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:19.685707 17056 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:19.804979 14367 leader_election.cc:400] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6.
I20260709 13:07:19.801702 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:19.832954 14367 leader_election.cc:403] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:07:19.787055 16963 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.812446 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:19.821539 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.766152 17214 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:19.795284 17188 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:19.833700 13782 raft_consensus.cc:2410] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:19.797923 16988 consensus_queue.cc:1059] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:07:19.699929 16954 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:19.835631 13757 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:19.874215 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:19.876770 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 72032.1us
I20260709 13:07:19.795650 17017 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:07:19.881388 14398 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:07:19.874295 17150 consensus_queue.cc:1048] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:07:19.887243 17246 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.868337 17138 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:19.868996 17206 raft_consensus.cc:697] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:07:19.895319 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 60885.1us
I20260709 13:07:19.896726 13757 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:19.892925 13788 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:19.900022 13707 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:07:19.916489 17173 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:19.921027 17056 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:19.925110 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:19.925498 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:19.925870 13783 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:19.926003 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:19.927917 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:19.928725 13790 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:19.929778 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:19.930472 13789 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:19.884016 17247 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.884187 17188 raft_consensus.cc:697] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:19.868695 16695 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:07:19.887843 17017 consensus_queue.cc:1243] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer b9d194f45e044e0988d5de1a99e5cd02 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:19.894747 16988 consensus_queue.cc:1243] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer b5029654a4384e43a68eb67b794949b7 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:19.877909 17214 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:19.960266 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 82615.8us
I20260709 13:07:19.961436 14367 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:19.955440 14393 raft_consensus.cc:1240] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:07:19.941666 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:19.956177 16948 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.017s	sys 0.038s
I20260709 13:07:19.907814 17227 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:19.960614 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 50931.5us
I20260709 13:07:19.969023 13757 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:19.963439 13782 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:19.939998 13710 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:07:19.964533 14367 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:07:19.957980 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 81178.3us
I20260709 13:07:19.936457 17138 raft_consensus.cc:697] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:19.959987 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:19.977506 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:19.966796 16948 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.017s	sys 0.038s
I20260709 13:07:19.980206 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:19.985059 14399 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:19.988487 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.972635 16931 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:19.990751 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:19.973347 17227 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.992161 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:19.994798 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:19.950310 17033 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:19.981160 16996 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.010s	sys 0.030s
I20260709 13:07:19.996840 13711 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:07:20.022210 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:20.024667 13782 raft_consensus.cc:2393] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 10: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:19.960002 17247 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:19.996479 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:20.032409 13859 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
W20260709 13:07:20.013469 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.023329 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:20.036576 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2716) took 1012 ms. Trace:
I20260709 13:07:20.029524 17227 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:19.987030 16988 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:20.045114 17197 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:20.037002 13858 rpcz_store.cc:276] 0709 13:07:19.024139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.209118 (+184979us) service_pool.cc:224] Handling call
0709 13:07:19.224866 (+ 15748us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:19.270873 (+ 46007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.270927 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:19.296985 (+ 26058us) log.cc:844] Serialized 52 byte log entry
0709 13:07:19.566516 (+269531us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:19.566576 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.566670 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.036355 (+469685us) raft_consensus.cc:1685] finished
0709 13:07:20.036374 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.036520 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31562,"raft.queue_time_us":36670,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":11128,"thread_start_us":215084,"threads_started":1,"wal-append.queue_time_us":417636}
I20260709 13:07:20.089764 17244 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:20.091447 14397 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:07:20.048851 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:20.092247 13782 raft_consensus.cc:2393] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 9: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:19.994066 16931 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.995846 17246 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6.
I20260709 13:07:20.055980 17313 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:20.056764 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 351993us
I20260709 13:07:20.093855 17223 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:20.058529 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:20.064504 17188 consensus_queue.cc:237] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:20.049016 17206 consensus_queue.cc:237] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:20.066576 16954 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:20.067011 17314 log.cc:927] Time spent T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:07:20.068280 17056 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:20.069092 17033 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:20.095853 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:20.096817 13783 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:20.097520 13859 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:19.972270 17000 consensus_queue.cc:237] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:20.030305 16697 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:20.029068 16996 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.011s	sys 0.030s
I20260709 13:07:20.078401 14399 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:19.992564 17316 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:07:20.057296 17077 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:20.099035 13789 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:20.072203 17208 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:20.096968 17056 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:20.099447 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:20.118048 13707 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:20.094782 17311 log.cc:927] Time spent T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:07:20.078677 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 480449us
I20260709 13:07:20.085260 16646 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.071971 17210 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:20.098743 17251 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.000s	sys 0.037s
I20260709 13:07:20.116484 13786 raft_consensus.cc:1240] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:20.138168 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:20.139173 13782 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
W20260709 13:07:20.099279 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 487000us
I20260709 13:07:20.101542 13829 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:20.098050 16931 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:20.105701 16988 raft_consensus.cc:697] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:20.131213 17056 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:20.144069 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 45699.1us
I20260709 13:07:20.153884 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:20.154950 13789 raft_consensus.cc:2393] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 13: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:20.144522 13682 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:07:20.143126 17251 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.000s	sys 0.037s
I20260709 13:07:20.158252 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:20.164065 13789 raft_consensus.cc:2393] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 7: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:20.159310 16913 raft_consensus.cc:3055] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:07:20.162663 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.168134 14367 leader_election.cc:400] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 5. Current term is 6.
I20260709 13:07:20.169247 14367 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:20.100335 17313 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:20.171984 13829 leader_election.cc:400] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 7. Current term is 8.
I20260709 13:07:20.147568 17033 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:20.174491 13829 leader_election.cc:403] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:20.147219 17320 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:20.184074 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:20.179344 13707 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:07:20.137434 16646 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:20.189167 13786 raft_consensus.cc:1240] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:20.185948 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:20.187000 13863 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.203435 13859 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:20.209347 14401 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:20.190729 14367 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:20.212378 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:20.167176 16913 raft_consensus.cc:740] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:20.149471 17004 consensus_queue.cc:1059] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:07:20.143973 16697 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:20.211753 13830 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:20.217931 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:20.216559 13857 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:20.183326 16989 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:20.222628 13858 raft_consensus.cc:2393] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 6: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:20.145318 17138 consensus_queue.cc:237] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:20.224471 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:20.222391 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.188508 17247 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:20.228379 13863 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:07:20.189049 17033 raft_consensus.cc:697] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:07:20.235152 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 63306.3us
W20260709 13:07:20.241129 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 60904.8us
I20260709 13:07:20.241998 13680 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:20.226168 17077 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:20.257014 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:20.258102 13782 raft_consensus.cc:2393] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 10: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:20.220731 17322 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:20.268774 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.239310 17214 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:20.205608 17320 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:20.283694 17344 raft_consensus.cc:2764] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:20.285295 13680 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:20.286042 17312 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:07:20.285683 16931 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:20.330516 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:20.286755 17208 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:20.288136 16697 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:20.334203 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:20.289166 17313 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:20.290505 17142 consensus_meta.cc:287] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.001s
I20260709 13:07:20.299924 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:20.300160 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:07:20.300951 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 69715.1us
W20260709 13:07:20.302861 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 103586us
I20260709 13:07:20.341464 13715 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.336216 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:20.334897 13709 raft_consensus.cc:2376] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7. Re-sending same reply.
I20260709 13:07:20.315112 13857 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:20.330011 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:20.307718 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:20.339174 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 95908.3us
I20260709 13:07:20.344743 13682 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:20.339084 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:20.339057 17274 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.000s	sys 0.015s
W20260709 13:07:20.345252 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 60079.1us
I20260709 13:07:20.279950 17322 raft_consensus.cc:697] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:20.345368 14366 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:20.352824 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:20.333923 17214 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:20.355212 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:20.352875 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:20.364107 13857 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:20.361196 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:20.365243 13712 raft_consensus.cc:2368] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8.
I20260709 13:07:20.365684 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:20.366268 13709 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:20.350785 17274 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.000s	sys 0.016s
I20260709 13:07:20.368680 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:20.256249 16988 consensus_queue.cc:237] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:20.363107 17326 log.cc:927] Time spent T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.177s	user 0.001s	sys 0.001s
I20260709 13:07:20.353629 17313 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:20.385993 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:20.387143 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:07:20.387975 17328 log.cc:927] Time spent T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:07:20.388455 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:20.368405 17142 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:20.389096 17332 log.cc:927] Time spent T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:07:20.389503 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:20.390872 13707 raft_consensus.cc:1275] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:20.391680 13860 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:20.333935 16943 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:07:20.293113 16913 consensus_queue.cc:260] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:20.369858 17004 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:20.393572 13710 raft_consensus.cc:2393] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 8: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:07:20.580719 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 235403us
I20260709 13:07:20.393194 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:20.599678 13707 raft_consensus.cc:1240] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:20.350418 17324 consensus_queue.cc:1059] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:07:20.617945 13707 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 11. Current term is 12. Ops: [9.5-11.6]
W20260709 13:07:20.627000 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 45268.7us
I20260709 13:07:20.628079 14366 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:20.402084 17077 raft_consensus.cc:697] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:20.582645 17313 raft_consensus.cc:697] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:20.648090 13709 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
W20260709 13:07:20.648823 13783 consensus_meta.cc:287] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.000s
I20260709 13:07:20.658916 13783 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:07:20.595463 17206 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:20.631572 17340 log.cc:927] Time spent T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:07:20.660589 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:20.667464 13709 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:20.668865 17233 consensus_queue.cc:1059] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:20.595309 17004 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:20.669667 17004 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.664824 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 942) took 1036 ms. Trace:
I20260709 13:07:20.672816 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:20.675791 17233 raft_consensus.cc:2764] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:20.677237 13680 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:20.683905 13709 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:07:20.625648 17223 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:20.379935 17033 consensus_queue.cc:237] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:20.630880 17244 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:20.647064 17210 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:20.663718 17324 consensus_queue.cc:1243] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer b5029654a4384e43a68eb67b794949b7 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:20.663252 17316 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:20.694873 16989 raft_consensus.cc:697] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:20.699014 13680 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:07:20.760192 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 61418.8us
I20260709 13:07:20.680106 16913 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:20.600930 17344 consensus_queue.cc:1059] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 13:07:20.726312 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:20.768976 13707 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:07:20.727203 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:07:20.736312 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.683972 17173 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:20.760948 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:20.712940 13715 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:20.766427 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:20.773142 13712 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
W20260709 13:07:20.773447 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 121932us
I20260709 13:07:20.683276 17251 consensus_queue.cc:1059] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:07:20.723955 17350 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:20.783648 17077 consensus_queue.cc:237] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:20.761111 17324 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:20.784513 17354 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:20.788012 17334 log.cc:927] Time spent T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.404s	user 0.000s	sys 0.001s
I20260709 13:07:20.688988 17322 consensus_queue.cc:237] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:20.682140 17206 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:20.790118 17004 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:20.774235 14366 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:07:20.779299 17305 log.cc:927] Time spent T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
I20260709 13:07:20.802604 13714 raft_consensus.cc:2393] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 10: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:07:20.759565 17338 log.cc:927] Time spent T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:07:20.776638 13715 raft_consensus.cc:1240] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 13:07:20.837265 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:20.860795 13707 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:07:20.836050 17344 consensus_queue.cc:1243] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer 35ecb005831740438d7537dd4b840e03 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:07:20.788050 17056 consensus_meta.cc:287] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.000s
W20260709 13:07:20.854290 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 80133.8us
I20260709 13:07:20.843931 16931 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:20.873852 14366 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:20.842921 17354 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:20.852576 16989 consensus_queue.cc:237] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:20.852735 17313 consensus_queue.cc:237] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:20.877720 17320 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:20.925026 17344 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:20.925683 17344 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.926172 17344 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:20.775745 17173 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:20.928917 17227 consensus_meta.cc:287] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.821s	user 0.007s	sys 0.002s
I20260709 13:07:20.929401 17227 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:20.929663 17173 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:20.931072 13782 raft_consensus.cc:2393] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 10: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:20.930986 17214 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.931794 17214 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:20.934285 17214 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:20.934895 17227 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:20.863904 17350 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:20.963402 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:20.952742 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 81610.6us
I20260709 13:07:20.954809 13757 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:20.859046 17251 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:20.882494 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:20.951860 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:20.919106 17324 raft_consensus.cc:3055] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:20.875208 17056 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:20.968796 14395 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
W20260709 13:07:20.969776 14395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 941) took 1341 ms (client timeout 1580 ms). Trace:
I20260709 13:07:20.970225 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:20.970121 14395 rpcz_store.cc:269] 0709 13:07:19.628030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.628196 (+   166us) service_pool.cc:224] Handling call
0709 13:07:20.299752 (+671556us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b5800077d98. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:07:20.969631 (+669879us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b54009169d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:20.969721 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1451083904}
I20260709 13:07:20.980211 14366 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:20.980075 17316 consensus_queue.cc:1059] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:20.981630 17316 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:20.983660 17251 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.984194 17251 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:20.986845 13757 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:20.988660 13682 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:20.995129 17227 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:20.995707 17227 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:20.996191 17227 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:20.996359 13714 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:07:20.998773 17077 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:07:20.914646 17334 log.cc:927] Time spent T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:21.000998 13858 raft_consensus.cc:1240] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:20.910444 16963 consensus_meta.cc:287] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 1.030s	user 0.008s	sys 0.001s
I20260709 13:07:21.010269 13682 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:20.905025 17206 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:21.013674 13682 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:07:21.019822 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.034577 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:21.035317 13860 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:20.988559 17324 raft_consensus.cc:740] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:20.877957 17354 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:21.000597 17320 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:21.005478 17056 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:21.035332 17153 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:21.054817 17271 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.055387 17271 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:21.057015 13860 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:21.057567 17271 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:21.048210 17153 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:21.072513 17153 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:21.075287 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:21.076368 13708 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:21.066766 17324 consensus_queue.cc:260] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:21.032804 16963 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:21.079602 17324 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.080006 17004 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:21.040977 17358 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:21.081450 16963 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:21.082646 17360 consensus_queue.cc:1175] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b5029654a4384e43a68eb67b794949b7" responder_term: 6 status { last_received { term: 6 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 6 index: 3 } }
I20260709 13:07:21.076452 17350 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:21.085686 13830 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:21.041929 17363 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:21.100060 17363 raft_consensus.cc:697] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:21.101361 17363 consensus_queue.cc:237] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:21.100106 13711 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58552 (request call id 711) took 1358 ms (client timeout 1536 ms). Trace:
W20260709 13:07:21.104079 13711 rpcz_store.cc:269] 0709 13:07:19.741916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.752114 (+ 10198us) service_pool.cc:224] Handling call
0709 13:07:21.099881 (+1347767us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54000c4c54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:21.100022 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540143872}
I20260709 13:07:21.106469 14401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 944) took 1477 ms. Trace:
I20260709 13:07:21.106897 14401 rpcz_store.cc:276] 0709 13:07:19.628935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.630522 (+  1587us) service_pool.cc:224] Handling call
0709 13:07:19.789862 (+159340us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b5800077d98. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:07:21.106266 (+1316404us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b540068a1d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:21.106393 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":833193984}
I20260709 13:07:21.107453 17362 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:21.107934 17362 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.108311 17362 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:21.108634 16924 raft_consensus.cc:3055] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:21.095209 17077 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:21.109354 17077 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.109826 17077 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.671742 14402 rpcz_store.cc:276] 0709 13:07:19.628327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.628576 (+   249us) service_pool.cc:224] Handling call
0709 13:07:20.159960 (+531384us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b5800077d98. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:07:20.160143 (+   183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.160341 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:20.228246 (+ 67905us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.620395 (+392149us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.636270 (+ 15875us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.637165 (+   895us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.637222 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:20.637286 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.637373 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.664747 (+ 27374us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24636,"prepare.queue_time_us":131714,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":26150,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":34233,"spinlock_wait_cycles":113857280,"thread_start_us":421777,"threads_started":2}
I20260709 13:07:21.121145 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:21.126258 14399 raft_consensus.cc:2410] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:21.129805 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:21.130697 14401 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
W20260709 13:07:21.135480 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.135273 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:07:21.136118 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 375228us
I20260709 13:07:21.115164 16646 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:21.115233 17251 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:21.149544 13789 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:21.152144 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:21.154551 13789 raft_consensus.cc:1240] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:21.157971 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:21.159132 13789 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:21.160476 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:21.162961 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:21.163707 13789 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:21.164515 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:21.165233 13789 raft_consensus.cc:2393] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 7: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:21.166239 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:21.167299 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:21.132844 16924 raft_consensus.cc:740] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:21.143756 16943 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:21.136716 16988 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:21.182371 13680 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:21.172745 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:21.182838 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:21.189044 13785 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:21.185036 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:21.174384 13829 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:21.176852 13756 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:21.185532 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:21.198112 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 49094.1us
I20260709 13:07:21.173180 13787 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:21.199146 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:21.194769 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 181171us
I20260709 13:07:21.205130 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:21.202224 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:21.143805 17223 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:21.207921 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:21.214159 13680 leader_election.cc:400] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7.
I20260709 13:07:21.214505 13680 leader_election.cc:403] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:21.213781 17004 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:21.222484 17271 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:21.155736 17362 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:21.225155 17362 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:21.225797 16924 consensus_queue.cc:260] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:21.226855 16924 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:21.192400 16943 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:21.229290 16943 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:21.196280 16988 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:21.231434 16988 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:21.233124 13707 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:21.234983 16943 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:21.235869 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:21.237128 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:21.237848 13783 raft_consensus.cc:2393] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 6: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:21.238619 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:21.148154 17138 consensus_queue.cc:1059] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:07:21.239287 13783 raft_consensus.cc:2393] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 7: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:21.253527 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:21.245460 13789 raft_consensus.cc:2410] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:21.222774 17344 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:21.191035 17347 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:21.255517 13785 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:21.271225 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:21.257671 13860 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:21.215276 17274 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:21.299641 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 46206.7us
I20260709 13:07:21.291054 17373 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:21.300536 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.301033 17251 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:21.326699 17373 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.327466 17373 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:21.329986 17373 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:21.331756 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:21.332360 13857 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:21.335932 13865 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:21.336768 17344 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:21.336946 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:21.337813 13865 raft_consensus.cc:2410] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:21.339005 13860 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:21.283687 17347 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:21.309515 17227 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:21.212662 17223 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:21.368954 17223 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:21.370787 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:21.372006 13859 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 9: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:21.376467 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:21.377491 17352 log.cc:927] Time spent T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.447s	user 0.000s	sys 0.000s
I20260709 13:07:21.378036 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:21.381055 13861 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:07:21.383798 17347 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:21.383517 17354 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:21.385082 13711 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:21.320150 16978 raft_consensus.cc:3055] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:21.321038 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.386063 16978 raft_consensus.cc:740] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:21.298545 17358 raft_consensus.cc:3055] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:21.386930 17358 raft_consensus.cc:740] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:21.387241 16978 consensus_queue.cc:260] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:21.387863 17358 consensus_queue.cc:260] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:21.344278 13857 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:21.389829 17354 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:21.344705 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:21.390488 13860 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:21.392144 17227 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:21.392575 13784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2217) took 1519 ms. Trace:
I20260709 13:07:21.384781 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:21.392939 13784 rpcz_store.cc:276] 0709 13:07:19.873548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.873986 (+   438us) service_pool.cc:224] Handling call
0709 13:07:21.392351 (+1518365us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540033c054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:21.392495 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2906653440}
I20260709 13:07:21.394111 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:21.395939 17077 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:21.347152 14368 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:21.348510 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:21.349359 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:21.349359 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:21.350503 17206 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.350416 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:21.351452 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:21.352259 14400 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:21.359627 17218 raft_consensus.cc:3055] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:21.427181 17218 raft_consensus.cc:740] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:21.428105 17218 consensus_queue.cc:260] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:21.428782 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:21.429502 13714 raft_consensus.cc:2368] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8.
I20260709 13:07:21.281476 17362 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7.
I20260709 13:07:21.429948 13784 raft_consensus.cc:1240] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:21.313983 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:07:21.403437 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 57970.6us
I20260709 13:07:21.430359 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:21.430945 13714 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 4.
I20260709 13:07:21.432116 17362 consensus_queue.cc:1059] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:21.404635 17354 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:21.404810 16996 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:21.433796 16996 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:21.436575 16996 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:21.405872 17345 consensus_queue.cc:1059] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:21.349516 17342 log.cc:927] Time spent T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.666s	user 0.003s	sys 0.000s
I20260709 13:07:21.406641 17325 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:21.408900 17344 consensus_queue.cc:1059] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:21.438987 17344 consensus_queue.cc:1243] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer b5029654a4384e43a68eb67b794949b7 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:21.409740 13682 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:07:21.407853 14398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 1127) took 1659 ms (client timeout 1565 ms). Trace:
W20260709 13:07:21.440548 14398 rpcz_store.cc:269] 0709 13:07:19.748535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.748892 (+   357us) service_pool.cc:224] Handling call
0709 13:07:21.407657 (+1658765us) spinlock_profiling.cc:243] Waited 81.9 ms on lock 0x7b54000fa854. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:21.407755 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188355456}
I20260709 13:07:21.419471 13786 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:21.420408 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:21.440013 13682 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:07:21.422000 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.426023 17357 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.426831 13712 raft_consensus.cc:1240] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:21.448491 14402 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:07:21.429322 17218 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:21.452055 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.365481 17356 log.cc:927] Time spent T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.576s	user 0.000s	sys 0.001s
I20260709 13:07:21.432217 13680 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:21.403829 17206 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:21.436734 17246 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.437662 17345 raft_consensus.cc:3055] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:21.419528 17153 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:21.445358 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:21.445076 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:21.449684 13712 pending_rounds.cc:85] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 5
I20260709 13:07:21.451344 13709 raft_consensus.cc:1240] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:21.458551 13680 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:21.447548 17325 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:21.459285 17325 raft_consensus.cc:697] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:21.460145 17325 consensus_queue.cc:237] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:21.460758 13680 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:21.461011 17373 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:21.461391 17344 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:21.461707 17373 raft_consensus.cc:697] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:21.461963 17344 raft_consensus.cc:697] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:21.460585 17153 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:21.462744 17373 consensus_queue.cc:237] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:21.463511 17357 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:21.471222 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:21.463687 13714 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.458775 13709 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:21.462895 17344 consensus_queue.cc:237] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:21.455736 17345 raft_consensus.cc:740] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:21.482228 13859 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:21.457336 13712 pending_rounds.cc:107] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 4.6
W20260709 13:07:21.472857 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 125816us
I20260709 13:07:21.491456 13712 raft_consensus.cc:2889] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:21.452255 17324 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:21.497859 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 321114us
I20260709 13:07:21.485497 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:21.499758 13756 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:21.455691 17246 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:21.450482 17271 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:21.481967 16996 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.503997 13680 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:21.505816 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:07:21.501873 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 327570us
I20260709 13:07:21.516117 13829 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:21.518895 13680 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:21.523478 13859 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:07:21.500648 17324 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.533913 13756 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:21.536279 13714 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:21.534667 13856 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:07:21.497867 17017 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.501210 17330 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:21.519843 17004 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:21.508724 17159 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:21.518764 17009 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:21.541024 13829 leader_election.cc:400] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7.
I20260709 13:07:21.501246 17206 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:21.497417 17274 consensus_queue.cc:1059] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:07:21.490345 17354 consensus_queue.cc:1059] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:07:21.508932 16924 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:21.518373 17188 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:21.544386 13682 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:21.570086 13829 leader_election.cc:403] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:07:21.557005 13756 leader_election.cc:400] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8.
I20260709 13:07:21.577656 14393 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:07:21.578765 13756 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:21.536934 17357 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:21.581137 13756 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:21.587376 13862 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:21.541142 17077 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:21.557960 17175 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:21.584995 17197 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7.
I20260709 13:07:21.557461 17017 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:21.557276 17246 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:21.580152 16924 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.590638 17362 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:21.557693 16963 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:21.619314 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:21.620085 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.585282 17367 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:21.591864 17274 raft_consensus.cc:3055] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:21.593943 13714 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:21.535106 16996 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:21.595899 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 55011.7us
I20260709 13:07:21.595727 16646 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:21.596781 17159 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.544690 17324 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:21.559389 17374 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:21.570647 17330 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.636736 17330 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:21.637207 17017 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:21.637492 16996 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:21.544683 17153 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:21.612975 17175 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:21.644430 17175 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:21.590586 17354 consensus_queue.cc:1243] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer 35ecb005831740438d7537dd4b840e03 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:21.617529 13756 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:21.623361 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:21.623603 13829 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:21.649206 13829 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:21.649797 13756 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:21.651072 16697 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:21.651255 17378 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:21.651636 16697 raft_consensus.cc:697] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:21.651770 13756 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:21.652177 17159 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:21.652596 17159 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.652588 16697 consensus_queue.cc:237] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:21.653234 17159 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.653424 13756 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:21.651099 13829 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:21.620779 13757 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:07:21.618340 17321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.007s	sys 0.013s
I20260709 13:07:21.627206 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:21.629256 13860 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:21.616330 16924 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:21.672293 13756 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:21.656601 13857 raft_consensus.cc:1275] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:21.623477 17274 raft_consensus.cc:740] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:21.615136 17150 consensus_queue.cc:1059] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:07:21.652834 17367 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:21.624151 17362 raft_consensus.cc:697] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:21.600984 17188 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:21.677137 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 56457.9us
I20260709 13:07:21.674502 13756 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:21.651746 17378 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:21.732342 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2211) took 2349 ms. Trace:
W20260709 13:07:21.672112 17321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.007s	sys 0.013s
I20260709 13:07:21.672096 16963 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:21.652832 17197 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:07:21.629624 17359 consensus_queue.cc:1048] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.094s
I20260709 13:07:21.692742 17077 raft_consensus.cc:2764] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:07:21.691701 17175 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:21.764261 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 70154.7us
W20260709 13:07:21.766870 13864 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.004s	sys 0.043s
W20260709 13:07:21.770045 13864 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.004s	sys 0.043s
I20260709 13:07:21.753443 13791 rpcz_store.cc:276] 0709 13:07:19.361968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.392938 (+ 30970us) service_pool.cc:224] Handling call
0709 13:07:19.438474 (+ 45536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.735905 (+297431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.710646 (+1974741us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54001b6cd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:21.710844 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":592434944}
I20260709 13:07:21.711907 17271 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:21.692236 17354 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:21.710776 16988 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:21.769843 13829 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:21.766160 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 91762.1us
I20260709 13:07:21.771160 17309 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:21.766425 17033 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.013s	sys 0.021s
W20260709 13:07:21.771786 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 450607us
I20260709 13:07:21.762322 17378 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:21.788502 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:21.792265 14400 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:21.793968 13709 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:21.796129 13680 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:21.796705 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:21.769414 16913 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.769220 17175 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:21.800294 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.732913 17380 consensus_queue.cc:1059] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 13:07:21.809060 13829 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:21.786314 17033 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.014s	sys 0.021s
I20260709 13:07:21.790711 17009 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:21.804345 17191 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 7. Current term is 8.
I20260709 13:07:21.780462 17354 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:21.808439 17175 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:21.835404 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 46887.6us
I20260709 13:07:21.845327 13713 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:21.846139 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:21.889566 13714 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
W20260709 13:07:21.889808 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 99722.7us
I20260709 13:07:21.847031 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:21.827345 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:21.809476 17374 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:21.892232 13710 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2439) took 1556 ms (client timeout 1556 ms). Trace:
W20260709 13:07:21.892663 13710 rpcz_store.cc:269] 0709 13:07:20.336245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.338073 (+  1828us) service_pool.cc:224] Handling call
0709 13:07:21.892040 (+1553967us) spinlock_profiling.cc:243] Waited 45.3 ms on lock 0x7b540012e154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:21.892169 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104232192}
I20260709 13:07:21.813820 17009 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:21.894528 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:21.895128 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 67869us
I20260709 13:07:21.891482 13757 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:21.894832 13790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 782) took 1866 ms. Trace:
I20260709 13:07:21.898675 13829 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:21.899966 13829 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:21.901077 13829 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:21.830425 17197 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:21.888480 17380 raft_consensus.cc:3055] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:21.902135 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 111962us
I20260709 13:07:21.918224 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:21.919100 13714 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:07:21.890096 16988 raft_consensus.cc:697] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:07:21.923012 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.806954 17274 consensus_queue.cc:260] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:21.902377 17009 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.902711 17033 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:21.898659 13790 rpcz_store.cc:276] 0709 13:07:20.028140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.028306 (+   166us) service_pool.cc:224] Handling call
0709 13:07:20.028755 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.073583 (+ 44828us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:20.210839 (+137256us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.440130 (+1229291us) spinlock_profiling.cc:243] Waited 6.72 ms on lock 0x7b18003961c0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e23a 00007f52324e8a2a
0709 13:07:21.894082 (+453952us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:21.894159 (+    77us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:21.894227 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.894624 (+   397us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.894765 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12124,"prepare.queue_time_us":109599,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":11901,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":6669,"spinlock_wait_cycles":15461632,"thread_start_us":551950,"threads_started":3,"wal-append.queue_time_us":1591348}
I20260709 13:07:21.910759 17271 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.911136 17223 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:21.930481 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:21.910969 17138 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:21.826356 17362 consensus_queue.cc:237] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:21.917387 17380 raft_consensus.cc:740] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:21.926024 17197 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.950846 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:21.952697 13713 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:21.964041 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:21.964799 13791 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:21.967386 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 66349.8us
I20260709 13:07:21.936750 16989 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:21.968376 13829 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:21.971271 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:21.969985 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 528022us
I20260709 13:07:21.973294 13788 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:21.977494 13715 raft_consensus.cc:1240] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:21.980342 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:21.935719 16963 consensus_queue.cc:1048] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:07:21.982043 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:21.982249 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:21.982625 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:21.933297 17330 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:21.985931 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:21.986744 14402 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:07:21.987674 17033 raft_consensus.cc:697] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:07:21.988445 17389 log.cc:927] Time spent T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:07:21.988855 17385 log.cc:927] Time spent T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:07:21.989239 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:21.961966 17188 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:21.989995 13858 raft_consensus.cc:1275] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:21.991159 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:21.992728 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:07:21.997761 17383 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:07:21.999728 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.002514 13791 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:22.035655 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:21.956450 17325 consensus_queue.cc:1059] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:07:21.951647 17373 consensus_queue.cc:1059] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 13:07:22.063861 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 95547.2us
W20260709 13:07:22.064206 17386 log.cc:927] Time spent T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:07:22.064224 14400 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:07:22.064563 13788 raft_consensus.cc:1240] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:22.064735 13829 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:22.046272 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.980795 17197 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.975958 17405 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:07:22.056110 17398 log.cc:927] Time spent T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:07:22.060003 13755 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:22.061507 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:22.071494 14401 raft_consensus.cc:2376] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10. Re-sending same reply.
I20260709 13:07:22.060817 17223 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.065903 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:21.977689 17359 consensus_queue.cc:1059] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:07:22.066506 13829 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:21.978087 16989 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.068349 14400 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:22.055035 14398 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.075911 17410 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.098431 13755 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:22.099742 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 761) took 2387 ms. Trace:
I20260709 13:07:22.100507 16618 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.100106 13864 rpcz_store.cc:276] 0709 13:07:19.712847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.713013 (+   166us) service_pool.cc:224] Handling call
0709 13:07:19.760145 (+ 47132us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.222628 (+462483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.222661 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:21.243276 (+1020615us) spinlock_profiling.cc:243] Waited 6.34 ms on lock 0x7b2c000cc698. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5230dd7a11 00007f5230de7372 00007f5232519a01 00007f52324de43a 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2
0709 13:07:21.243710 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:07:21.804101 (+560391us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:21.804153 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.804245 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:22.099481 (+295236us) raft_consensus.cc:1685] finished
0709 13:07:22.099500 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.099684 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":289292,"raft.queue_time_us":289672,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"spinlock_wait_cycles":14588800,"thread_start_us":724268,"threads_started":2,"wal-append.queue_time_us":852874}
I20260709 13:07:22.102671 13755 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:22.102628 17368 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:22.077723 17033 consensus_queue.cc:237] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.103994 16954 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.035598 16988 consensus_queue.cc:237] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.081025 14397 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:22.085193 17345 consensus_queue.cc:260] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:22.094202 14395 raft_consensus.cc:2368] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11.
I20260709 13:07:22.108274 17345 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:22.111124 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:22.111891 14400 raft_consensus.cc:2393] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 10: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:22.115983 17410 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.117313 16963 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:22.071730 17197 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.118644 17223 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:22.132131 14401 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:07:22.123852 13680 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:22.149744 13864 raft_consensus.cc:1240] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:22.157626 17159 consensus_meta.cc:287] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.504s	user 0.007s	sys 0.002s
I20260709 13:07:22.158115 17159 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.130354 13789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48902
I20260709 13:07:22.134915 17359 consensus_queue.cc:1243] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer b5029654a4384e43a68eb67b794949b7 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:22.083187 16924 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.154954 16989 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:22.164463 17223 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:22.171687 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:22.168779 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:22.088691 17405 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.147393 17374 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:22.177429 17390 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:07:22.149248 17354 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:22.179939 17009 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:22.176472 17412 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:22.181630 14401 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 9: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:22.180810 17223 raft_consensus.cc:697] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:22.194175 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:22.208346 13860 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:07:22.195261 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:22.195762 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:22.202368 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:22.203198 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 119968us
I20260709 13:07:22.168231 17159 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:22.210978 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:22.212183 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:22.213199 13861 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:07:22.208847 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:22.210417 14395 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:22.218492 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:22.218803 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:22.220738 13865 raft_consensus.cc:2393] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 8: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:22.166399 17410 consensus_queue.cc:1059] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:07:22.167007 17363 consensus_queue.cc:1059] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.043s
W20260709 13:07:22.223059 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.224723 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:22.225608 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:22.221822 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:22.232115 13791 raft_consensus.cc:1240] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:22.229607 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:22.236025 13784 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.241567 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:22.236944 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:22.238724 14368 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:22.244048 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:22.244257 13787 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:22.222460 17319 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.254280 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:22.227545 17173 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.221545 17197 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:22.235961 17404 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.236330 16963 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.219832 17223 consensus_queue.cc:237] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:22.236516 17330 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:22.260162 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:22.259939 14368 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:22.278141 14368 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:22.269240 13784 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:22.279369 13861 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:22.252384 17159 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:22.281159 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.256356 17244 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:22.291894 14396 raft_consensus.cc:1240] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:07:22.294638 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:22.295344 14401 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.242204 17412 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.300604 17412 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:22.301301 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.304795 17395 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
W20260709 13:07:22.307121 17391 log.cc:927] Time spent T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.249s	user 0.002s	sys 0.000s
I20260709 13:07:22.308777 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:22.276441 16963 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.308903 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:22.311801 13782 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:07:22.312121 13863 raft_consensus.cc:2393] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 10: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:22.312971 16963 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:22.263727 17404 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.315099 13787 raft_consensus.cc:1240] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:22.315682 17404 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:22.316510 17399 log.cc:927] Time spent T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
W20260709 13:07:22.317528 17324 consensus_meta.cc:287] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.675s	user 0.005s	sys 0.005s
I20260709 13:07:22.318375 17271 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.320662 17405 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:22.320472 17175 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.322021 17009 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:22.322441 17397 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.347s	user 0.001s	sys 0.000s
I20260709 13:07:22.323151 17239 raft_consensus.cc:3055] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:22.323587 17239 raft_consensus.cc:740] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:22.292554 17322 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:22.324144 17322 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.324590 17322 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.324527 17239 consensus_queue.cc:260] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.325760 17239 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.286166 16996 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:22.328060 16996 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.328474 16996 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:22.331030 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 264573us
I20260709 13:07:22.332715 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:22.333969 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:22.338788 17378 consensus_meta.cc:287] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.001s
I20260709 13:07:22.338939 17358 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.340171 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:22.341491 13786 raft_consensus.cc:2393] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 8: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:22.342121 13708 raft_consensus.cc:1275] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:22.341495 13713 raft_consensus.cc:1240] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:22.346143 14367 leader_election.cc:400] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8.
I20260709 13:07:22.346446 14367 leader_election.cc:403] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:07:22.347047 14367 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:22.317960 17324 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:22.298563 17380 consensus_queue.cc:260] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:22.350121 14398 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:22.349975 13829 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:22.355264 14401 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:22.347694 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:22.362402 13785 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:22.358031 14367 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:22.359689 14395 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:22.364075 13784 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:22.364984 17380 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:22.365033 17188 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:22.365990 17244 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:22.367651 17203 raft_consensus.cc:3055] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:22.368017 17412 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:22.368269 13829 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:22.367210 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 946) took 1024 ms. Trace:
I20260709 13:07:22.388046 14393 rpcz_store.cc:276] 0709 13:07:21.342503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.342904 (+   401us) service_pool.cc:224] Handling call
0709 13:07:22.367051 (+1024147us) spinlock_profiling.cc:243] Waited 54.5 ms on lock 0x7b54004c18d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:22.367140 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125267712}
I20260709 13:07:22.388792 13829 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:22.390245 13829 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:22.287169 17159 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:22.375231 13708 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:22.376924 13713 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:22.261456 17173 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.381206 13865 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:22.394307 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:22.384478 14367 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:22.385653 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:22.373977 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:22.380893 17017 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:07:22.397192 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:22.410392 13709 raft_consensus.cc:2393] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 9: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:22.368584 17247 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8.
I20260709 13:07:22.392747 13714 raft_consensus.cc:1275] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:22.258834 17319 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.383494 17188 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.411737 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:22.415773 14393 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
W20260709 13:07:22.390961 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.410648 17347 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.339241 17378 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:22.413463 17330 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:07:22.426723 13860 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:07:22.417232 13756 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:22.434020 17362 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.435683 17211 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.436187 17362 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.437831 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:22.438282 17362 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:22.389747 17251 consensus_queue.cc:1059] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:07:22.440903 17251 raft_consensus.cc:3055] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:22.440686 17211 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:22.441295 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:22.442627 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.448047 14367 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:22.452149 14367 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:22.391456 17412 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:22.456682 13755 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:22.461795 17173 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:22.463680 17244 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.463908 17175 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:22.464682 17244 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:22.465159 17244 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:22.413851 16924 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:22.413908 17271 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.387715 17203 raft_consensus.cc:740] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:22.434231 16931 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:22.511118 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:22.429231 17188 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.508790 16954 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:22.520591 16954 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.520318 17203 consensus_queue.cc:260] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.521031 16954 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.521173 16931 raft_consensus.cc:697] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:22.428661 17159 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:22.521607 16996 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.521610 17203 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.513548 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:22.428946 17417 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
I20260709 13:07:22.508683 17213 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.522253 16931 consensus_queue.cc:237] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.533174 17378 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:22.541260 16996 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:22.509583 17325 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.546821 17325 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.465583 17244 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:22.468695 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 51065.1us
I20260709 13:07:22.426622 17319 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:22.516494 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:22.571976 14401 raft_consensus.cc:2393] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 8: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:22.509745 13756 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:22.492512 17412 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:22.412102 17416 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:22.573115 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 63949.9us
I20260709 13:07:22.441291 17251 raft_consensus.cc:740] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:22.574470 13756 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:22.575915 13829 leader_election.cc:400] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11.
W20260709 13:07:22.574868 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.441793 17320 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.131s
I20260709 13:07:22.574111 17175 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.569885 17213 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:22.618160 13789 raft_consensus.cc:606] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Received request to transfer leadership
I20260709 13:07:22.618628 13789 raft_consensus.cc:614] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:22.619660 13788 raft_consensus.cc:2410] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:22.620149 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:22.621097 13709 raft_consensus.cc:2393] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 8: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:22.622068 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:22.608558 17233 raft_consensus.cc:3055] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:22.604460 17313 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.596436 17159 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.627562 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:22.623593 17233 raft_consensus.cc:740] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:22.630581 13713 raft_consensus.cc:2393] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 8: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:22.638298 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:22.644661 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 499392us
I20260709 13:07:22.625478 16988 consensus_queue.cc:1059] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:07:22.623852 16697 consensus_queue.cc:1048] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:07:22.608728 17417 consensus_queue.cc:1059] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
W20260709 13:07:22.649797 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.651763 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.643102 17324 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:22.654978 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:22.657895 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 206491us
I20260709 13:07:22.658089 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:22.651464 17239 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.663594 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:07:22.663935 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 70312us
I20260709 13:07:22.665442 13680 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:22.668219 17325 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:22.668818 17325 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:22.669263 17325 raft_consensus.cc:697] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:22.673056 16948 raft_consensus.cc:3055] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:22.673635 16948 raft_consensus.cc:740] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:22.675350 16978 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.670126 17325 consensus_queue.cc:237] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.678814 17210 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:22.643136 17313 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:22.684346 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:22.657413 16924 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.686424 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:22.687778 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:22.694510 13716 raft_consensus.cc:1217] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 5.3->[7.4-9.5]   Dedup: 9.5->[]
I20260709 13:07:22.695139 13716 raft_consensus.cc:1240] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 13:07:22.695567 17271 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.696094 17271 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.698482 17271 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:22.698640 16954 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.662757 17233 consensus_queue.cc:260] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.705538 17233 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:22.707010 13789 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:07:22.708374 13789 pending_rounds.cc:85] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 5
I20260709 13:07:22.709087 13789 pending_rounds.cc:107] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:07:22.734512 13789 raft_consensus.cc:2889] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:22.709096 17324 consensus_queue.cc:1175] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ceb06175847b428ea8bd77055fcddf58" responder_term: 13 status { last_received { term: 10 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 12. Current term is 13. Ops: [12.11-12.11]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:07:22.767560 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.685235 17322 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.661522 17362 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:07:22.770300 14399 raft_consensus.cc:1240] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:22.681172 17373 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:22.772238 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:22.770840 13829 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:22.775210 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:22.778067 13858 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.782044 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:22.788568 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:22.789156 14402 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.789757 14397 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:22.790350 14400 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:22.682542 17417 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 13:07:22.799552 14401 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:22.792416 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:22.794504 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:22.681803 17239 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.685443 17210 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.782984 17347 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.814932 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:22.685848 17412 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.815810 13789 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:22.818306 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:22.822966 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:22.785647 17373 raft_consensus.cc:697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:22.837066 13711 raft_consensus.cc:1240] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:22.824041 14395 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:22.830366 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:22.839082 13791 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:07:22.831583 17274 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.808101 17431 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.816656 16989 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:07:22.811527 16695 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:07:22.834298 13861 raft_consensus.cc:1240] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:22.835955 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.832497 17426 log.cc:927] Time spent T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:07:22.841193 13714 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:22.852660 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:22.845589 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:22.845818 14402 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:22.839936 17191 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:22.847730 17313 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:22.848556 17431 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.856992 13861 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:22.868191 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:22.815724 16924 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:07:22.868747 13861 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:22.868880 13791 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:22.869647 13680 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:22.870530 13858 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:07:22.880300 13680 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:22.880831 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:22.881508 13791 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:07:22.872617 16989 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.868772 17191 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.891029 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:22.891848 13786 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.902439 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:22.902482 13680 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:22.904333 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:22.904819 17153 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:22.905215 13791 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:22.905354 17153 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.905969 17153 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.910140 14402 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:07:22.916110 17394 log.cc:927] Time spent T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.976s	user 0.003s	sys 0.000s
I20260709 13:07:22.918236 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:22.923246 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:22.926618 13859 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:22.926278 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:22.931628 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 730) took 1515 ms. Trace:
I20260709 13:07:22.932126 13712 rpcz_store.cc:276] 0709 13:07:21.415909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.449061 (+ 33152us) service_pool.cc:224] Handling call
0709 13:07:21.449450 (+   389us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:21.492402 (+ 42952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.492432 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:21.503582 (+ 11150us) log.cc:844] Serialized 52 byte log entry
0709 13:07:21.794943 (+291361us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:21.794998 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.795080 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:22.915436 (+1120356us) spinlock_profiling.cc:243] Waited 6.89 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:07:22.920630 (+  5194us) raft_consensus.cc:1685] finished
0709 13:07:22.920657 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.931557 (+ 10900us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":7340,"spinlock_wait_cycles":15842560,"thread_start_us":261304,"threads_started":1,"wal-append.queue_time_us":376133}
I20260709 13:07:22.882671 17374 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:22.945034 13791 raft_consensus.cc:1275] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:07:22.934031 17438 log.cc:927] Time spent T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:07:22.949013 13791 raft_consensus.cc:1240] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:22.954392 13791 raft_consensus.cc:3055] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:22.954962 13791 raft_consensus.cc:740] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:07:22.941347 17380 consensus_meta.cc:287] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.008s
I20260709 13:07:22.929999 17233 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:22.961154 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:22.962013 14397 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.966120 13757 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:22.940299 17367 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.968650 13785 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:22.956180 13791 consensus_queue.cc:260] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:22.970129 13791 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.944370 17374 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.985610 13784 raft_consensus.cc:1240] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:22.986521 13786 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:22.950429 17313 consensus_queue.cc:1048] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:07:22.959362 16954 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:22.997925 13858 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:22.963860 17233 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.002012 13757 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:22.950430 16695 consensus_queue.cc:1048] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
W20260709 13:07:23.016610 17437 log.cc:927] Time spent T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:07:23.017683 17213 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:23.018117 17435 log.cc:927] Time spent T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:07:23.019670 13715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2461) took 1825 ms. Trace:
W20260709 13:07:22.970304 16988 consensus_queue.cc:1175] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b5029654a4384e43a68eb67b794949b7" responder_term: 8 status { last_received { term: 6 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:23.020071 13715 rpcz_store.cc:276] 0709 13:07:21.194533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.194632 (+    99us) service_pool.cc:224] Handling call
0709 13:07:21.208612 (+ 13980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.980116 (+771504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.019376 (+1039260us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b540010c054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:23.019609 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1716661632}
I20260709 13:07:23.022575 16946 raft_consensus.cc:3055] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:23.023015 16946 raft_consensus.cc:740] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:22.988987 17367 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.972822 17374 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.007759 17405 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:23.011308 13599 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f09ef105d67b41dba510b44a6567d790 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 35ecb005831740438d7537dd4b840e03 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:22.973219 17159 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:23.009734 16954 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:22.933900 17373 consensus_queue.cc:237] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:22.968012 16989 consensus_queue.cc:1059] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:07:23.032691 13789 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:23.035202 13791 raft_consensus.cc:1275] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:07:23.035678 13791 pending_rounds.cc:85] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 4
I20260709 13:07:23.036684 13791 pending_rounds.cc:107] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:07:23.037081 13791 raft_consensus.cc:2889] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:23.003777 17233 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:23.049034 17191 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:23.056423 17239 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:23.057509 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:23.058467 14394 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:23.058753 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:23.059571 13715 raft_consensus.cc:2410] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:07:23.005796 17380 consensus_queue.cc:1059] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:07:23.066622 17410 raft_consensus.cc:3055] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:23.067075 17410 raft_consensus.cc:740] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:23.070284 14368 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:23.070109 17244 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:23.038092 16946 consensus_queue.cc:260] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:23.071923 14402 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:23.072291 16946 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.072616 17203 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:23.073169 17203 raft_consensus.cc:697] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:23.074015 17203 consensus_queue.cc:237] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:23.079955 17441 log.cc:927] Time spent T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:07:23.036186 17412 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:23.085544 13716 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:23.091979 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:23.094051 13756 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:23.095687 13756 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:23.095825 16695 consensus_queue.cc:1048] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:23.096582 17000 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.097118 13756 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:23.097434 16695 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:23.100302 13858 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:23.100373 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:23.100528 13756 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:23.102861 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.102407 17431 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:23.098676 17191 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.104828 17358 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:23.122502 17191 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:23.123531 17396 log.cc:927] Time spent T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 1.160s	user 0.007s	sys 0.003s
I20260709 13:07:23.105011 16695 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.099270 16931 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:07:23.098865 17330 consensus_queue.cc:1059] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:07:23.170181 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:07:23.175158 13662 auto_rebalancer.cc:893] Removing replace marker failed: Replica 35ecb005831740438d7537dd4b840e03 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:07:23.175676 13662 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:07:23.176026 13662 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:07:23.176254 17413 raft_consensus.cc:3055] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:23.176815 17413 raft_consensus.cc:740] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:23.182798 17191 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:23.184098 17188 consensus_meta.cc:287] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.664s	user 0.009s	sys 0.023s
I20260709 13:07:23.184558 17188 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:23.186708 17188 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:23.196136 17153 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:23.197917 17175 raft_consensus.cc:3055] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:23.157017 17231 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.156533 17244 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:23.201793 17175 raft_consensus.cc:740] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:23.163736 16978 consensus_queue.cc:1059] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:07:23.255908 17175 consensus_queue.cc:260] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:23.236078 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:23.260025 13680 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:23.261497 17373 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:23.262336 17430 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:23.262104 17413 consensus_queue.cc:260] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:23.262988 17430 raft_consensus.cc:697] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:23.258826 17374 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:23.269591 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:23.270154 13790 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:23.240074 17233 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:23.245980 16954 consensus_queue.cc:1059] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:23.247153 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:23.252317 17000 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:23.224633 17231 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:23.253410 17153 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:23.236764 16946 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.266762 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:23.269173 14397 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
W20260709 13:07:23.271559 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 138223us
I20260709 13:07:23.278542 14402 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
W20260709 13:07:23.279830 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.274420 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:23.288595 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:23.262141 17373 raft_consensus.cc:697] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:23.270478 17413 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.292164 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:07:23.290222 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 185363us
I20260709 13:07:23.294131 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:07:23.296049 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.273696 16695 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:23.264815 17325 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:07:23.299714 14396 raft_consensus.cc:1240] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:23.303153 13707 raft_consensus.cc:1275] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:23.304260 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:23.306609 16697 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.306973 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:23.307868 14397 raft_consensus.cc:2393] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 6: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:23.308226 13715 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:07:23.308800 13755 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:23.263971 17430 consensus_queue.cc:237] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:23.318593 17373 consensus_queue.cc:237] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:23.323311 17233 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:23.324148 17231 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:23.324679 17374 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:23.288439 16946 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:23.312052 13784 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:23.298584 17227 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.347914 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:23.351052 17142 consensus_queue.cc:1059] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:23.352057 13789 raft_consensus.cc:1240] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:23.352187 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:23.353071 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:23.354178 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:23.355093 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:23.356365 16946 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:23.356992 17142 raft_consensus.cc:3055] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:23.363878 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:23.362947 17142 raft_consensus.cc:740] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:23.364518 17465 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:23.365109 17465 raft_consensus.cc:697] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:23.365280 17142 consensus_queue.cc:260] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:23.366021 17465 consensus_queue.cc:237] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:23.366688 17142 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:23.371575 13856 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 2063) took 2114 ms (client timeout 1922 ms). Trace:
W20260709 13:07:23.372130 13856 rpcz_store.cc:269] 0709 13:07:21.256858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.270839 (+ 13981us) service_pool.cc:224] Handling call
0709 13:07:23.371251 (+2100412us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54002d87d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:23.371443 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":603702144}
I20260709 13:07:23.373371 13862 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:23.308290 16697 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:23.376966 13789 raft_consensus.cc:2410] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:07:23.377206 16697 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:23.383579 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:23.399660 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:23.401486 13862 raft_consensus.cc:1275] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:23.403728 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:23.404356 14402 raft_consensus.cc:2376] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8. Re-sending same reply.
I20260709 13:07:23.360916 17227 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:23.430397 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:23.437043 13790 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:23.438186 14366 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:23.438709 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:23.440210 17387 log.cc:927] Time spent T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 1.518s	user 0.004s	sys 0.000s
I20260709 13:07:23.441265 17367 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:23.386369 17150 consensus_queue.cc:1048] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:07:23.444860 14402 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:07:23.452194 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 143473us
I20260709 13:07:23.455014 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:23.455825 14396 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
W20260709 13:07:23.457899 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.457825 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:23.459297 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:23.459852 13790 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:23.458531 14396 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:07:23.472259 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 799) took 1254 ms. Trace:
I20260709 13:07:23.474125 14366 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:23.474361 13790 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:07:23.475672 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:23.476760 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:23.472662 13788 rpcz_store.cc:276] 0709 13:07:22.218066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.218230 (+   164us) service_pool.cc:224] Handling call
0709 13:07:23.466992 (+1248762us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b54000b1b54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:23.472197 (+  5205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":919843712}
I20260709 13:07:23.477411 13790 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.479324 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 810) took 1248 ms. Trace:
I20260709 13:07:23.479712 13782 rpcz_store.cc:276] 0709 13:07:22.230982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.236652 (+  5670us) service_pool.cc:224] Handling call
0709 13:07:23.479162 (+1242510us) spinlock_profiling.cc:243] Waited 68.2 ms on lock 0x7b5400371254. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:23.479270 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156757248}
W20260709 13:07:23.485333 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 114967us
I20260709 13:07:23.464318 17203 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:23.488109 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.488408 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:23.487797 14366 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:23.478242 17330 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:23.490909 14366 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:23.500344 13790 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:23.500749 17203 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:23.504907 17203 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:23.507591 14366 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:23.509923 17227 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:23.510123 17320 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:23.510514 17320 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:23.489446 17466 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.510895 17320 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:23.511195 17466 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:23.513280 17466 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:23.490834 17392 consensus_queue.cc:1059] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:07:23.514734 17392 raft_consensus.cc:3055] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:23.515074 17392 raft_consensus.cc:740] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:23.515959 17392 consensus_queue.cc:260] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:23.517202 17392 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:23.520033 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 56134.6us
I20260709 13:07:23.520722 13755 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:23.524955 13680 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:23.529672 14366 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:23.530432 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:23.531073 13712 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:07:23.532184 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:23.494017 17142 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:23.536226 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:23.537046 13716 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:07:23.541133 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:23.541955 13714 raft_consensus.cc:2410] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:23.543828 13709 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:23.527982 17368 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.546885 14366 leader_election.cc:304] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:23.549265 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:23.549470 14366 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:23.550642 14366 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:23.534765 17004 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.551571 17319 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:23.552045 17203 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:23.552484 17459 raft_consensus.cc:2764] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:23.543658 17367 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:23.572818 17367 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.573213 17367 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.573583 16948 consensus_queue.cc:260] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:23.542897 17354 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.583756 17354 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:23.548453 17247 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:23.578248 17004 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:23.568008 17368 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:23.592345 17368 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:23.592865 17368 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.593266 17368 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:23.593595 17367 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:23.594060 17210 leader_election.cc:290] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:23.535562 17330 consensus_queue.cc:1059] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:07:23.596068 17330 raft_consensus.cc:3055] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:23.596438 17330 raft_consensus.cc:740] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:23.596940 17354 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:23.597281 17330 consensus_queue.cc:260] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:23.598488 17330 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:23.598634 17367 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:23.600855 17448 log.cc:927] Time spent T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.172s	user 0.002s	sys 0.000s
W20260709 13:07:23.624603 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.601369 16646 raft_consensus.cc:3055] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:23.627712 16646 raft_consensus.cc:740] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:23.628830 16646 consensus_queue.cc:260] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:23.630267 16646 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:23.631984 17322 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:23.634833 17175 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:23.645162 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:23.649339 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:23.601715 17004 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:23.604729 17462 log.cc:927] Time spent T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:07:23.607923 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:23.610523 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:23.659164 14396 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.610873 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:23.612196 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:23.660459 13858 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:07:23.661914 13858 raft_consensus.cc:1275] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:23.613857 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:23.663003 13860 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:07:23.664155 13757 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:23.618453 17227 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:23.609436 17320 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:23.595230 17368 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:23.654172 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 120515us
I20260709 13:07:23.615626 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:23.664242 14368 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:23.671954 17392 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:23.672396 14368 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:23.673255 17392 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:23.673970 13783 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:23.659251 13864 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:07:23.665186 13757 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:23.689018 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:23.690035 13864 raft_consensus.cc:2410] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:23.692799 13757 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:23.699352 13857 raft_consensus.cc:1275] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:23.702190 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:23.704104 13864 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:23.706393 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:23.734619 13860 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:23.708408 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:23.738940 13858 raft_consensus.cc:2410] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:07:23.705289 13865 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:23.715332 13857 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:23.684286 17458 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:23.745357 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:23.684369 17358 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.746775 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:23.749709 13865 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.751334 17358 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:23.753867 17358 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:23.685863 17247 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:07:23.647645 17410 consensus_queue.cc:260] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:23.756835 17410 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:23.699527 16695 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:23.759720 16695 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.760131 16695 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.716989 17319 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:07:23.764482 13863 raft_consensus.cc:1240] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:23.766678 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:23.767474 13864 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
W20260709 13:07:23.769315 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 76628.2us
I20260709 13:07:23.770900 17358 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:23.771032 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:23.772156 17358 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.772495 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 807) took 1542 ms. Trace:
I20260709 13:07:23.772694 17358 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.772927 13787 rpcz_store.cc:276] 0709 13:07:22.230134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.263207 (+ 33073us) service_pool.cc:224] Handling call
0709 13:07:22.263561 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:22.315513 (+ 51952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.772275 (+1456762us) spinlock_profiling.cc:243] Waited 51.3 ms on lock 0x7b54000df554. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:23.772441 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117939968}
I20260709 13:07:23.776145 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2759) took 1454 ms. Trace:
I20260709 13:07:23.776693 13862 rpcz_store.cc:276] 0709 13:07:22.321348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.334764 (+ 13416us) service_pool.cc:224] Handling call
0709 13:07:23.373180 (+1038416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.402372 (+ 29192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.775889 (+373517us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54002d87d0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:23.776069 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2387418368}
I20260709 13:07:23.782750 14396 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:07:23.784925 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:23.787977 13860 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
W20260709 13:07:23.768342 17462 log.cc:927] Time spent T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:07:23.749827 17458 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:23.768527 17448 log.cc:927] Time spent T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:23.802845 13865 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:23.689271 17227 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:23.813594 16695 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:23.804992 17458 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:23.864621 14396 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:23.866576 17378 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:23.848780 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1738) took 1499 ms. Trace:
W20260709 13:07:23.850205 17460 log.cc:927] Time spent T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:23.868104 13785 rpcz_store.cc:276] 0709 13:07:22.348905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.528582 (+179677us) service_pool.cc:224] Handling call
0709 13:07:22.528905 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.969150 (+440245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.848523 (+879373us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54001e6c54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:23.848712 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1010334592}
I20260709 13:07:23.871737 13789 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:23.873320 17457 log.cc:927] Time spent T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.559s	user 0.004s	sys 0.000s
I20260709 13:07:23.852780 17227 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:23.841674 17405 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:23.880724 17405 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:23.882087 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1154) took 1445 ms. Trace:
I20260709 13:07:23.882548 14398 rpcz_store.cc:276] 0709 13:07:22.436380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.438810 (+  2430us) service_pool.cc:224] Handling call
0709 13:07:22.439070 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.025162 (+586092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.025200 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:23.025251 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:23.025291 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.881755 (+856464us) spinlock_profiling.cc:243] Waited 586 ms on lock 0x7b540070fb54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:23.881797 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.881920 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1347156224}
W20260709 13:07:23.857177 17472 log.cc:927] Time spent T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:07:23.862015 17009 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.884236 17009 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:23.886050 17173 raft_consensus.cc:3055] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:23.886453 17173 raft_consensus.cc:740] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:23.886775 17009 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:23.862876 17077 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.890673 17077 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:23.880746 17251 consensus_queue.cc:260] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:23.892292 17251 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.893321 17077 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:23.866127 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:23.894224 14395 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:07:23.894958 14367 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:23.900704 17431 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:23.883139 17405 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:23.858549 17320 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:23.901149 17431 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.901628 17431 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.867198 17378 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:23.887267 17173 consensus_queue.cc:260] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:23.904222 17378 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:23.897185 17017 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:07:23.898659 17473 log.cc:927] Time spent T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.347s	user 0.000s	sys 0.002s
I20260709 13:07:23.904906 17017 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:23.906109 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:23.906987 14398 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:07:23.907697 17017 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:23.911921 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 387010us
I20260709 13:07:23.912225 17324 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:23.912865 17324 raft_consensus.cc:697] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:23.913648 17324 consensus_queue.cc:237] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:23.914050 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:23.915100 13680 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:23.915956 16989 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:23.916363 17362 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:23.916795 17362 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.917130 17362 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:23.918085 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.918514 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.918629 17378 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.919159 17378 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:23.921492 17378 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:23.922363 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:23.928675 13707 raft_consensus.cc:1240] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:23.920488 13682 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:23.848124 17358 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:23.940873 13713 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:23.941491 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:23.945286 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:23.949659 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:23.951110 13712 raft_consensus.cc:3055] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:23.951632 13712 raft_consensus.cc:740] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:23.956777 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:23.957522 13714 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
I20260709 13:07:23.943897 17373 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:23.959022 17373 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:23.947479 17323 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:23.960146 17323 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:23.961153 17373 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:23.962150 17323 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:23.957232 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:23.963687 13708 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.904645 17173 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.952502 13712 consensus_queue.cc:260] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:23.970148 13712 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:23.967442 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:23.970428 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 50017.5us
I20260709 13:07:23.972090 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:23.975054 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 44492us
I20260709 13:07:23.978451 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:23.979205 13711 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:07:23.976603 17325 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:23.944041 17410 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:23.992508 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:23.976750 17378 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:23.997220 17378 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:23.997939 17345 consensus_queue.cc:1059] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:23.976547 17322 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:07:23.974486 17373 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:24.003181 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:24.016731 13712 raft_consensus.cc:1275] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:07:23.999394 17378 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:24.017900 13712 pending_rounds.cc:85] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 7
I20260709 13:07:24.018198 13708 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:07:24.009212 17410 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:24.018958 13712 pending_rounds.cc:107] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:07:24.000254 17362 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:24.006745 13682 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:24.020212 17430 raft_consensus.cc:2764] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:24.020690 13682 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:24.004491 17358 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:24.021170 17362 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:24.020707 17410 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:24.004703 17363 consensus_queue.cc:1059] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:07:24.022600 17430 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:24.024412 17231 consensus_queue.cc:1048] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:24.025260 17231 consensus_queue.cc:1243] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer b5029654a4384e43a68eb67b794949b7 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:24.026476 17363 raft_consensus.cc:3055] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:24.026979 17363 raft_consensus.cc:740] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:24.006968 17313 consensus_queue.cc:1059] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:07:24.028442 17313 raft_consensus.cc:3055] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:24.028868 17313 raft_consensus.cc:740] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:24.029678 17313 consensus_queue.cc:260] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:24.030772 17004 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:24.030856 13680 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:24.031081 17313 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:24.031497 17004 raft_consensus.cc:697] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:24.012120 13830 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:07:24.034101 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.028281 17363 consensus_queue.cc:260] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:24.034855 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:24.019296 13712 raft_consensus.cc:2889] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:24.036180 13682 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:24.036680 14396 raft_consensus.cc:1240] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:23.976939 17323 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:24.037401 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:24.043819 14402 raft_consensus.cc:2393] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 11: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:23.983958 17325 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:24.023162 16695 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:24.046664 14395 raft_consensus.cc:1275] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:24.000404 17214 raft_consensus.cc:3055] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:24.045517 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:24.051823 17373 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:24.046255 17017 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:07:24.042092 17430 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:24.078388 13829 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:24.006714 16989 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:07:24.054248 17325 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:24.054302 16646 consensus_queue.cc:1059] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:24.055101 17153 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:24.042804 17410 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:24.044984 14366 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:24.077649 17188 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.062598 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:24.064236 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:24.067927 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:24.100128 13710 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.101100 13713 raft_consensus.cc:1240] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:24.052496 17004 consensus_queue.cc:237] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:24.084914 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:24.082238 17459 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.076603 17214 raft_consensus.cc:740] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:24.103259 14402 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 13. Current term is 14. Ops: []
W20260709 13:07:24.093510 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 48599.7us
I20260709 13:07:24.054145 13682 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:24.082154 17077 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:24.096325 13712 raft_consensus.cc:2393] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 9: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:24.102152 13714 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.071058 13756 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:24.065330 17323 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:24.086093 17430 raft_consensus.cc:697] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:24.125613 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:24.137988 13856 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:07:24.082753 17374 consensus_queue.cc:1059] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:07:24.129447 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:24.142684 13862 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.135349 17009 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:24.136092 17413 consensus_queue.cc:1059] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:24.080873 17378 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:07:24.137116 13857 raft_consensus.cc:3055] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:24.147305 13857 raft_consensus.cc:740] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:24.092371 17363 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.094911 17251 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:24.140851 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:24.141206 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 70269.4us
I20260709 13:07:24.094805 17410 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:07:24.143191 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 89117.8us
W20260709 13:07:24.149703 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.129356 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:24.160130 13863 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.153772 13710 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
I20260709 13:07:24.160338 13682 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:07:24.162071 17477 log.cc:927] Time spent T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.411s	user 0.001s	sys 0.003s
I20260709 13:07:24.166334 13856 raft_consensus.cc:1275] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:24.169620 13757 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:24.102543 17188 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:24.122267 17358 consensus_queue.cc:1048] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:07:24.172045 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:24.146060 17000 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:24.172660 17153 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:24.176880 13862 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
I20260709 13:07:24.178333 16946 consensus_queue.cc:1048] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:24.150496 17208 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:24.180898 17431 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:24.148815 17378 consensus_queue.cc:1243] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer 35ecb005831740438d7537dd4b840e03 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:24.193192 13856 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:07:24.198576 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:24.199458 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:24.200155 13786 raft_consensus.cc:2393] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 9: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:24.194947 13756 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:24.201658 13682 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:24.197301 13757 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:24.163035 17410 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:24.164477 17413 consensus_queue.cc:1243] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer b9d194f45e044e0988d5de1a99e5cd02 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:24.127112 17459 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:24.246665 13782 raft_consensus.cc:1275] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:24.150895 17077 consensus_queue.cc:1059] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:07:24.252774 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:24.254204 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:24.244505 17178 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:24.271092 13785 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:24.197456 17211 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:24.277706 14396 raft_consensus.cc:2393] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 9: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:24.281491 13786 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:24.281705 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:24.281795 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:24.282310 13788 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:24.284082 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 89229us
I20260709 13:07:24.279376 13856 pending_rounds.cc:85] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 5
W20260709 13:07:24.285846 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 88656.1us
I20260709 13:07:24.286482 13856 pending_rounds.cc:107] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:07:24.286883 13856 raft_consensus.cc:2889] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:24.285354 13756 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:24.292248 13714 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:07:24.247517 16646 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:24.149243 17458 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:24.275941 17477 log.cc:927] Time spent T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:07:24.331085 13785 raft_consensus.cc:1275] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:24.298902 13863 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:07:24.354810 17017 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:24.355700 17017 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:24.359182 17017 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:24.289078 17211 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:24.372792 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:07:24.385638 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 97632.2us
I20260709 13:07:24.171113 17214 consensus_queue.cc:260] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:24.387535 13755 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:24.294829 17325 raft_consensus.cc:2764] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:24.248353 17208 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:24.294270 17000 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:24.389974 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:24.408146 13785 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:24.331058 16695 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:24.397492 17360 raft_consensus.cc:3055] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:24.296289 17077 consensus_queue.cc:1243] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer 35ecb005831740438d7537dd4b840e03 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:24.331503 17353 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:24.370123 17482 log.cc:927] Time spent T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:07:24.296144 16646 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:24.389154 16931 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.385895 17324 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.414326 14366 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:07:24.402824 17471 log.cc:927] Time spent T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:07:24.281391 17178 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:24.390115 17211 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:24.448757 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 203929us
I20260709 13:07:24.258111 17430 consensus_queue.cc:237] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:24.470290 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 56038.1us
I20260709 13:07:24.472611 13755 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:24.478796 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 351078us
I20260709 13:07:24.446915 16646 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:24.441670 17469 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:24.428007 17360 raft_consensus.cc:740] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:07:24.492564 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.476929 17353 raft_consensus.cc:697] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 8 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:24.468338 17324 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:24.476090 17320 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:24.467664 16931 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:24.629630 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:24.631377 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:24.632398 13710 raft_consensus.cc:2393] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 9: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:07:24.569712 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.498782 17469 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.494151 16695 raft_consensus.cc:697] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:24.668282 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:24.571134 16697 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:24.625795 17308 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.742041 14395 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:07:24.689782 17402 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.014s	sys 0.007s
W20260709 13:07:24.650709 17173 consensus_meta.cc:287] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.680s	user 0.011s	sys 0.008s
I20260709 13:07:24.659781 17469 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:24.741115 17482 log.cc:927] Time spent T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:07:24.788753 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 823) took 1008 ms. Trace:
I20260709 13:07:24.660374 17431 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:24.840809 17362 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.841439 17362 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:24.842175 17316 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.842729 17316 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:24.789412 17507 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:07:24.844326 17494 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.272s	user 0.000s	sys 0.000s
I20260709 13:07:24.846161 17353 consensus_queue.cc:237] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:24.777953 17499 log.cc:927] Time spent T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:07:24.786464 17493 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:07:24.779522 17178 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:24.887938 17362 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:24.799955 17459 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:24.790561 17233 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.780324 17208 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:24.783282 17322 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.819478 13787 rpcz_store.cc:276] 0709 13:07:23.780521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.780659 (+   138us) service_pool.cc:224] Handling call
0709 13:07:23.780945 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.798731 (+ 17786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.798782 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:23.807833 (+  9051us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.095955 (+288122us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:24.095993 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.096063 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.788521 (+692458us) raft_consensus.cc:1685] finished
0709 13:07:24.788549 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.788689 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17381,"raft.queue_time_us":17521,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":15980,"thread_start_us":276489,"threads_started":1,"wal-append.queue_time_us":835023}
W20260709 13:07:24.761224 17402 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.014s	sys 0.012s
W20260709 13:07:24.907320 13788 consensus_meta.cc:287] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.624s	user 0.008s	sys 0.000s
I20260709 13:07:24.677069 17360 consensus_queue.cc:260] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:24.925127 16989 raft_consensus.cc:3055] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:24.925604 16989 raft_consensus.cc:740] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:24.921190 17322 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:24.926383 16989 consensus_queue.cc:260] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:24.927982 17322 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:24.928606 13788 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
W20260709 13:07:24.937007 17492 log.cc:927] Time spent T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
I20260709 13:07:24.913105 17233 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:24.942286 17233 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:24.875108 17507 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:24.944603 17489 log.cc:927] Time spent T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.496s	user 0.000s	sys 0.001s
I20260709 13:07:24.945524 17507 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:24.946079 17496 log.cc:927] Time spent T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 13:07:24.947118 17324 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:24.947504 17478 log.cc:927] Time spent T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 1.093s	user 0.005s	sys 0.000s
I20260709 13:07:24.948632 13858 raft_consensus.cc:1240] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:24.896382 16695 consensus_queue.cc:237] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:24.952255 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 822) took 1278 ms. Trace:
I20260709 13:07:24.952770 13791 rpcz_store.cc:276] 0709 13:07:23.673499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.673618 (+   119us) service_pool.cc:224] Handling call
0709 13:07:23.673905 (+   287us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:23.690805 (+ 16900us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.690842 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:23.699695 (+  8853us) log.cc:844] Serialized 52 byte log entry
0709 13:07:23.934952 (+235257us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:23.967487 (+ 32535us) log.cc:844] Serialized 14 byte log entry
0709 13:07:23.968080 (+   593us) log.cc:844] Serialized 14 byte log entry
0709 13:07:23.972594 (+  4514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.972689 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.006927 (+ 34238us) spinlock_profiling.cc:243] Waited 7.37 ms on lock 0x7b1800375d00. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f1522 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
0709 13:07:24.951974 (+945047us) raft_consensus.cc:1685] finished
0709 13:07:24.952009 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.952182 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20644,"prepare.queue_time_us":72039,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":6859,"raft.queue_time_us":28329,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":31248,"spinlock_wait_cycles":36880000,"thread_start_us":151404,"threads_started":1,"wal-append.queue_time_us":345624}
I20260709 13:07:24.925186 17360 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.958367 13857 consensus_queue.cc:260] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:24.959304 13857 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:24.959591 17458 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:24.960179 17458 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.960644 17458 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:24.961975 17476 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 1.107s	user 0.000s	sys 0.007s
I20260709 13:07:24.955192 13756 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:24.942437 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 791) took 1027 ms. Trace:
I20260709 13:07:24.967121 13865 rpcz_store.cc:276] 0709 13:07:23.914740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.944347 (+ 29607us) service_pool.cc:224] Handling call
0709 13:07:23.944651 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.945002 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:23.968343 (+ 23341us) log.cc:844] Serialized 14 byte log entry
0709 13:07:24.294748 (+326405us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.330432 (+ 35684us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.330626 (+   194us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:24.330673 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.330764 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.936439 (+605675us) spinlock_profiling.cc:243] Waited 47.4 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:07:24.942130 (+  5691us) raft_consensus.cc:1685] finished
0709 13:07:24.942224 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.942381 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4664,"prepare.queue_time_us":186,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":148470,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":14944,"spinlock_wait_cycles":108958592,"thread_start_us":321091,"threads_started":1,"wal-append.queue_time_us":500116}
I20260709 13:07:24.789796 17308 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:24.972718 13790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1744) took 1434 ms. Trace:
I20260709 13:07:24.977514 16989 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.978112 17402 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:24.978700 17402 raft_consensus.cc:697] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:24.973234 13790 rpcz_store.cc:276] 0709 13:07:23.538515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.539932 (+  1417us) service_pool.cc:224] Handling call
0709 13:07:23.540241 (+   309us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:23.541302 (+  1061us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.541330 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:23.541838 (+   508us) log.cc:844] Serialized 52 byte log entry
0709 13:07:23.612942 (+ 71104us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:23.613014 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.613081 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.961421 (+1348340us) spinlock_profiling.cc:243] Waited 85.2 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:07:24.966283 (+  4862us) raft_consensus.cc:1685] finished
0709 13:07:24.966302 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.972652 (+  6350us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":719,"raft.queue_time_us":1449,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3851,"spinlock_wait_cycles":195908480,"thread_start_us":56877,"threads_started":1,"wal-append.queue_time_us":302718}
I20260709 13:07:24.899662 17173 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.992717 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:24.993922 13857 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:07:24.994169 13788 raft_consensus.cc:2393] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 9: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:24.994270 13857 pending_rounds.cc:85] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 7
I20260709 13:07:24.994587 13857 pending_rounds.cc:107] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:07:24.994805 13857 raft_consensus.cc:2889] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:24.909068 17513 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:24.966516 17494 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:07:24.981397 17493 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:07:25.039932 14366 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:24.994853 17458 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:25.051977 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:25.052692 13788 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:25.058246 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:25.058976 13716 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:25.036676 17485 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:07:25.052419 17313 consensus_meta.cc:287] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 1.021s	user 0.013s	sys 0.000s
I20260709 13:07:25.036674 17251 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:24.999614 17173 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:25.042265 17322 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:25.000353 17513 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:25.048949 17373 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:25.057281 17330 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:25.077988 13707 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:07:25.081709 17373 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:25.055567 16931 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:25.085335 13715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2494) took 1135 ms. Trace:
I20260709 13:07:25.085724 13715 rpcz_store.cc:276] 0709 13:07:23.949905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.967270 (+ 17365us) service_pool.cc:224] Handling call
0709 13:07:23.989814 (+ 22544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.060276 (+ 70462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.060305 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:24.060345 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:24.060378 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.085106 (+1024728us) spinlock_profiling.cc:243] Waited 70.3 ms on lock 0x7b54002e8bd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:25.085152 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.085267 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161603328}
I20260709 13:07:25.090467 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:25.092607 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:25.096033 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:25.096629 13858 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:25.097064 13716 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:25.100019 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:25.002158 17402 consensus_queue.cc:237] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:25.102161 13857 raft_consensus.cc:2410] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:25.106178 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:25.098652 16697 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
W20260709 13:07:25.107828 17490 log.cc:927] Time spent T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:07:25.109555 17513 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:25.110785 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:25.102145 17405 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.112843 17405 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:25.113935 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:25.114544 14395 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:25.116304 17508 log.cc:927] Time spent T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:25.116942 17316 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:25.104171 17227 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.082727 17459 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.073655 17233 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:25.122509 14366 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:25.087209 17330 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:25.123647 14395 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
W20260709 13:07:25.126683 13829 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.007s	sys 0.009s
I20260709 13:07:25.073760 17485 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:25.129112 13858 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:25.130338 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:25.134045 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:25.079607 17251 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:25.135330 14398 raft_consensus.cc:2410] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:07:25.131129 13829 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.008s	sys 0.009s
I20260709 13:07:25.134683 13783 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
W20260709 13:07:25.139096 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 645673us
I20260709 13:07:25.139846 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:25.140211 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:25.122932 17512 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.157737 13829 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:25.129271 17513 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:25.139990 16646 consensus_meta.cc:287] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.620s	user 0.007s	sys 0.003s
I20260709 13:07:25.154088 13790 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:25.083639 17322 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:25.117978 17227 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:25.138686 14397 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.004s	sys 0.011s
I20260709 13:07:25.160504 13829 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:25.161206 16646 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:25.156261 17509 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:25.128605 17330 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:25.196869 13829 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:25.142134 17363 consensus_meta.cc:287] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.978s	user 0.009s	sys 0.005s
W20260709 13:07:25.190542 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.170953 17500 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:25.225780 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.124874 17459 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:25.169402 14397 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.004s	sys 0.011s
I20260709 13:07:25.175757 17517 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:25.161021 17513 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.160090 17077 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:25.226671 16646 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:25.172693 17509 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:25.259740 17509 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:25.268106 17173 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:25.269094 17491 log.cc:927] Time spent T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.657s	user 0.001s	sys 0.000s
I20260709 13:07:25.271975 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 794) took 1354 ms. Trace:
I20260709 13:07:25.272404 13861 rpcz_store.cc:276] 0709 13:07:23.917745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.924261 (+  6516us) service_pool.cc:224] Handling call
0709 13:07:23.924556 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.924880 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.924909 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:23.925325 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.245569 (+320244us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:24.245609 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.245674 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.268504 (+1022830us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:07:25.271588 (+  3084us) raft_consensus.cc:1685] finished
0709 13:07:25.271618 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.271910 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3073,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":7183,"spinlock_wait_cycles":76882304,"thread_start_us":319855,"threads_started":1,"wal-append.queue_time_us":520064}
I20260709 13:07:25.132318 17233 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:25.278267 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:25.279163 14398 raft_consensus.cc:2410] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:25.199208 17308 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:25.255637 17077 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:25.257025 17523 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:07:25.258462 17188 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:25.258888 17514 log.cc:927] Time spent T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:07:25.274840 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2112) took 1097 ms. Trace:
I20260709 13:07:25.251237 17513 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:25.276645 13829 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:25.226950 17009 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:25.227576 17410 consensus_meta.cc:287] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.951s	user 0.013s	sys 0.000s
I20260709 13:07:25.169492 17512 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:25.283466 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2499) took 1217 ms. Trace:
I20260709 13:07:25.284484 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:25.285221 13757 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:25.295876 14399 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:07:25.287637 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:25.296878 13783 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
W20260709 13:07:25.276160 17211 consensus_meta.cc:287] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.797s	user 0.009s	sys 0.006s
I20260709 13:07:25.288733 13862 rpcz_store.cc:276] 0709 13:07:24.177331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.485571 (+308240us) service_pool.cc:224] Handling call
0709 13:07:24.485916 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.797885 (+311969us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.797928 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.798578 (+   650us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.102746 (+304168us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:25.108708 (+  5962us) log.cc:844] Serialized 14 byte log entry
0709 13:07:25.126500 (+ 17792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.126594 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.274629 (+148035us) raft_consensus.cc:1685] finished
0709 13:07:25.274646 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.274770 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24141,"prepare.queue_time_us":2065,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":379201,"raft.run_cpu_time_us":360,"raft.run_wall_time_us":44130,"thread_start_us":608140,"threads_started":2,"wal-append.queue_time_us":399341}
I20260709 13:07:25.299583 13757 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:25.303692 17458 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:25.305315 13856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2109) took 1133 ms. Trace:
I20260709 13:07:25.305482 16954 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:25.306970 13757 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:25.308344 13757 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:25.309940 17308 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:25.298874 17410 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:25.310429 17009 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:25.310865 13860 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:25.311143 17308 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:25.311652 17308 raft_consensus.cc:697] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:25.312258 17410 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:25.312556 17512 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:25.313812 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.314015 17485 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:25.315102 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:25.315547 17459 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:25.315655 14396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 977) took 1271 ms. Trace:
I20260709 13:07:25.315876 13861 raft_consensus.cc:2393] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 8: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:25.316071 14396 rpcz_store.cc:276] 0709 13:07:24.044566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.045217 (+   651us) service_pool.cc:224] Handling call
0709 13:07:25.315459 (+1270242us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54005145d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:25.315597 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":483048704}
I20260709 13:07:25.316984 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:25.317210 17077 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:25.318317 17322 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:25.319757 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:25.320391 17405 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:25.320906 17354 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:25.321579 17354 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:25.323451 14366 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:25.324326 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:25.305768 13856 rpcz_store.cc:276] 0709 13:07:24.172913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.272222 (+ 99309us) service_pool.cc:224] Handling call
0709 13:07:24.272538 (+   316us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:24.410758 (+138220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.410785 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:24.411317 (+   532us) log.cc:844] Serialized 52 byte log entry
0709 13:07:24.667251 (+255934us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:24.770524 (+103273us) log.cc:844] Serialized 14 byte log entry
0709 13:07:24.833221 (+ 62697us) log.cc:844] Serialized 14 byte log entry
0709 13:07:24.867689 (+ 34468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.867777 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.305091 (+437314us) raft_consensus.cc:1685] finished
0709 13:07:25.305111 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.305255 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85989,"prepare.queue_time_us":118182,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":74,"raft.queue_time_us":320247,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":8041,"spinlock_wait_cycles":5208320,"thread_start_us":178549,"threads_started":1,"wal-append.queue_time_us":650135}
W20260709 13:07:25.324753 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.294313 13711 rpcz_store.cc:276] 0709 13:07:24.065868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.065978 (+   110us) service_pool.cc:224] Handling call
0709 13:07:24.066634 (+   656us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.094726 (+ 28092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.094761 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.095206 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.403744 (+308538us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:24.433550 (+ 29806us) log.cc:844] Serialized 14 byte log entry
0709 13:07:24.437543 (+  3993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.276208 (+838665us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b54002639d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:25.276283 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.276339 (+    56us) raft_consensus.cc:1685] finished
0709 13:07:25.283248 (+  6909us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.283384 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25427,"prepare.queue_time_us":29909,"prepare.run_wall_time_us":2951,"raft.queue_time_us":23138,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":26552,"spinlock_wait_cycles":56412800,"thread_start_us":260307,"threads_started":1,"wal-append.queue_time_us":660826}
I20260709 13:07:25.324936 13783 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:07:25.326705 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:25.327119 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:25.327757 13714 raft_consensus.cc:1240] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:07:25.328668 13791 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:25.328856 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:25.329523 13715 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:25.329941 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:25.331660 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:25.281800 17517 consensus_queue.cc:1059] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:07:25.332602 17214 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:25.332227 13788 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:25.333011 17469 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:25.312556 17308 consensus_queue.cc:237] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:25.337754 17227 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:25.338017 17324 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.338548 17324 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:25.339735 17522 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:25.340876 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:25.341131 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:25.341434 13859 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:25.343767 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:25.343887 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:25.344270 14402 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEARNER]: Advancing to term 10
I20260709 13:07:25.344451 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:25.347349 13864 raft_consensus.cc:3055] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:25.347728 13864 raft_consensus.cc:740] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:25.348628 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:25.348580 13864 consensus_queue.cc:260] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:25.349310 14394 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:25.349588 13680 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:25.350116 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:25.350885 14394 raft_consensus.cc:2393] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 11: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:25.349720 13864 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:25.352120 13789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 825) took 1061 ms. Trace:
I20260709 13:07:25.352480 13789 rpcz_store.cc:276] 0709 13:07:24.290514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.290915 (+   401us) service_pool.cc:224] Handling call
0709 13:07:24.371109 (+ 80194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.494685 (+123576us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.494729 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:24.494781 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:24.494824 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.351916 (+857092us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54001e7154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:25.351959 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.352068 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":283661056}
I20260709 13:07:25.353649 17251 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:25.347635 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:25.356186 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:25.358946 13859 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
W20260709 13:07:25.360139 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.366143 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:25.396517 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.335160 17469 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:25.398449 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:25.400468 13859 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 12: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:25.400967 13756 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:25.402374 13756 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:25.402513 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 126742us
I20260709 13:07:25.403211 13829 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:25.403755 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:25.404515 14396 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:25.398581 13711 raft_consensus.cc:1240] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:25.369226 13757 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:07:25.399032 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 75677.1us
I20260709 13:07:25.409057 14366 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:25.399436 14402 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 10 LEARNER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:07:25.413635 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 53363us
I20260709 13:07:25.414379 13680 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:25.416005 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:25.416997 13715 raft_consensus.cc:2410] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:25.419865 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:25.421003 13859 raft_consensus.cc:2410] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 13:07:25.415880 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 48372.1us
W20260709 13:07:25.422427 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 53290.5us
I20260709 13:07:25.416841 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:25.423202 13712 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:07:25.423813 13680 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:25.288722 17484 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 13:07:25.421627 17009 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:25.411471 17322 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:25.430449 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:25.434170 14366 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:25.434429 13859 raft_consensus.cc:2410] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:07:25.432096 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.428983 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:25.340250 17522 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:25.436743 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:25.437281 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:25.437897 13856 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:25.436280 13755 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:25.440847 13756 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:25.441984 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:25.443069 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:25.464435 17410 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:25.421859 17517 raft_consensus.cc:3055] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:25.464856 17374 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:25.465477 17521 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:25.465898 17271 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:25.350484 17529 consensus_queue.cc:1048] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:07:25.478621 17354 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:25.483047 17323 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:25.486584 17330 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:25.415733 17153 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:07:25.529533 17077 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:25.440375 17500 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.533650 17517 raft_consensus.cc:740] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:25.496312 17233 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:25.496963 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 976) took 1461 ms. Trace:
W20260709 13:07:25.497925 17519 log.cc:927] Time spent T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:07:25.547480 16697 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:25.506539 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:25.508641 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2784) took 1387 ms. Trace:
I20260709 13:07:25.432829 17469 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:25.464893 13862 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:25.513427 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:25.399552 17430 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:25.438794 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:25.588066 13861 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:25.515502 13857 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:25.439440 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:25.520020 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 77003us
I20260709 13:07:25.592402 13829 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:25.526299 13864 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:07:25.593327 13864 pending_rounds.cc:85] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 7
I20260709 13:07:25.593636 13864 pending_rounds.cc:107] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:07:25.593915 13864 raft_consensus.cc:2889] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:25.594796 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2102) took 1430 ms. Trace:
I20260709 13:07:25.528142 14396 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
I20260709 13:07:25.422550 17373 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:25.430418 17004 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:25.536038 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 95274us
I20260709 13:07:25.398945 17211 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:25.438585 17322 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.540964 14367 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:25.437371 17380 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:25.446656 17227 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:22.772891 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:25.446486 17188 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:25.417260 17345 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.116s
I20260709 13:07:25.513057 17173 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:25.433126 17231 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.109s
I20260709 13:07:25.514309 17413 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:25.488469 17520 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:25.568318 13830 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:07:25.621673 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 53446.4us
I20260709 13:07:25.621850 13790 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
W20260709 13:07:25.624138 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.532644 17497 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:25.625738 13682 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:25.500519 16948 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:25.584734 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:25.640136 13716 raft_consensus.cc:2410] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:25.584863 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:25.641461 13707 raft_consensus.cc:2410] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:07:25.652300 17251 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.652869 17251 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:25.653334 17373 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.653672 17330 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:25.653872 17373 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:25.654968 17251 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:25.655552 16946 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:25.656131 17373 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:25.656059 16946 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:25.656699 17373 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:25.657183 17373 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:25.656792 17517 consensus_queue.cc:260] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:25.658103 16946 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:25.658838 17517 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:25.660168 17535 log.cc:927] Time spent T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:07:25.660509 13682 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:25.662091 17430 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:25.662281 17153 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:25.662518 17430 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.662712 17153 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.662923 17430 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:25.663118 17153 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:25.611819 17410 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:25.613296 17173 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.665473 17173 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:25.586639 13860 rpcz_store.cc:276] 0709 13:07:24.121355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.121522 (+   167us) service_pool.cc:224] Handling call
0709 13:07:24.121992 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.311245 (+1189253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.508438 (+197193us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540004ae54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:25.508588 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2733737344}
I20260709 13:07:25.550232 17521 raft_consensus.cc:697] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:25.666533 17522 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:25.613840 16931 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:25.667428 17521 consensus_queue.cc:237] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:25.668263 16989 consensus_meta.cc:287] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.690s	user 0.010s	sys 0.000s
I20260709 13:07:25.600670 13756 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:25.668908 13709 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
W20260709 13:07:25.669341 17492 log.cc:927] Time spent T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:07:25.613224 17488 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:07:25.624090 17227 raft_consensus.cc:697] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 8 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:25.670979 17227 consensus_queue.cc:237] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:25.671563 17211 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:25.602715 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:25.606326 13829 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:25.674142 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 67917.8us
I20260709 13:07:25.675007 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:25.581544 14397 rpcz_store.cc:276] 0709 13:07:24.035868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.038727 (+  2859us) service_pool.cc:224] Handling call
0709 13:07:24.039021 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.039243 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:24.384434 (+345191us) log.cc:844] Serialized 14 byte log entry
0709 13:07:25.471166 (+1086732us) log.cc:844] Serialized 14 byte log entry
0709 13:07:25.496619 (+ 25453us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:25.496681 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:25.496732 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.496796 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.496906 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":274167,"prepare.queue_time_us":1710971,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":30194,"raft.run_cpu_time_us":3702,"raft.run_wall_time_us":16605,"thread_start_us":1149381,"threads_started":2,"wal-append.queue_time_us":854571}
W20260709 13:07:25.580812 17515 log.cc:927] Time spent T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.561s	user 0.000s	sys 0.007s
W20260709 13:07:25.608935 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 68091.8us
I20260709 13:07:25.612989 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:25.544531 17513 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:25.615816 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:25.618053 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:25.619748 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:25.694574 13711 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:07:25.634428 17497 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:25.608480 17322 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:25.613598 17188 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.620397 17509 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:25.659147 17373 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:25.595187 13864 rpcz_store.cc:276] 0709 13:07:24.164192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.164429 (+   237us) service_pool.cc:224] Handling call
0709 13:07:24.177174 (+ 12745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.347240 (+1170066us) spinlock_profiling.cc:243] Waited 69.8 ms on lock 0x7b54002f1320. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f5232455dc0 00007f52324e01c0 00007f52324e1231 00007f52324ddd8f 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c
0709 13:07:25.594497 (+247257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.594728 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160630528}
I20260709 13:07:25.679405 13829 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:25.626864 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:25.694666 13715 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:25.698405 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:25.663677 17313 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:25.698092 14367 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:25.718499 14401 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:25.718937 17402 consensus_queue.cc:1059] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:25.672999 17271 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:25.579460 17500 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:25.621299 17520 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.775564 13856 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
W20260709 13:07:25.715972 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 115410us
I20260709 13:07:25.697011 17410 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:25.672729 17211 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:25.721854 14367 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:25.703003 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 272199us
I20260709 13:07:25.793292 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 975) took 1757 ms. Trace:
I20260709 13:07:25.700973 17077 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:25.798386 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 364265us
I20260709 13:07:25.782961 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:25.784541 13712 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:25.780803 13707 raft_consensus.cc:1275] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:25.702876 17188 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:25.842088 13680 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:25.805346 13861 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:07:25.625098 17413 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:25.840617 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 66018.7us
I20260709 13:07:25.843160 14393 rpcz_store.cc:276] 0709 13:07:24.035484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.037929 (+  2445us) service_pool.cc:224] Handling call
0709 13:07:24.038236 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.038496 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:24.047109 (+  8613us) log.cc:844] Serialized 14 byte log entry
0709 13:07:25.467397 (+1420288us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b18002904a0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f36bc0a 00007f5238aab219 00007f522f3f3a40 00007f522f3ee4e4 00007f522f3ee455 00007f5235ed63c7 00007f52324e89a7 00007f52324f80bf 00007f52324f8038
0709 13:07:25.467640 (+   243us) log.cc:844] Serialized 14 byte log entry
0709 13:07:25.792912 (+325272us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:25.792971 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:25.793024 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.793096 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.793229 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1376566,"prepare.queue_time_us":1434745,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":3051,"raft.queue_time_us":30699,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":3121,"spinlock_wait_cycles":3839360,"thread_start_us":324934,"threads_started":1}
I20260709 13:07:25.720916 17511 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:25.849810 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:25.850914 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:25.768631 17330 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.812644 13862 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:07:25.858312 13682 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:25.859016 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:25.853684 14366 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:25.866014 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:25.867077 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:25.868629 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:25.869323 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:25.869942 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:25.870779 13785 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 8: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
W20260709 13:07:25.873345 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.874047 13829 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:25.798368 16931 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:25.867671 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:25.867901 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:25.849613 17231 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:25.878156 13782 raft_consensus.cc:1275] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:25.798211 17520 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:25.716933 16946 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.141s
I20260709 13:07:25.879024 13829 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:25.879681 13788 pending_rounds.cc:85] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 4
I20260709 13:07:25.920773 13788 pending_rounds.cc:107] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:07:25.921079 13788 raft_consensus.cc:2889] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:25.880924 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.922693 13829 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:25.891319 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:25.891966 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:25.770094 17271 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:25.892890 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:25.930325 14398 raft_consensus.cc:2393] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 5: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:25.893505 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:25.894400 13784 raft_consensus.cc:2393] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 7: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:25.897064 13783 raft_consensus.cc:1240] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:25.886961 17504 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:25.844599 17412 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.852725 13791 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
W20260709 13:07:25.910997 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 188931us
I20260709 13:07:25.937902 14367 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:25.876905 17515 log.cc:927] Time spent T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:07:25.924945 14393 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:07:25.803526 17459 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:25.926935 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:25.928089 13786 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:25.848029 17410 raft_consensus.cc:697] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:25.859025 17511 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:25.889115 17345 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:25.983867 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:25.943356 14393 pending_rounds.cc:85] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 9
I20260709 13:07:25.936703 13680 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:25.886942 16931 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:26.027467 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:26.028292 14393 pending_rounds.cc:107] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 10.10
W20260709 13:07:25.998375 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.032236 14393 raft_consensus.cc:2889] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:25.989720 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 106283us
I20260709 13:07:26.043797 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:26.044404 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 107805us
I20260709 13:07:26.045778 13789 raft_consensus.cc:1217] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Deduplicated request from leader. Original: 4.6->[5.7-6.8]   Dedup: 5.7->[6.8-6.8]
I20260709 13:07:26.046291 13789 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: [5.7-6.8]
I20260709 13:07:26.046720 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:25.941504 17017 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:26.059943 13757 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:25.984105 17251 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:25.939502 17077 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:25.935405 17271 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.036880 16931 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:26.086437 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.989006 17511 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:25.943188 17466 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:25.887617 17330 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:25.934814 17505 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:26.048195 17504 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:07:26.099159 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 52505.5us
I20260709 13:07:26.053221 17233 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:25.934686 17373 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.156s
I20260709 13:07:25.984553 17412 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:26.052165 17345 raft_consensus.cc:697] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:26.027257 17459 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.118512 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:26.088356 17251 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.130355 14402 raft_consensus.cc:2393] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 14: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:07:26.096828 17214 consensus_meta.cc:287] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.764s	user 0.008s	sys 0.004s
I20260709 13:07:26.124841 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:26.135093 13782 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:07:26.142743 14393 raft_consensus.cc:1240] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 10 LEARNER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:26.143807 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:26.144557 14394 raft_consensus.cc:1240] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:26.145429 14396 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:26.145352 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:26.142879 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:26.104874 17380 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:26.102684 17313 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:26.156793 16646 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.163980 16646 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.114785 17233 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.175818 17345 consensus_queue.cc:237] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.176837 17505 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:26.177266 17543 log.cc:927] Time spent T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:07:26.177538 17505 consensus_queue.cc:1059] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:26.178335 17505 consensus_queue.cc:1059] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:26.179060 17505 raft_consensus.cc:3055] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:26.179699 17537 log.cc:927] Time spent T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 13:07:26.179747 17505 raft_consensus.cc:740] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:26.129972 17363 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:07:26.181732 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:26.116400 17504 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:26.181212 17505 consensus_queue.cc:260] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.182480 14400 raft_consensus.cc:2368] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 7. Current term is 8.
I20260709 13:07:26.181243 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2110) took 2004 ms. Trace:
I20260709 13:07:26.126400 13612 catalog_manager.cc:5697] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 6 to 7, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 7 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:26.183879 13829 leader_election.cc:400] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 7. Current term is 8.
I20260709 13:07:26.122444 17402 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:26.112588 17458 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:26.152472 17251 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.154023 17549 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:26.189131 17233 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.206909 17505 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.207019 17559 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.107046 17173 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.152707 16946 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:26.148056 17518 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:26.212206 17402 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.212217 17509 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:26.256417 17413 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:26.258054 17430 consensus_meta.cc:287] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.595s	user 0.005s	sys 0.004s
I20260709 13:07:26.258477 17430 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:26.244210 17497 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:26.261499 17173 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:26.160094 17231 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:26.111740 17466 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:26.201824 13863 rpcz_store.cc:276] 0709 13:07:24.176701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.336626 (+159925us) service_pool.cc:224] Handling call
0709 13:07:24.337025 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.615280 (+278255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.615330 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:25.317463 (+702133us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b2c000cc698. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5230dd7a11 00007f5230de7372 00007f5232519a01 00007f52324de43a 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2
0709 13:07:25.317869 (+   406us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.599971 (+282102us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:25.600015 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.600082 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.180944 (+580862us) raft_consensus.cc:1685] finished
0709 13:07:26.180975 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.181183 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":155921,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":19961,"spinlock_wait_cycles":27980544,"thread_start_us":559468,"threads_started":2,"wal-append.queue_time_us":456012}
I20260709 13:07:26.205945 13829 leader_election.cc:403] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:26.226114 17553 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.228751 17188 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.228670 17324 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:26.189584 17380 raft_consensus.cc:697] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:07:26.215276 17517 consensus_meta.cc:287] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.520s	user 0.006s	sys 0.001s
W20260709 13:07:26.252573 17536 log.cc:927] Time spent T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.308s	user 0.001s	sys 0.001s
I20260709 13:07:26.252334 16946 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.254243 17402 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:26.254665 17518 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:26.268262 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 84528.6us
I20260709 13:07:26.133569 17410 consensus_queue.cc:237] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:26.278052 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 188251us
I20260709 13:07:26.269564 17507 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 7. Current term is 8.
I20260709 13:07:26.218631 17458 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:26.326011 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:26.303113 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.305786 17000 raft_consensus.cc:3055] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:26.309104 17231 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:26.335523 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:07:26.304265 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 237698us
W20260709 13:07:26.272258 17552 log.cc:927] Time spent T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:07:26.315485 13784 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:26.238612 17526 raft_consensus.cc:3055] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:26.241578 17459 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:26.333967 13680 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:26.330545 14398 raft_consensus.cc:2410] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:26.346243 13712 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:26.349423 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:26.354488 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:26.355057 13790 raft_consensus.cc:2393] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 10: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:26.349617 13711 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:26.356352 14396 raft_consensus.cc:1240] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:26.354571 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:26.358107 13712 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.349442 13858 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:26.326646 17363 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.363750 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:26.262883 17559 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.319516 17324 consensus_queue.cc:1059] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:07:26.329671 17000 raft_consensus.cc:740] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:26.366756 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:26.370741 13865 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:07:26.366458 17542 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 13:07:26.314160 17553 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.377332 13712 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:26.363843 17529 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:26.363570 17526 raft_consensus.cc:740] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:26.387205 14395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1191) took 1110 ms. Trace:
I20260709 13:07:26.387646 14395 rpcz_store.cc:276] 0709 13:07:25.276743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.280036 (+  3293us) service_pool.cc:224] Handling call
0709 13:07:25.280254 (+   218us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.280626 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.280655 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:25.281074 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.693992 (+412918us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:25.694034 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.694100 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.208534 (+514434us) spinlock_profiling.cc:243] Waited 5.52 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:07:26.385535 (+177001us) raft_consensus.cc:1685] finished
0709 13:07:26.385557 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.387129 (+  1572us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":2399,"spinlock_wait_cycles":12690816,"thread_start_us":412669,"threads_started":1,"wal-append.queue_time_us":561221}
I20260709 13:07:26.380993 13756 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:26.366711 17522 consensus_queue.cc:1048] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:07:26.379860 17412 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:26.382699 17308 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.399521 13829 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:26.407653 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.410988 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:26.368824 17363 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.379333 17313 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:07:26.438398 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:26.439333 13710 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:26.429412 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:26.443745 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:26.433108 16646 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:26.475687 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 82468.3us
I20260709 13:07:26.397054 17522 consensus_queue.cc:1243] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer 35ecb005831740438d7537dd4b840e03 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:07:26.477411 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 97326.7us
I20260709 13:07:26.440578 13830 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:26.482594 17507 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:26.424486 17000 consensus_queue.cc:260] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:26.484253 17000 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:26.485894 17504 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:26.488036 17565 log.cc:927] Time spent T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:07:26.493275 16931 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.495821 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:26.497611 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:26.498329 13861 raft_consensus.cc:2393] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 9: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:26.435076 16946 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:26.502481 17153 consensus_meta.cc:287] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.838s	user 0.007s	sys 0.000s
I20260709 13:07:26.506160 17363 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:26.508306 17559 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:26.509073 17188 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:26.509675 17518 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:26.481077 16954 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:26.510649 17553 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:26.510792 16954 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:26.511303 16954 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.424290 17568 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.515692 17466 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:26.515817 17568 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.478538 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:26.519685 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:26.493633 14396 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:07:26.431985 17538 log.cc:927] Time spent T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.214s	user 0.002s	sys 0.000s
I20260709 13:07:26.522009 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:26.478799 13709 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 6: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:26.522538 14400 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:26.520931 13865 raft_consensus.cc:1275] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:26.520244 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:26.520319 13856 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:26.520823 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:26.524808 13859 raft_consensus.cc:2393] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 12: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:26.526890 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:26.523264 13857 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:07:26.502907 17153 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:26.529140 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:26.530260 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:26.531692 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:26.475399 17412 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:26.482968 17507 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:26.531975 17570 log.cc:927] Time spent T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:07:26.564466 17412 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:26.534260 14368 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:26.387393 17380 consensus_queue.cc:237] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:26.566280 13856 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 12: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:26.486974 17251 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.571610 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:26.572372 13860 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:07:26.433177 17308 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:26.564988 17412 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:26.522853 17502 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.592229 13713 raft_consensus.cc:2368] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10.
I20260709 13:07:26.528587 17517 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:26.569098 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 87083.3us
I20260709 13:07:26.597322 13682 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:26.531152 16931 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:26.568311 14368 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:26.606859 13612 catalog_manager.cc:5697] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 1 to 5, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 5 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:26.612993 17559 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:26.609958 14399 raft_consensus.cc:2368] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8.
W20260709 13:07:26.614331 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 46106.4us
I20260709 13:07:26.615020 17458 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:26.516322 17526 consensus_queue.cc:260] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.570027 17518 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:26.623831 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 104247us
W20260709 13:07:26.624032 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.621034 13682 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:26.626127 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:26.626605 13682 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:26.627125 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:26.566164 17507 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.628911 13682 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:26.631572 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:26.634467 16646 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:26.634884 16646 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.634991 13789 raft_consensus.cc:2393] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 7: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:26.635277 16646 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.640570 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:26.641117 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 272266us
I20260709 13:07:26.642001 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:26.592636 17233 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:26.635910 16948 consensus_meta.cc:287] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.995s	user 0.012s	sys 0.000s
I20260709 13:07:26.623462 17004 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:26.633921 17363 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:26.653834 17520 consensus_meta.cc:287] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.718s	user 0.009s	sys 0.001s
I20260709 13:07:26.654343 17308 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:26.654572 17233 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:26.647460 17373 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:26.616901 17517 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:26.655326 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:26.530798 17511 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.633617 16946 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:26.630137 17553 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.658730 16646 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.622503 17529 consensus_queue.cc:1048] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:07:26.666713 17363 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:07:26.636009 17413 consensus_queue.cc:1175] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "35ecb005831740438d7537dd4b840e03" responder_term: 10 status { last_received { term: 10 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 10 index: 10 } }
I20260709 13:07:26.640383 17488 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:26.669023 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:26.669185 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:26.670205 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:26.706866 13789 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.656339 17526 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:26.683027 17324 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.675824 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:26.678431 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:26.681243 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:26.682235 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:26.659096 17004 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.610239 17502 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:26.685813 13791 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:26.662926 13829 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:26.682883 17271 consensus_meta.cc:287] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.579s	user 0.010s	sys 0.000s
I20260709 13:07:26.665329 17483 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:26.730006 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 67180.1us
I20260709 13:07:26.704895 17363 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:26.664412 17559 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:26.706208 13859 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:26.704698 16646 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:26.678251 17373 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:26.684043 17497 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.710101 14393 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.708998 14402 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:26.671772 17520 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.655638 17150 consensus_queue.cc:1048] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:07:26.663542 17561 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:07:26.659191 17560 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:07:26.704550 17173 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:07:26.746037 17483 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:26.731711 17410 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:26.756218 13785 pending_rounds.cc:85] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 2
W20260709 13:07:26.753613 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 44224us
I20260709 13:07:26.785983 13785 pending_rounds.cc:107] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:07:26.786369 13785 raft_consensus.cc:2889] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:26.786412 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:26.748589 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 77446.2us
I20260709 13:07:26.714339 17004 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:26.789088 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 85058.6us
I20260709 13:07:26.771659 16646 consensus_queue.cc:1059] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:26.778775 14393 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:26.746976 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:26.790127 13680 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:26.788569 13756 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:26.790432 14401 raft_consensus.cc:2393] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 10: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:26.743799 13789 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:26.760288 17373 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:26.790226 13862 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.702214 17553 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.791764 13756 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:26.730444 17271 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:26.723184 17324 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:26.798678 16646 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:26.799225 13680 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:26.798384 13788 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:07:26.795203 17405 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:26.787582 17581 log.cc:927] Time spent T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:07:26.760905 17559 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.809604 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:26.815186 14396 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:07:26.785022 17568 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:26.795588 17529 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:26.826768 13862 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:26.828064 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:26.829591 16646 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:26.830222 16646 raft_consensus.cc:697] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:26.772550 17497 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:26.831221 16646 consensus_queue.cc:237] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.804597 17466 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:26.879009 17466 raft_consensus.cc:697] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:26.880244 17466 consensus_queue.cc:237] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.884243 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 763) took 1302 ms. Trace:
I20260709 13:07:26.884714 13714 rpcz_store.cc:276] 0709 13:07:25.581494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.582201 (+   707us) service_pool.cc:224] Handling call
0709 13:07:25.610271 (+ 28070us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.721766 (+111495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.721810 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:25.721864 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:25.721917 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.883982 (+1162065us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54001540d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:26.884034 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.884171 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255887232}
I20260709 13:07:26.886538 16954 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:26.712028 17488 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.817565 17402 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.829461 17380 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:07:26.841820 17578 log.cc:927] Time spent T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:07:26.843745 17584 log.cc:927] Time spent T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:07:26.845407 17583 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:07:26.846848 17520 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:26.847360 17513 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:26.849377 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2518) took 1070 ms. Trace:
I20260709 13:07:26.851276 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:26.805792 17556 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:07:26.857969 17517 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:26.858775 17572 log.cc:927] Time spent T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:07:26.863215 17511 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:26.870577 17430 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:26.872251 17553 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:26.874222 17559 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:26.795967 16948 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:07:26.877470 17497 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:26.878281 17505 consensus_meta.cc:287] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.629s	user 0.006s	sys 0.004s
I20260709 13:07:26.892992 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:26.895839 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:26.905224 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:26.908861 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:26.971010 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:26.971385 13861 raft_consensus.cc:2410] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 9 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:07:26.907840 17322 consensus_meta.cc:287] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 1.188s	user 0.011s	sys 0.003s
I20260709 13:07:26.918685 13856 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 9: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:26.917513 13713 rpcz_store.cc:276] 0709 13:07:25.779246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.782659 (+  3413us) service_pool.cc:224] Handling call
0709 13:07:26.849164 (+1066505us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b5400149454. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:26.849304 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1723892992}
I20260709 13:07:26.841866 17324 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:26.916692 13787 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:26.947335 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:26.977260 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:26.942741 17517 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.945362 17522 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.986845 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:26.994475 13858 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:07:26.915997 17380 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.911649 17402 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:26.998100 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:27.001600 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:26.969710 17150 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:26.969470 17308 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:27.005836 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:27.010829 17500 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:27.011622 17150 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:27.019723 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:27.020577 13708 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:07:27.020731 13713 raft_consensus.cc:2410] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:07:27.022149 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:27.022755 13708 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:27.023845 17150 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:27.036871 17564 log.cc:927] Time spent T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.659s	user 0.000s	sys 0.001s
I20260709 13:07:27.039149 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:27.040033 13713 raft_consensus.cc:2393] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 10: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:27.040635 17251 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:27.042670 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:27.043951 13829 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:27.044816 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:27.046710 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:27.040355 13708 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:27.051836 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:27.053433 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:27.056903 13861 raft_consensus.cc:1275] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:27.059062 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:27.059319 17579 log.cc:927] Time spent T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.345s	user 0.001s	sys 0.000s
I20260709 13:07:27.059974 13708 raft_consensus.cc:2393] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 7: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:27.061336 13829 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:27.064707 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:27.065416 16954 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:27.066295 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:07:27.066548 14399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 987) took 1174 ms (client timeout 1551 ms). Trace:
W20260709 13:07:27.068373 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:27.067106 14399 rpcz_store.cc:269] 0709 13:07:25.892241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.892386 (+   145us) service_pool.cc:224] Handling call
0709 13:07:27.066358 (+1173972us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b540052bcd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:27.066492 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1532977920}
W20260709 13:07:27.069342 17558 log.cc:927] Time spent T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.886s	user 0.001s	sys 0.003s
I20260709 13:07:27.000566 17522 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:27.032441 17308 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:27.071580 13715 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:27.072547 17308 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:26.998499 17517 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:27.076695 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:26.983352 17322 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:27.080559 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:27.065026 17500 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:27.081728 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:27.082248 13783 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:27.082304 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:27.083045 13861 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:27.084290 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:27.085273 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:27.085770 13861 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.088479 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:27.089020 13863 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:27.094058 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:27.075264 17517 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:27.078155 13682 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:27.078274 14366 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:27.097277 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:27.099053 17017 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:27.094952 13782 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:07:27.103663 13783 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:27.064791 17594 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:27.112922 14395 raft_consensus.cc:2368] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 7. Current term is 8.
I20260709 13:07:27.104851 17500 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:27.114334 17500 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:27.118137 17500 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:27.106801 17009 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:27.119010 17009 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:27.120921 17488 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:27.121145 17009 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:27.110697 17507 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:27.128183 13859 raft_consensus.cc:2368] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 8. Current term is 9.
I20260709 13:07:27.110505 16946 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:27.130934 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:27.131814 17322 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:27.132963 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:27.133196 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:27.133564 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:27.138294 17214 raft_consensus.cc:3055] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:27.138420 17522 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:27.138752 17214 raft_consensus.cc:740] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:27.141570 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:27.146590 17308 consensus_queue.cc:1048] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:27.155871 13830 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:27.158083 13829 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:27.159530 17488 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:27.160128 17488 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:27.160658 17488 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:27.163578 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:27.164526 14366 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:27.165956 14366 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:27.164520 13787 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:27.177196 13829 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:27.179309 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:27.181123 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:27.183218 13861 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:27.183478 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:27.189489 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:27.191107 13829 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:27.191392 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:27.192063 13788 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.185734 13863 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:27.105191 16989 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:27.195896 16989 raft_consensus.cc:697] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:27.197149 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:27.198141 13863 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:27.127321 17507 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:27.202227 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 392289us
I20260709 13:07:27.207891 14400 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:27.178619 17594 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:27.212940 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:27.179098 17559 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:27.179589 17322 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:27.220783 14400 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:27.212984 14398 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:27.222236 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:27.203323 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:27.224105 13861 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:27.224987 13788 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:27.225392 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:27.225873 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:27.186928 17505 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:27.230022 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:27.230471 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:27.230973 14368 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:27.231691 13756 leader_election.cc:400] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10.
W20260709 13:07:27.223851 17412 consensus_meta.cc:287] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.607s	user 0.011s	sys 0.003s
I20260709 13:07:27.224805 17517 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:27.223575 17322 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.240151 14398 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:27.233777 17526 consensus_meta.cc:287] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.003s
I20260709 13:07:27.230360 17153 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:27.235716 17593 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:27.316068 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:27.232595 17559 raft_consensus.cc:697] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:27.315922 13756 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:27.212064 17004 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:27.247030 13829 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:27.321552 13857 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:07:27.335248 13756 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:27.335784 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 88820.8us
W20260709 13:07:27.329537 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 75244.2us
I20260709 13:07:27.340591 14367 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:27.201243 17214 consensus_queue.cc:260] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:27.243813 17017 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:27.246395 17322 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:27.248409 17553 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.346998 17000 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:27.355281 13708 raft_consensus.cc:2368] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10.
I20260709 13:07:27.353561 17553 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:27.239787 17412 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:27.345351 17487 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:27.342353 13603 maintenance_manager.cc:419] P a8849f59e7a642f3b694e3e403857ae7: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033372
I20260709 13:07:27.347261 17526 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:27.348073 17591 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:27.355794 17541 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:27.395236 13860 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:27.248368 16989 consensus_queue.cc:237] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:27.339735 17593 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:27.401597 17373 consensus_meta.cc:287] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.002s
I20260709 13:07:27.392684 17526 raft_consensus.cc:697] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:27.238343 13863 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:27.425009 14368 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:27.236403 13861 raft_consensus.cc:2393] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 7: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:27.437247 13707 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
W20260709 13:07:27.415920 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 168624us
I20260709 13:07:27.438529 13680 leader_election.cc:400] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8.
I20260709 13:07:27.438809 13756 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:27.438819 13680 leader_election.cc:403] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:27.380203 17597 consensus_queue.cc:1059] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:07:27.459082 13787 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
W20260709 13:07:27.435793 17466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.016s	sys 0.064s
I20260709 13:07:27.397907 17591 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:27.478642 17553 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:27.481067 17412 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:27.482679 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:27.487566 17522 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8.
I20260709 13:07:27.492352 17526 consensus_queue.cc:237] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:27.493832 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:27.497905 17521 raft_consensus.cc:1064] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
W20260709 13:07:27.498399 17521 raft_consensus.cc:1068] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02: Unable to promote non-voter ceb06175847b428ea8bd77055fcddf58: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:27.491168 17330 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:27.503873 13680 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:27.503744 17324 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:27.505133 17593 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:27.505687 17577 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:27.509511 17577 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.443138 17513 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:27.460036 17363 consensus_meta.cc:287] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.691s	user 0.013s	sys 0.000s
I20260709 13:07:27.442776 16695 raft_consensus.cc:2764] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:07:27.517899 13860 raft_consensus.cc:3055] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:27.508863 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:27.512888 17004 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:27.406090 17559 consensus_queue.cc:237] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:27.518277 13860 raft_consensus.cc:740] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:27.521205 14400 raft_consensus.cc:1240] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:27.519073 13860 consensus_queue.cc:260] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:27.509948 17577 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:27.550848 13860 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.511150 17521 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:07:27.473337 17466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.020s	sys 0.064s
I20260709 13:07:27.424667 17373 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:27.576347 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:27.577931 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:27.578568 13862 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:27.580219 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42104 (request call id 807) took 1085 ms. Trace:
I20260709 13:07:27.580686 13858 rpcz_store.cc:276] 0709 13:07:26.494447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.495597 (+  1150us) service_pool.cc:224] Handling call
0709 13:07:27.579998 (+1084401us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b54001ad1d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:27.580129 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1102855424}
I20260709 13:07:27.569156 17412 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:07:27.582234 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.582592 17412 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:27.585179 17412 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:27.552526 17513 raft_consensus.cc:697] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:27.594630 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:27.595667 16646 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.007s	sys 0.013s
W20260709 13:07:27.596084 16646 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.007s	sys 0.014s
I20260709 13:07:27.517228 17593 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:07:27.605003 13862 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
W20260709 13:07:27.606632 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 266147us
I20260709 13:07:27.523161 17363 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:27.617730 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:27.628347 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:27.629622 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:27.654995 13709 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:07:27.632102 17466 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:27.637401 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:27.642403 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:27.659401 13791 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:07:27.601583 17412 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:27.646222 16695 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:27.560446 17597 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.650025 14402 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:27.649881 13680 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:27.651623 14367 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:27.665411 14367 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:27.667666 13714 raft_consensus.cc:2410] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:27.615742 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:27.603652 17345 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.424s	user 0.004s	sys 0.022s
I20260709 13:07:27.645143 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:27.670854 13788 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:27.668406 14367 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:27.570261 17521 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:27.647704 17324 consensus_queue.cc:1059] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:07:27.676087 14367 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:27.725726 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 50139.4us
I20260709 13:07:27.726732 14367 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:07:27.766324 14368 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 1.874s (SENT) [suppressed 12 similar messages]
I20260709 13:07:27.677403 17553 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:27.778553 17591 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:27.670526 17345 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.492s	user 0.005s	sys 0.022s
I20260709 13:07:27.655818 17227 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:07:27.671679 17188 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:27.670526 17589 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:27.788707 13788 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:27.677856 17541 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:07:27.791013 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 129493us
I20260709 13:07:27.845162 13860 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:07:27.843076 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:27.847025 13860 pending_rounds.cc:85] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 6
I20260709 13:07:27.847366 13860 pending_rounds.cc:107] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:07:27.847664 13860 raft_consensus.cc:2889] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:27.783870 17330 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:27.789178 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 139404us
W20260709 13:07:27.781662 17570 log.cc:927] Time spent T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:07:27.780742 17509 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.850894 13860 pending_rounds.cc:107] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:07:27.674711 17597 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:27.781188 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 54573.5us
I20260709 13:07:27.661660 17466 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:27.860253 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:27.790617 17553 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:27.664199 17412 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:27.866281 13755 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:27.875960 13860 raft_consensus.cc:2889] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:27.877748 13680 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:07:27.943919 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 77716.8us
W20260709 13:07:27.944443 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 66754.5us
I20260709 13:07:27.944734 13755 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:27.848845 17004 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:27.896451 17150 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:27.862989 17324 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:27.867317 17541 raft_consensus.cc:697] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 12 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:27.874141 17517 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:07:27.982079 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:27.988237 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 43580.1us
W20260709 13:07:27.990675 17586 log.cc:927] Time spent T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:07:27.943957 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 177695us
I20260709 13:07:27.941159 17526 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:27.926260 17345 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:27.949345 17599 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:07:27.927534 17553 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:07:27.948577 17606 log.cc:927] Time spent T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:07:27.782796 17513 consensus_queue.cc:237] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:27.857892 16946 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:27.948587 17487 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:27.989638 17551 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:27.991757 17591 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:27.898658 17509 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:28.053709 17608 log.cc:927] Time spent T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 13:07:27.946045 16989 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 13:07:28.028028 17517 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:28.046017 17373 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:28.049193 17553 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.094835 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:28.049324 17507 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:28.012082 17150 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:28.011719 17324 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:28.075513 17322 consensus_meta.cc:287] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.706s	user 0.011s	sys 0.000s
I20260709 13:07:28.022897 17004 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:28.039111 17526 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:28.061879 17593 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 13:07:28.122452 17606 log.cc:927] Time spent T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:07:28.099050 17354 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:28.067979 16946 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:28.094063 17591 raft_consensus.cc:697] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:28.106242 17611 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:28.165656 17363 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:28.176793 17610 log.cc:927] Time spent T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:07:28.170361 17521 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:28.197163 13859 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
W20260709 13:07:28.187666 17488 consensus_meta.cc:287] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 1.024s	user 0.009s	sys 0.003s
I20260709 13:07:28.174427 17324 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:28.189401 17251 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.160679 17507 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:28.167999 17322 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:28.171355 17541 consensus_queue.cc:237] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:28.179236 17354 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:28.187616 17611 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:28.228745 17603 log.cc:927] Time spent T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:07:28.206115 17488 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:28.230629 17612 log.cc:927] Time spent T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 13:07:28.227852 17466 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:28.234166 17602 log.cc:927] Time spent T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.235s	user 0.001s	sys 0.001s
I20260709 13:07:28.217139 17251 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:28.234902 17412 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:28.246666 17616 log.cc:927] Time spent T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
W20260709 13:07:28.249956 17615 log.cc:927] Time spent T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:07:28.227130 17591 consensus_queue.cc:237] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:28.271768 17597 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:28.274036 17577 consensus_meta.cc:287] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.712s	user 0.008s	sys 0.001s
I20260709 13:07:28.274572 17577 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:28.270053 17617 log.cc:927] Time spent T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 13:07:28.269186 17623 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 13:07:28.279701 17596 log.cc:927] Time spent T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.926s	user 0.001s	sys 0.013s
I20260709 13:07:28.285333 17577 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:28.336284 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 324394us
I20260709 13:07:28.351758 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 2533) took 1138 ms. Trace:
I20260709 13:07:28.349783 13612 catalog_manager.cc:5697] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 3 to 4, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 4 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:28.352458 13716 rpcz_store.cc:276] 0709 13:07:27.213379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.213656 (+   277us) service_pool.cc:224] Handling call
0709 13:07:27.232681 (+ 19025us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.232985 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.233012 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.237245 (+  4233us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.656238 (+418993us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:27.656296 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.656357 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.350925 (+694568us) raft_consensus.cc:1685] finished
0709 13:07:28.351011 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.351492 (+   481us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":228,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":3190,"thread_start_us":417830,"threads_started":1,"wal-append.queue_time_us":602896}
I20260709 13:07:28.355099 13612 catalog_manager.cc:5697] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 2 to 6, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 6 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:28.357213 13708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2527) took 1293 ms (client timeout 1679 ms). Trace:
I20260709 13:07:28.358650 13709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58552 (request call id 779) took 1388 ms. Trace:
I20260709 13:07:28.360391 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58552 (request call id 783) took 1359 ms. Trace:
W20260709 13:07:28.366609 13708 rpcz_store.cc:269] 0709 13:07:27.064178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.064447 (+   269us) service_pool.cc:224] Handling call
0709 13:07:28.356688 (+1292241us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b5400260554. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:28.357009 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":665018752}
I20260709 13:07:28.371464 13680 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:28.372216 13612 catalog_manager.cc:5697] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.367064 13714 rpcz_store.cc:276] 0709 13:07:27.001187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.001314 (+   127us) service_pool.cc:224] Handling call
0709 13:07:28.359865 (+1358551us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b540008e154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:28.360185 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1529398656}
I20260709 13:07:28.377207 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2835) took 1131 ms. Trace:
I20260709 13:07:28.377622 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2306) took 1676 ms. Trace:
I20260709 13:07:28.379194 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2130) took 1849 ms. Trace:
I20260709 13:07:28.380292 13790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2299) took 2031 ms. Trace:
I20260709 13:07:28.380914 13790 rpcz_store.cc:276] 0709 13:07:26.348814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.372697 (+ 23883us) service_pool.cc:224] Handling call
0709 13:07:26.384349 (+ 11652us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.384669 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.384698 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:26.385481 (+   783us) log.cc:844] Serialized 26 byte log entry
0709 13:07:26.629593 (+244112us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:26.631113 (+  1520us) log.cc:844] Serialized 14 byte log entry
0709 13:07:26.668469 (+ 37356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.668564 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:27.586465 (+917901us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b180027e560. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3bf2a6 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f13f3 00007f522f3f37c1
0709 13:07:28.254133 (+667668us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b180027e560. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f13f3 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
0709 13:07:28.379722 (+125589us) raft_consensus.cc:1685] finished
0709 13:07:28.379772 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.380068 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":163443,"prepare.queue_time_us":3556,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":78378,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":2070,"spinlock_wait_cycles":13902464,"thread_start_us":243834,"threads_started":1,"wal-append.queue_time_us":283209}
I20260709 13:07:28.366948 13709 rpcz_store.cc:276] 0709 13:07:26.970518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.970768 (+   250us) service_pool.cc:224] Handling call
0709 13:07:28.358181 (+1387413us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b54000c5654. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:28.358434 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1571120512}
I20260709 13:07:28.385135 17150 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:28.389636 17560 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:28.392831 17354 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:28.377748 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2834) took 1226 ms. Trace:
I20260709 13:07:28.408171 17529 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:28.409080 17529 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:28.417760 13614 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49436 (request call id 327) took 16917 ms (client timeout 15000 ms). Trace:
I20260709 13:07:28.420226 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:28.375241 13612 catalog_manager.cc:5697] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 5 to 7, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 7 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.421589 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:28.421932 17488 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:28.422595 13787 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:07:28.422638 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:28.423022 13612 catalog_manager.cc:5697] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 3 to 5, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 5 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.390973 17560 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:28.379771 13865 rpcz_store.cc:276] 0709 13:07:26.529898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.531049 (+  1151us) service_pool.cc:224] Handling call
0709 13:07:26.531349 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.533503 (+  2154us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:27.155242 (+621739us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b180043e400. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3ee455 00007f5235ed63c7 00007f52324e89a7 00007f52324f80bf 00007f52324f8038
0709 13:07:27.561818 (+406576us) log.cc:844] Serialized 14 byte log entry
0709 13:07:27.656385 (+ 94567us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.656824 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.656957 (+   133us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:27.656993 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.657060 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.378449 (+721389us) raft_consensus.cc:1685] finished
0709 13:07:28.378620 (+   171us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.378982 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":179782,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":247,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":11357,"spinlock_wait_cycles":42762112,"thread_start_us":500311,"threads_started":2,"wal-append.queue_time_us":633567}
I20260709 13:07:28.433842 17004 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:28.434007 13612 catalog_manager.cc:5697] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 7 to 8, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 8 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:28.418255 13614 rpcz_store.cc:269] 0709 13:07:11.500084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.500380 (+   296us) service_pool.cc:224] Handling call
0709 13:07:28.417493 (+16917113us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:18.367888 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:18.368853 (+   965us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:18.368929 (+    76us) write_op.cc:435] Acquired schema lock
0709 13:07:18.368970 (+    41us) tablet.cc:662] Decoding operations
0709 13:07:18.489188 (+120218us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:18.489271 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:18.489310 (+    39us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:07:18.575469 (+ 86159us) tablet.cc:701] Row locks acquired
0709 13:07:18.575514 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:07:18.575702 (+   188us) write_op.cc:270] Start()
0709 13:07:18.575842 (+   140us) write_op.cc:276] Timestamp: P: 1783602438575637 usec, L: 0
0709 13:07:18.575886 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:07:18.585224 (+  9338us) log.cc:844] Serialized 9837 byte log entry
0709 13:07:19.501298 (+916074us) op_driver.cc:464] REPLICATION: finished
0709 13:07:20.173231 (+671933us) write_op.cc:301] APPLY: starting
0709 13:07:20.173357 (+   126us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:20.245111 (+ 71754us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:20.245250 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:20.291511 (+ 46261us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:20.684437 (+392926us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=25
0709 13:07:20.715290 (+ 30853us) write_op.cc:312] APPLY: finished
0709 13:07:20.782804 (+ 67514us) log.cc:844] Serialized 170 byte log entry
0709 13:07:21.240663 (+457859us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b54003edd54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324db32a 00007f5232460f14 00007f5232460ec3 00007f5232460e38 00007f5232460df3 00007f52324600dc 00007f5232489e16 00007f5232471cbb 00007f523245c39d 00007f523245fd75
0709 13:07:21.326290 (+ 85627us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f522f3d40ac 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b
0709 13:07:21.787391 (+461101us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:21.804528 (+ 17137us) write_op.cc:454] Released schema lock
0709 13:07:21.814710 (+ 10182us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:21.946692 (+131982us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:21.952520 (+  5828us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1309175,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":650473,"apply.run_cpu_time_us":29101,"apply.run_wall_time_us":1755711,"num_ops":25,"prepare.queue_time_us":935823,"prepare.run_cpu_time_us":23916,"prepare.run_wall_time_us":319498,"raft.queue_time_us":415465,"raft.run_cpu_time_us":61322,"raft.run_wall_time_us":1788817,"replication_time_us":925209,"spinlock_wait_cycles":475762944,"thread_start_us":2537551,"threads_started":5,"wal-append.queue_time_us":1304923,"wal-append.run_cpu_time_us":43405,"wal-append.run_wall_time_us":2668115}]]}
W20260709 13:07:28.441527 14401 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 1203) took 2106 ms (client timeout 2701 ms). Trace:
W20260709 13:07:28.442085 14401 rpcz_store.cc:269] 0709 13:07:26.334993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.335221 (+   228us) service_pool.cc:224] Handling call
0709 13:07:28.441170 (+2105949us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b540052b054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:28.441363 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1044117376}
I20260709 13:07:28.443795 14367 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:28.448642 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:28.259871 17517 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:28.449581 13716 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:28.450594 17560 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:28.450826 16646 raft_consensus.cc:1064] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:07:28.428267 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:28.451617 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 80466.6us
I20260709 13:07:28.452682 13680 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:28.456043 17634 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:28.420536 13783 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:28.440233 13612 catalog_manager.cc:5697] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 4 to 5, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 5 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.378191 13785 rpcz_store.cc:276] 0709 13:07:26.700923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.746551 (+ 45628us) service_pool.cc:224] Handling call
0709 13:07:26.755981 (+  9430us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:26.798038 (+ 42057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.798078 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:26.798614 (+   536us) log.cc:844] Serialized 52 byte log entry
0709 13:07:26.944951 (+146337us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:26.989031 (+ 44080us) log.cc:844] Serialized 14 byte log entry
0709 13:07:26.990775 (+  1744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.990884 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.279111 (+1288227us) spinlock_profiling.cc:243] Waited 89.8 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:07:28.376861 (+ 97750us) raft_consensus.cc:1685] finished
0709 13:07:28.377042 (+   181us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.377370 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65813,"prepare.queue_time_us":43899,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":9288,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":10842,"spinlock_wait_cycles":206522240,"thread_start_us":107809,"threads_started":1,"wal-append.queue_time_us":544739}
I20260709 13:07:28.404186 13864 rpcz_store.cc:276] 0709 13:07:27.151573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.168367 (+ 16794us) service_pool.cc:224] Handling call
0709 13:07:27.168639 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.184130 (+ 15491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.184161 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.198464 (+ 14303us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.591900 (+393436us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:27.591957 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.592054 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.377244 (+785190us) raft_consensus.cc:1685] finished
0709 13:07:28.377284 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.377573 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15084,"raft.queue_time_us":15232,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":14798,"thread_start_us":358254,"threads_started":1,"wal-append.queue_time_us":704660}
I20260709 13:07:28.377707 13863 rpcz_store.cc:276] 0709 13:07:27.245662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.450873 (+205211us) service_pool.cc:224] Handling call
0709 13:07:27.452675 (+  1802us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.452962 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.453000 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.556824 (+103824us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.005325 (+448501us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:28.005457 (+   132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.005612 (+   155us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.376412 (+370800us) raft_consensus.cc:1685] finished
0709 13:07:28.376458 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.376892 (+   434us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":350401,"threads_started":1,"wal-append.queue_time_us":610553}
I20260709 13:07:28.439222 16946 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:28.440330 14395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 822) took 2029 ms (client timeout 1792 ms). Trace:
W20260709 13:07:28.461623 14395 rpcz_store.cc:269] 0709 13:07:26.410518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.410685 (+   167us) service_pool.cc:224] Handling call
0709 13:07:28.439814 (+2029129us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b54005c1054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:28.440106 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1576369408}
I20260709 13:07:28.472256 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:28.474120 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:28.478207 13756 leader_election.cc:400] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10.
I20260709 13:07:28.478742 13756 leader_election.cc:403] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:28.480216 17380 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:28.456779 17634 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:28.481072 17634 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:28.481129 17380 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10.
I20260709 13:07:28.483400 13865 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:28.485733 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:28.486680 13712 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.488303 17402 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:28.488549 17322 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:28.489375 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:28.489773 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:28.470248 13612 catalog_manager.cc:5697] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 1 to 3, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 3 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.491374 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:28.499841 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:28.502110 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:28.547674 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:28.553191 13709 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:28.550091 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 46366.3us
I20260709 13:07:28.559548 13860 raft_consensus.cc:2393] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 10: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:07:28.566459 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 114537us
I20260709 13:07:28.529232 16646 consensus_queue.cc:237] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:28.560627 16946 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:28.561033 17611 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:28.577723 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.579537 14368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.011s	sys 0.025s
I20260709 13:07:28.580001 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:28.580650 13682 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.009s	sys 0.004s
I20260709 13:07:28.580993 17324 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:28.569770 17529 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:28.583936 13612 catalog_manager.cc:5697] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 3 to 6, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 6 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.586457 17502 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:28.596928 17324 raft_consensus.cc:697] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:28.588008 17374 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.598026 17374 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:28.598376 17324 consensus_queue.cc:237] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:28.589506 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:28.573392 17568 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:28.581626 17271 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:28.596410 13682 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.010s	sys 0.004s
W20260709 13:07:28.613613 14368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.012s	sys 0.025s
I20260709 13:07:28.600857 17374 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:28.599887 17504 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:07:28.594795 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.611824 13612 catalog_manager.cc:5697] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 7 to 8, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 8 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.619740 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:28.590359 16946 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:28.620705 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:28.621503 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:28.621731 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:28.622428 17507 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:28.622766 13757 leader_election.cc:400] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 8. Current term is 9.
I20260709 13:07:28.622601 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:28.623106 17529 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.632860 17529 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:28.633387 13789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 838) took 1838 ms. Trace:
I20260709 13:07:28.633862 13789 rpcz_store.cc:276] 0709 13:07:26.795251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.796995 (+  1744us) service_pool.cc:224] Handling call
0709 13:07:26.799014 (+  2019us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.817998 (+ 18984us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.818026 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:26.818066 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:26.818102 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.632895 (+1814793us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b54002ebb54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:28.632966 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.633196 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43208960}
I20260709 13:07:28.624426 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:28.636277 14398 raft_consensus.cc:2368] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15.
I20260709 13:07:28.624619 17363 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:28.636308 14399 raft_consensus.cc:2393] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 5: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:28.625412 17642 consensus_queue.cc:1059] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:28.630234 13712 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:28.632130 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:28.645290 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:28.645393 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:28.646201 13707 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:07:28.646248 13859 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:28.649212 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:28.650010 13709 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:07:28.650969 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:28.652061 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:28.653191 13715 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 6: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:28.653904 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:28.654698 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:28.655973 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:28.659598 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:28.660904 17313 raft_consensus.cc:3055] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:28.640355 17363 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:28.661309 17313 raft_consensus.cc:740] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:28.654692 13791 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:28.663532 13713 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
W20260709 13:07:28.666280 14396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 997) took 1996 ms (client timeout 2219 ms). Trace:
I20260709 13:07:28.666371 17487 consensus_queue.cc:1059] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:28.666721 14396 rpcz_store.cc:269] 0709 13:07:26.669843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.669974 (+   131us) service_pool.cc:224] Handling call
0709 13:07:28.665907 (+1995933us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400595bd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:28.666073 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248798592}
I20260709 13:07:28.667866 16697 raft_consensus.cc:3055] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:28.668236 16697 raft_consensus.cc:740] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:28.669183 17505 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:28.669399 16697 consensus_queue.cc:260] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:28.670037 17505 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:28.671054 16697 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.671936 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:28.673785 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:28.671644 17504 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:28.676076 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:28.676540 17504 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:28.678612 17505 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:28.680353 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.640195 17330 consensus_meta.cc:287] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.763s	user 0.013s	sys 0.009s
I20260709 13:07:28.699337 13783 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:07:28.704360 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:28.704157 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:28.712347 13716 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:07:28.703902 13682 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:28.720939 13707 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:28.725701 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:28.727545 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:28.728493 14393 raft_consensus.cc:1240] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:28.729285 17214 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.725317 13612 catalog_manager.cc:5697] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:28.733393 13857 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42104 (request call id 815) took 2207 ms (client timeout 1522 ms). Trace:
I20260709 13:07:28.733973 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:07:28.733907 13857 rpcz_store.cc:269] 0709 13:07:26.526201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.528918 (+  2717us) service_pool.cc:224] Handling call
0709 13:07:28.732867 (+2203949us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b5400234e54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:28.733106 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1754870528}
I20260709 13:07:28.734787 13858 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.733206 13612 catalog_manager.cc:5697] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 5 to 8, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 8 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.736013 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:28.706220 17505 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.744134 17505 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:28.749369 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 52831.8us
I20260709 13:07:28.749918 17374 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:28.750430 13682 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:28.751492 17591 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:28.752377 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:28.752470 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:28.753414 13865 raft_consensus.cc:2376] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10. Re-sending same reply.
I20260709 13:07:28.707713 17330 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:28.755100 13860 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:28.755339 14399 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:28.760655 17251 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:28.761439 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:28.762928 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:28.763936 13790 raft_consensus.cc:2368] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9.
I20260709 13:07:28.762612 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:28.764936 17509 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:28.766294 17526 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:28.698314 17529 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:28.762638 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:28.761421 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:28.724932 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:28.776297 14396 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:28.776818 17363 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:28.778524 14367 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:28.799062 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:28.798597 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:28.762602 17313 consensus_queue.cc:260] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:28.750444 17374 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:28.812475 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:28.810788 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:28.817898 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:28.726338 17553 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:28.818174 17374 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.865849 13830 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:28.868014 13830 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:28.870139 17488 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:28.871071 17488 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:28.854396 17251 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:28.871551 13829 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:28.880957 14397 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.877475 13861 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:07:28.862239 17509 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.857172 17526 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:28.885255 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:28.887857 13858 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:28.894990 17483 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:28.895610 17505 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:28.896018 17556 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:07:28.900631 13682 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:07:28.900990 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 46430.6us
I20260709 13:07:28.902530 13829 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:28.903658 17251 raft_consensus.cc:697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 15 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:28.905443 17004 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:28.905112 17251 consensus_queue.cc:237] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:28.906029 17004 raft_consensus.cc:697] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:28.891239 17553 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:28.921370 13830 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:28.933017 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:28.933857 13716 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:07:28.928241 13789 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:07:28.872394 17634 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:28.932152 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:28.941643 13860 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:07:28.925397 17488 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:28.948786 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:28.955170 17233 raft_consensus.cc:3055] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:28.957113 13856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2831) took 1937 ms. Trace:
I20260709 13:07:28.976665 14366 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:28.962008 17526 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:28.962934 16946 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:28.907166 17004 consensus_queue.cc:237] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:28.975893 17511 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:28.976630 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 50177.7us
I20260709 13:07:28.976881 17591 consensus_queue.cc:1059] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:28.990065 13856 rpcz_store.cc:276] 0709 13:07:27.019199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.035777 (+ 16578us) service_pool.cc:224] Handling call
0709 13:07:27.036147 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.075940 (+ 39793us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.075981 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.076445 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.520151 (+443706us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:27.520196 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.956379 (+1436183us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b54003dccd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:28.956462 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.956542 (+    80us) raft_consensus.cc:1685] finished
0709 13:07:28.956561 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.956913 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":324,"raft.queue_time_us":999,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":88,"spinlock_wait_cycles":90724736,"thread_start_us":443321,"threads_started":1,"wal-append.queue_time_us":706102}
I20260709 13:07:28.987747 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:28.999989 13757 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:07:28.997525 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.998725 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 96300.9us
I20260709 13:07:29.001691 13711 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:28.991127 17233 raft_consensus.cc:740] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:07:28.979106 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.010473 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.921988 17509 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:29.010918 13708 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:07:29.024212 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:29.002125 17511 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.033427 13707 raft_consensus.cc:2368] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 9. Current term is 10.
I20260709 13:07:29.037474 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:29.035368 17511 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:29.074651 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.078953 14366 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:29.080257 17594 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:29.084201 13708 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:29.089418 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:29.090346 14397 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:29.095182 14402 raft_consensus.cc:2393] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 11: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:29.078809 17488 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:29.097486 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 239355us
I20260709 13:07:29.092922 17308 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:29.102816 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 223459us
I20260709 13:07:29.104156 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:29.103581 13830 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:29.109735 14396 raft_consensus.cc:2393] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 10: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:29.101577 17308 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.105216 17541 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:29.114880 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 90304.8us
I20260709 13:07:29.124935 17526 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:29.125524 17654 log.cc:927] Time spent T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:07:29.138195 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:29.179100 17000 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:29.180130 17469 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:29.180060 17000 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:29.180822 17469 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:29.182448 17000 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:29.182828 17469 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:29.204183 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:29.206584 17313 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.115568 17308 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:29.211740 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 67822.5us
W20260709 13:07:29.212980 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 109476us
I20260709 13:07:29.214672 13830 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:29.218612 13755 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:29.207866 13680 leader_election.cc:400] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15.
I20260709 13:07:29.219625 13680 leader_election.cc:403] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:07:29.220485 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 150374us
I20260709 13:07:29.225530 13829 leader_election.cc:400] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9.
I20260709 13:07:29.225852 13829 leader_election.cc:403] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:07:29.233430 13755 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:29.143322 17634 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:29.238312 17214 consensus_meta.cc:287] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.508s	user 0.012s	sys 0.002s
I20260709 13:07:29.238853 13830 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:29.239496 17521 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15.
I20260709 13:07:29.240387 17374 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:29.241508 17505 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9.
I20260709 13:07:29.223923 17322 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:29.219462 16697 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:29.234107 17488 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:29.284140 17509 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:29.285967 17655 log.cc:927] Time spent T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:07:29.288044 16697 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:29.261650 17150 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:29.335677 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 111907us
I20260709 13:07:29.337241 16697 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:29.337477 17354 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:07:29.293383 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 60018.6us
I20260709 13:07:29.341770 14366 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:07:29.293905 17610 log.cc:927] Time spent T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:07:29.342053 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:29.342844 13782 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:07:29.343380 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:29.343711 17367 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:29.344079 17553 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:29.344008 13789 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:29.284480 17017 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:29.345687 17017 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:29.294871 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 56102.1us
I20260709 13:07:29.313335 17505 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:29.348119 17017 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:29.289551 17077 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:29.348397 13830 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:29.348778 17077 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.349220 17077 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:29.321391 17374 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:29.257400 17363 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.249455 17000 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:29.351367 17363 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:29.263320 17504 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:29.355458 17504 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:29.355928 17504 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.356949 17592 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:29.357556 17592 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:29.222764 17526 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:07:29.330446 17513 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:29.359906 17513 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:29.360591 17526 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:29.362407 17513 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:29.363101 17513 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:29.331919 17233 consensus_queue.cc:260] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:29.364313 17233 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:29.364753 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.333563 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 71316.2us
I20260709 13:07:29.367007 13711 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:29.368242 17374 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.368454 13680 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:07:29.334903 17665 log.cc:927] Time spent T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:07:29.368862 17374 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:29.335381 17652 log.cc:927] Time spent T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:07:29.370043 14367 leader_election.cc:400] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 9. Current term is 10.
I20260709 13:07:29.370445 14367 leader_election.cc:403] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:29.337265 13682 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:29.371243 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:29.372118 17568 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 9. Current term is 10.
I20260709 13:07:29.372570 17634 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:29.373005 17214 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:29.373319 17568 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:29.348205 17505 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:29.313968 17651 log.cc:927] Time spent T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:07:29.373605 17214 raft_consensus.cc:697] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:29.376371 17214 consensus_queue.cc:237] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:29.376941 13716 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:29.344445 17367 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:29.387831 14368 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:29.388921 17367 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:29.389039 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 81851.3us
I20260709 13:07:29.389941 14368 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:29.391378 17627 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:29.395145 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:29.395818 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:29.396638 14401 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 10: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:29.396703 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:29.397830 17627 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.398350 17627 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:29.400682 17627 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:29.405552 13708 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:29.406354 17410 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:29.406985 17410 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:29.407896 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 57724.9us
I20260709 13:07:29.408926 17509 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:29.388825 17017 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:29.412580 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 44219.8us
I20260709 13:07:29.267993 13829 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:29.409123 17410 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:29.407281 17363 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:29.443066 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:29.425588 13830 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:29.429965 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:29.428617 13788 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:29.442975 13789 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:29.430285 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:29.430980 13786 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:29.453603 14366 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:29.451687 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 60253.6us
I20260709 13:07:29.482179 13755 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:29.456032 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:29.477761 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:29.413008 17017 raft_consensus.cc:697] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:29.493249 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:29.438189 17004 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:29.494854 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 84595.9us
I20260709 13:07:29.496021 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:29.499926 13858 raft_consensus.cc:2368] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 9. Current term is 10.
W20260709 13:07:29.501015 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 233066us
I20260709 13:07:29.434116 17592 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:29.413129 17505 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:29.351141 17511 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:29.503767 17004 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:29.505873 16946 raft_consensus.cc:3055] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:29.507915 17363 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:29.508445 17354 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.508709 13790 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:29.367662 17513 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:29.509171 17353 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:29.511035 17150 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:29.523357 17469 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.517031 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:29.517733 17553 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:29.518046 17077 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:29.519786 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:29.519622 17593 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:29.519040 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:29.433043 17374 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:29.430086 17402 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:29.520851 13682 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:29.523741 13859 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:07:29.495290 17509 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:29.531064 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 48001us
I20260709 13:07:29.525636 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:29.532269 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:29.542512 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:29.541632 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:29.544373 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:29.544849 13865 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:29.520815 17410 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:29.514263 17526 consensus_queue.cc:1059] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:29.542701 13791 raft_consensus.cc:2376] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8. Re-sending same reply.
I20260709 13:07:29.565971 13713 raft_consensus.cc:1240] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:29.540926 16946 raft_consensus.cc:740] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:29.545413 17556 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:29.580098 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 98017.8us
I20260709 13:07:29.595033 13680 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:29.595705 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:29.587882 13711 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:07:29.587165 13857 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:29.591377 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:29.594144 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:29.594856 13861 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:29.595784 13755 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:29.573032 13715 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
I20260709 13:07:29.567576 17553 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:29.581497 17469 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:29.601358 13710 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:29.603437 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:29.603953 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 83182.9us
I20260709 13:07:29.608469 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:29.609957 14400 raft_consensus.cc:2410] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:29.613519 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:29.615585 13859 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:29.617157 13682 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:29.603672 17553 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.594677 17488 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.619805 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:29.610294 17556 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:29.624008 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:29.624789 17500 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.625448 17556 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:29.625268 17500 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:29.627086 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:29.593957 17402 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:29.627204 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:29.630081 13860 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:29.660782 13680 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:29.639045 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:29.640458 14393 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:07:29.666504 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 61440.7us
I20260709 13:07:29.602097 17150 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:29.603580 17374 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.679028 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:29.605218 17330 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:29.568631 17363 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:29.600385 17410 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:29.739212 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:29.616442 17354 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:29.744338 13783 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:29.645398 17000 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:29.748414 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:29.756767 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:29.757341 17231 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:29.757689 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:29.761778 13786 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:07:29.759593 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:29.649158 17469 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:29.622134 17517 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:29.743700 13682 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:29.637470 17513 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:29.638784 17077 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:29.627615 17625 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:29.833253 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:29.806367 17553 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:29.859885 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:29.860792 13707 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:29.627290 17500 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:29.734797 17367 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:29.766870 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:29.768069 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:29.769214 13789 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:29.633402 17504 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:29.770483 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:29.639714 17511 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:29.773285 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 97377us
W20260709 13:07:29.774282 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 159751us
I20260709 13:07:29.764832 17231 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.749431 17233 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:29.636147 17308 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:29.636283 17004 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:29.779165 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:29.873572 13784 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:29.764436 17483 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:07:29.784526 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:29.622413 17017 consensus_queue.cc:237] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:29.771719 17330 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:29.880139 13864 raft_consensus.cc:1240] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:29.778766 17593 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:29.758069 17488 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:29.812824 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:29.814563 13786 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:29.787883 17541 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:07:29.848862 17509 raft_consensus.cc:697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:29.869184 13680 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:29.845983 17517 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:07:29.876452 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 106081us
I20260709 13:07:29.877096 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:29.640929 16946 consensus_queue.cc:260] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:29.887354 13783 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:07:29.888257 13782 raft_consensus.cc:606] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:29.874274 17231 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.915084 13782 raft_consensus.cc:614] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:29.870935 17367 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:29.861764 17077 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.894362 17363 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:29.915661 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:29.876865 17500 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:29.895144 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:29.857916 17625 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:29.918152 13862 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
W20260709 13:07:29.923976 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.928653 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 59554.8us
I20260709 13:07:29.930154 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:29.919248 17656 log.cc:927] Time spent T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.183s	user 0.001s	sys 0.001s
I20260709 13:07:29.894577 17517 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:29.881259 17591 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:07:29.911828 17402 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:29.957643 13829 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:29.881181 17521 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:07:29.921234 17233 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:29.891878 17593 raft_consensus.cc:697] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:29.963078 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:29.953678 17363 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:29.975035 13858 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:07:29.959739 17511 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:29.979518 13680 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:29.973367 17000 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:30.010092 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 52688.8us
I20260709 13:07:29.952929 17077 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:30.013288 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:29.962869 17677 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:30.016953 13757 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:29.998613 17511 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.997892 17410 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:30.009021 17233 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:30.032387 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:29.978341 17500 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:30.034883 14400 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 10 LEARNER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:07:30.046134 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 54400.6us
I20260709 13:07:30.047840 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:30.050417 14368 leader_election.cc:400] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 9. Current term is 10.
I20260709 13:07:30.053705 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:30.059886 17675 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:07:30.060254 17330 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:30.061452 17587 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.061985 17587 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:30.064010 17488 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:30.065217 17679 log.cc:927] Time spent T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:07:30.065593 17625 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:30.066355 17367 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:30.067880 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:30.064150 17687 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:30.071900 17687 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:30.072327 17687 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.073295 17077 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:30.074607 17670 log.cc:927] Time spent T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7: Append to log took a long time: real 0.360s	user 0.003s	sys 0.000s
I20260709 13:07:30.031108 17511 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:30.047374 17668 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:07:30.092101 14368 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:30.103708 14368 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:30.103889 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:30.087785 13784 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:07:30.030370 17000 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:30.063946 17676 log.cc:927] Time spent T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:07:30.104801 13709 raft_consensus.cc:2410] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:30.073734 17593 consensus_queue.cc:237] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:30.084439 17150 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:30.109385 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:07:30.091722 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 115124us
I20260709 13:07:30.064049 17587 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:30.119751 13680 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:30.106313 17488 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:30.129029 17690 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:07:30.131798 17685 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:30.110587 17308 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:30.127555 17521 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:30.135831 17521 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:30.110361 17541 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:30.136307 17674 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:30.136670 17500 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:30.134799 17517 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:30.138928 17000 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:30.139699 17517 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:30.032999 17509 consensus_queue.cc:237] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:30.110067 17504 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:30.136328 17521 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:30.147819 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 134185us
I20260709 13:07:30.152320 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:30.152966 13789 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
W20260709 13:07:30.154016 17671 log.cc:927] Time spent T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.507s	user 0.000s	sys 0.009s
W20260709 13:07:30.154541 17673 log.cc:927] Time spent T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 13:07:30.032536 17677 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:30.121964 17150 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:30.168682 17505 raft_consensus.cc:3055] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:30.164541 13829 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:30.174762 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:30.175155 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 158294us
I20260709 13:07:30.176692 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:30.177497 13785 raft_consensus.cc:2410] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:07:30.171311 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:30.179435 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:30.175660 17150 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:30.175871 17505 raft_consensus.cc:740] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:30.243548 17689 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:30.183904 17504 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:30.237702 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:30.244062 17689 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.246235 13785 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:30.251566 13858 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:30.253906 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:30.254830 13857 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:30.268862 13830 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:30.258817 13829 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:30.270236 14368 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:30.252368 17504 raft_consensus.cc:697] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:30.252731 17689 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:30.282073 13830 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:30.285567 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 57905.1us
I20260709 13:07:30.286777 13680 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:07:30.289336 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 174142us
I20260709 13:07:30.272354 17513 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:30.294095 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:30.296631 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:30.256847 17233 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:07:30.256601 17591 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:07:30.302186 13785 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:30.285753 17685 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:30.307534 13787 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:07:30.307687 17698 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:30.307950 13787 pending_rounds.cc:85] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 6
I20260709 13:07:30.308205 13787 pending_rounds.cc:107] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:07:30.308477 13787 raft_consensus.cc:2889] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:30.303593 17505 consensus_queue.cc:260] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:30.313118 17505 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:30.314564 17706 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:30.315042 17706 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:30.315399 17706 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.318774 17231 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:30.289448 17004 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:07:30.289638 17521 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:30.320852 17231 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:30.321997 17521 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:30.323837 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:30.324477 14401 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:30.327099 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:30.327314 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:30.329638 17322 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:30.329763 17699 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:30.330785 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:30.338024 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:30.340189 13786 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:30.299127 13830 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:30.359309 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:30.360057 13789 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:30.365609 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:30.369750 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:30.370723 17685 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:30.371766 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:30.374127 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 84824.1us
I20260709 13:07:30.380131 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:30.354003 17593 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:07:30.330288 17699 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.330407 17680 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:30.389345 13830 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:30.397569 17511 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:30.399609 17500 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:30.400055 17500 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.400408 17500 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.432034 17587 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.432798 17587 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:30.436254 17677 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:30.443331 17504 consensus_queue.cc:237] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:30.448935 17709 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:30.372015 17502 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:30.450587 17502 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.450961 17502 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:30.455595 17699 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:30.465421 14366 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:30.359038 17330 consensus_queue.cc:1059] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 13:07:30.469252 17513 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:30.469503 17330 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:30.469936 17513 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:30.470486 17330 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:30.471714 17702 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:30.472422 17702 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:30.471751 17710 raft_consensus.cc:3055] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:30.476286 17710 raft_consensus.cc:740] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:30.477356 17710 consensus_queue.cc:260] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:30.478945 17710 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:30.377971 17233 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.102s
W20260709 13:07:30.486603 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.330256 17322 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:30.492187 17322 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:30.494683 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 111640us
I20260709 13:07:30.495875 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2860) took 1115 ms. Trace:
I20260709 13:07:30.496537 13680 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:30.496294 13864 rpcz_store.cc:276] 0709 13:07:29.380886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.381034 (+   148us) service_pool.cc:224] Handling call
0709 13:07:29.381297 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.888415 (+507118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.495636 (+607221us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b5400300cd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:30.495816 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1146780032}
I20260709 13:07:30.498569 13757 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:30.505781 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:30.510052 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:30.498708 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:30.514788 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 237285us
I20260709 13:07:30.475173 17702 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:30.515307 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:30.517858 13680 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:30.514770 14367 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:30.526386 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:30.527454 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:30.532203 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:30.533881 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:30.534775 13707 raft_consensus.cc:2393] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 13: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:30.536103 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:30.537043 13716 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 7: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:30.532994 13708 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:30.501616 17587 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:30.547281 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:30.564307 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:30.516350 16697 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:30.566223 13709 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:07:30.577661 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:30.531648 17354 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:30.520318 17685 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.578498 13859 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:30.535564 17698 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:30.535683 17674 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:30.598456 14394 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:30.542019 17322 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:30.543948 17702 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.566032 17488 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.568156 17231 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:07:30.606222 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:30.524731 17521 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:07:30.621879 14395 raft_consensus.cc:1240] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:30.611918 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:30.580449 16697 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:30.517328 17150 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:30.605573 17701 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:30.587338 17354 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.613811 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:30.623343 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:30.588697 17697 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:30.642867 13859 raft_consensus.cc:2393] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 12: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:30.645962 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:30.648120 13829 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:30.649088 17504 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:30.673892 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:30.674790 13789 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 7: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:30.675544 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:30.676101 13789 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:30.673844 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:30.678098 13787 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:30.635463 16697 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:30.681329 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.626421 17511 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:30.626276 17675 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:30.640738 17354 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:30.620401 17702 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:30.605967 17674 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:30.711602 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:30.849538 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:30.850611 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:30.608130 17685 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:30.860221 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:30.861070 13713 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:30.851222 13707 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:30.871011 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:30.669858 17488 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:30.879601 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 255449us
I20260709 13:07:30.893256 13756 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:30.900934 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:30.901711 17677 consensus_queue.cc:1059] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:30.902118 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:30.902716 17677 raft_consensus.cc:3055] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:30.903087 17677 raft_consensus.cc:740] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:30.903970 17677 consensus_queue.cc:260] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:30.905087 17677 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.910281 17587 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:30.903196 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:30.913854 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:30.911265 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:07:30.878993 17687 consensus_meta.cc:287] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.806s	user 0.006s	sys 0.007s
I20260709 13:07:30.928121 13707 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:07:30.662776 17697 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:30.937853 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:30.941689 13789 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:07:30.944214 13713 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
W20260709 13:07:30.930344 13865 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.008s	sys 0.007s
I20260709 13:07:30.881613 17511 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:30.888965 17509 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:07:30.963778 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 50956.8us
W20260709 13:07:30.925104 17706 consensus_meta.cc:287] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.609s	user 0.009s	sys 0.002s
I20260709 13:07:30.968803 17363 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:30.970435 17627 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:07:30.971022 17725 log.cc:927] Time spent T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:07:30.982240 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:30.957501 13865 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.008s	sys 0.008s
I20260709 13:07:30.979776 13789 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:31.061692 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:31.013896 17685 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:31.023157 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2168) took 1415 ms. Trace:
W20260709 13:07:31.013792 17716 log.cc:927] Time spent T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:07:31.071365 13860 rpcz_store.cc:276] 0709 13:07:29.607529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.674216 (+ 66687us) service_pool.cc:224] Handling call
0709 13:07:29.674586 (+   370us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:29.881140 (+206554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.881174 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:29.911163 (+ 29989us) log.cc:844] Serialized 52 byte log entry
0709 13:07:30.383313 (+472150us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b180028e040. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e0d1 00007f5232499a0f
0709 13:07:30.599970 (+216657us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:30.600088 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.600226 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.022831 (+422605us) raft_consensus.cc:1685] finished
0709 13:07:31.022851 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.023095 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45577,"raft.queue_time_us":189398,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":10360,"spinlock_wait_cycles":8238464,"thread_start_us":356217,"threads_started":2,"wal-append.queue_time_us":820427}
I20260709 13:07:31.073314 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:31.074025 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:30.958079 17322 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:07:30.998363 17720 log.cc:927] Time spent T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:07:31.076068 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1245) took 1004 ms. Trace:
I20260709 13:07:31.074893 17322 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.076550 14398 rpcz_store.cc:276] 0709 13:07:30.072100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.101763 (+ 29663us) service_pool.cc:224] Handling call
0709 13:07:30.121490 (+ 19727us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.164012 (+ 42522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.164058 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:30.167519 (+  3461us) log.cc:844] Serialized 26 byte log entry
0709 13:07:30.509164 (+341645us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:30.509237 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.509364 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.075807 (+566443us) raft_consensus.cc:1685] finished
0709 13:07:31.075833 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.076001 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":740,"raft.queue_time_us":15187,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":89,"thread_start_us":261811,"threads_started":1,"wal-append.queue_time_us":438112}
I20260709 13:07:31.002552 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:31.012442 17717 log.cc:927] Time spent T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
W20260709 13:07:31.012959 17722 log.cc:927] Time spent T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:07:30.981922 17706 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:31.080782 13861 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:31.082033 17706 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:30.997295 17733 consensus_queue.cc:1059] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:07:31.021862 17697 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:31.083034 17706 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:30.922755 17483 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:07:31.023476 17488 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:30.848917 17675 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.062659 14401 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 5.
I20260709 13:07:31.068611 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:31.086090 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:54782 (request call id 30) took 1687 ms. Trace:
W20260709 13:07:31.012552 17727 log.cc:927] Time spent T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:07:31.078955 17322 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:30.958698 17251 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:31.014300 17553 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:31.084113 17706 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:31.087251 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:31.074172 13858 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:31.105510 13858 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:31.107565 17251 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.112501 17251 leader_election.cc:290] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:31.113521 17731 log.cc:927] Time spent T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:07:31.114514 17706 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:31.124472 14396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1237) took 1486 ms. Trace:
I20260709 13:07:31.124948 14396 rpcz_store.cc:276] 0709 13:07:29.638215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.638330 (+   115us) service_pool.cc:224] Handling call
0709 13:07:29.638612 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.915519 (+276907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.915564 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:29.915619 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:29.915664 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.124168 (+1208504us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b5400147154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:31.124233 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.124386 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":634058112}
W20260709 13:07:31.130590 17699 consensus_meta.cc:287] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.674s	user 0.005s	sys 0.004s
I20260709 13:07:31.086454 13782 rpcz_store.cc:276] 0709 13:07:29.339254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.342611 (+  3357us) service_pool.cc:224] Handling call
0709 13:07:31.026362 (+1683751us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b540033bb54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324d8853 00007f52374a660a 00007f5230a2c7d4 00007f5230a2c762 00007f5230a2c691 00007f5230a2c60c 00007f5230a2b8c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:31.026499 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1252459264}
I20260709 13:07:30.947710 17687 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.132735 13715 raft_consensus.cc:1240] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:31.133459 13783 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2338) took 1707 ms (client timeout 1876 ms). Trace:
I20260709 13:07:31.093879 17017 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.136844 13791 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:31.169813 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:07:31.142280 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 139805us
I20260709 13:07:31.174054 13680 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:31.175381 17150 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:31.176007 13680 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:31.143767 17721 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:31.144161 17698 raft_consensus.cc:3055] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:31.145021 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 807) took 1063 ms. Trace:
W20260709 13:07:31.172539 13783 rpcz_store.cc:269] 0709 13:07:29.426315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.426429 (+   114us) service_pool.cc:224] Handling call
0709 13:07:31.133264 (+1706835us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b54000eced4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:31.133380 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":671506816}
I20260709 13:07:31.025878 17521 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:07:31.187556 17674 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:30.997540 17627 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.190395 17627 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:31.178506 17699 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.002875 17509 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.194741 14393 raft_consensus.cc:2393] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 12: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:31.153909 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:31.154104 13757 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:31.196132 13862 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:07:31.196213 17509 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:31.197230 13757 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:31.198143 13862 raft_consensus.cc:1240] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:31.198768 17689 consensus_meta.cc:287] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.899s	user 0.005s	sys 0.007s
I20260709 13:07:31.199019 13757 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:31.090440 13789 raft_consensus.cc:1240] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:31.178186 17721 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:31.178854 13710 rpcz_store.cc:276] 0709 13:07:30.081530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.093724 (+ 12194us) service_pool.cc:224] Handling call
0709 13:07:30.109529 (+ 15805us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.109868 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.110820 (+   952us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:30.127953 (+ 17133us) log.cc:844] Serialized 26 byte log entry
0709 13:07:30.569794 (+441841us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:30.569846 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.569930 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.144733 (+574803us) raft_consensus.cc:1685] finished
0709 13:07:31.144762 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.144948 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4509,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":4465,"thread_start_us":334390,"threads_started":1,"wal-append.queue_time_us":891718}
I20260709 13:07:31.180955 17593 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:31.182337 17701 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:31.178285 17698 raft_consensus.cc:740] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:31.186592 17687 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:31.186924 17675 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:31.187121 13863 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:31.194118 17699 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:31.218513 13830 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:31.199637 17587 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:31.199785 13682 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:30.990103 17511 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.234347 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:31.150990 17513 consensus_meta.cc:287] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.680s	user 0.012s	sys 0.000s
W20260709 13:07:31.205412 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 264965us
I20260709 13:07:31.207861 13707 raft_consensus.cc:1240] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:31.211848 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:31.244375 13709 raft_consensus.cc:2393] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 9: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:31.211935 17721 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:31.208290 17505 consensus_meta.cc:287] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.895s	user 0.011s	sys 0.000s
I20260709 13:07:31.221892 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:31.229478 17675 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:31.232750 14400 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:31.242631 13830 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:31.212769 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:31.208593 17150 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:31.258860 17627 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:31.258576 17553 consensus_queue.cc:1059] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:07:31.220297 17502 consensus_meta.cc:287] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.769s	user 0.012s	sys 0.000s
I20260709 13:07:31.173003 17556 consensus_queue.cc:1059] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
W20260709 13:07:31.233902 17710 consensus_meta.cc:287] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.755s	user 0.012s	sys 0.003s
I20260709 13:07:31.216476 17509 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:31.235973 17587 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.281605 13830 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:31.245489 17706 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:31.199313 17689 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.300904 17634 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:31.304858 17689 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:31.273394 17233 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:07:31.273466 17500 consensus_meta.cc:287] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.873s	user 0.010s	sys 0.002s
I20260709 13:07:31.222728 17701 raft_consensus.cc:697] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:31.200109 17017 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.284580 17687 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:31.286943 17723 log.cc:927] Time spent T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.403s	user 0.003s	sys 0.000s
I20260709 13:07:31.273905 17513 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.291798 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:31.292522 17627 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.293687 17553 raft_consensus.cc:3055] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:31.295688 16697 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:31.283581 13859 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:07:31.300401 13830 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:31.328905 13830 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:31.301256 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.302537 17748 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:31.297721 17502 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.303277 17634 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:31.305219 17719 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:31.286541 17675 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.331995 13680 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:31.300927 17587 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:31.336438 13830 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:31.337694 13829 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:07:31.335901 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 127117us
I20260709 13:07:31.305361 17591 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:07:31.305806 17509 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.312902 17500 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.308367 17354 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.347210 17634 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:31.381780 13787 consensus_meta.cc:287] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.702s	user 0.009s	sys 0.000s
I20260709 13:07:31.382256 13787 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:07:31.351886 17701 consensus_queue.cc:237] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.354030 17502 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:31.354955 17511 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:31.356664 17627 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:31.360819 17742 log.cc:927] Time spent T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:31.362680 17017 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:31.358780 17721 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.326339 17553 raft_consensus.cc:740] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:31.334666 17488 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:31.340186 17687 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.339956 17706 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:31.383256 13787 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:07:31.385295 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:31.380582 13757 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:31.323557 17743 consensus_queue.cc:1059] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:07:31.387948 17500 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:31.389657 17509 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:31.371922 17748 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:31.391372 17354 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:31.391794 13864 raft_consensus.cc:2368] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8.
I20260709 13:07:31.393657 16697 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:31.373785 17719 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:31.306095 17698 consensus_queue.cc:260] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.395016 17513 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:31.376063 17231 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:31.396595 17675 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:31.397218 17746 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:31.372102 17689 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:31.462945 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 216903us
W20260709 13:07:31.447803 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 67335.2us
I20260709 13:07:31.448325 13787 raft_consensus.cc:606] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:07:31.471266 13787 raft_consensus.cc:614] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:31.405056 17591 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:31.454780 17734 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:31.403599 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:31.503208 14394 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.443037 17511 consensus_queue.cc:1059] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:07:31.505632 17734 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:31.508270 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:31.508839 13787 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.459496 17687 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:31.506419 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.506075 17231 raft_consensus.cc:697] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:07:31.516556 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.472486 17689 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.471683 17748 raft_consensus.cc:697] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:31.520270 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 815) took 1014 ms. Trace:
I20260709 13:07:31.509330 13756 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:31.526532 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2870) took 1029 ms. Trace:
I20260709 13:07:31.533198 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:31.534628 13787 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:31.527441 13712 rpcz_store.cc:276] 0709 13:07:30.506296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.506541 (+   245us) service_pool.cc:224] Handling call
0709 13:07:30.528074 (+ 21533us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.675815 (+147741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.675861 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:30.711121 (+ 35260us) log.cc:844] Serialized 26 byte log entry
0709 13:07:31.063159 (+352038us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:31.063240 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.063338 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.520044 (+456706us) raft_consensus.cc:1685] finished
0709 13:07:31.520069 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.520210 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54886,"raft.queue_time_us":85194,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":17622,"thread_start_us":317934,"threads_started":2,"wal-append.queue_time_us":383543}
I20260709 13:07:31.511340 17150 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:31.536235 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:31.529784 13860 rpcz_store.cc:276] 0709 13:07:30.497152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.079425 (+582273us) service_pool.cc:224] Handling call
0709 13:07:31.079739 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.080004 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:31.098980 (+ 18976us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.460055 (+361075us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.525691 (+ 65636us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.526156 (+   465us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:31.526202 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:31.526250 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.526356 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.526480 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26905,"prepare.queue_time_us":58243,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":76,"raft.queue_time_us":23937,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":7952,"spinlock_wait_cycles":84924672,"thread_start_us":404229,"threads_started":2,"wal-append.queue_time_us":404570}
I20260709 13:07:31.509956 17698 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.537848 13756 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:31.574357 17556 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:31.555549 17231 consensus_queue.cc:237] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:31.577541 17687 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:31.574049 17721 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:31.598662 13715 raft_consensus.cc:1275] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:31.510317 17591 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:31.528046 17689 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:31.507723 17746 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.603210 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:31.605209 17746 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:31.597533 17749 log.cc:927] Time spent T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:07:31.608835 17752 log.cc:927] Time spent T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:07:31.596882 17502 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:31.610889 17502 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.612887 13784 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:07:31.578337 17719 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:31.509917 17734 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.579571 14394 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:31.581368 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:31.587145 13857 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:07:31.503180 17553 consensus_queue.cc:260] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.570457 17748 consensus_queue.cc:237] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.590201 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:31.590634 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 54484.1us
I20260709 13:07:31.648494 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:31.649159 13712 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:31.590173 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 52400.1us
I20260709 13:07:31.613459 13784 raft_consensus.cc:606] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Received request to transfer leadership to TS ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:31.593477 17634 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:31.651358 13784 raft_consensus.cc:614] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:31.651643 13756 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:31.653633 14394 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:31.654176 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:31.654693 13756 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:31.621027 16946 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:31.656314 13756 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:31.601279 17763 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:31.621721 17689 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.628111 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42104 (request call id 845) took 1129 ms. Trace:
I20260709 13:07:31.630265 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:31.635335 13856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2874) took 1137 ms. Trace:
I20260709 13:07:31.668219 13864 rpcz_store.cc:276] 0709 13:07:30.498284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.498384 (+   100us) service_pool.cc:224] Handling call
0709 13:07:31.627861 (+1129477us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b54002d7dd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:31.628026 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2024179456}
I20260709 13:07:31.641991 17702 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:31.668555 13856 rpcz_store.cc:276] 0709 13:07:30.498168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.081557 (+583389us) service_pool.cc:224] Handling call
0709 13:07:31.081845 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.199587 (+117742us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.199615 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:31.199651 (+    36us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:31.199684 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.635090 (+435406us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54003dbdd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:31.635141 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.635264 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270371584}
I20260709 13:07:31.678871 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:31.680466 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:31.680773 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:31.681910 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:31.681934 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:31.684552 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:31.685382 13864 raft_consensus.cc:2393] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 12: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:31.686185 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:31.686825 13682 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:31.688126 14368 leader_election.cc:400] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8.
I20260709 13:07:31.688496 14368 leader_election.cc:403] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:31.683127 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:31.690999 13860 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:31.699506 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.670713 17762 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:31.705809 17587 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:31.706753 17721 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:31.708240 17587 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:31.676535 17634 raft_consensus.cc:697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:31.709197 17591 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:31.709676 17634 consensus_queue.cc:237] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.712041 17689 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:31.712532 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:31.713773 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:31.659184 17763 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:31.714547 13790 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:07:31.714830 17763 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.715296 17766 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:31.715934 17766 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.718483 17766 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:31.719244 17556 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:31.720412 13787 raft_consensus.cc:1240] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:31.721859 17502 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:31.703943 17675 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:07:31.726804 13599 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f09ef105d67b41dba510b44a6567d790 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 35ecb005831740438d7537dd4b840e03 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 10 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:31.731994 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:31.732688 13862 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:31.742820 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:31.764554 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:31.765822 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:31.750156 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.767472 13864 raft_consensus.cc:2393] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 6: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:31.755995 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1040) took 1226 ms. Trace:
I20260709 13:07:31.755133 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2178) took 1487 ms. Trace:
I20260709 13:07:31.704828 17529 raft_consensus.cc:2955] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 4 to 9, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:31.749985 14368 leader_election.cc:304] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:31.767794 17689 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:31.768934 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:31.773522 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:31.754104 17683 log.cc:927] Time spent T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.570s	user 0.004s	sys 0.000s
W20260709 13:07:31.778019 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 99222.1us
I20260709 13:07:31.780685 13860 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:07:31.812237 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:31.813211 14402 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:07:31.815124 14368 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:31.781047 14397 rpcz_store.cc:276] 0709 13:07:30.529942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.530106 (+   164us) service_pool.cc:224] Handling call
0709 13:07:30.565428 (+ 35322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.889833 (+324405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.889880 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:30.889936 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:30.889985 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.755684 (+865699us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b54006d0454. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:31.755757 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.755918 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":745412864}
I20260709 13:07:31.781241 13861 rpcz_store.cc:276] 0709 13:07:30.267967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.318115 (+ 50148us) service_pool.cc:224] Handling call
0709 13:07:30.318394 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.081140 (+762746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.754853 (+673713us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b54003750d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:31.755061 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1752919424}
I20260709 13:07:31.820837 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1784) took 2122 ms. Trace:
I20260709 13:07:31.788964 13712 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:31.796736 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:31.792014 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:31.809612 13864 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:31.785203 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:31.783066 17502 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:31.856178 13862 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:07:31.821379 13791 rpcz_store.cc:276] 0709 13:07:29.685878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.686016 (+   138us) service_pool.cc:224] Handling call
0709 13:07:31.136603 (+1450587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.173316 (+ 36713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.807789 (+634473us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54000eced0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:31.808011 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3332809472}
I20260709 13:07:31.797456 13714 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:07:31.823190 17699 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:31.858656 13857 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:07:31.859966 13757 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:31.794661 17751 raft_consensus.cc:3055] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:31.837016 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:31.790676 17017 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:31.822645 17509 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:31.854921 14400 raft_consensus.cc:2955] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 4 to 9, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:31.869431 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:31.808105 17719 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:31.823872 17374 consensus_queue.cc:1059] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:07:31.882059 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:31.857779 17766 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:31.858820 17363 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.910111 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:31.861236 17677 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:31.799582 17763 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.913079 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1790) took 1957 ms. Trace:
I20260709 13:07:31.913542 17763 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:31.913473 13788 rpcz_store.cc:276] 0709 13:07:29.956087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.956295 (+   208us) service_pool.cc:224] Handling call
0709 13:07:29.966275 (+  9980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.178757 (+212482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.178787 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:30.178824 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:30.178863 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.912824 (+1733961us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54001e6c54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:31.912879 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.913018 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488240000}
I20260709 13:07:31.914793 17591 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.914567 17734 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:31.915309 17591 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:31.914988 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:31.790971 17689 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:31.910826 13786 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:31.869897 13680 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:31.919561 17721 consensus_queue.cc:1059] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:31.920197 17734 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:31.920897 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:31.922559 17591 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:31.866233 17751 raft_consensus.cc:740] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:07:31.927964 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 58165.2us
I20260709 13:07:31.875994 17701 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:31.870393 17699 raft_consensus.cc:697] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 12 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:31.872080 17017 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:31.934759 17004 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:31.931838 17721 raft_consensus.cc:3055] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:31.947583 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:31.932301 17677 raft_consensus.cc:697] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:31.942349 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:31.935178 17766 raft_consensus.cc:697] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:31.959842 16646 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:31.958392 17733 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:31.909771 17509 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.875375 17502 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:31.949834 17701 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:31.972961 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:31.979277 13786 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:07:31.927173 17363 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:31.959013 17017 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.959010 17721 raft_consensus.cc:740] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:31.985850 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:31.966820 17374 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:31.965766 16946 consensus_queue.cc:1059] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:07:31.981292 17701 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:32.012315 16946 raft_consensus.cc:3055] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:32.012871 16946 raft_consensus.cc:740] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:32.013813 16946 consensus_queue.cc:260] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:32.016395 17771 log.cc:927] Time spent T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:07:32.023963 17513 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:32.024653 17513 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.027815 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:32.028676 17513 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:32.029134 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:32.029951 13786 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:32.031984 17766 consensus_queue.cc:237] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.034082 17502 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:32.034830 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:32.035852 14397 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:07:32.037281 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:32.037500 17677 consensus_queue.cc:237] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:32.037322 17509 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:32.038983 17502 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:32.039523 17502 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:32.039669 16946 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:32.040066 17502 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.048395 17689 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:32.053571 17675 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8.
I20260709 13:07:32.031133 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:32.055214 13786 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:31.968825 17733 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:32.065181 17502 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.076383 17502 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:32.076756 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 836) took 2027 ms. Trace:
I20260709 13:07:32.077354 13863 rpcz_store.cc:276] 0709 13:07:30.049101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.049222 (+   121us) service_pool.cc:224] Handling call
0709 13:07:30.049500 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.216518 (+1167018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.076465 (+859947us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54002fadd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:32.076678 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2615819008}
I20260709 13:07:32.078639 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:32.081713 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 2884) took 1367 ms. Trace:
I20260709 13:07:32.084071 13858 rpcz_store.cc:276] 0709 13:07:30.714064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.110382 (+396318us) service_pool.cc:224] Handling call
0709 13:07:31.110706 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.281811 (+171105us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.281839 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:31.281885 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:31.281926 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.081404 (+799478us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b5400387554. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:32.081466 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.081619 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393077632}
I20260709 13:07:32.088593 13859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 2875) took 1580 ms. Trace:
I20260709 13:07:32.086454 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:32.089090 13859 rpcz_store.cc:276] 0709 13:07:30.508653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.877967 (+369314us) service_pool.cc:224] Handling call
0709 13:07:32.088392 (+1210425us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54003dc2d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:32.088524 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":848761600}
I20260709 13:07:32.108170 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:32.108887 14400 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.064041 17469 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.112303 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:32.113230 13830 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:32.055665 17374 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:32.122130 13786 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:07:32.136754 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:32.137964 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:32.138542 13786 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:32.136689 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 232231us
I20260709 13:07:32.111447 17719 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:07:32.144191 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 213738us
W20260709 13:07:32.160727 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.169077 13860 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:32.145660 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:32.174041 14400 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:32.176254 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:32.177984 17745 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:32.178707 17745 raft_consensus.cc:697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:32.179946 17745 consensus_queue.cc:237] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.055320 17751 consensus_queue.cc:260] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:32.133069 17706 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:32.110212 17689 consensus_queue.cc:1048] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:07:32.197919 13786 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:32.116856 17675 consensus_queue.cc:1059] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:07:32.204792 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:32.205900 13786 raft_consensus.cc:2393] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 12: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:32.121449 17469 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:32.080562 17699 consensus_queue.cc:237] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.185972 17764 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:32.200558 17763 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:32.169574 17634 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:32.201521 17753 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:32.216964 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:32.209069 17706 raft_consensus.cc:697] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:32.227340 13786 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:32.195603 17719 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.236061 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:32.237582 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:32.143002 17721 consensus_queue.cc:260] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:32.215497 17758 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:32.216226 17751 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:32.234377 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:32.243971 13786 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:07:32.250623 13786 raft_consensus.cc:606] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Received request to transfer leadership to TS ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:32.261830 13788 raft_consensus.cc:1240] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:32.227169 17753 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:32.219848 17764 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.271325 13788 raft_consensus.cc:1275] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:32.220264 17763 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:32.301509 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 155921us
I20260709 13:07:32.273135 17753 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:32.233867 17634 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.303107 13829 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:32.309906 13829 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:32.311108 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:32.316854 13829 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:32.320806 13829 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:32.310542 17733 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:32.322710 17509 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:32.318663 17680 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:32.323637 17689 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:32.326843 17374 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:32.326160 17748 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:32.331284 17529 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:32.345006 17509 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:32.360949 17509 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:32.348995 17502 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:32.362350 17502 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.364292 17634 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:32.365105 17502 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:32.366539 17779 log.cc:927] Time spent T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:07:32.368125 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2349) took 1824 ms. Trace:
W20260709 13:07:32.368438 17776 log.cc:927] Time spent T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:07:32.368620 13785 rpcz_store.cc:276] 0709 13:07:30.543642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.732439 (+188797us) service_pool.cc:224] Handling call
0709 13:07:30.857402 (+124963us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:30.857853 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.857894 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:30.899806 (+ 41912us) log.cc:844] Serialized 52 byte log entry
0709 13:07:31.719363 (+819557us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b1800416800. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e0d1 00007f5232499a0f
0709 13:07:31.968237 (+248874us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:32.213444 (+245207us) log.cc:844] Serialized 14 byte log entry
0709 13:07:32.213711 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.213822 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:32.367739 (+153917us) raft_consensus.cc:1685] finished
0709 13:07:32.367865 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.368050 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":322413,"prepare.run_wall_time_us":48,"raft.queue_time_us":11839,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":16930,"spinlock_wait_cycles":44442752,"thread_start_us":482765,"threads_started":2,"wal-append.queue_time_us":1413710}
I20260709 13:07:32.374157 17517 raft_consensus.cc:3055] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:32.374708 17517 raft_consensus.cc:740] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:07:32.382819 13714 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2560) took 1877 ms (client timeout 1830 ms). Trace:
W20260709 13:07:32.383351 13714 rpcz_store.cc:269] 0709 13:07:30.504993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.505130 (+   137us) service_pool.cc:224] Handling call
0709 13:07:32.382584 (+1877454us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54001b8d54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:32.382725 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2918762368}
I20260709 13:07:32.347968 17680 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:32.419364 17775 log.cc:927] Time spent T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:07:32.387789 17703 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:32.399799 17680 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:32.402956 17469 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:32.418965 17592 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:32.343062 17706 consensus_queue.cc:237] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.429783 17766 consensus_queue.cc:1048] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:07:32.403926 17529 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.426708 17786 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:32.435626 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 108279us
I20260709 13:07:32.432003 17675 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:32.435539 17719 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:32.489226 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 164845us
I20260709 13:07:32.429569 17517 consensus_queue.cc:260] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:32.494446 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:32.494606 17748 raft_consensus.cc:697] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:32.485600 17689 raft_consensus.cc:697] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:32.497367 13785 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:32.433984 17703 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.494510 17794 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:32.436787 17592 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.491139 17747 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:32.520807 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:32.538412 13712 raft_consensus.cc:2410] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
W20260709 13:07:32.506999 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 214929us
I20260709 13:07:32.516758 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:32.513048 17764 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:32.528091 17719 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.544294 17719 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.548949 17719 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:32.487394 17675 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.562486 13716 raft_consensus.cc:1240] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:32.553838 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:32.556118 17788 log.cc:927] Time spent T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:32.557574 17592 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:32.551406 17782 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:07:32.559847 17801 consensus_queue.cc:1059] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:07:32.513003 17783 log.cc:927] Time spent T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:07:32.555478 17763 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:32.561408 16946 consensus_meta.cc:287] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.000s
I20260709 13:07:32.567342 13785 raft_consensus.cc:1240] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:32.569242 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:32.504716 17150 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:32.506796 17517 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:32.567297 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 63663.4us
W20260709 13:07:32.573411 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 85431.1us
I20260709 13:07:32.587770 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:32.594280 13756 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:32.597882 13756 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:32.550215 17794 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.608353 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:32.613219 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:32.613384 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2184) took 1398 ms. Trace:
I20260709 13:07:32.589819 17150 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:32.622831 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:32.553727 17747 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.626387 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:32.630518 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:32.615053 13861 rpcz_store.cc:276] 0709 13:07:31.214661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.823405 (+608744us) service_pool.cc:224] Handling call
0709 13:07:31.826369 (+  2964us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.831792 (+  5423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.831853 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:32.207240 (+375387us) spinlock_profiling.cc:243] Waited 9.35 ms on lock 0x7b2c000cc698. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5230dd7a11 00007f5230de7372 00007f5232519a01 00007f52324de43a 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2
0709 13:07:32.209857 (+  2617us) log.cc:844] Serialized 26 byte log entry
0709 13:07:32.324161 (+114304us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:32.324207 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.324285 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:32.592807 (+268522us) raft_consensus.cc:1685] finished
0709 13:07:32.592831 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.613308 (+ 20477us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3886,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":21499776,"thread_start_us":94166,"threads_started":1,"wal-append.queue_time_us":214772}
I20260709 13:07:32.639624 13712 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:07:32.641158 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:32.642975 13756 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:32.614109 17784 log.cc:927] Time spent T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:07:32.645088 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:32.645109 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:32.607492 17763 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:32.614887 17592 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:32.646770 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 64409.1us
I20260709 13:07:32.643136 16946 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:32.672045 13785 raft_consensus.cc:1240] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:32.646673 17786 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:07:32.662238 17785 log.cc:927] Time spent T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:07:32.589742 17748 consensus_queue.cc:237] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:32.653676 17592 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:32.667313 17763 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:32.667943 17804 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:32.691542 17808 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
W20260709 13:07:32.692715 17757 log.cc:927] Time spent T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 1.190s	user 0.006s	sys 0.000s
I20260709 13:07:32.695468 17529 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:32.696571 17796 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:07:32.699039 17778 log.cc:927] Time spent T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.358s	user 0.000s	sys 0.001s
I20260709 13:07:32.723385 13680 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:07:32.705561 17754 log.cc:927] Time spent T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 1.179s	user 0.003s	sys 0.000s
I20260709 13:07:32.707950 17553 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:32.709426 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:32.709820 17794 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:32.711158 13861 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:32.711747 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:32.713601 13829 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:32.714507 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:32.681047 17675 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:32.627588 17689 consensus_queue.cc:237] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:32.714263 17017 consensus_meta.cc:287] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.711s	user 0.011s	sys 0.002s
I20260709 13:07:32.680215 16946 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:32.741919 17772 log.cc:927] Time spent T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.519s	user 0.001s	sys 0.000s
I20260709 13:07:32.720031 17804 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.765851 17513 raft_consensus.cc:3055] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:32.766359 17513 raft_consensus.cc:740] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:07:32.766917 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 53403.5us
I20260709 13:07:32.683979 17786 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.758635 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:32.767781 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:32.738096 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2350) took 2142 ms. Trace:
I20260709 13:07:32.802151 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2181) took 1588 ms. Trace:
I20260709 13:07:32.772804 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:32.771035 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:32.787287 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:32.814921 13710 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:32.785476 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:07:32.716132 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 125440us
I20260709 13:07:32.687263 17592 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:32.722074 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:32.818481 13860 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 5: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:32.764036 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:32.701731 17680 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:32.677321 16697 consensus_queue.cc:1059] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:07:32.727617 13680 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:32.813861 13857 rpcz_store.cc:276] 0709 13:07:31.213782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.765868 (+552086us) service_pool.cc:224] Handling call
0709 13:07:31.857460 (+ 91592us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.860284 (+  2824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.801880 (+941596us) spinlock_profiling.cc:243] Waited 91.2 ms on lock 0x7b54002d96d0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:32.802078 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209774848}
W20260709 13:07:32.769706 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.763067 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2187) took 1338 ms. Trace:
I20260709 13:07:32.883399 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:32.883876 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:32.725872 17719 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:32.885247 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 213301us
I20260709 13:07:32.812815 13856 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:32.732457 17713 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:32.819438 13863 raft_consensus.cc:2393] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 8: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:32.821177 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:32.893134 14400 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 10: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:32.894747 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:32.895597 13861 raft_consensus.cc:2393] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 13: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:32.771719 17799 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.887181 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:32.881978 13862 rpcz_store.cc:276] 0709 13:07:31.424898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.895321 (+470423us) service_pool.cc:224] Handling call
0709 13:07:31.935656 (+ 40335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.946868 (+ 11212us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:31.960133 (+ 13265us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.960325 (+   192us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:31.960371 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:31.960423 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.762775 (+802352us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b54002fb2d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:32.762839 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.762991 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17181,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":3994,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":6786,"spinlock_wait_cycles":26662144}
I20260709 13:07:32.788342 17231 raft_consensus.cc:3055] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:07:32.773990 17701 consensus_meta.cc:287] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.762s	user 0.011s	sys 0.003s
I20260709 13:07:32.767916 17511 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:32.889570 13856 raft_consensus.cc:1240] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:32.909238 17800 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:32.909369 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:32.909744 17800 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:32.910281 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:32.909420 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:32.905282 17231 raft_consensus.cc:740] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:32.740593 17509 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:32.890002 13709 raft_consensus.cc:2368] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8.
I20260709 13:07:32.912308 17150 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:32.913405 17511 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:32.913964 17511 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:32.914961 17753 consensus_meta.cc:287] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.001s
I20260709 13:07:32.915439 17753 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.918430 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:32.813181 13782 rpcz_store.cc:276] 0709 13:07:30.595374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.176141 (+580767us) service_pool.cc:224] Handling call
0709 13:07:31.176671 (+   530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.176989 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.177016 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:31.177885 (+   869us) log.cc:844] Serialized 564 byte log entry
0709 13:07:31.327001 (+149116us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:31.327054 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.327143 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:32.692420 (+1365277us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b24001140c8. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f2779c4 00007f522f275acb 00007f522f430dc9 00007f522f430a55 00007f522f43009d 00007f523206210e 00007f523207988c 00007f5232078bb6 00007f52320787d8 00007f5232082221
0709 13:07:32.737819 (+ 45399us) raft_consensus.cc:1685] finished
0709 13:07:32.737841 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.738029 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31798144,"thread_start_us":148846,"threads_started":1,"wal-append.queue_time_us":283000}
I20260709 13:07:32.890549 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:32.918973 13783 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:32.888043 13864 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:32.737807 14396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1050) took 1334 ms. Trace:
I20260709 13:07:32.764169 17747 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:32.891423 17374 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:32.886023 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 158493us
I20260709 13:07:32.745770 17363 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:32.817855 17685 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:32.899724 13789 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:32.878328 17634 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.938498 14367 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:32.818742 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 164588us
I20260709 13:07:32.767843 17804 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:32.743494 17703 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:32.918190 17701 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.890286 13682 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:07:32.963359 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 73146.2us
I20260709 13:07:32.963382 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:32.966377 14367 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:32.967180 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:32.935478 17808 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.935057 17753 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:32.783052 17764 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.114s
I20260709 13:07:32.919737 14396 rpcz_store.cc:276] 0709 13:07:31.403379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.403510 (+   131us) service_pool.cc:224] Handling call
0709 13:07:31.403829 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.404171 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.404200 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:31.792479 (+388279us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b18004a8240. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3bf2a6 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5230dd7a11 00007f5230de7372 00007f5232519a01 00007f52324de43a
0709 13:07:32.371949 (+579470us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b2c00012878. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5230dd7a11 00007f5230de7372 00007f5232519a01 00007f52324de43a 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2
0709 13:07:32.372499 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:07:32.500885 (+128386us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:32.500927 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.501018 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:32.737610 (+236592us) raft_consensus.cc:1685] finished
0709 13:07:32.737631 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.737749 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18710,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":16901,"spinlock_wait_cycles":48744448,"thread_start_us":127960,"threads_started":1,"wal-append.queue_time_us":218303}
I20260709 13:07:32.912329 17231 consensus_queue.cc:260] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.929610 17800 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:32.907759 17799 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.933125 17786 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:32.892179 17719 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:32.993436 17719 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:32.897472 17713 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.993747 17799 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:32.937839 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:32.995993 13712 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:07:32.927043 13783 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:32.938436 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2169) took 3302 ms. Trace:
I20260709 13:07:32.997241 14367 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:32.822512 17017 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.897138 13756 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:32.968945 17733 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.767267 17513 consensus_queue.cc:260] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.962322 14395 raft_consensus.cc:1240] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:32.748588 17488 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:32.974119 13782 raft_consensus.cc:2393] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 11: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:32.943049 17747 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.976270 14397 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 12 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:32.984194 13708 raft_consensus.cc:1240] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:32.959013 13859 raft_consensus.cc:2955] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 4 to 9, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:32.997650 13865 rpcz_store.cc:276] 0709 13:07:29.618207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.772087 (+153880us) service_pool.cc:224] Handling call
0709 13:07:30.077644 (+305557us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.077908 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.077938 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:30.103464 (+ 25526us) log.cc:844] Serialized 26 byte log entry
0709 13:07:30.270109 (+166645us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:31.000894 (+730785us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.262069 (+261175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.262175 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.262237 (+    62us) raft_consensus.cc:1685] finished
0709 13:07:31.262255 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.920602 (+1658347us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b5400387050. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:32.920750 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":711299,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":2651,"raft.queue_time_us":71499,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":684565248,"thread_start_us":1047071,"threads_started":3,"wal-append.queue_time_us":343739,"wal-append.run_cpu_time_us":2557,"wal-append.run_wall_time_us":1562110}
I20260709 13:07:32.999452 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:32.972441 17502 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:33.003190 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 106150us
I20260709 13:07:32.956023 13856 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:33.006690 17308 raft_consensus.cc:3055] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:32.951675 17685 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:32.994134 17713 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:33.034632 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:33.028203 17733 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.003103 17231 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:33.035265 14367 leader_election.cc:400] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8.
I20260709 13:07:32.964315 17634 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:33.044445 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 87001.5us
I20260709 13:07:33.035171 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:33.007426 17801 consensus_queue.cc:1059] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:07:32.978334 17808 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.034916 17553 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:33.032027 17502 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:33.086244 17502 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:33.028285 17815 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:33.088198 17808 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:33.007573 17675 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:33.091290 14394 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:33.080919 14366 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:33.034546 17308 raft_consensus.cc:740] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:33.082809 13790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2356) took 1744 ms. Trace:
I20260709 13:07:33.095212 13790 rpcz_store.cc:276] 0709 13:07:31.338601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.338898 (+   297us) service_pool.cc:224] Handling call
0709 13:07:31.339678 (+   780us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.715005 (+375327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.082580 (+1367575us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54003df254. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:33.082755 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":861489536}
I20260709 13:07:33.096361 17813 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:33.097064 17813 raft_consensus.cc:697] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:33.097664 17810 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.134s
I20260709 13:07:33.093772 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:33.094759 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:33.099905 14396 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
I20260709 13:07:33.035043 17488 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:33.100457 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:33.102869 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:33.103171 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:33.037405 17747 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.102547 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:33.104933 14397 raft_consensus.cc:2393] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 12: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:33.106088 16946 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:33.105963 17308 consensus_queue.cc:260] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:33.106796 17488 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:33.078229 17795 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.216s
I20260709 13:07:33.104710 17680 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:33.094658 17797 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:33.132583 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:33.132808 14400 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:33.134249 14399 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:33.131956 16697 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:07:33.138664 17816 log.cc:927] Time spent T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:07:33.138338 16697 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.139503 17813 consensus_queue.cc:237] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:33.140471 16697 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:33.140995 17017 leader_election.cc:290] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:33.142433 17509 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:33.144611 17747 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:33.166980 17733 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:33.140332 17685 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:33.184448 14397 raft_consensus.cc:3055] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:33.185041 14397 raft_consensus.cc:740] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:33.189716 17592 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:33.191725 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:33.191953 17592 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:33.193111 17824 log.cc:927] Time spent T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 13:07:33.193907 17823 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:07:33.185937 17308 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.187961 14397 consensus_queue.cc:260] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.216689 14397 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.219969 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:33.222455 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:33.226291 14397 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:33.227833 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:33.227891 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:33.232772 17502 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.220361 17713 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:33.236685 17713 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:33.236593 17502 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:33.238454 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:33.240896 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.242753 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:33.244015 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:33.244843 14400 raft_consensus.cc:2393] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 12: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:33.252923 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:33.261439 14368 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:33.266569 14395 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:07:33.266975 14395 pending_rounds.cc:85] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 10
I20260709 13:07:33.267181 14395 pending_rounds.cc:107] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:07:33.267391 14395 raft_consensus.cc:2889] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:33.268585 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:33.268821 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:33.225992 17511 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:33.270113 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:33.269249 13860 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:33.270323 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:33.271216 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:33.273844 14400 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:07:33.273950 14397 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:33.277992 13680 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:33.252332 17698 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:07:33.271620 17797 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:33.282105 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:33.289921 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:33.291076 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:33.301426 13711 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:33.291908 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:33.302345 13713 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
I20260709 13:07:33.302897 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:33.303208 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:33.303829 13713 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:07:33.304167 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:33.304580 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:33.304960 13786 raft_consensus.cc:2410] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:33.292104 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:33.292757 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:33.307103 17634 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:33.310168 17803 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:07:33.310318 13710 raft_consensus.cc:1240] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:33.316449 17513 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:33.271790 17363 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:07:33.294957 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:33.295642 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:33.296295 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:33.322904 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:33.323133 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:33.325111 13715 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:33.298137 13782 raft_consensus.cc:1240] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:07:33.299351 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:33.297149 17758 raft_consensus.cc:3055] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:33.328100 17758 raft_consensus.cc:740] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:33.328212 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:33.328940 14400 raft_consensus.cc:2393] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 10: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:33.328979 17758 consensus_queue.cc:260] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.330374 17758 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.336650 13711 raft_consensus.cc:1240] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:33.338253 13709 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:07:33.336612 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:33.341809 17814 log.cc:927] Time spent T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.294s	user 0.000s	sys 0.003s
I20260709 13:07:33.342211 17627 consensus_queue.cc:1059] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:33.343024 17627 raft_consensus.cc:3055] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:33.343324 17627 raft_consensus.cc:740] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:33.344022 17511 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:33.344189 17627 consensus_queue.cc:260] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.345305 17627 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:33.346200 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.347153 17000 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:33.347622 17469 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.347725 17000 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.348129 17469 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:33.349809 17000 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:33.349927 17469 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:33.347893 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:33.357800 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.367856 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:33.370108 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 370763us
I20260709 13:07:33.370615 17746 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:33.371191 17746 raft_consensus.cc:697] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:33.372054 17746 consensus_queue.cc:237] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.373764 14399 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:07:33.374114 14399 pending_rounds.cc:85] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 10
I20260709 13:07:33.374178 13791 raft_consensus.cc:1275] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:33.374387 14399 pending_rounds.cc:107] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:07:33.374775 14399 raft_consensus.cc:2889] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:33.375074 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:33.375820 13787 raft_consensus.cc:2393] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 5: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:33.376052 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1045) took 2145 ms. Trace:
I20260709 13:07:33.301268 17713 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:33.376685 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:33.377271 17713 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.377655 17713 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:33.380030 13785 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:33.382069 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:33.382594 13786 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:33.383667 17799 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.375368 13791 raft_consensus.cc:1240] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:33.384145 17799 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:33.385771 13756 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:07:33.373476 13829 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.132:43039 timed out after 1.749s (SENT) [suppressed 7 similar messages]
I20260709 13:07:33.386359 17799 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:33.386499 17150 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:33.374784 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:33.387509 13830 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:33.388592 17810 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:33.388975 17810 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:33.389319 17810 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:33.374411 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:33.394389 13790 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:07:33.394856 17517 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.395395 17517 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.397605 14400 raft_consensus.cc:1240] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:33.397966 17363 consensus_queue.cc:1059] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:33.376539 17593 consensus_queue.cc:1059] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:07:33.398829 17374 raft_consensus.cc:3055] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:33.398916 16646 consensus_queue.cc:1059] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:33.399253 17374 raft_consensus.cc:740] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:33.400421 17701 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:33.400846 16946 raft_consensus.cc:3055] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:33.401227 16946 raft_consensus.cc:740] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:33.401610 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:33.402292 13710 raft_consensus.cc:2368] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10.
I20260709 13:07:33.401954 16946 consensus_queue.cc:260] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:33.403048 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:33.403842 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:33.404006 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:33.404554 13708 raft_consensus.cc:2393] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 11: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:33.405790 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:33.406886 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:33.407455 13709 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:33.407796 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:33.376442 14393 rpcz_store.cc:276] 0709 13:07:31.230597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.230721 (+   124us) service_pool.cc:224] Handling call
0709 13:07:31.231056 (+   335us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:31.329685 (+ 98629us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.329714 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:31.339504 (+  9790us) log.cc:844] Serialized 52 byte log entry
0709 13:07:31.774688 (+435184us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b180031df80. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e0d1 00007f5232499a0f
0709 13:07:32.117788 (+343100us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:32.168538 (+ 50750us) log.cc:844] Serialized 14 byte log entry
0709 13:07:32.168780 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.375113 (+1206333us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b180031df80. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3bf2a6 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419
0709 13:07:33.375761 (+   648us) spinlock_profiling.cc:243] Waited 98.3 ms on lock 0x7b540059a454. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:33.375791 (+    30us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.375831 (+    40us) raft_consensus.cc:1685] finished
0709 13:07:33.375847 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.375966 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44459,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":3859,"raft.queue_time_us":627,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":15409,"spinlock_wait_cycles":309476864,"thread_start_us":342909,"threads_started":1,"wal-append.queue_time_us":864429,"wal-append.run_cpu_time_us":3599,"wal-append.run_wall_time_us":1165282}
I20260709 13:07:33.400065 17374 consensus_queue.cc:260] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.411996 17374 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:33.413496 14366 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:33.414657 14366 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:33.417157 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 44555us
I20260709 13:07:33.414978 13786 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:07:33.421306 13709 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:07:33.423348 14394 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:33.425551 13715 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:33.425822 13790 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:07:33.429345 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:33.430183 13713 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 4.
I20260709 13:07:33.427194 14366 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:33.431761 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:33.432822 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:33.417387 13784 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
W20260709 13:07:33.415704 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 60032.9us
W20260709 13:07:33.438761 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 44831us
I20260709 13:07:33.443343 13682 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:33.443305 13757 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:33.452085 17827 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:33.452569 17827 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:33.454095 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:33.454296 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 68600.2us
I20260709 13:07:33.454380 16697 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:33.454941 16697 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:33.455292 16697 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:33.456779 13756 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:33.459055 13756 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:33.463847 14398 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:07:33.476078 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 48970.5us
I20260709 13:07:33.436007 17017 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:33.489936 13682 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:33.453023 13610 catalog_manager.cc:5697] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 2 to 5, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 5 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:33.481468 14366 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:33.453958 17469 raft_consensus.cc:2764] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:07:33.460247 17675 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:33.397650 17517 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:33.453747 17324 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.498906 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:33.453064 17827 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.482934 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:33.436383 17797 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:33.521755 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:33.546438 13859 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:33.530905 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:33.549700 13860 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
W20260709 13:07:33.530845 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 157370us
I20260709 13:07:33.534925 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:33.536738 13612 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57116 (request call id 228) took 19612 ms (client timeout 15000 ms). Trace:
I20260709 13:07:33.553102 14368 leader_election.cc:304] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:33.481025 17751 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:33.447360 17803 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
W20260709 13:07:33.539566 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 58200.6us
I20260709 13:07:33.485348 17592 raft_consensus.cc:2764] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:07:33.544343 16697 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.548509 13715 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:07:33.557677 13682 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:33.544569 13610 catalog_manager.cc:5697] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 6 to 7, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 7 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:07:33.561498 14366 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:33.560011 13830 leader_election.cc:400] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10.
I20260709 13:07:33.563244 13830 leader_election.cc:403] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:33.564999 16697 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:33.568791 13829 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:33.574750 13680 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:33.579533 13859 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:33.538375 17794 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:33.582352 14366 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:33.544701 17324 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.597023 17324 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:33.522677 17762 consensus_queue.cc:1059] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:07:33.599547 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:33.594856 13610 catalog_manager.cc:5697] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 9 to 10, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 10 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.605705 13859 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:07:33.599721 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 46556.8us
I20260709 13:07:33.607329 13861 raft_consensus.cc:1240] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:33.610272 13829 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:33.551604 13612 rpcz_store.cc:269] 0709 13:07:13.924194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.924406 (+   212us) service_pool.cc:224] Handling call
0709 13:07:33.536662 (+19612256us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:29.127221 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:29.136789 (+  9568us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:29.207464 (+ 70675us) write_op.cc:435] Acquired schema lock
0709 13:07:29.207500 (+    36us) tablet.cc:662] Decoding operations
0709 13:07:29.314790 (+107290us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:29.314920 (+   130us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:29.314962 (+    42us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:07:29.316868 (+  1906us) tablet.cc:701] Row locks acquired
0709 13:07:29.316929 (+    61us) write_op.cc:260] PREPARE: finished
0709 13:07:29.317173 (+   244us) write_op.cc:270] Start()
0709 13:07:29.317374 (+   201us) write_op.cc:276] Timestamp: P: 1783602449317076 usec, L: 0
0709 13:07:29.317420 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 13:07:29.318577 (+  1157us) log.cc:844] Serialized 5512 byte log entry
0709 13:07:30.468152 (+1149575us) op_driver.cc:464] REPLICATION: finished
0709 13:07:31.122568 (+654416us) write_op.cc:301] APPLY: starting
0709 13:07:31.122689 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:31.155558 (+ 32869us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:31.155710 (+   152us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:31.157284 (+  1574us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:31.157760 (+   476us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=28
0709 13:07:31.157857 (+    97us) write_op.cc:312] APPLY: finished
0709 13:07:31.158393 (+   536us) log.cc:844] Serialized 101 byte log entry
0709 13:07:31.181018 (+ 22625us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:31.181180 (+   162us) write_op.cc:454] Released schema lock
0709 13:07:31.181248 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:31.181661 (+   413us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:31.181687 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4385365,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":635563,"apply.run_cpu_time_us":5571,"apply.run_wall_time_us":59121,"num_ops":14,"prepare.queue_time_us":165453,"prepare.run_cpu_time_us":10782,"prepare.run_wall_time_us":369159,"raft.queue_time_us":391792,"raft.run_cpu_time_us":9479,"raft.run_wall_time_us":195216,"replication_time_us":1150554,"thread_start_us":632695,"threads_started":4,"wal-append.queue_time_us":287713,"wal-append.run_cpu_time_us":42548,"wal-append.run_wall_time_us":2578021}]]}
I20260709 13:07:33.556195 17751 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:33.616647 14366 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:33.626209 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:33.626896 14394 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:33.627907 13680 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:33.601097 17819 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:33.624053 17751 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:33.600384 17363 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:33.629113 13610 catalog_manager.cc:5697] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 4 to 6, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 6 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:33.621184 17812 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:33.623594 17324 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:07:33.636433 13715 raft_consensus.cc:1240] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:33.629231 17231 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:33.637116 17231 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.637642 17231 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:33.570380 17517 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.565812 17675 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:33.636102 13610 catalog_manager.cc:5697] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 6 to 7, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 7 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:33.639699 17517 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:33.609138 17719 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:33.606580 17811 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:33.614032 13830 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:33.618563 17214 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:33.608788 17799 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10.
I20260709 13:07:33.619427 17786 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:33.640792 13610 catalog_manager.cc:5697] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:33.655383 17511 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:33.654479 13830 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:33.663568 13829 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:33.666334 14366 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:33.630975 17762 consensus_queue.cc:1243] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer b9d194f45e044e0988d5de1a99e5cd02 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:33.671152 14366 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:33.649413 17719 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.651275 17214 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.674072 13610 catalog_manager.cc:5697] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.675741 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:33.653964 17746 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:33.664533 17794 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:33.668601 13682 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:33.677631 14366 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:33.650216 17819 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:07:33.663698 17811 raft_consensus.cc:697] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:33.661963 17511 raft_consensus.cc:697] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:07:33.710141 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 261351us
I20260709 13:07:33.709789 13610 catalog_manager.cc:5697] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 4 to 5, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 5 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.675943 17719 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.676787 17801 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:33.716310 14366 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:33.662767 17698 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:33.706604 17815 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:33.715852 13755 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:33.734544 16697 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:33.679776 17214 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.711256 17733 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:33.723326 13610 catalog_manager.cc:5697] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 6 to 7, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 7 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:33.737224 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 253050us
I20260709 13:07:33.738386 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:33.740135 17801 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:33.740996 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.740705 17675 consensus_queue.cc:1059] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:33.732110 17794 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:33.679595 17748 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:33.724495 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 48070.4us
I20260709 13:07:33.667774 17680 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:33.734400 13755 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:33.674805 17747 consensus_queue.cc:1059] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:07:33.661767 17753 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:07:33.757253 13610 catalog_manager.cc:5697] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 5 to 6, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 6 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:33.734899 17689 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:33.711407 17810 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:33.714669 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 234837us
I20260709 13:07:33.748801 13712 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 4.
I20260709 13:07:33.749621 17815 raft_consensus.cc:3055] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:33.754527 13858 raft_consensus.cc:1240] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:33.732630 17799 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:33.733049 17488 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:07:33.748075 17733 raft_consensus.cc:697] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:33.777613 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:33.784632 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:33.771217 13864 raft_consensus.cc:1240] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:33.772266 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:33.771615 13610 catalog_manager.cc:5697] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.786531 13860 raft_consensus.cc:1240] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:33.787289 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:33.787657 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:33.787952 13784 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:33.754988 17680 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.757365 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:33.791857 13856 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:07:33.777310 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:33.792327 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:33.752923 13829 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:33.793171 13783 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 5.
I20260709 13:07:33.748785 17517 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:33.782225 13789 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:33.768532 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:33.794319 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:33.787199 13610 catalog_manager.cc:5697] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 3 to 4, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 4 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:33.759107 17758 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:33.791716 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:33.797338 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:33.800518 13785 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:33.767297 17801 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:33.799005 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 46196.8us
I20260709 13:07:33.769904 17815 raft_consensus.cc:740] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:33.822594 13791 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:07:33.823398 17815 consensus_queue.cc:260] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.824839 17815 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:33.832605 17810 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:33.833583 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:33.834326 13789 raft_consensus.cc:2393] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 13: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:33.798972 13790 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:33.773993 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:33.803012 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:33.835597 13787 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:33.808045 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:33.837066 13784 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:33.807049 13829 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:33.807749 13782 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:33.802865 17748 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:33.815582 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:33.821689 17721 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:33.811228 17833 log.cc:927] Time spent T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:07:33.798429 17680 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:33.849520 13785 raft_consensus.cc:1240] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:33.851210 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:33.845221 13829 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:33.859690 13790 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:33.770813 17689 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.861917 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:33.800050 17308 consensus_queue.cc:1059] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:07:33.863951 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:33.864437 14395 raft_consensus.cc:2393] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 10: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:33.860643 13789 raft_consensus.cc:2955] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 4 to 9, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:33.852382 17517 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:33.865995 13782 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:33.850135 17488 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:33.876415 13787 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:33.807749 17839 consensus_queue.cc:1059] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:07:33.859980 17748 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:33.882174 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.807687 17799 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.787652 17733 consensus_queue.cc:237] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:33.864283 17746 consensus_queue.cc:1048] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:07:33.799328 17811 consensus_queue.cc:237] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:33.914397 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 50522.1us
I20260709 13:07:33.803087 17511 consensus_queue.cc:237] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:33.854408 17810 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
W20260709 13:07:33.922686 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 159717us
I20260709 13:07:33.925170 13756 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:33.839282 17801 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.893633 17685 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:33.908988 17799 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:33.944518 13756 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:33.906893 17689 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:33.887528 17488 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.929242 17517 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:33.928260 17753 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:33.913880 17719 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.926994 17703 consensus_queue.cc:1059] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:07:33.944715 17839 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:33.959614 17834 log.cc:927] Time spent T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.224s	user 0.001s	sys 0.002s
W20260709 13:07:33.988197 17713 consensus_meta.cc:287] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.610s	user 0.009s	sys 0.002s
I20260709 13:07:33.988088 17680 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.988646 17713 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.989768 13707 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 14: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:33.990198 17680 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:33.990800 17214 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.991259 17713 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:33.992654 17488 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:33.992908 17214 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:33.993093 17719 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:33.993350 13861 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:07:33.978310 17792 consensus_queue.cc:1059] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:07:33.995100 17231 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.997411 17231 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:33.998857 17703 raft_consensus.cc:3055] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:33.999265 17703 raft_consensus.cc:740] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:34.000401 17703 consensus_queue.cc:260] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.002584 17488 raft_consensus.cc:3055] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:34.002997 17488 raft_consensus.cc:740] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:34.003208 17703 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.003803 17488 consensus_queue.cc:260] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:33.959040 17685 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.006260 17685 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:33.962558 17799 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:07:34.001794 17827 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:33.985107 17753 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:33.994524 17374 consensus_meta.cc:287] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.005s
I20260709 13:07:34.014235 17753 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:34.011188 17827 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:34.016223 17801 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:34.017716 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:34.020154 16946 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.027313 17808 raft_consensus.cc:3055] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:34.027880 17808 raft_consensus.cc:740] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:34.029695 13715 raft_consensus.cc:1240] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:34.031224 17838 raft_consensus.cc:3055] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:34.031698 17838 raft_consensus.cc:740] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:34.031797 17517 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:34.032600 17838 consensus_queue.cc:260] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.035396 17675 consensus_queue.cc:1059] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:34.039126 13716 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:34.028896 17808 consensus_queue.cc:260] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.040927 17795 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.052410 13830 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:07:34.041344 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.041765 14367 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:34.055809 17675 raft_consensus.cc:3055] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:34.056257 17675 raft_consensus.cc:740] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:34.040576 17751 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.057098 17675 consensus_queue.cc:260] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.058070 13788 raft_consensus.cc:2393] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 9: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
W20260709 13:07:33.971197 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 117744us
I20260709 13:07:34.058326 17675 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.058848 13680 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:34.059491 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:34.059620 17502 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:34.060204 13707 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 9: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:34.060135 17502 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:34.060763 17502 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.050640 17753 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:34.061589 13708 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:34.062513 13680 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:34.063301 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:34.053053 17799 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:34.060518 17795 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:34.045085 17762 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:34.047796 17748 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:34.065002 16946 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:34.069633 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:34.069891 16946 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:34.067183 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:34.051343 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 113421us
I20260709 13:07:34.072190 16946 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:34.073087 17838 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:34.075551 13829 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:34.043504 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 99070us
I20260709 13:07:34.077802 13680 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:34.085129 13709 raft_consensus.cc:1275] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:34.086093 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:34.089834 17719 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:34.090694 17854 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:34.091197 17854 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.091569 17854 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:34.067788 17815 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:34.084975 17827 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:34.096232 17827 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:34.068897 17799 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.101133 17827 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:34.101796 17799 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:34.061595 17753 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.104110 17753 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:34.108374 17794 consensus_queue.cc:1059] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:34.109530 17794 raft_consensus.cc:3055] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:34.109956 17794 raft_consensus.cc:740] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:34.108404 17374 consensus_queue.cc:1059] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:07:34.111229 13786 raft_consensus.cc:3055] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:34.111707 13786 raft_consensus.cc:740] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:34.112027 17374 raft_consensus.cc:3055] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:34.112490 17374 raft_consensus.cc:740] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:34.113641 17374 consensus_queue.cc:260] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:34.112412 13786 consensus_queue.cc:260] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.116415 13786 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:34.116004 17794 consensus_queue.cc:260] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.117633 17794 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:34.108666 17214 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:34.112506 17751 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:34.115268 17374 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.127456 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:34.135660 17721 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:34.136930 17762 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:34.137773 16697 consensus_queue.cc:1059] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:34.137624 17762 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.127406 13790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:07:34.139573 13790 raft_consensus.cc:606] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Received request to transfer leadership to TS ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:34.140035 13790 raft_consensus.cc:614] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:34.140780 17762 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:34.147135 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.143838 17808 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:34.145274 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:34.148206 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:34.148334 17469 raft_consensus.cc:3055] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:34.148977 14395 raft_consensus.cc:2393] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 9: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:34.111173 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:34.150066 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:34.150887 17795 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:34.148839 17469 raft_consensus.cc:740] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:07:34.155570 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 75635.4us
I20260709 13:07:34.178947 13756 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:34.117704 13861 raft_consensus.cc:1240] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:34.169507 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:34.170969 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 81469.3us
I20260709 13:07:34.180922 13862 raft_consensus.cc:2393] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 9: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:34.181030 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:34.185326 16946 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:34.186218 13680 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:07:34.189021 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 113582us
I20260709 13:07:34.187870 13756 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:34.190786 13829 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:34.195047 16946 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:34.199108 13756 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:34.200268 16697 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:34.197768 13757 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:34.187772 17324 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:34.203958 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:34.207943 13757 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:34.208191 14395 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:34.204497 16946 consensus_queue.cc:1059] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:34.204983 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:34.209038 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:34.210208 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:34.211606 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:34.211709 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:34.212481 13786 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:34.215556 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:34.214076 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:34.212769 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:34.216727 16946 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.217391 16946 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.208420 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:34.221097 13788 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:34.220469 13708 raft_consensus.cc:2368] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 10. Current term is 11.
I20260709 13:07:34.205366 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:34.223433 13680 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:34.198271 17795 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:34.229176 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:34.198618 17799 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.238988 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:34.233592 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.233747 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:34.202574 17150 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:34.235893 14402 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:34.243155 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:34.205142 17748 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:34.241289 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:07:34.226971 17592 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:07:34.243707 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:34.247882 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:34.286929 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:34.248935 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:34.239288 14395 raft_consensus.cc:2376] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9. Re-sending same reply.
I20260709 13:07:34.197171 17792 consensus_queue.cc:1048] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:07:34.187604 17786 consensus_queue.cc:1059] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:07:34.251210 14398 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.238145 17719 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:34.303464 17841 log.cc:927] Time spent T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:07:34.309047 17748 raft_consensus.cc:697] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:34.310117 17748 consensus_queue.cc:237] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:34.214525 17762 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:34.248204 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:34.261653 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:34.262462 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:34.327435 14402 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.263566 17488 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.218755 17469 consensus_queue.cc:260] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.195236 17753 consensus_queue.cc:1059] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:07:34.237965 17591 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:07:34.269155 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:34.269886 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:34.339671 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:34.340195 13783 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.270623 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:34.341692 14399 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.201498 17733 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:07:34.272922 17502 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:34.238401 17308 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:34.238262 17634 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:34.218503 17721 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
W20260709 13:07:34.277921 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.367798 17799 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.219831 17827 raft_consensus.cc:3055] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:34.368528 17827 raft_consensus.cc:740] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:34.369478 17827 consensus_queue.cc:260] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:34.370491 17827 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.371212 17502 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:34.373188 17753 raft_consensus.cc:3055] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:34.373579 17753 raft_consensus.cc:740] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:34.374359 17753 consensus_queue.cc:260] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.283782 17751 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.294358 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:34.359700 17634 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:34.376466 17753 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:34.376833 17634 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:34.301739 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:34.201630 17839 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:34.379532 13784 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:34.379626 17839 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.380151 17839 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:34.305131 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:34.323755 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:34.384897 13859 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:34.327911 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:34.336615 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:34.337652 13829 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:34.386299 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 48743.7us
I20260709 13:07:34.386837 17469 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:34.386925 13829 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:34.376847 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:34.389207 14396 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:07:34.300163 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:34.335090 16946 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:34.357033 14400 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:34.323869 17685 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.279280 17854 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:34.410920 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:34.368340 17799 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:34.283023 17815 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:34.279639 17150 raft_consensus.cc:697] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:34.416383 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:34.414597 17800 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:34.416836 17150 consensus_queue.cc:237] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.417514 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:34.418143 14396 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:07:34.418968 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:34.376017 17751 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.425225 17751 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:34.379122 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:34.432507 13858 raft_consensus.cc:2368] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 5. Current term is 6.
I20260709 13:07:34.396906 13783 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:07:34.354791 14397 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:34.393829 14402 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:34.404019 14398 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:07:34.338558 17719 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:34.366537 17680 raft_consensus.cc:3055] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:34.417431 17800 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.438297 14399 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:07:34.439730 13682 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:34.437047 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:34.404019 13829 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:34.441123 14401 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:07:34.466095 14400 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:34.411124 17786 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:34.469116 14394 raft_consensus.cc:2410] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:07:34.466548 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:34.467031 13716 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:34.467263 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 63366.2us
I20260709 13:07:34.472354 13829 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:34.474856 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:34.476359 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:34.489706 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:34.493023 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 53349.6us
I20260709 13:07:34.460256 17800 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.460783 17680 raft_consensus.cc:740] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:34.412887 17685 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:34.466364 17815 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:34.474409 17746 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:34.431222 17839 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:34.485144 17792 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:34.510780 14393 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 13:07:34.511080 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 49738.3us
I20260709 13:07:34.492712 17354 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.499838 17786 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:34.518747 13707 raft_consensus.cc:1275] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:34.520332 13680 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:34.480439 17517 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:07:34.523721 13790 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 6: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:34.501596 17324 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:34.484963 17853 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 13:07:34.523162 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.526036 13680 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:34.511404 17689 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:34.533689 13682 leader_election.cc:400] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 5. Current term is 6.
I20260709 13:07:34.534174 13682 leader_election.cc:403] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:07:34.536954 17850 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:34.537380 17363 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:34.537922 17363 raft_consensus.cc:697] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:34.537792 13680 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:34.539855 17848 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.540551 17848 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.544384 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:34.544906 13783 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:34.545972 13756 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:34.547660 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:34.547904 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:34.548552 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:34.548998 13709 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:07:34.549441 13709 pending_rounds.cc:85] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 6
I20260709 13:07:34.549702 13709 pending_rounds.cc:107] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:07:34.549964 13709 raft_consensus.cc:2889] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:34.527406 17786 raft_consensus.cc:697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:34.552645 17786 consensus_queue.cc:237] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.556603 17839 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:34.557751 17799 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:34.558223 17685 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:34.558755 17854 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:34.522051 17354 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:34.561563 17680 consensus_queue.cc:260] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.538910 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:34.526700 17746 consensus_queue.cc:1048] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:07:34.567340 17827 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:34.567953 17827 raft_consensus.cc:697] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:34.568876 17827 consensus_queue.cc:237] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.571600 17721 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:34.572192 17721 raft_consensus.cc:697] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:34.572604 17762 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:34.572750 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:34.573386 13715 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:07:34.573093 17721 consensus_queue.cc:237] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.573945 13756 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:34.575716 17680 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.578298 17839 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:34.578500 13864 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:07:34.525342 17733 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:34.579334 13756 leader_election.cc:400] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 10. Current term is 11.
I20260709 13:07:34.571619 13680 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:34.599431 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:34.566311 17850 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 5. Current term is 6.
I20260709 13:07:34.581763 17363 consensus_queue.cc:237] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.511925 17815 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.583891 17811 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.618821 13756 leader_election.cc:403] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:07:34.586830 17868 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:07:34.588344 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:34.525821 17324 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:34.581243 13707 raft_consensus.cc:1275] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:34.604372 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:34.623028 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 43818.3us
I20260709 13:07:34.611766 13786 raft_consensus.cc:1240] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:34.613683 13680 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:34.614925 17733 raft_consensus.cc:697] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:34.617748 17815 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:34.585134 13830 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:34.629899 13856 raft_consensus.cc:1240] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:34.630025 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 410095us
I20260709 13:07:34.609027 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:34.621537 13709 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
I20260709 13:07:34.616983 17634 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.620728 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:34.651105 13716 raft_consensus.cc:2393] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 11: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:34.596665 17848 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:34.630270 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 45227.4us
I20260709 13:07:34.614936 17698 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:34.624955 17324 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.715688 13757 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:34.646523 17591 consensus_queue.cc:1059] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:34.648993 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:34.649219 13714 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:07:34.628481 17839 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 10. Current term is 11.
I20260709 13:07:34.668490 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:34.627450 17794 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 13:07:34.691525 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.698037 17231 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:34.701123 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 211457us
I20260709 13:07:34.755472 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:34.705456 13708 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:34.621708 17811 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.706408 13756 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:34.708611 17634 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:34.601243 17809 consensus_queue.cc:1059] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:07:34.772090 17809 raft_consensus.cc:3055] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:34.772534 17809 raft_consensus.cc:740] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:34.710860 13830 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:07:34.773666 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 62877us
I20260709 13:07:34.637907 17748 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:34.775717 17748 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.776219 17748 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:34.776791 13864 raft_consensus.cc:1275] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:34.781980 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:34.783008 13864 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 6: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:34.767336 13829 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:34.785027 17511 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:34.785619 17511 raft_consensus.cc:697] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:34.788422 13829 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:34.773754 17753 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:34.789484 17753 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.789971 17753 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.791710 17517 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:34.786703 17511 consensus_queue.cc:237] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.798640 17809 consensus_queue.cc:260] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.800480 17809 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.757997 17698 raft_consensus.cc:697] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:34.814683 13829 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:34.820744 17517 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:34.824333 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.855379 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:34.856673 13829 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:34.857733 13829 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:34.858589 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 152292us
I20260709 13:07:34.860720 13756 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:34.866866 13787 raft_consensus.cc:1275] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:34.869796 13829 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:34.809298 17698 consensus_queue.cc:237] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:34.754362 17848 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.873713 14401 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:34.844859 17488 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:34.876495 17689 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:34.933456 14398 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:34.865661 17792 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.871516 17517 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:34.914065 13786 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:34.919806 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:07:34.922870 13602 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.740s	user 0.006s	sys 0.027s
I20260709 13:07:34.871270 17308 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:34.925711 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 65010.9us
W20260709 13:07:34.942034 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.924335 17751 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:34.911721 17721 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:34.934743 17786 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:34.939857 17517 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:34.871999 17733 consensus_queue.cc:237] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:35.022265 13713 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:07:35.041576 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 138411us
I20260709 13:07:34.944511 17810 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:07:34.955461 17815 consensus_queue.cc:1059] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:07:35.019891 17000 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 13:07:35.028398 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 52990us
I20260709 13:07:35.018930 17517 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:35.007089 17794 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:07:35.139573 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 194069us
I20260709 13:07:35.110049 17004 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.018391 17721 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:35.153554 14399 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.000s	sys 0.014s
W20260709 13:07:35.174593 14399 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.000s	sys 0.014s
I20260709 13:07:35.178951 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:35.143054 17794 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:35.188884 17849 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.251371 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:35.251739 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:35.254230 13789 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
W20260709 13:07:35.177032 17827 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.000s	sys 0.014s
W20260709 13:07:35.239995 17876 log.cc:927] Time spent T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
W20260709 13:07:35.271993 17885 log.cc:927] Time spent T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:07:35.272317 17838 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:35.273027 17838 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:35.274102 17849 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:35.276625 17849 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:35.277328 17354 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:35.190016 17308 consensus_queue.cc:1048] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:07:35.252606 17811 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:35.279762 17874 log.cc:927] Time spent T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.349s	user 0.001s	sys 0.000s
I20260709 13:07:35.275202 17838 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:35.285398 17869 log.cc:927] Time spent T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.358s	user 0.001s	sys 0.000s
I20260709 13:07:35.295111 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:35.191682 17004 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:35.298148 14395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.002s	sys 0.007s
W20260709 13:07:35.281536 17827 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.001s	sys 0.014s
I20260709 13:07:35.299222 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1831) took 1085 ms. Trace:
I20260709 13:07:35.249754 17897 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:35.300890 14366 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:07:35.302186 14395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.003s	sys 0.007s
I20260709 13:07:35.302188 13713 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
W20260709 13:07:35.337250 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 95880.7us
I20260709 13:07:35.338430 14367 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:35.306123 13782 rpcz_store.cc:276] 0709 13:07:34.213429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.213560 (+   131us) service_pool.cc:224] Handling call
0709 13:07:34.234070 (+ 20510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.368741 (+134671us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:34.551328 (+182587us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.916489 (+365161us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:34.916928 (+   439us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:34.917942 (+  1014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.298962 (+381020us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54003bd154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:35.299026 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.299163 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9566,"prepare.queue_time_us":285402,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":81275,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":22721,"spinlock_wait_cycles":309191552,"thread_start_us":490092,"threads_started":2,"wal-append.queue_time_us":472420}
W20260709 13:07:35.339941 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 96113.6us
I20260709 13:07:35.338039 17897 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:35.347285 17888 log.cc:927] Time spent T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
W20260709 13:07:35.348639 17872 log.cc:927] Time spent T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
W20260709 13:07:35.311874 17753 consensus_meta.cc:287] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.521s	user 0.003s	sys 0.011s
W20260709 13:07:35.355010 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 54230.6us
I20260709 13:07:35.364974 17004 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:35.357342 17469 consensus_meta.cc:287] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.967s	user 0.012s	sys 0.000s
I20260709 13:07:35.303046 17150 consensus_queue.cc:1048] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:07:35.370134 13756 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:35.357695 17748 consensus_meta.cc:287] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.581s	user 0.012s	sys 0.002s
I20260709 13:07:35.357712 17815 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.384052 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:35.384478 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:35.385066 13716 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:07:35.386217 13756 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:35.379634 17721 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:35.387390 17469 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:35.388027 17809 consensus_meta.cc:287] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.587s	user 0.014s	sys 0.000s
W20260709 13:07:35.388417 17894 log.cc:927] Time spent T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:07:35.388666 17809 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:35.388733 17794 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:35.389672 17794 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:35.390127 17794 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.360616 17753 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:35.392496 17753 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:35.393316 17748 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:35.395514 13856 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:35.396026 17902 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:35.396714 13708 raft_consensus.cc:2393] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 9: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:35.397210 17902 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:35.390558 17794 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:35.398831 17680 consensus_meta.cc:287] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.798s	user 0.004s	sys 0.005s
I20260709 13:07:35.402215 13713 raft_consensus.cc:1240] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:35.403494 17469 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:35.403939 17469 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.404322 17469 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:35.362515 17746 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:35.404959 17746 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:35.405988 14395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 873) took 1081 ms. Trace:
I20260709 13:07:35.407027 17746 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:35.407976 17904 log.cc:927] Time spent T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:07:35.415318 17892 log.cc:927] Time spent T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:07:35.406414 14395 rpcz_store.cc:276] 0709 13:07:34.324733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.428141 (+103408us) service_pool.cc:224] Handling call
0709 13:07:34.428454 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:34.428802 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:34.652058 (+223256us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.354961 (+702903us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:35.355383 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 13:07:35.355541 (+   158us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:35.355571 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.355633 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.405775 (+ 50142us) raft_consensus.cc:1685] finished
0709 13:07:35.405794 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.405932 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23122,"prepare.queue_time_us":509050,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":6053,"raft.queue_time_us":62460,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":4851,"thread_start_us":848905,"threads_started":2,"wal-append.queue_time_us":693526}
W20260709 13:07:35.422776 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:35.415190 17891 log.cc:927] Time spent T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
W20260709 13:07:35.415458 17890 log.cc:927] Time spent T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:07:35.429229 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:35.429898 17800 consensus_meta.cc:287] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.920s	user 0.011s	sys 0.000s
I20260709 13:07:35.430334 17800 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:35.408056 17517 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:35.432770 17850 raft_consensus.cc:3055] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:35.441118 17850 raft_consensus.cc:740] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:35.442015 17850 consensus_queue.cc:260] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:35.442962 17850 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:35.435920 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 867) took 1196 ms. Trace:
I20260709 13:07:35.440435 17902 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:35.431989 13859 raft_consensus.cc:2368] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 8. Current term is 9.
I20260709 13:07:35.443945 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2392) took 1201 ms. Trace:
I20260709 13:07:35.443691 14393 rpcz_store.cc:276] 0709 13:07:34.239903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.240087 (+   184us) service_pool.cc:224] Handling call
0709 13:07:34.510180 (+270093us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:34.515065 (+  4885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.435645 (+920580us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b54005942d0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:35.435808 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620307328}
I20260709 13:07:35.444345 13785 rpcz_store.cc:276] 0709 13:07:34.242143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.242657 (+   514us) service_pool.cc:224] Handling call
0709 13:07:35.443737 (+1201080us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b54001b62d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:35.443891 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1161962880}
I20260709 13:07:35.445214 13859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 2234) took 1035 ms. Trace:
I20260709 13:07:35.445819 13859 rpcz_store.cc:276] 0709 13:07:34.413568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.413786 (+   218us) service_pool.cc:224] Handling call
0709 13:07:35.444962 (+1031176us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b5400300cd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:35.445137 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2211872000}
I20260709 13:07:35.450317 13863 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:35.417388 17838 consensus_queue.cc:1059] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:07:35.453689 17838 consensus_queue.cc:1243] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer b9d194f45e044e0988d5de1a99e5cd02 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:35.454262 17838 raft_consensus.cc:3055] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:35.454617 17838 raft_consensus.cc:740] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:35.469877 17897 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:35.471993 17675 raft_consensus.cc:3055] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:35.472501 17675 raft_consensus.cc:740] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:35.413790 17815 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:35.473399 17675 consensus_queue.cc:260] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:35.475265 17815 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:35.483283 13784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2397) took 1199 ms. Trace:
I20260709 13:07:35.483482 17748 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:35.483757 13784 rpcz_store.cc:276] 0709 13:07:34.284028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.381280 (+ 97252us) service_pool.cc:224] Handling call
0709 13:07:34.381548 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:34.434504 (+ 52956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:34.434531 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:34.593478 (+158947us) spinlock_profiling.cc:243] Waited 6.21 ms on lock 0x7b2c000108d8. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5230dd7a11 00007f5230de7372 00007f5232519a01 00007f52324de43a 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2
0709 13:07:34.597288 (+  3810us) log.cc:844] Serialized 26 byte log entry
0709 13:07:34.765766 (+168478us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:34.765800 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.482958 (+717158us) spinlock_profiling.cc:243] Waited 52.6 ms on lock 0x7b54002ebb54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:35.483010 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.483058 (+    48us) raft_consensus.cc:1685] finished
0709 13:07:35.483073 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.483222 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":325,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":26801,"spinlock_wait_cycles":135376000,"thread_start_us":150040,"threads_started":1,"wal-append.queue_time_us":343830}
I20260709 13:07:35.487272 17469 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:35.489878 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:35.490243 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:35.490671 13791 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 6: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:35.491549 13783 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:35.491743 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:35.495553 17838 consensus_queue.cc:260] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:35.496491 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:35.497032 17838 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:35.500226 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:35.500645 17800 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:35.501587 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:35.503533 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:35.504333 13863 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 8: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:35.506143 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:35.510231 14395 raft_consensus.cc:1240] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:35.511178 13785 raft_consensus.cc:1275] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:07:35.515112 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 176763us
I20260709 13:07:35.519604 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:35.510852 17324 consensus_meta.cc:287] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.745s	user 0.009s	sys 0.002s
I20260709 13:07:35.537276 13788 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 8: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:35.542760 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:35.543190 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:35.543963 13786 raft_consensus.cc:2410] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:35.544670 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:35.535075 13680 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:35.551103 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:35.551678 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.552090 13789 raft_consensus.cc:2393] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 11: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:35.532941 17758 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.567696 17758 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:35.568370 13755 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:35.569953 17758 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:35.571900 17910 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:35.577520 17469 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:35.578183 17517 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:35.554472 17231 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:35.581192 17813 consensus_queue.cc:1059] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:35.582316 17813 raft_consensus.cc:3055] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:35.582744 17813 raft_consensus.cc:740] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:35.585460 13716 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:35.579161 17231 raft_consensus.cc:697] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:35.588454 17231 consensus_queue.cc:237] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:35.590852 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:35.559739 13782 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:35.597121 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:35.553016 17795 consensus_queue.cc:1048] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:07:35.558185 17897 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.603097 13789 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:35.603605 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:35.555003 17324 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:35.608314 13708 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:35.566474 17004 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.609700 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:07:35.537922 17882 log.cc:927] Time spent T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.495s	user 0.001s	sys 0.002s
I20260709 13:07:35.599761 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:35.612082 13682 leader_election.cc:400] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 8. Current term is 9.
I20260709 13:07:35.613106 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:35.601143 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:35.602515 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.602600 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:35.604281 13790 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.616966 13830 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:35.598810 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:35.606699 14394 raft_consensus.cc:1275] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:35.607234 14401 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:35.607486 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:35.608135 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:35.604574 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:35.609725 17004 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:35.613677 13715 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:35.557521 17721 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:35.628834 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:35.606489 17851 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:35.633466 13790 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:35.633872 14394 raft_consensus.cc:2410] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:35.602063 17906 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.631402 17908 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:35.634305 17748 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:35.602259 17905 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:35.621106 17634 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:35.625125 17854 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:07:35.646324 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 290266us
I20260709 13:07:35.659314 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:35.661089 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:35.661458 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.664909 14394 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:35.666041 13715 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:35.609788 17794 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:35.639778 17851 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.657820 16946 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:35.672164 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:35.669209 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:35.673156 14394 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:35.674398 13790 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:07:35.675020 14396 raft_consensus.cc:2393] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 8: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:35.610927 17897 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:35.678728 14366 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:35.677094 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:35.629834 17813 consensus_queue.cc:260] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:35.676733 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:35.688385 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.692237 13784 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:35.645475 17908 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:35.639178 17721 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:35.696947 14398 raft_consensus.cc:2368] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10.
W20260709 13:07:35.696825 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 65873.3us
I20260709 13:07:35.684449 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:35.699014 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:35.702385 14399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1106) took 1094 ms. Trace:
I20260709 13:07:35.704182 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:35.704885 13863 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 8: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:35.677525 17851 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:35.680958 17751 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.714859 16946 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.725440 16946 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:35.676579 17748 raft_consensus.cc:697] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:35.715842 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:35.671659 17363 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:07:35.670341 17854 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:35.656654 17905 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:35.685253 17848 consensus_meta.cc:287] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.751s	user 0.011s	sys 0.000s
I20260709 13:07:35.727859 14398 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:07:35.716131 13755 leader_election.cc:400] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10.
I20260709 13:07:35.730281 17511 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:35.645288 17906 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:35.779870 17721 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:35.782084 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.784893 17912 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:35.785410 17912 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:35.786147 13783 raft_consensus.cc:1275] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:07:35.786538 13783 pending_rounds.cc:85] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 9
I20260709 13:07:35.786743 13783 pending_rounds.cc:107] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:07:35.786965 13783 raft_consensus.cc:2889] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:35.787586 17854 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:35.787853 17912 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:35.578997 13602 maintenance_manager.cc:643] P a8849f59e7a642f3b694e3e403857ae7: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 8.116s	user 0.190s	sys 0.084s Metrics: {"bytes_written":30147,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":43762,"dirs.run_cpu_time_us":321,"dirs.run_wall_time_us":2123,"drs_written":1,"lbm_read_time_us":444,"lbm_reads_lt_1ms":4,"lbm_write_time_us":150016,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":7,"lbm_writes_lt_1ms":26,"peak_mem_usage":0,"raft.queue_time_us":326169,"raft.run_cpu_time_us":41847,"raft.run_wall_time_us":165551,"reinsert_count":0,"rows_written":63,"spinlock_wait_cycles":13052288,"thread_start_us":368494,"threads_started":3,"update_count":14,"wal-append.queue_time_us":574467}
I20260709 13:07:35.673864 17808 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:35.741297 13755 leader_election.cc:403] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:35.745744 17748 consensus_queue.cc:237] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:35.799476 17591 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.800182 17591 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:35.802644 17591 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:35.748538 17908 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:35.749691 17875 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:35.751547 17897 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:35.752502 17517 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:35.805058 17517 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:35.806257 17906 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:35.754737 13680 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:07:35.807758 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 53127.9us
I20260709 13:07:35.764458 17794 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:35.807081 17517 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:35.814730 16946 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:35.764679 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:35.727984 17751 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:35.720724 17827 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:35.767285 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:35.720323 17900 consensus_queue.cc:1059] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:07:35.770409 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:35.770430 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:35.854229 13715 raft_consensus.cc:2393] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 15: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:35.771664 17511 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:35.773406 17675 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:35.798763 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 82757.2us
I20260709 13:07:35.799265 17469 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:35.792028 17848 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:35.902647 13789 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:35.806384 17813 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:35.760051 17004 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:35.763310 17905 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:35.852779 17808 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:35.819835 13707 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:07:35.899237 13603 maintenance_manager.cc:419] P a8849f59e7a642f3b694e3e403857ae7: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10638 bytes on disk
I20260709 13:07:35.906131 17905 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.815389 16946 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:35.929338 16946 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.929719 16946 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:35.915242 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 236589us
W20260709 13:07:35.917114 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 48831.4us
I20260709 13:07:35.917933 14367 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:07:35.884425 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 253242us
I20260709 13:07:35.925241 16697 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:35.935222 16697 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:35.933452 14366 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:35.944469 14398 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:35.702759 14399 rpcz_store.cc:276] 0709 13:07:34.607511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.610380 (+  2869us) service_pool.cc:224] Handling call
0709 13:07:34.617299 (+  6919us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.617535 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:35.249968 (+632433us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.671379 (+421411us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.701223 (+ 29844us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:35.701270 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:35.701311 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.701380 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.702320 (+   940us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50445,"prepare.queue_time_us":636425,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":90,"raft.queue_time_us":52937,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":60,"thread_start_us":937756,"threads_started":3,"wal-append.queue_time_us":267475}
I20260709 13:07:35.908074 17808 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:35.954702 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:36.029856 14396 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:35.956370 17004 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.031013 17004 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:35.991119 17308 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.987870 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:35.989013 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:35.989357 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:36.041342 13783 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:07:35.924827 17897 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:35.992169 13757 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:35.925011 17848 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.995488 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:35.995911 16697 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:35.953708 17907 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:36.003746 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:35.984932 17748 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:07:36.008006 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:36.008762 16946 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:36.010462 13602 maintenance_manager.cc:643] P a8849f59e7a642f3b694e3e403857ae7: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.034s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":441,"lbm_reads_lt_1ms":4}
I20260709 13:07:36.027489 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:36.022418 17811 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:36.037189 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 103861us
I20260709 13:07:35.967549 13830 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:36.041256 13785 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:35.990149 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:36.050227 16697 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:36.050406 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 58399.9us
I20260709 13:07:35.952762 17905 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:35.930066 17900 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:35.999821 17517 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:36.010664 17875 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.101074 14366 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:36.056192 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 343501us
I20260709 13:07:36.043504 17758 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:36.096292 16946 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:36.106248 13829 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:36.042848 17808 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:36.049706 17899 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:36.046141 17897 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:36.055648 17907 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:36.098266 17890 log.cc:927] Time spent T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:07:36.121171 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 153761us
I20260709 13:07:36.122627 13829 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:36.009891 17929 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 13:07:36.051755 17848 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:36.132604 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.104277 17893 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:07:36.143529 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:36.144047 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:36.134370 17932 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:07:36.135990 17936 log.cc:927] Time spent T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:07:36.127884 17899 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:36.127456 17897 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:36.132771 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:36.358791 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:36.359480 13863 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:07:36.360436 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:36.361477 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:36.362512 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:36.364013 17925 log.cc:927] Time spent T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:07:36.364967 17848 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:36.143332 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:36.047253 17308 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:36.368853 13862 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:07:36.370115 13862 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:07:36.370447 13862 pending_rounds.cc:85] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 10
I20260709 13:07:36.370661 13862 pending_rounds.cc:107] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:07:36.370872 13862 raft_consensus.cc:2889] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:36.353153 17923 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:07:36.379969 17324 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:36.381856 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 881) took 1450 ms. Trace:
I20260709 13:07:36.382274 14402 rpcz_store.cc:276] 0709 13:07:34.931484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.932310 (+   826us) service_pool.cc:224] Handling call
0709 13:07:34.932702 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.115810 (+183108us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:35.163613 (+ 47803us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.500254 (+336641us) spinlock_profiling.cc:243] Waited 5.54 ms on lock 0x7b18003ce8c0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e23a 00007f52324e8a2a
0709 13:07:35.662874 (+162620us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:35.670879 (+  8005us) log.cc:844] Serialized 26 byte log entry
0709 13:07:35.671023 (+   144us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:35.671055 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.671138 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.381521 (+710383us) raft_consensus.cc:1685] finished
0709 13:07:36.381629 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.381780 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8282,"prepare.queue_time_us":218894,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":4822,"raft.queue_time_us":30555,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":29787,"spinlock_wait_cycles":12744448,"thread_start_us":282024,"threads_started":2,"wal-append.queue_time_us":659811}
I20260709 13:07:36.388043 17912 raft_consensus.cc:3055] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:36.388603 17912 raft_consensus.cc:740] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:36.389609 17912 consensus_queue.cc:260] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:36.371232 17004 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:36.370119 17308 leader_election.cc:290] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:36.364995 17899 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:36.402374 17751 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:36.403692 17469 consensus_meta.cc:287] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.000s
I20260709 13:07:36.404139 17469 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10.
I20260709 13:07:36.291041 17748 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:36.405660 17748 raft_consensus.cc:697] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:36.406538 17748 consensus_queue.cc:237] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:36.115697 17875 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:36.411787 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:36.412346 13864 raft_consensus.cc:1275] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:36.413017 14366 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:36.413525 17875 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:36.415284 17916 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:36.415570 17713 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.415786 17916 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.416240 17916 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.416139 17713 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:36.304275 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 199421us
I20260709 13:07:36.118925 17758 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:36.420586 13757 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:36.265039 16697 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:36.421722 17758 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:36.419709 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:36.124452 17930 consensus_queue.cc:1048] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.178s
I20260709 13:07:36.421957 16697 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:36.422596 13715 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:36.110468 17517 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:36.258785 13858 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:07:36.131088 17907 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:36.296094 14368 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:36.118641 17753 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.143s
I20260709 13:07:36.139361 17929 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.128456 17853 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:36.107481 17900 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:36.127784 17810 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:36.119056 17908 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:36.098500 17811 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:36.124310 17854 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:07:36.213456 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 90926.9us
I20260709 13:07:36.289356 17808 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:36.141072 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:36.347666 17838 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.501852 13865 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
W20260709 13:07:36.353125 17938 log.cc:927] Time spent T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:07:36.353961 17905 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:36.406967 13707 raft_consensus.cc:1240] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:36.440387 17813 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:36.411229 13787 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:07:36.472128 13862 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:36.471946 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:36.484160 17758 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:36.472575 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 59650.3us
W20260709 13:07:36.474422 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 54037.2us
I20260709 13:07:36.530045 13790 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:36.474594 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:36.475615 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:36.476548 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:36.531121 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:36.475194 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:36.531733 14396 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:07:36.478237 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:36.533241 13714 raft_consensus.cc:2393] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 16: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:36.481804 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:36.426082 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.483799 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:36.483856 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:36.486312 13785 raft_consensus.cc:1240] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:36.488016 16697 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:36.489632 13786 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:07:36.536195 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:36.492216 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 196248us
I20260709 13:07:36.494022 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:36.537262 13783 raft_consensus.cc:2393] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 8: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:36.537642 13715 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
W20260709 13:07:36.459388 17851 consensus_meta.cc:287] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.746s	user 0.010s	sys 0.000s
I20260709 13:07:36.508342 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:36.543895 13859 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:36.512933 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:36.426590 17517 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:36.524349 13863 raft_consensus.cc:2393] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 13: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:36.491729 17912 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:36.552862 17897 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:36.539613 17930 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.537654 17231 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:36.555634 17851 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:36.555799 17930 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:36.557909 17851 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:36.533768 14395 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:07:36.498080 17921 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:36.532301 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:36.531687 14393 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:07:36.559113 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:36.561983 13862 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:36.540946 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:36.292830 13789 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:07:36.563390 13829 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:36.562340 13716 raft_consensus.cc:2393] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 10: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:36.421559 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:36.536834 13710 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:36.528520 14366 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:36.545977 14396 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:36.570577 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:36.517488 17511 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:36.584609 13859 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:36.516310 17810 raft_consensus.cc:697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:36.572934 17004 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.574332 13757 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:36.587212 17004 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:36.610824 13680 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:36.544926 17713 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:36.517107 17808 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:36.518303 17838 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:36.515627 17854 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:36.571919 17792 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:36.491035 17929 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:36.626530 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:36.577934 17902 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.578173 17921 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:36.537317 17899 consensus_queue.cc:1059] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:07:36.544866 17758 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:36.555857 17231 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:36.642882 17004 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:36.645862 13786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 1849) took 1046 ms. Trace:
I20260709 13:07:36.647687 14366 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:36.655125 13784 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
W20260709 13:07:36.654675 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 171689us
I20260709 13:07:36.621745 17721 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:36.577852 17517 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:07:36.576327 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:36.685746 13786 rpcz_store.cc:276] 0709 13:07:35.599071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.601618 (+  2547us) service_pool.cc:224] Handling call
0709 13:07:36.645673 (+1044055us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54000b2554. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:36.645795 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1713318656}
I20260709 13:07:36.684815 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:36.578045 17746 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:07:36.692495 13857 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:07:36.697808 13857 pending_rounds.cc:85] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 7
I20260709 13:07:36.698251 13857 pending_rounds.cc:107] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:07:36.698603 13857 raft_consensus.cc:2889] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:36.700124 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:36.643567 17921 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:36.716033 17926 log.cc:927] Time spent T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:07:36.723739 17940 log.cc:927] Time spent T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:07:36.725091 13788 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:36.625084 17852 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.115s
I20260709 13:07:36.472319 17932 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:36.737210 14394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1121) took 1023 ms. Trace:
I20260709 13:07:36.649706 17902 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:36.694489 17721 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.742218 14394 rpcz_store.cc:276] 0709 13:07:35.714132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.716261 (+  2129us) service_pool.cc:224] Handling call
0709 13:07:35.716591 (+   330us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:36.044054 (+327463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.044099 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:36.052662 (+  8563us) log.cc:844] Serialized 52 byte log entry
0709 13:07:36.288953 (+236291us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:36.316476 (+ 27523us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.316761 (+   285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.316870 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.360469 (+ 43599us) spinlock_profiling.cc:243] Waited 6.93 ms on lock 0x7b1800365d40. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f1522 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
0709 13:07:36.723987 (+363518us) raft_consensus.cc:1685] finished
0709 13:07:36.736951 (+ 12964us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.737136 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27261,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":32646,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":28259,"spinlock_wait_cycles":15929088,"thread_start_us":476440,"threads_started":2,"wal-append.queue_time_us":608835}
I20260709 13:07:36.699038 17908 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:36.712908 17931 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
W20260709 13:07:36.713982 17675 consensus_meta.cc:287] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.793s	user 0.005s	sys 0.008s
I20260709 13:07:36.728446 17921 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:36.774648 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:36.822602 13756 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:36.823081 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:36.825330 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:36.828224 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:36.829912 14398 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:07:36.830507 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:36.833889 13713 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:07:36.832834 14367 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:36.775100 17721 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:36.823911 13858 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:36.851347 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:36.851384 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:36.851563 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:36.852464 13713 raft_consensus.cc:2393] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 11: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:36.864172 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:36.869086 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 46560.9us
I20260709 13:07:36.870771 13756 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:36.725618 17810 consensus_queue.cc:237] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:36.804633 17908 raft_consensus.cc:697] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:36.842212 17680 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:36.838622 17838 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:36.898028 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:36.853782 17893 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:36.902746 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:36.896245 16946 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:36.910830 16946 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:36.862423 17758 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:36.878181 17897 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:36.936612 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:36.907401 17927 log.cc:927] Time spent T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:07:36.886653 17943 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:36.909376 17893 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.907783 17839 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.964352 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:36.965190 13858 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 5.
I20260709 13:07:36.933825 17680 raft_consensus.cc:697] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:36.941116 17469 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:36.975697 17231 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:36.945493 17758 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:36.976296 17758 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.969676 17839 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:36.963093 17893 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.976712 17758 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:36.962503 17947 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 13:07:36.978225 17839 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:36.975991 17908 consensus_queue.cc:237] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:36.952836 17943 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.969329 17852 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.989109 17852 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:36.991151 17852 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:36.915943 17930 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:36.979444 17932 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:36.986755 17943 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:37.024224 17905 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:37.029863 17905 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:37.027460 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 330014us
I20260709 13:07:37.019347 17838 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.062000 13682 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:37.065493 13865 raft_consensus.cc:1240] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:37.074198 13682 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:37.074839 17902 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:37.086158 17953 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:07:37.087738 17961 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.088388 17961 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.090919 17961 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:37.093842 17912 consensus_meta.cc:287] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.000s
I20260709 13:07:37.066363 17854 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:37.111090 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 240386us
I20260709 13:07:37.119184 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:37.131795 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:37.140157 13710 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:07:37.141883 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:37.097492 17751 raft_consensus.cc:3055] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:37.075978 17960 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:37.073380 17838 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.143677 13756 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:37.150449 13789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 902) took 1163 ms. Trace:
I20260709 13:07:37.150890 13789 rpcz_store.cc:276] 0709 13:07:35.987371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.987525 (+   154us) service_pool.cc:224] Handling call
0709 13:07:37.150284 (+1162759us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54002f9754. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:37.150389 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578567040}
I20260709 13:07:37.108299 17897 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:37.153820 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:37.106912 17957 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:37.108836 17851 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:07:37.155947 13680 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.001s	sys 0.021s
I20260709 13:07:37.158020 14402 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.071214 17680 consensus_queue.cc:237] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.158226 13708 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:37.139019 17961 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:37.138805 17675 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:37.100544 17721 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:37.143599 17902 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:37.143458 17751 raft_consensus.cc:740] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:37.145583 17905 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:37.111704 17852 consensus_queue.cc:1048] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:07:37.112373 17912 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:37.108181 17231 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:07:37.155310 17910 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:37.178997 14402 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:37.167351 17957 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:07:37.167160 13680 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.002s	sys 0.022s
I20260709 13:07:37.165540 17324 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.162256 17897 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:37.181165 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 563001us
W20260709 13:07:37.176952 17948 log.cc:927] Time spent T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:07:37.165052 17851 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.174816 17675 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.174626 17902 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:37.180370 17910 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.169903 17961 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.219163 17810 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:37.213884 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:37.190382 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:37.189738 17897 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:37.227736 17949 log.cc:927] Time spent T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:07:37.182701 17957 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.212535 17838 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:37.226765 17967 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:37.229718 13715 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:07:37.208905 17721 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:37.215346 17916 consensus_meta.cc:287] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.798s	user 0.002s	sys 0.009s
I20260709 13:07:37.184278 17324 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.180687 17912 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.200106 17758 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.216092 17960 consensus_queue.cc:1059] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:07:37.218864 17899 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.239284 13756 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:37.240231 17945 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:37.225906 17910 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:37.244535 17675 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:37.251034 17808 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:37.244516 17916 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.267546 17899 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:37.268177 17592 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:37.277216 17592 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.277616 17592 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:37.257197 17961 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:37.241145 17967 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:37.311633 13757 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:37.300982 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2241) took 1166 ms. Trace:
I20260709 13:07:37.220293 17751 consensus_queue.cc:260] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:37.300585 13755 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:37.290860 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2240) took 1157 ms. Trace:
I20260709 13:07:37.372603 13861 rpcz_store.cc:276] 0709 13:07:36.133874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.134021 (+   147us) service_pool.cc:224] Handling call
0709 13:07:36.134299 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.684659 (+550360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.684690 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:36.684732 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:36.684769 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.290627 (+605858us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b54000d11d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:37.290680 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.290801 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1265214208}
I20260709 13:07:37.375597 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:37.376006 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:37.235157 17810 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.262107 17957 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:37.268774 17945 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.271944 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:37.403020 17150 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:37.288725 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:37.332532 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:37.412364 13788 raft_consensus.cc:2393] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 11: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:37.412524 17945 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:37.326139 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:37.292838 13830 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:37.332854 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:37.419608 13791 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:07:37.323140 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:37.315863 17852 raft_consensus.cc:3055] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:37.293833 16946 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:37.353482 14366 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:37.253924 17893 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:37.366464 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 178240us
I20260709 13:07:37.435007 17852 raft_consensus.cc:740] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:37.460609 13680 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:37.461637 17374 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:37.461400 17852 consensus_queue.cc:260] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:37.462090 17374 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:37.294320 17916 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:37.462714 13680 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:37.463243 17916 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:37.463789 17916 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.377357 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:37.465027 17721 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:37.465682 17231 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:37.465838 17916 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:37.466174 17231 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:37.466657 17231 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.467075 17945 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:37.467471 17945 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:37.467797 17945 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.468570 13856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 883) took 1212 ms. Trace:
I20260709 13:07:37.468971 13856 rpcz_store.cc:276] 0709 13:07:36.256600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.286335 (+ 29735us) service_pool.cc:224] Handling call
0709 13:07:36.286694 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.286954 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:36.437571 (+150617us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.467987 (+1030416us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b1800341bc0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f52320864bc 00007f522f3d448b 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e23a
0709 13:07:37.468195 (+   208us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:37.468246 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:37.468300 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.468395 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.468512 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":150234,"prepare.queue_time_us":229565,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":77,"spinlock_wait_cycles":26592640,"thread_start_us":139271,"threads_started":1,"wal-append.queue_time_us":508825}
I20260709 13:07:37.472394 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:37.314051 17748 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:37.475399 13756 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:37.363726 13860 rpcz_store.cc:276] 0709 13:07:36.137782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.137902 (+   120us) service_pool.cc:224] Handling call
0709 13:07:36.138155 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.802972 (+664817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.803003 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:36.803040 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:36.803073 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.300773 (+497700us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b540006ed54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:37.300814 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.300929 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1528490368}
I20260709 13:07:37.317562 17324 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:37.286707 17902 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:37.282619 17907 consensus_meta.cc:287] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.784s	user 0.008s	sys 0.001s
I20260709 13:07:37.380847 17929 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:37.381698 17900 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:37.382998 17943 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.301635 17910 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:37.387982 17952 log.cc:927] Time spent T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.368s	user 0.003s	sys 0.000s
W20260709 13:07:37.396657 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 85129.5us
I20260709 13:07:37.398867 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:37.402916 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:37.403687 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:37.405511 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:37.498239 13786 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.498605 14396 raft_consensus.cc:2393] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 10: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:37.406215 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:37.409006 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 108522us
I20260709 13:07:37.499524 13755 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:37.501240 13755 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:37.409579 16697 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:37.502319 16697 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.502816 16697 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:37.332813 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:37.298507 13829 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:37.418910 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:37.297926 17808 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:07:37.436167 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 143383us
I20260709 13:07:37.319386 17912 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:37.438452 17957 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:37.310163 17854 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:37.454283 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:37.515753 14394 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:07:37.454757 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:37.456257 17942 log.cc:927] Time spent T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.578s	user 0.001s	sys 0.001s
I20260709 13:07:37.458474 17811 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:37.458938 17810 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:37.462551 17374 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.238863 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:37.477980 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.376935 17675 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:37.531728 17675 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.524682 13786 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:07:37.535732 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:37.479745 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 126348us
I20260709 13:07:37.537529 14366 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:37.484869 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:37.416626 17905 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:37.488425 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:37.462585 17852 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:37.306485 17921 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.497247 13757 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:37.547014 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 49910.6us
I20260709 13:07:37.547978 13757 leader_election.cc:304] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:37.483122 17308 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:37.486173 17916 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:37.499974 13861 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:07:37.511365 13830 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:37.511256 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 212809us
I20260709 13:07:37.551791 13829 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:37.516634 14395 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:07:37.551352 13830 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:37.515162 17932 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:37.558640 17932 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.514379 17808 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.527652 17854 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:37.515056 17929 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:37.482605 17748 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:37.573062 17748 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:37.510234 17900 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:37.573448 17808 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:37.573690 17900 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:37.574028 17854 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:37.574175 17900 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:37.511720 17902 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:37.516997 13755 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:37.550374 17905 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.556201 17800 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:37.557700 17851 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:37.550014 17897 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:37.487118 17907 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.562476 13757 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:37.554997 16697 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.549180 17751 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.545567 17811 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:37.550091 17909 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:37.546145 17866 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:37.608124 16697 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:37.551330 17308 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.552837 17916 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:37.553260 17810 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:37.553406 17975 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:07:37.565991 17908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.030s	sys 0.078s
W20260709 13:07:37.577561 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 60563us
I20260709 13:07:37.577924 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:37.560880 17689 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:37.588043 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 1.04864e+06us
W20260709 13:07:37.625694 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 70611.2us
I20260709 13:07:37.627144 14368 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:37.565428 17675 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:37.608821 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 46456.7us
I20260709 13:07:37.576356 17902 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:37.622272 14400 raft_consensus.cc:2368] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14.
I20260709 13:07:37.632134 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:37.632405 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:37.632987 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:37.596702 17808 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.629833 17811 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:37.577889 17849 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:37.633556 14395 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:37.634482 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:07:37.625876 17908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.030s	sys 0.078s
I20260709 13:07:37.621585 17916 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:37.621513 17961 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:37.645007 17689 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:37.645746 17689 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:37.597633 17897 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.649180 17897 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:37.638547 17943 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:37.628983 13757 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:37.652182 17984 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:37.652781 17984 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.654958 17984 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:37.655715 17849 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:37.639142 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:37.659926 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:37.660460 17905 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:37.633921 13788 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 6.
I20260709 13:07:37.612627 17308 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:37.661649 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:37.611559 17839 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:37.663089 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:37.642083 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:37.663899 13788 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:37.642562 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:37.665383 13784 raft_consensus.cc:2393] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 10: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:37.666404 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:37.667748 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:37.668740 13788 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 12: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:37.668514 17374 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:37.660562 13863 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:37.635546 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:37.671443 13786 raft_consensus.cc:2393] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 16: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:37.671833 17910 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:37.672735 17893 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:37.674638 17900 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.675173 17931 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:37.676101 17231 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.675998 17931 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:37.623224 17866 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.678876 17931 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:37.635452 17902 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:37.680471 17866 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:37.676808 17900 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:37.633940 17975 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.639956 17808 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.638615 17810 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:37.697250 17810 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:37.698594 17808 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:37.699334 13857 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:37.699959 17592 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.702309 17592 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:37.667124 13784 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:07:37.704349 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:37.707914 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:37.708161 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:37.708560 14396 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:07:37.708961 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:37.704664 13790 raft_consensus.cc:2368] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 11. Current term is 12.
I20260709 13:07:37.709380 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:37.709558 14399 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:07:37.710435 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:37.710742 14396 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:37.716480 14394 raft_consensus.cc:2393] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 6: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:37.717646 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:37.718526 13786 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:37.720247 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:37.722182 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:37.719092 13829 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:37.729982 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:37.733109 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.733224 17517 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:37.733785 17517 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.734197 17517 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:37.738574 17984 consensus_queue.cc:1059] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:37.690012 17907 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:37.687945 17374 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:37.739969 17810 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:37.740221 17984 raft_consensus.cc:3055] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:37.740651 17984 raft_consensus.cc:740] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:37.741603 17984 consensus_queue.cc:260] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.747400 17945 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:37.748172 17921 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:37.751618 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:37.757109 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:37.758782 14402 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.760217 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:37.760767 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:37.761476 13860 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:37.764750 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:37.765576 13859 raft_consensus.cc:2393] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 12: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:37.768180 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:37.770520 13786 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:37.772076 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:37.769382 13784 raft_consensus.cc:1275] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:37.766705 13863 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:07:37.773026 13786 raft_consensus.cc:2393] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 10: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:37.776151 13757 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:37.776715 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:37.743208 17984 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.786237 13860 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:37.686937 17689 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:37.688195 17308 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:37.805034 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:37.803246 13755 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:37.814453 13755 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:37.816617 13755 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:37.818394 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:37.816820 14402 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:37.821379 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:37.795019 17900 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:37.827611 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:37.828547 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:37.830731 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:37.834985 13787 raft_consensus.cc:2368] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12.
I20260709 13:07:37.837524 14399 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:37.817363 17961 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:37.821228 17813 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:37.848559 13755 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:37.843777 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 214483us
I20260709 13:07:37.802067 17902 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.829777 17943 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:37.829298 17231 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:37.855118 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:07:37.860459 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 68104.7us
I20260709 13:07:37.862090 17910 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:37.852236 17982 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:37.863495 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:37.865384 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:37.866143 14399 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:07:37.849706 17813 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:37.863706 17945 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:37.870769 17308 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:37.871273 17935 log.cc:927] Time spent T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.856s	user 0.003s	sys 0.000s
I20260709 13:07:37.863246 17982 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.868966 13680 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:37.874668 17231 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:37.875003 17813 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.875097 17231 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.875694 17231 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.876127 13783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 1855) took 1328 ms. Trace:
I20260709 13:07:37.876526 13783 rpcz_store.cc:276] 0709 13:07:36.547811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.548519 (+   708us) service_pool.cc:224] Handling call
0709 13:07:36.831967 (+283448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.904524 (+ 72557us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:36.906607 (+  2083us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.112671 (+206064us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.136431 (+ 23760us) log.cc:844] Serialized 26 byte log entry
0709 13:07:37.136591 (+   160us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:37.136630 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.136700 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:37.222754 (+ 86054us) raft_consensus.cc:1685] finished
0709 13:07:37.222805 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.445797 (+222992us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b18003984a0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f1522 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
0709 13:07:37.875956 (+430159us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54001b6cd0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:37.876067 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82370,"prepare.queue_time_us":2193,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":3407,"raft.queue_time_us":109776,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":31944,"spinlock_wait_cycles":682688640,"thread_start_us":197190,"threads_started":1,"wal-append.queue_time_us":260582}
I20260709 13:07:37.878680 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:37.863199 17899 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:37.879750 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2420) took 2166 ms. Trace:
I20260709 13:07:37.880106 13782 rpcz_store.cc:276] 0709 13:07:35.713113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.715244 (+  2131us) service_pool.cc:224] Handling call
0709 13:07:35.732727 (+ 17483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.732926 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.732950 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:35.740766 (+  7816us) log.cc:844] Serialized 26 byte log entry
0709 13:07:36.097737 (+356971us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:36.097797 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.097888 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:37.870677 (+1772789us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:07:37.879486 (+  8809us) raft_consensus.cc:1685] finished
0709 13:07:37.879506 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.879697 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24783104,"thread_start_us":356469,"threads_started":1,"wal-append.queue_time_us":1229742}
I20260709 13:07:37.881706 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:37.882800 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:37.882642 17680 consensus_queue.cc:1048] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:37.885109 17517 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.886293 17231 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:37.887245 17902 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:37.887667 13861 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:07:37.889362 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:37.890080 17231 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:37.889400 13680 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:37.890728 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:37.892148 17852 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:37.892170 13680 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:37.892685 17852 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:37.893095 17852 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.893471 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:37.894156 13790 raft_consensus.cc:2368] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12.
I20260709 13:07:37.894901 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:37.842154 17753 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:07:37.895254 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:37.854485 17943 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:37.855865 17900 raft_consensus.cc:697] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:37.873558 17982 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:37.879257 13783 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:37.902410 13783 raft_consensus.cc:1240] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:37.895789 13782 raft_consensus.cc:2368] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9.
I20260709 13:07:37.895898 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:37.904482 13783 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:37.905443 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:37.905973 14393 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:37.893445 13680 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:07:37.897709 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.901142 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:37.908612 17851 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:37.908914 13789 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:07:37.896487 17943 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.906144 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:37.896375 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:37.913264 13829 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:37.896776 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:37.915961 13789 raft_consensus.cc:1275] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:07:37.918440 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 49210.8us
I20260709 13:07:37.921382 13682 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:37.921350 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:37.925670 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:37.926795 13789 raft_consensus.cc:1275] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:37.927296 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:37.919278 13755 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:37.926733 13714 raft_consensus.cc:1275] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:07:37.928757 13714 pending_rounds.cc:85] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 5
I20260709 13:07:37.929148 13714 pending_rounds.cc:107] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:07:37.929392 13714 raft_consensus.cc:2889] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:37.926697 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:37.927464 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:37.928408 13709 raft_consensus.cc:2393] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 8: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:37.931687 16946 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:37.934108 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:37.934233 13788 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:37.934580 13829 leader_election.cc:400] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12.
I20260709 13:07:37.934947 13829 leader_election.cc:403] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:37.935652 13789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48902
I20260709 13:07:37.936879 13789 raft_consensus.cc:606] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Received request to transfer leadership
I20260709 13:07:37.909191 17851 raft_consensus.cc:697] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:37.957221 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:37.957561 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:37.958093 17851 consensus_queue.cc:237] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:37.958702 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:37.959918 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:37.960642 13714 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.972595 14397 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:07:37.937301 13789 raft_consensus.cc:614] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:37.938278 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:37.940689 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:37.977381 17517 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:37.941725 17977 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.006s
W20260709 13:07:37.942603 17969 log.cc:927] Time spent T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.709s	user 0.000s	sys 0.003s
I20260709 13:07:37.945056 17852 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:37.945917 17308 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:37.946853 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:37.987187 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:37.987720 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:37.987849 13716 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:07:37.988042 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:37.988746 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:37.989276 13709 raft_consensus.cc:1240] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:37.951897 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:37.989805 13715 raft_consensus.cc:1240] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:37.990188 13707 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:07:37.986779 13713 raft_consensus.cc:1240] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:37.990733 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:37.995872 17308 raft_consensus.cc:697] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:37.996856 17308 consensus_queue.cc:237] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.928861 17689 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:37.932548 17324 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:37.897881 17231 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:37.897172 17900 consensus_queue.cc:237] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.920279 17929 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:37.956053 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:38.006363 13662 auto_rebalancer.cc:893] Removing replace marker failed: Replica 35ecb005831740438d7537dd4b840e03 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:07:38.006793 13662 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:07:38.007084 13662 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:07:38.007776 17758 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:38.008059 13830 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:37.957370 17800 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:07:37.895403 17916 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:38.013546 13830 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:37.984504 13865 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:07:37.986785 17852 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:37.999492 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:38.017042 13856 raft_consensus.cc:2393] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 13: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:37.999605 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:38.003332 13707 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:07:37.980858 13682 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:38.017956 17004 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:37.994853 17813 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:37.981374 13714 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:07:37.939811 13829 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:38.018303 14367 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:07:38.030567 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 90782.5us
I20260709 13:07:38.030754 14367 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:38.034525 13829 leader_election.cc:400] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9.
I20260709 13:07:38.035029 13829 leader_election.cc:403] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:07:38.023726 13707 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:38.036396 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:38.026036 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:38.029470 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:38.002650 17902 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:38.017113 14393 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:07:38.001230 17517 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:38.048312 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:38.049226 13786 raft_consensus.cc:1240] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:38.050856 14402 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:38.005653 17231 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:38.013228 17324 raft_consensus.cc:697] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:38.037418 13755 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:38.036573 17945 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:38.053004 13829 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:38.015161 17689 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:38.027587 17957 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:38.032549 17753 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:38.058605 17231 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:38.060086 14402 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:07:38.054863 13682 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:38.062536 17374 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:38.037315 17808 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:38.046734 17517 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:38.040192 17675 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:38.080157 13682 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:38.065661 17150 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:38.032785 17984 consensus_queue.cc:1048] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:07:38.052482 17929 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9.
I20260709 13:07:38.037000 17680 consensus_queue.cc:1059] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:07:38.063755 17945 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:38.091090 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:38.090231 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:38.105087 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:38.087545 17808 raft_consensus.cc:697] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:38.105831 13861 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:38.105844 17893 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:38.106389 17811 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:38.106973 17810 raft_consensus.cc:3055] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:38.106688 17893 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:38.107225 17905 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:38.107986 17905 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:38.065169 17930 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:38.068903 17374 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.109287 17893 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:38.109673 17374 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:38.067814 17932 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:38.107474 17810 raft_consensus.cc:740] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:38.112474 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:38.102275 17753 consensus_queue.cc:1048] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:07:38.113600 17905 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:38.080423 17748 consensus_queue.cc:1048] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:07:38.115844 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:38.116138 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:38.100857 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:38.118069 13865 raft_consensus.cc:2410] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:38.092743 17960 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:38.112526 17810 consensus_queue.cc:260] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:38.121600 17810 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:38.122720 17916 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:38.127331 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:38.127713 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:38.127436 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:38.128054 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:38.127694 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:38.129881 13862 raft_consensus.cc:2393] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 6: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:38.129642 13857 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:38.126088 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:38.126477 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:38.126752 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:38.059461 17902 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:38.133420 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:38.133805 13711 raft_consensus.cc:2393] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 15: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:38.133833 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:38.122581 17374 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:38.135143 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 70555.4us
I20260709 13:07:38.066401 17957 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:38.106557 17808 consensus_queue.cc:237] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:38.149224 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:38.153194 13790 raft_consensus.cc:2368] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 15. Current term is 16.
I20260709 13:07:38.149763 13829 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:38.125216 17945 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:38.102998 17150 raft_consensus.cc:697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:38.124922 17675 raft_consensus.cc:697] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:38.098990 17324 consensus_queue.cc:237] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:38.157347 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:38.134351 17977 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:38.161839 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:38.166347 14393 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:07:38.134359 17907 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:38.171954 17813 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:38.171586 17907 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:38.107016 17811 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:38.142915 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:38.175108 17811 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:38.168660 17150 consensus_queue.cc:237] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:38.123936 17943 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:38.167778 13829 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:38.178051 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:38.179893 14393 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:07:38.183709 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:07:38.188571 14400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 1124) took 2243 ms (client timeout 1983 ms). Trace:
I20260709 13:07:38.182256 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:38.192261 14400 rpcz_store.cc:269] 0709 13:07:35.945181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.950150 (+  4969us) service_pool.cc:224] Handling call
0709 13:07:36.027312 (+ 77162us) spinlock_profiling.cc:243] Waited 5.28 ms on lock 0x7b5800077d98. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:07:38.178817 (+2151505us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54005e7ed4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:38.188483 (+  9666us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3516525056}
I20260709 13:07:38.175793 17907 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:38.175834 17993 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:07:38.138589 17960 consensus_queue.cc:1059] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:07:38.179541 17680 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:38.176929 17977 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.211894 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:38.213366 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:38.214695 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:38.220916 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:38.222671 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 71465us
I20260709 13:07:38.206247 17748 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:38.211272 17977 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:38.227731 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 122277us
I20260709 13:07:38.229969 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:38.231405 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:38.232909 14368 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:38.235627 14368 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:38.219091 17680 raft_consensus.cc:697] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 15 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:38.225555 17851 raft_consensus.cc:3055] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:38.236652 17811 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:38.239393 17921 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:38.239581 14368 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:38.224630 17960 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:07:38.256601 14368 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:38.261912 14368 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:38.264022 14368 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:38.268813 14368 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:38.246426 17851 raft_consensus.cc:740] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:38.253535 17921 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.226109 17675 consensus_queue.cc:237] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:38.258311 17916 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:38.258598 17811 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:38.269690 17999 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:38.272333 17905 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:38.290759 13857 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
W20260709 13:07:38.278267 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 53285.4us
I20260709 13:07:38.276820 17921 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:38.281253 14368 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:38.270848 17987 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:38.269840 17995 log.cc:927] Time spent T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:07:38.288468 17902 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:38.314262 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:38.316743 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:38.284255 17982 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:38.289453 17374 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:38.324576 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:38.324859 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:38.294804 17957 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:38.314250 17907 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:38.381943 17374 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:38.283573 17680 consensus_queue.cc:237] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:38.388892 18002 log.cc:927] Time spent T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:07:38.319612 17943 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:38.320508 17905 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:38.405864 17977 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:38.407683 18003 log.cc:927] Time spent T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:07:38.416985 17905 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:38.394613 17957 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:38.389034 17231 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:38.293766 17851 consensus_queue.cc:260] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:38.428762 17851 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:38.429261 17231 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:38.419304 17905 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:38.430761 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:38.440953 13857 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:38.442703 14368 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:38.294534 17999 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:38.453544 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 136886us
I20260709 13:07:38.456632 14366 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:38.460364 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:38.467365 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:38.467772 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:38.469244 13707 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 12: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:38.471204 14366 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:07:38.478610 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 449481us
I20260709 13:07:38.480378 13830 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:38.449043 17811 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:38.484531 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:38.494769 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:38.496141 13830 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:38.497205 13712 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:38.499876 13830 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:38.505806 14366 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:38.507401 14366 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:38.481844 17905 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:38.491950 17810 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.490957 17758 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.516160 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:38.512140 14366 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:38.517666 13707 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 7: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:38.518136 14366 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:38.493695 17811 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:38.509142 17984 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:38.509541 17907 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:38.521564 14366 leader_election.cc:400] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 11. Current term is 12.
I20260709 13:07:38.533344 14366 leader_election.cc:403] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:07:38.522019 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:38.509733 17753 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:38.503122 17748 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:38.511006 18009 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:38.534984 13714 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:38.515511 17982 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:38.535777 13712 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:07:38.523628 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:38.562325 13707 raft_consensus.cc:2368] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 16. Current term is 17.
I20260709 13:07:38.519083 17967 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:38.540190 17977 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:38.540725 17800 consensus_meta.cc:287] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.003s
I20260709 13:07:38.521415 17808 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:38.553038 17945 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:38.581884 17800 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12.
I20260709 13:07:38.554231 17984 consensus_queue.cc:1059] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:38.555786 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:38.515075 17929 consensus_queue.cc:1059] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:07:38.528023 17811 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:38.521181 17893 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:38.556762 17957 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:38.581115 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:07:38.583496 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 71581.2us
I20260709 13:07:38.592989 13830 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:38.586143 13715 raft_consensus.cc:2393] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 10: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:38.573429 13714 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:07:38.587672 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:38.588544 13709 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:38.575647 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:38.537655 17905 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 11. Current term is 12.
I20260709 13:07:38.557253 18009 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:38.520812 17810 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:38.588471 17982 raft_consensus.cc:697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:38.601081 17810 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:38.601285 17982 consensus_queue.cc:237] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:38.606323 18009 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:38.521852 17758 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:38.584300 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 49882.4us
I20260709 13:07:38.617113 14366 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:38.618685 14366 leader_election.cc:400] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 15. Current term is 16.
I20260709 13:07:38.619071 14366 leader_election.cc:403] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:07:38.617856 17753 raft_consensus.cc:3055] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:38.620497 17753 raft_consensus.cc:740] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:38.621321 17753 consensus_queue.cc:260] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:38.622561 17753 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:38.623189 17945 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:38.623770 17905 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:38.624343 17893 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:38.626286 17758 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:38.627595 18024 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:38.627952 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:38.629521 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:38.638130 18009 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:38.639379 17921 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:38.641829 17967 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.646905 13708 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:07:38.644497 13756 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:38.666785 13756 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:38.661688 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 169733us
I20260709 13:07:38.667915 13680 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:38.668537 13756 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:38.652235 14366 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:38.654949 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:38.655908 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:38.669189 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:38.670464 13864 raft_consensus.cc:2376] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9. Re-sending same reply.
I20260709 13:07:38.657729 13682 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:38.671536 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:38.659622 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:38.673046 13860 raft_consensus.cc:2393] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 12: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:38.663304 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:38.663690 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:38.675904 13682 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:38.669615 17374 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:38.661180 17808 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 15. Current term is 16.
I20260709 13:07:38.687865 17811 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:38.684306 17909 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:38.684567 18020 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:38.672178 17866 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:38.684077 18027 raft_consensus.cc:2764] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:07:38.685489 17905 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:38.669911 17150 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:38.672060 17517 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:38.698500 17811 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:38.675385 17967 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:38.687430 17975 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:38.718420 17967 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:38.722090 14395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 892) took 1015 ms. Trace:
I20260709 13:07:38.722779 18009 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:38.722657 14395 rpcz_store.cc:276] 0709 13:07:37.706888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.710406 (+  3518us) service_pool.cc:224] Handling call
0709 13:07:37.710679 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.710827 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:37.815948 (+105121us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.721429 (+905481us) spinlock_profiling.cc:243] Waited 34.1 ms on lock 0x7b18003e1ca0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f52320864bc 00007f522f3d448b 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e23a
0709 13:07:38.721659 (+   230us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:38.721724 (+    65us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:38.721782 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.721866 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.722009 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":152645,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":520,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"spinlock_wait_cycles":78505856,"thread_start_us":156031,"threads_started":2,"wal-append.queue_time_us":193782}
I20260709 13:07:38.739207 17999 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:38.734396 17921 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:38.752569 17909 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:38.690060 13756 leader_election.cc:400] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 16. Current term is 17.
W20260709 13:07:38.794464 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 104416us
W20260709 13:07:38.796011 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 118121us
I20260709 13:07:38.808012 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:38.804579 13755 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:38.812418 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:38.813956 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:38.814388 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:38.816011 14398 raft_consensus.cc:2410] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:07:38.795051 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 125818us
I20260709 13:07:38.816891 13788 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:38.817847 13680 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:38.818617 13756 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:38.829993 17363 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:38.840073 17374 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:38.840757 13682 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:38.844357 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:38.844686 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2446) took 1065 ms. Trace:
I20260709 13:07:38.844913 17004 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:38.845317 13787 rpcz_store.cc:276] 0709 13:07:37.779489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.818084 (+ 38595us) service_pool.cc:224] Handling call
0709 13:07:38.844073 (+1025989us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b54001e6c54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:38.844407 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36166912}
I20260709 13:07:38.831089 17751 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:38.878211 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:38.884922 13711 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:07:38.890558 13860 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:07:38.905196 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 56341us
I20260709 13:07:38.906189 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:38.907491 17930 raft_consensus.cc:3055] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:38.908003 17930 raft_consensus.cc:740] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:38.909636 17930 consensus_queue.cc:260] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:38.903275 13756 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:38.925544 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:38.940917 17899 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:38.942260 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:38.942998 14398 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:38.944056 17916 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:38.947515 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:38.955996 17930 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:38.957660 14367 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:38.962965 18032 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:07:38.964905 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.965023 17810 consensus_queue.cc:1059] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:38.965437 18024 consensus_queue.cc:1059] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:38.966946 17748 raft_consensus.cc:3055] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:38.967497 17748 raft_consensus.cc:740] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:38.968725 17748 consensus_queue.cc:260] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:38.969581 17987 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:38.969815 14367 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:38.970738 17748 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:38.970912 17987 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:38.990126 14395 raft_consensus.cc:1240] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:38.990945 14400 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:38.952925 17150 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:38.995291 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:39.011163 17907 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.011835 17907 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:39.013078 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:39.013696 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:39.014674 13713 raft_consensus.cc:2393] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 8: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:39.016278 13715 raft_consensus.cc:1275] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:39.018519 17907 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:39.020934 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:39.021132 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:39.021986 13789 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 12: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:39.023288 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:39.024667 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:39.025398 14398 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:07:39.030743 13830 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:39.031662 18024 consensus_queue.cc:1048] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:39.036825 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:39.051342 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:39.053088 14398 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:39.057721 13710 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:39.062129 13710 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:07:39.062568 13710 pending_rounds.cc:85] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 10
I20260709 13:07:39.062855 13710 pending_rounds.cc:107] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:07:39.063755 17810 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.063891 17753 consensus_queue.cc:1059] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:39.063184 13710 raft_consensus.cc:2889] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:39.067245 18024 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:39.067884 13789 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:39.070214 13784 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:39.071132 18045 consensus_queue.cc:1059] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:39.053097 17150 raft_consensus.cc:697] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:39.073401 17909 raft_consensus.cc:3055] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:39.073834 17909 raft_consensus.cc:740] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:39.074117 17150 consensus_queue.cc:237] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:39.075315 17909 consensus_queue.cc:260] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:39.108740 17909 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:39.078408 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:39.080387 13862 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:39.080811 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:39.092768 18027 consensus_queue.cc:1059] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:39.098537 13680 leader_election.cc:400] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12.
I20260709 13:07:39.099560 17689 raft_consensus.cc:3055] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:39.104131 13829 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:39.113327 18027 raft_consensus.cc:3055] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:39.113742 18027 raft_consensus.cc:740] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:07:39.114477 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 68265.9us
I20260709 13:07:39.114943 18027 consensus_queue.cc:260] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:39.116087 18024 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:39.115625 17930 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.116539 18027 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:39.107690 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 137968us
I20260709 13:07:39.119921 13787 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:07:39.120738 13787 raft_consensus.cc:606] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:07:39.125521 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:39.147764 13783 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:07:39.128770 17689 raft_consensus.cc:740] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:39.159356 14367 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:39.148545 17899 raft_consensus.cc:697] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:07:39.174360 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 353416us
I20260709 13:07:39.174899 13786 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:39.186105 13787 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:07:39.186977 13787 raft_consensus.cc:606] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:07:39.187381 13787 raft_consensus.cc:614] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:39.186362 13713 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:39.164959 17907 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.154304 17689 consensus_queue.cc:260] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:39.209398 17231 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:07:39.217617 17945 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:39.218393 17945 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:39.218751 17987 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:39.221807 17675 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:39.222642 17675 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:39.191524 17899 consensus_queue.cc:237] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:39.229187 13783 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:39.230178 17675 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:39.230329 13864 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:07:39.230906 13864 pending_rounds.cc:85] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 8
I20260709 13:07:39.232748 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 1336) took 1196 ms. Trace:
I20260709 13:07:39.233213 14399 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:39.233170 14397 rpcz_store.cc:276] 0709 13:07:38.035979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.036132 (+   153us) service_pool.cc:224] Handling call
0709 13:07:39.231622 (+1195490us) spinlock_profiling.cc:243] Waited 61.4 ms on lock 0x7b54004a9aa0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f5232455dc0 00007f52324e1e18 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6
0709 13:07:39.232457 (+   835us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54004a8b54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:39.232571 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2489673856}
I20260709 13:07:39.214672 13680 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:39.231208 13864 pending_rounds.cc:107] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:07:39.241731 13864 raft_consensus.cc:2889] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:39.252234 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 46006us
I20260709 13:07:39.235606 17231 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:39.245194 17689 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:39.266820 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:39.280632 16946 consensus_queue.cc:1059] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:39.281199 18001 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:39.267401 13829 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:39.282855 17810 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:39.283514 17810 raft_consensus.cc:697] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:39.283802 13680 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:39.283957 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:39.284968 18036 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:39.285590 18036 raft_consensus.cc:697] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 12 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:39.284641 17810 consensus_queue.cc:237] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:39.286599 18036 consensus_queue.cc:237] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:39.269847 17984 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:07:39.272490 13856 consensus_meta.cc:287] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.006s
I20260709 13:07:39.276135 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:39.267557 18046 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:07:39.288874 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:39.289918 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:39.283059 18001 raft_consensus.cc:3055] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:39.221166 17945 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:39.304031 14395 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:39.294528 18001 raft_consensus.cc:740] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:39.305012 13856 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:07:39.310225 14394 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:39.293457 17753 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:07:39.321785 13756 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:39.320261 17987 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:07:39.329128 17374 consensus_queue.cc:1059] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:39.330063 17374 raft_consensus.cc:3055] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:39.330425 17374 raft_consensus.cc:740] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:39.293045 17984 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:39.314738 17930 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.351018 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:39.331276 17374 consensus_queue.cc:260] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:39.360961 13757 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:39.368180 17909 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:39.368250 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 47321.5us
I20260709 13:07:39.363667 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:39.341991 17930 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:39.357247 17987 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:39.371994 13757 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:39.379235 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 85011.5us
I20260709 13:07:39.380187 13756 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:39.349568 17363 consensus_queue.cc:1059] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:07:39.389599 13829 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:39.392169 13787 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:07:39.392773 13787 raft_consensus.cc:606] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:07:39.393213 13787 raft_consensus.cc:614] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:39.393182 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 44020.3us
I20260709 13:07:39.404605 13680 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:39.390228 18045 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:39.407714 17957 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:07:39.418830 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 46935.7us
I20260709 13:07:39.408881 17374 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:39.388479 17987 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:39.431187 13757 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:39.438982 13865 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:39.386198 18001 consensus_queue.cc:260] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:39.409809 17967 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:39.442086 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.436079 17909 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:39.442487 18054 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:07:39.447659 18006 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:07:39.442219 17899 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:39.451215 14366 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.596s (SENT) [suppressed 7 similar messages]
I20260709 13:07:39.453919 17517 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.454531 17517 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:39.456983 17517 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:39.460781 17987 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:39.461544 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.467360 18001 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.474390 17987 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:39.475090 17987 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:39.481469 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:39.487776 17987 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:39.442651 17983 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:39.442373 18012 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:39.476472 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:39.510164 13682 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:07:39.509444 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 136313us
W20260709 13:07:39.506237 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 89661.6us
I20260709 13:07:39.508231 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:39.517835 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:39.514832 13791 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:07:39.531957 18006 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:39.532565 18006 raft_consensus.cc:697] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:39.533782 17984 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:39.533514 18006 consensus_queue.cc:237] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:39.535336 18027 raft_consensus.cc:3055] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:39.536273 18027 raft_consensus.cc:740] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:39.537964 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:39.538865 13783 raft_consensus.cc:2410] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:07:39.533471 18065 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
W20260709 13:07:39.531252 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 110075us
I20260709 13:07:39.549472 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:39.556324 13756 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:39.558894 16946 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.553930 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:39.559554 16946 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:39.547282 17810 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.556008 17957 raft_consensus.cc:697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:39.567898 17957 consensus_queue.cc:237] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:39.560400 17921 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:39.574851 17921 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:39.553397 17983 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:39.589905 17899 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:39.587252 17983 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:39.591822 17983 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.592597 18027 consensus_queue.cc:260] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:39.593842 18027 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.595777 18046 raft_consensus.cc:993] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03: : Instructing follower b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:07:39.596256 18046 raft_consensus.cc:1081] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Signalling peer b5029654a4384e43a68eb67b794949b7 to start an election
W20260709 13:07:39.604661 18063 log.cc:927] Time spent T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:07:39.609694 17921 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:39.611397 13786 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:07:39.612833 13786 raft_consensus.cc:606] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:39.613166 13786 raft_consensus.cc:614] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:39.613890 17930 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:39.618578 13787 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:07:39.619249 13787 raft_consensus.cc:606] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:07:39.619629 13787 raft_consensus.cc:614] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:39.619887 16946 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:39.620810 17810 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:39.621948 13829 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:39.623322 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:39.623489 17810 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:39.623873 17748 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:39.623943 13787 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:39.627569 13680 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:39.628511 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:39.632185 17374 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:39.632665 17374 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.633036 17374 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:39.635854 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:39.636451 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:39.637116 13857 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
W20260709 13:07:39.638461 13610 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49444 (request call id 320) took 24654 ms (client timeout 15000 ms). Trace:
I20260709 13:07:39.638415 14368 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:39.639348 17921 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:39.639768 17921 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:39.639809 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:39.640259 17921 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:39.640678 13711 raft_consensus.cc:2393] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 12: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
W20260709 13:07:39.643803 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 90120.3us
I20260709 13:07:39.648833 13830 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:39.684792 17748 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:39.720150 13864 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:07:39.727368 18075 log.cc:927] Time spent T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.071s	user 0.000s	sys 0.003s
I20260709 13:07:39.747541 13859 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:59780
I20260709 13:07:39.748276 13859 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:39.748620 13859 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:39.754751 13611 catalog_manager.cc:5697] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.760004 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:39.764840 13611 catalog_manager.cc:5697] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 2 to 6, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 6 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:39.759473 17983 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:39.773957 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:39.782202 18045 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.809674 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:39.810284 14400 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:39.811920 13785 raft_consensus.cc:1275] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:39.811128 17374 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:39.813282 13715 raft_consensus.cc:1240] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:39.814736 13783 raft_consensus.cc:2393] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 11: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:39.773512 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:39.774346 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:39.775210 13789 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:39.774230 13791 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:39.771205 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:39.816737 14398 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:39.770598 13611 catalog_manager.cc:5697] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 3 to 5, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 5 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:39.820086 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:39.821216 13710 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:39.825093 13864 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:39.827867 17753 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.828393 14397 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:39.829159 13708 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:39.835157 13787 raft_consensus.cc:2393] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 8: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:39.836243 13860 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:39.828393 17753 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:39.838644 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:39.840797 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:39.845099 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:39.848654 17930 consensus_queue.cc:1059] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:39.849776 17930 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.850728 17854 raft_consensus.cc:3055] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:39.851315 17753 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:39.856901 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:39.857726 13707 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:07:39.859014 13830 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:39.859839 17753 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:39.860244 17753 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.860615 17753 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:39.643481 13610 rpcz_store.cc:269] 0709 13:07:14.983463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.983666 (+   203us) service_pool.cc:224] Handling call
0709 13:07:39.638244 (+24654578us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:34.376999 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:34.377550 (+   551us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:34.377586 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:07:34.377603 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:34.378654 (+  1051us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:34.378718 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:34.378744 (+    26us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:07:34.423785 (+ 45041us) tablet.cc:701] Row locks acquired
0709 13:07:34.423815 (+    30us) write_op.cc:260] PREPARE: finished
0709 13:07:34.424010 (+   195us) write_op.cc:270] Start()
0709 13:07:34.424127 (+   117us) write_op.cc:276] Timestamp: P: 1783602454423953 usec, L: 0
0709 13:07:34.424161 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:07:34.565206 (+141045us) log.cc:844] Serialized 4844 byte log entry
0709 13:07:34.902690 (+337484us) spinlock_profiling.cc:243] Waited 60.1 ms on lock 0x7b54003edd54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324d9e28 00007f5235f14581 00007f5235f13d58 00007f5235f189f1 00007f5235f189a9 00007f5235f18939 00007f5235f18901 00007f5235f17b2d 000000000038f354 000000000038f199
0709 13:07:35.297152 (+394462us) op_driver.cc:464] REPLICATION: finished
0709 13:07:35.562733 (+265581us) write_op.cc:301] APPLY: starting
0709 13:07:35.562872 (+   139us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:36.600013 (+1037141us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:36.612643 (+ 12630us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:37.198916 (+586273us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:37.208082 (+  9166us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:07:37.208158 (+    76us) write_op.cc:312] APPLY: finished
0709 13:07:37.208621 (+   463us) log.cc:844] Serialized 113 byte log entry
0709 13:07:37.460125 (+251504us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f522f3d40ac 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b
0709 13:07:37.576184 (+116059us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:37.596455 (+ 20271us) write_op.cc:454] Released schema lock
0709 13:07:37.607735 (+ 11280us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:37.630276 (+ 22541us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:37.630317 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1503845,"reported_tablets":33,"spinlock_wait_cycles":17408,"child_traces":[["op",{"apply.queue_time_us":262168,"apply.run_cpu_time_us":52597,"apply.run_wall_time_us":2058697,"cfile_cache_hit":46,"cfile_cache_hit_bytes":48070,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6217,"cfile_init":2,"lbm_read_time_us":84724,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":9,"num_ops":12,"prepare.queue_time_us":388587,"prepare.run_cpu_time_us":8597,"prepare.run_wall_time_us":528078,"replication_time_us":867012,"spinlock_wait_cycles":170258688,"thread_start_us":670029,"threads_started":3,"wal-append.queue_time_us":425002,"wal-append.run_cpu_time_us":1034,"wal-append.run_wall_time_us":1055248}]]}
W20260709 13:07:39.865806 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.819648 17967 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:07:39.851189 17854 raft_consensus.cc:740] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:39.872525 14366 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:39.873131 13710 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:39.824172 18045 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:39.840335 13611 catalog_manager.cc:5697] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:39.827394 18046 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:07:39.874233 17899 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:39.878639 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:39.886787 13859 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:39.863284 17909 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:07:39.901420 13787 raft_consensus.cc:2393] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 12: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:39.863502 18069 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:07:39.910256 13859 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:39.877657 17930 consensus_queue.cc:1048] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:07:39.918572 17893 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:39.922053 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:39.922655 17374 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:39.922650 13784 raft_consensus.cc:3055] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:39.923166 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:39.923391 13784 raft_consensus.cc:740] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:39.923897 13715 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:39.924431 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 57072.9us
I20260709 13:07:39.924324 13784 consensus_queue.cc:260] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:39.925432 14366 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:39.926846 17907 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:39.927685 17907 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:39.927920 13611 catalog_manager.cc:5697] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.929790 17907 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:39.925554 13784 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:39.929488 13611 catalog_manager.cc:5697] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 6 to 10, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 10 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:39.918653 17899 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:39.935557 13785 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:07:39.936196 13611 catalog_manager.cc:5697] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 5 to 7, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 7 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:39.940861 14366 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:39.941296 13784 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
I20260709 13:07:39.942332 14366 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:39.950933 13829 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:39.943815 14366 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:39.957062 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:39.936815 17899 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:39.945490 13611 catalog_manager.cc:5697] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 7 to 8, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 8 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.944546 17893 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:39.959942 17982 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:39.962312 18045 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:39.968950 18072 log.cc:927] Time spent T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
W20260709 13:07:39.971076 18078 log.cc:927] Time spent T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:07:39.973176 13715 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
I20260709 13:07:39.959076 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:39.975492 13782 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:39.981299 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 76599.5us
I20260709 13:07:39.988950 17899 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:39.987263 13611 catalog_manager.cc:5697] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 5 to 7, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 7 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.990154 17893 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:39.997291 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 53579.5us
I20260709 13:07:39.998978 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:39.999806 13710 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 11: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:40.003813 14366 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:39.984931 17945 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:40.002791 18071 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:07:40.001698 13611 catalog_manager.cc:5697] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 5 to 6, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 6 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.996456 17748 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:39.999943 17983 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:40.028704 13857 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:07:40.033219 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 88211.5us
I20260709 13:07:40.033540 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:40.035851 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:40.019927 17907 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:40.041986 13786 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:40.053351 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:40.054122 13859 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:07:40.023772 17945 raft_consensus.cc:697] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 7 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:40.052670 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:40.071746 13784 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:40.074059 13611 catalog_manager.cc:5697] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:40.103654 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 101756us
I20260709 13:07:40.112022 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:40.128254 17748 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.128840 17748 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:40.132149 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:40.132984 13715 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:07:40.134555 13830 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:40.135653 18024 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:40.136142 18024 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.136554 18024 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.059921 17921 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:40.102963 13611 catalog_manager.cc:5697] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 3 to 5, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 5 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:40.090775 18036 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:07:40.160785 14393 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:07:40.156009 13611 catalog_manager.cc:5697] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 7 to 8, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 8 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.184460 18093 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:40.185071 18093 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:40.145255 17758 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.167s
I20260709 13:07:40.189949 17854 consensus_queue.cc:260] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:40.196549 17921 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:40.210479 13782 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:07:40.213299 13783 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:40.148362 18065 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:07:40.166777 17748 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:40.214427 13611 catalog_manager.cc:5697] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 3 to 8, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 8 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:40.191166 17854 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.229849 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:40.187327 18093 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:40.248147 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 78744.4us
I20260709 13:07:40.167440 17945 consensus_queue.cc:237] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:40.263813 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:40.264465 13857 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:40.265501 13757 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:40.275524 13790 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:07:40.275965 13790 pending_rounds.cc:85] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 12
I20260709 13:07:40.276187 13790 pending_rounds.cc:107] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:07:40.276444 13790 raft_consensus.cc:2889] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:40.283840 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 163493us
I20260709 13:07:40.287189 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:40.286463 13757 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:07:40.298408 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 208847us
I20260709 13:07:40.300112 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:40.285599 18066 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:40.268509 18045 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:40.311169 13786 raft_consensus.cc:2393] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 12: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
W20260709 13:07:40.301333 18090 log.cc:927] Time spent T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.147s	user 0.000s	sys 0.003s
I20260709 13:07:40.324136 18088 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:40.324625 18088 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:40.324990 18088 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.311774 17907 consensus_queue.cc:1059] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:07:40.298553 18071 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:07:40.337050 18088 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:40.313743 18045 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.306514 17893 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:40.338132 18045 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:40.315451 18066 raft_consensus.cc:697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:40.349077 18066 consensus_queue.cc:237] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:40.365020 13856 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:07:40.385248 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:40.395542 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.398080 13711 raft_consensus.cc:2393] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 10: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:40.409283 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:40.382823 17675 raft_consensus.cc:3055] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:40.411561 17675 raft_consensus.cc:740] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:40.412765 17675 consensus_queue.cc:260] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:40.416878 18097 log.cc:927] Time spent T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.119s	user 0.002s	sys 0.000s
W20260709 13:07:40.421111 17753 consensus_meta.cc:287] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.560s	user 0.012s	sys 0.000s
I20260709 13:07:40.420883 18006 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.421888 17753 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:40.421937 18006 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:40.424731 13860 raft_consensus.cc:2368] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 11. Current term is 12.
I20260709 13:07:40.431300 13713 raft_consensus.cc:1240] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:40.372212 17916 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:40.433122 17916 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:40.436556 14400 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:40.438529 18006 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:40.445020 13865 raft_consensus.cc:2410] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:07:40.459789 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 69903.7us
I20260709 13:07:40.469266 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:40.435278 17916 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:40.471396 13713 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 10: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:40.511193 13856 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:40.515318 17374 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:40.512418 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:40.531294 13711 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:40.534762 17231 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.536401 17231 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:40.544577 14368 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:40.541661 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:40.549300 13789 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:07:40.537534 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:40.551190 13713 raft_consensus.cc:2393] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 10: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:40.535118 17753 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:40.571686 17231 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:40.551697 18106 consensus_queue.cc:1059] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 13:07:40.568482 17916 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:40.578287 18088 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:40.566251 18024 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:40.609681 17753 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:40.628860 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:40.616317 17916 raft_consensus.cc:697] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 12 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:40.632782 13857 raft_consensus.cc:2368] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 10. Current term is 11.
I20260709 13:07:40.623701 18106 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.645674 17916 consensus_queue.cc:237] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:40.629572 17753 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:40.666529 14368 leader_election.cc:400] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 10. Current term is 11.
I20260709 13:07:40.666929 14368 leader_election.cc:403] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:40.674808 13789 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:07:40.675797 13829 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:40.640982 18106 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:40.680135 13711 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:07:40.684049 17982 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.685734 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:40.692296 13757 leader_election.cc:400] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 11. Current term is 12.
I20260709 13:07:40.692742 13757 leader_election.cc:403] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:40.695554 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:40.708148 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:40.708813 13858 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
W20260709 13:07:40.708940 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.680598 17517 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.712344 17517 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:40.714221 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:40.714761 13708 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.717849 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:40.718442 17907 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.718935 17907 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:40.720937 17907 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:40.727325 18024 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:40.649523 18045 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:40.694110 17689 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:40.729313 17689 raft_consensus.cc:697] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:40.730261 17675 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.704772 18084 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 11. Current term is 12.
I20260709 13:07:40.692571 18106 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:40.730299 17689 consensus_queue.cc:237] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:40.712807 14367 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:40.738909 17899 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.739404 17899 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:40.741528 17899 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:40.747661 14400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:40042
I20260709 13:07:40.748306 14400 raft_consensus.cc:606] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:40.748617 14400 raft_consensus.cc:614] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:40.749015 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:40.760874 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:40.767546 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:40.767902 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:40.768481 13862 raft_consensus.cc:2410] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:40.768837 13715 raft_consensus.cc:2410] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:40.769876 17753 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:40.770735 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:07:40.772684 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:40.774070 13682 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:40.775496 13682 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:40.776647 18065 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:40.775576 18027 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:40.780161 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:40.781456 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:40.719172 17982 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 10. Current term is 11.
I20260709 13:07:40.784294 13864 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:40.780277 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:40.786525 13787 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:07:40.785151 18027 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.791966 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:40.792565 14401 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:40.792148 18027 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.794821 14368 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:40.797623 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:40.798187 14395 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:40.799662 17921 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:40.800509 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 53591us
I20260709 13:07:40.801857 17517 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:40.802618 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:40.803169 13864 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:40.803665 18098 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:40.803081 13713 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
I20260709 13:07:40.805832 18088 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.806320 18088 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:40.806595 17899 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.807232 17899 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:40.808370 18088 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:40.809218 17899 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:40.812749 18098 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.813447 18098 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:40.815825 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:40.816368 13757 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:40.818408 13830 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:40.818842 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:40.819303 17517 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:40.819769 17517 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.820238 17517 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.820394 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:40.820986 13710 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:07:40.800602 18045 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:40.829720 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:40.832998 13864 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:07:40.837597 13756 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:40.843273 13757 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:40.845260 13708 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:07:40.846426 13830 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:40.845219 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:40.848572 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:40.852025 14393 raft_consensus.cc:2393] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 9: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:40.849889 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:40.844189 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:40.853103 14394 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:07:40.863199 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:40.848573 13788 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
I20260709 13:07:40.880080 13757 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:40.881265 17374 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:40.877358 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 54221.3us
I20260709 13:07:40.883188 17374 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.883728 17374 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:40.888891 13662 auto_rebalancer.cc:629] Failed to schedule move for tablet 7c307c37029c4b5596bad2e08bda02bf: Illegal state: Replica b9d194f45e044e0988d5de1a99e5cd02 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:40.878624 17748 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:40.897470 17748 raft_consensus.cc:697] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:40.898380 17748 consensus_queue.cc:237] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:40.902760 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:40.912039 13708 raft_consensus.cc:1275] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:40.885710 17758 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:40.899667 18093 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:40.887878 18088 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:40.909719 18084 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:40.886873 17517 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:40.915982 17758 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.942940 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:40.943676 14394 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:40.944077 17758 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:40.931933 18118 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.261s	user 0.001s	sys 0.003s
I20260709 13:07:40.948308 13680 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:40.952678 14400 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:07:40.954756 16946 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:40.955292 16946 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.955696 16946 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.964327 14393 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:40.924623 18093 raft_consensus.cc:697] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 13 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:40.915743 18065 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:07:40.988262 13857 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 8: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:40.931334 18088 raft_consensus.cc:697] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:40.925624 17930 consensus_queue.cc:1048] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:07:40.949219 18098 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:40.988037 17899 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.014518 17517 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:41.017361 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:41.021389 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:41.022063 13708 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.998945 17987 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:41.024161 17374 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:41.020516 13755 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:41.018108 18005 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.036862 18093 consensus_queue.cc:237] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:41.043406 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:41.044106 13787 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.049393 17930 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.050001 17930 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:41.018505 18088 consensus_queue.cc:237] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:41.039805 18101 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:41.052623 18101 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.052973 18101 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:40.996793 17753 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:07:41.003976 18027 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:41.018563 17899 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:41.064122 18103 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.077652 17899 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:41.077921 18103 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:41.083876 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:41.085295 13788 raft_consensus.cc:1275] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:41.087307 18116 consensus_queue.cc:1048] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:41.087749 13860 raft_consensus.cc:1240] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:41.057729 18005 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:41.089582 17921 consensus_queue.cc:1059] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:41.090488 17921 raft_consensus.cc:3055] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:41.090812 17921 raft_consensus.cc:740] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:41.091316 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:41.092084 14400 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:07:41.091665 17921 consensus_queue.cc:260] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:41.093677 17921 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:41.094619 13711 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:07:41.095561 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:41.096203 14400 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.098031 18103 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:41.100884 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:41.101517 13864 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:41.102458 13789 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:41.104272 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:41.105226 13682 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:41.106798 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:41.107450 13715 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:41.107569 17517 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:41.108286 18012 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:41.108690 18012 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.108999 18012 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.113245 17758 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:41.114380 13785 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 8: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:41.115155 13830 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:41.117195 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:41.117287 17945 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:41.113433 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:41.119179 13713 raft_consensus.cc:2368] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10.
I20260709 13:07:41.119477 14394 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:07:41.120716 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:41.122319 13755 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:41.123071 13830 leader_election.cc:400] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10.
I20260709 13:07:41.103257 17930 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:41.123390 13830 leader_election.cc:403] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:41.118971 17945 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.124202 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:41.125970 16946 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:41.091132 18005 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:41.139755 18103 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:41.143886 18103 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.144220 18103 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:41.146755 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:41.148197 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:41.150936 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:41.151518 14394 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.154148 14400 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:41.158074 13708 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:41.155299 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:41.160504 18066 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:41.161118 18066 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:41.121932 18027 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:41.164211 16946 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:41.142231 17945 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.165488 13830 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:41.139904 17517 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.165970 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:41.167234 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:41.166882 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1366) took 1138 ms. Trace:
I20260709 13:07:41.164852 13787 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:41.146203 18084 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:41.170639 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:41.173233 14400 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.177477 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:41.178261 13860 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.180455 13710 raft_consensus.cc:2368] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11.
I20260709 13:07:41.190374 18012 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:41.185463 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:41.197062 13830 leader_election.cc:400] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11.
I20260709 13:07:41.197415 13830 leader_election.cc:403] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:41.164914 18066 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:41.167754 17957 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:41.203186 17957 raft_consensus.cc:697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:41.204109 17957 consensus_queue.cc:237] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:41.173282 14402 rpcz_store.cc:276] 0709 13:07:40.016249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.016382 (+   133us) service_pool.cc:224] Handling call
0709 13:07:40.645846 (+629464us) spinlock_profiling.cc:243] Waited 875 us on lock 0x7b5800077d98. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9eee 0000000000375939 00007f523742d1e0 00007f52374f60c4 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:07:40.646007 (+   161us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.847311 (+201304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.847338 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:40.853844 (+  6506us) log.cc:844] Serialized 26 byte log entry
0709 13:07:40.997339 (+143495us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:40.997374 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.154449 (+157075us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b540052b054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:41.154503 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.154543 (+    40us) raft_consensus.cc:1685] finished
0709 13:07:41.154555 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.154658 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14553,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":3684,"spinlock_wait_cycles":77683200,"thread_start_us":255970,"threads_started":2,"wal-append.queue_time_us":156903}
I20260709 13:07:41.200950 13791 consensus_queue.cc:237] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:41.210022 14400 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:07:41.234352 17374 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:41.173969 18084 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.219662 13680 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:41.183560 17930 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:41.211731 17758 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:41.253479 18084 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:41.256536 18027 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:41.312772 14394 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:41.323765 13785 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:41.324815 13860 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:07:41.325335 17983 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11.
I20260709 13:07:41.325776 17984 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:41.296693 17930 raft_consensus.cc:697] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:07:41.317844 18135 log.cc:927] Time spent T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:07:41.319792 18027 raft_consensus.cc:697] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:07:41.391304 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 90592.5us
I20260709 13:07:41.428064 13711 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:41.432090 13680 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:41.433112 18096 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:41.433773 18096 raft_consensus.cc:697] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:41.434640 18096 consensus_queue.cc:237] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:41.453260 18116 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:07:41.473658 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 64794us
I20260709 13:07:41.488399 13711 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:07:41.546236 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 205683us
W20260709 13:07:41.511925 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 154631us
I20260709 13:07:41.493922 17930 consensus_queue.cc:237] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:41.588150 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:41.565953 18027 consensus_queue.cc:237] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:41.616312 18133 log.cc:927] Time spent T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 13:07:41.625810 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 57006.8us
I20260709 13:07:41.502153 18101 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:41.638516 13782 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
W20260709 13:07:41.509485 18125 log.cc:927] Time spent T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:07:41.644191 18137 log.cc:927] Time spent T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:07:41.667340 13708 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:41.678566 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:07:41.680590 18134 log.cc:927] Time spent T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:07:41.699985 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 69502.3us
I20260709 13:07:41.700722 18012 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:41.701143 13755 consensus_peers.cc:597] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0b0054f48c4947acaea83521993a8f01. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.704326 17517 consensus_meta.cc:287] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.000s
I20260709 13:07:41.704730 17517 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10.
I20260709 13:07:41.705999 18142 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:41.706503 18142 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:41.710484 18142 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:41.716645 17945 consensus_meta.cc:287] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.535s	user 0.007s	sys 0.000s
I20260709 13:07:41.719101 13864 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:41.717633 17945 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:41.721676 17945 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:41.721839 18084 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:41.723819 13789 raft_consensus.cc:2393] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 12: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
W20260709 13:07:41.749660 17957 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.023s	sys 0.032s
I20260709 13:07:41.774127 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:41.774514 17374 consensus_queue.cc:1059] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:41.775094 13715 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.762763 18101 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:41.780944 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:41.777303 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 220889us
W20260709 13:07:41.769392 17957 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.023s	sys 0.032s
I20260709 13:07:41.791949 13782 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:07:41.799549 17374 consensus_queue.cc:1059] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:41.768301 17517 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.014s
W20260709 13:07:41.818326 18103 consensus_meta.cc:287] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.666s	user 0.012s	sys 0.000s
W20260709 13:07:41.870460 18149 log.cc:927] Time spent T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.325s	user 0.003s	sys 0.000s
I20260709 13:07:41.874344 13715 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:07:41.885509 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:41.886356 13857 raft_consensus.cc:2368] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10.
I20260709 13:07:41.910414 13857 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:41.862071 18103 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:41.908833 18084 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:41.941103 13757 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:41.947299 13757 leader_election.cc:400] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10.
I20260709 13:07:41.947871 13757 leader_election.cc:403] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:41.949198 18140 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.951853 14400 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:41.944247 18088 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:41.954979 17753 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:41.958320 16946 raft_consensus.cc:3055] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:41.958768 16946 raft_consensus.cc:740] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:41.965467 13789 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:07:41.952418 18095 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:07:41.967167 13857 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:41.968147 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:41.960754 16946 consensus_queue.cc:260] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:41.978649 18136 log.cc:927] Time spent T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.416s	user 0.000s	sys 0.002s
I20260709 13:07:41.979840 13858 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:41.982237 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:41.983659 13710 raft_consensus.cc:2368] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10.
I20260709 13:07:41.986410 17374 consensus_queue.cc:1059] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:41.991886 18088 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:07:41.995507 13715 raft_consensus.cc:1240] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:41.995699 18103 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:41.992187 17967 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:07:41.999367 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:42.000033 13756 leader_election.cc:400] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10.
I20260709 13:07:42.001327 18095 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:42.002269 17943 consensus_queue.cc:1059] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:42.003290 18095 raft_consensus.cc:3055] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:42.000128 13708 raft_consensus.cc:2393] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 12: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:42.003696 18095 raft_consensus.cc:740] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:42.004726 18095 consensus_queue.cc:260] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:42.005864 18095 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.031785 13830 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:42.033032 18066 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:42.033556 18066 raft_consensus.cc:697] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:42.034382 18066 consensus_queue.cc:237] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:42.047070 14397 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:07:42.047503 14397 pending_rounds.cc:85] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 11
I20260709 13:07:42.047722 14397 pending_rounds.cc:107] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:07:42.047940 14397 raft_consensus.cc:2889] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:42.051314 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:42.061553 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:42.071740 14397 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.075860 13864 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:07:42.077167 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 110583us
I20260709 13:07:42.063009 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:42.095157 16946 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:42.117463 13755 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:42.121726 14395 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:42.126941 14399 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:42.140131 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:42.140877 13786 raft_consensus.cc:2393] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 12: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:42.159828 13613 catalog_manager.cc:5697] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 7 to 11, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 11 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:07:42.160614 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 46124.2us
I20260709 13:07:42.163015 13682 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:42.165073 17374 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:42.162001 13613 catalog_manager.cc:5697] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:42.173617 13613 catalog_manager.cc:5697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 6 to 7, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 7 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:42.143555 18084 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:42.117050 17758 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
W20260709 13:07:42.178292 13611 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49428 (request call id 328) took 22909 ms (client timeout 15000 ms). Trace:
I20260709 13:07:42.175216 13613 catalog_manager.cc:5697] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:42.183964 13613 catalog_manager.cc:5697] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 4 to 7, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 7 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.184710 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:42.192214 13613 catalog_manager.cc:5697] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 6 to 8, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 8 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.197237 13613 catalog_manager.cc:5697] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 7 to 10, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 10 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:07:42.179947 13611 rpcz_store.cc:269] 0709 13:07:19.272095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.273570 (+  1475us) service_pool.cc:224] Handling call
0709 13:07:21.415046 (+2141476us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b54003edd54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232448090 00007f52324e6f3a 00007f523829d1cc 00007f523839b37e 00007f523685c2a4 00007f523685c232 00007f523685c161 00007f523685c0dc 00007f523685b392 00007f523081948c 00007f52308188c6
0709 13:07:42.178213 (+20763167us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:40.634890 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:40.665194 (+ 30304us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:40.665248 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:07:40.665267 (+    19us) tablet.cc:662] Decoding operations
0709 13:07:40.671065 (+  5798us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:40.671189 (+   124us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:40.671223 (+    34us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:07:40.672684 (+  1461us) tablet.cc:701] Row locks acquired
0709 13:07:40.672743 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:07:40.672938 (+   195us) write_op.cc:270] Start()
0709 13:07:40.673098 (+   160us) write_op.cc:276] Timestamp: P: 1783602460672866 usec, L: 0
0709 13:07:40.673134 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:07:40.744856 (+ 71722us) log.cc:844] Serialized 5552 byte log entry
0709 13:07:41.318506 (+573650us) op_driver.cc:464] REPLICATION: finished
0709 13:07:41.687891 (+369385us) write_op.cc:301] APPLY: starting
0709 13:07:41.687995 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:41.721511 (+ 33516us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:41.721621 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:41.990974 (+269353us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:41.991334 (+   360us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:07:41.991401 (+    67us) write_op.cc:312] APPLY: finished
0709 13:07:41.994166 (+  2765us) log.cc:844] Serialized 129 byte log entry
0709 13:07:41.994365 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:41.994510 (+   145us) write_op.cc:454] Released schema lock
0709 13:07:41.994577 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:42.095948 (+101371us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:42.109135 (+ 13187us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":36105,"reported_tablets":43,"spinlock_wait_cycles":1207865216,"child_traces":[["op",{"apply.queue_time_us":347062,"apply.run_cpu_time_us":21480,"apply.run_wall_time_us":362587,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62647,"num_ops":14,"prepare.queue_time_us":182300,"prepare.run_cpu_time_us":45071,"prepare.run_wall_time_us":354575,"raft.queue_time_us":203335,"raft.run_cpu_time_us":112354,"raft.run_wall_time_us":414100,"replication_time_us":625123,"thread_start_us":762168,"threads_started":4,"wal-append.queue_time_us":296449}]]}
I20260709 13:07:42.206265 14397 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:07:42.207602 13755 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:42.209187 13613 catalog_manager.cc:5697] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 6 to 8, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 8 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:42.217226 18141 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:42.245085 13613 catalog_manager.cc:5697] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 8 to 11, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 11 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:42.248379 13613 catalog_manager.cc:5697] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:07:42.253691 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 81869.9us
I20260709 13:07:42.254734 13613 catalog_manager.cc:5697] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 7 to 11, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 11 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:42.245059 18141 raft_consensus.cc:697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:42.255621 13864 raft_consensus.cc:2955] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
W20260709 13:07:42.260782 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 96744.3us
I20260709 13:07:42.250574 18140 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10.
I20260709 13:07:42.262068 13613 catalog_manager.cc:5697] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 5 to 10, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 10 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.272297 14400 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:42.271580 13613 catalog_manager.cc:5697] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 5 to 7, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 7 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:42.290064 13613 catalog_manager.cc:5697] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 3 to 6, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 6 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:42.292860 13613 catalog_manager.cc:5697] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 3 to 7, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 7 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:07:42.295439 18169 log.cc:927] Time spent T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:07:42.299075 13613 catalog_manager.cc:5697] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 6 to 7, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 7 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.309160 13613 catalog_manager.cc:5697] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 8 to 11, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 11 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:42.291195 18168 ts_tablet_manager.cc:933] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:42.316392 13613 catalog_manager.cc:5697] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 8 to 12, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 12 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:42.321286 13613 catalog_manager.cc:5697] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 7 to 10, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 10 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:42.316104 18163 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:07:42.326850 18141 consensus_queue.cc:237] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:42.343664 18165 log.cc:927] Time spent T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:07:42.259979 17899 raft_consensus.cc:2955] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:07:42.357467 13864 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:42.367273 13790 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:07:42.368996 13613 catalog_manager.cc:5697] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:42.371297 18168 tablet_copy_client.cc:323] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.130:36047
I20260709 13:07:42.370787 13613 catalog_manager.cc:5697] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 8 to 9, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 9 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:42.374212 13613 catalog_manager.cc:5697] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 5 to 9, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 9 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:07:42.372013 18162 log.cc:927] Time spent T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.172s	user 0.000s	sys 0.002s
W20260709 13:07:42.431463 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 72148.4us
I20260709 13:07:42.433108 16946 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:42.435144 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:42.444998 18163 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:42.446938 18005 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:42.380365 13613 catalog_manager.cc:5697] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 4 to 9, term changed from 7 to 10, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:42.461627 17374 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:42.479456 18175 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:42.508239 13707 raft_consensus.cc:1275] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:42.525545 13782 raft_consensus.cc:1275] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:07:42.527670 18166 log.cc:927] Time spent T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.314s	user 0.001s	sys 0.003s
I20260709 13:07:42.533809 17517 consensus_queue.cc:1048] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:42.539402 17517 consensus_queue.cc:1048] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:07:42.606782 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 64420.9us
I20260709 13:07:42.623041 13801 tablet_copy_service.cc:140] P 35ecb005831740438d7537dd4b840e03: Received BeginTabletCopySession request for tablet 0b0054f48c4947acaea83521993a8f01 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:45134)
I20260709 13:07:42.623723 13801 tablet_copy_service.cc:161] P 35ecb005831740438d7537dd4b840e03: Beginning new tablet copy session on tablet 0b0054f48c4947acaea83521993a8f01 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:45134: session id = ceb06175847b428ea8bd77055fcddf58-0b0054f48c4947acaea83521993a8f01
I20260709 13:07:42.630784 13709 raft_consensus.cc:2955] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:07:42.646378 13790 raft_consensus.cc:1275] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:42.677230 17753 consensus_queue.cc:1048] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 13:07:42.750200 18183 log.cc:927] Time spent T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:07:42.780445 18179 log.cc:927] Time spent T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.127s	user 0.001s	sys 0.001s
W20260709 13:07:42.788669 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 100021us
W20260709 13:07:42.785308 18167 log.cc:927] Time spent T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.579s	user 0.000s	sys 0.012s
I20260709 13:07:42.804127 13709 raft_consensus.cc:1275] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:07:42.808936 18186 log.cc:927] Time spent T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:07:42.810014 14401 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:42.816819 18095 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:42.829569 17984 consensus_queue.cc:1048] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:42.898259 13709 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:42.913228 18140 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:07:42.908473 17899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:45130 (request call id 23) took 1796 ms. Trace:
I20260709 13:07:42.935674 17899 rpcz_store.cc:276] 0709 13:07:41.103039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.103151 (+   112us) service_pool.cc:224] Handling call
0709 13:07:41.162520 (+ 59369us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b2c000108d8. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5230dd7a11 00007f5230de6a0a 00007f5230de6693 00007f5230de6631 00007f5232519902 00007f52325196dd 00007f52324e4f3f 00007f52324e46b3 00007f52374a4d29 00007f5230a231d4 00007f5230a23162
0709 13:07:41.200153 (+ 37633us) spinlock_profiling.cc:243] Waited 33.5 ms on lock 0x7b580083cfd0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f523243a0aa 00007f52324bc447 00007f52324d970a 00007f52324da76a 00007f52324d991b 00007f52324e503c 00007f52324e46b3 00007f52374a4d29 00007f5230a231d4 00007f5230a23162
0709 13:07:41.287093 (+ 86940us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b4c003ddd80. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52307aaa20 00007f52307bba29 00007f5230781644 00007f52307a8f2d 00007f52307a8b93 00007f52324371af 00007f5232436f3e 00007f52324bc888 00007f52324d975c 00007f52324da76a 00007f52324d991b
0709 13:07:41.318450 (+ 31357us) log.cc:844] Serialized 506 byte log entry
0709 13:07:41.428669 (+110219us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b2c000108d8. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5230dd7a11 00007f5230de6a0a 00007f5230de6693 00007f5230de6631 00007f523251ab52 00007f523251acf5 00007f5232457691 00007f5232437eaa 00007f523243ed53 00007f523243ecd9 00007f523243ec69
0709 13:07:41.728961 (+300292us) spinlock_profiling.cc:243] Waited 4.45 ms on lock 0x7b18003fc1c0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3bf2a6 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52307aaa20 00007f52307bba29 00007f52307bc13f 00007f52307802ab
0709 13:07:41.729603 (+   642us) spinlock_profiling.cc:243] Waited 41.2 ms on lock 0x7b4c003ddd80. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52307aaa20 00007f52307bba29 00007f52307bc13f 00007f52307802ab 00007f52307adf3c 00007f52307ae3fe 00007f5230a3b50b 00007f523243a381 00007f523243826b 00007f523243ed53 00007f523243ecd9
0709 13:07:41.910343 (+180740us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b1800010ce0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f523251ad01 00007f5232457691 00007f5232437eaa 00007f523243ed53 00007f523243ecd9 00007f523243ec69 00007f523243ec31 00007f523243ddfd 000000000038f354 000000000038f199
0709 13:07:42.899764 (+989421us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79675,"raft.queue_time_us":112606,"raft.run_cpu_time_us":9372,"raft.run_wall_time_us":985544,"spinlock_wait_cycles":468965760,"thread_start_us":141105,"threads_started":1}
I20260709 13:07:42.947686 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:42.954443 13801 tablet_copy_source_session.cc:215] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:42.963557 18168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b0054f48c4947acaea83521993a8f01. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:42.975159 13662 auto_rebalancer.cc:629] Failed to schedule move for tablet ac05b1933cb74e488759c38bd76d8d00: Illegal state: Replica 35ecb005831740438d7537dd4b840e03 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:07:42.983618 13662 auto_rebalancer.cc:629] Failed to schedule move for tablet cd386d71cc264abca3dbfa88ffd4e951: Illegal state: Replica b9d194f45e044e0988d5de1a99e5cd02 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:43.076859 18168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:56582 (request call id 1400) took 1015 ms. Trace:
I20260709 13:07:43.085323 13782 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:07:43.084520 18168 rpcz_store.cc:276] 0709 13:07:42.060906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.061009 (+   103us) service_pool.cc:224] Handling call
0709 13:07:42.320791 (+259782us) ts_tablet_manager.cc:934] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
0709 13:07:42.962070 (+641279us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:07:42.988638 (+ 26568us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:42.988757 (+   119us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:07:43.076049 (+ 87292us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:07:43.076388 (+   339us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:43.076691 (+   303us) ts_tablet_manager.cc:989] Replica registered.
0709 13:07:43.076744 (+    53us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":369,"tablet-copy.queue_time_us":192140,"thread_start_us":164651,"threads_started":2}
I20260709 13:07:43.086014 13782 raft_consensus.cc:606] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:07:43.086434 13782 raft_consensus.cc:614] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:43.086515 18168 tablet_copy_client.cc:806] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:43.087190 18168 tablet_copy_client.cc:670] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:43.091502 18168 tablet_copy_client.cc:538] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:43.097684 13713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:07:43.109025 13713 raft_consensus.cc:606] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:07:43.112565 13713 raft_consensus.cc:614] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:43.123927 13788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ff0635cc3464389804f1758fde23012"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:07:43.124576 13788 raft_consensus.cc:606] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:07:43.127446 13788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:07:43.128036 13788 raft_consensus.cc:606] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Received request to transfer leadership to TS ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:43.126570 18168 tablet_bootstrap.cc:492] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:07:43.137445 13782 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:07:43.138068 13782 raft_consensus.cc:606] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:07:43.138584 13782 raft_consensus.cc:614] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:43.145794 13788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa2169d517e24498a35dae28da79c931"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:07:43.146399 13788 raft_consensus.cc:606] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:07:43.147739 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:07:43.149302 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:43.213898 18184 raft_consensus.cc:993] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03: : Instructing follower b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:07:43.214443 18184 raft_consensus.cc:1081] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Signalling peer b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:07:43.216169 13864 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa2169d517e24498a35dae28da79c931"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:59780
I20260709 13:07:43.216701 13864 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:43.217026 13864 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:43.228118 13864 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:43.232249 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:43.232801 13782 raft_consensus.cc:3055] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:43.233095 13782 raft_consensus.cc:740] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:43.233752 13782 consensus_queue.cc:260] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:43.234869 13782 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:43.241225 13864 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:43.241436 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:43.242066 14401 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:43.248776 14401 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:43.250881 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:43.251773 17984 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:43.252259 17984 raft_consensus.cc:697] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:43.253108 17984 consensus_queue.cc:237] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:43.259851 13613 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57116 (request call id 229) took 3900 ms. Trace:
I20260709 13:07:43.267338 13782 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:43.260279 13613 rpcz_store.cc:276] 0709 13:07:39.359494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.359951 (+   457us) service_pool.cc:224] Handling call
0709 13:07:43.259758 (+3899807us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:42.698454 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:42.699044 (+   590us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:42.699253 (+   209us) write_op.cc:435] Acquired schema lock
0709 13:07:42.699271 (+    18us) tablet.cc:662] Decoding operations
0709 13:07:42.827592 (+128321us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:42.827679 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:42.827716 (+    37us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:07:42.829401 (+  1685us) tablet.cc:701] Row locks acquired
0709 13:07:42.829423 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:07:42.829563 (+   140us) write_op.cc:270] Start()
0709 13:07:42.829672 (+   109us) write_op.cc:276] Timestamp: P: 1783602462829518 usec, L: 0
0709 13:07:42.829698 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:07:42.830435 (+   737us) log.cc:844] Serialized 9085 byte log entry
0709 13:07:42.894344 (+ 63909us) op_driver.cc:464] REPLICATION: finished
0709 13:07:42.970898 (+ 76554us) write_op.cc:301] APPLY: starting
0709 13:07:42.970989 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:43.086497 (+115508us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:43.086591 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:43.201184 (+114593us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:43.202030 (+   846us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:07:43.202086 (+    56us) write_op.cc:312] APPLY: finished
0709 13:07:43.226025 (+ 23939us) log.cc:844] Serialized 204 byte log entry
0709 13:07:43.226781 (+   756us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:43.226981 (+   200us) write_op.cc:454] Released schema lock
0709 13:07:43.227036 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:43.227480 (+   444us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:43.227510 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":192728,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":66648,"apply.run_cpu_time_us":29914,"apply.run_wall_time_us":256542,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100267,"num_ops":23,"prepare.queue_time_us":14915,"prepare.run_cpu_time_us":6152,"prepare.run_wall_time_us":136207,"replication_time_us":11067,"spinlock_wait_cycles":1066752,"thread_start_us":60288,"threads_started":2}]]}
I20260709 13:07:43.300729 13614 catalog_manager.cc:5697] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 5 to 7, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 7 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.318722 13614 catalog_manager.cc:5697] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 7 to 9, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 9 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:43.334578 13614 catalog_manager.cc:5697] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 6 to 8, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 8 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:43.352797 13614 catalog_manager.cc:5697] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 6 to 8, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 8 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:43.359347 13614 catalog_manager.cc:5697] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 7 to 9, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 9 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.364809 13614 catalog_manager.cc:5697] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 8 to 10, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 10 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.393810 18140 raft_consensus.cc:993] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03: : Instructing follower b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:07:43.394366 18140 raft_consensus.cc:1081] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Signalling peer b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:07:43.398397 13865 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ff0635cc3464389804f1758fde23012"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:59780
I20260709 13:07:43.398941 13865 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:43.399269 13865 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.411234 18175 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.411857 18175 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:43.414089 18175 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:43.415122 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:43.417281 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:43.417896 13782 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:07:43.419108 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:43.420070 18175 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:43.420526 18175 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.420884 18175 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:43.428092 18175 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:43.432617 13614 catalog_manager.cc:5697] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 4 to 7, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 7 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.438321 18071 raft_consensus.cc:993] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03: : Instructing follower ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:07:43.438838 18071 raft_consensus.cc:1081] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Signalling peer ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:07:43.440490 14393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:56582
I20260709 13:07:43.441006 14393 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:43.441315 14393 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:43.434303 13614 catalog_manager.cc:5697] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 6 to 8, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 8 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:43.517663 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 74855.9us
I20260709 13:07:43.521492 17984 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:43.522042 17984 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:43.528604 13614 catalog_manager.cc:5697] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.529599 17984 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:43.530172 13614 catalog_manager.cc:5697] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 7 to 10, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 10 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:43.539598 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:43.540277 13788 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:07:43.546880 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:43.547501 13788 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:43.549297 13614 catalog_manager.cc:5697] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.550073 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:43.550776 13709 raft_consensus.cc:2393] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 11: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:43.550747 13614 catalog_manager.cc:5697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 7 to 8, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 8 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:43.543468 13829 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:43.557061 13614 catalog_manager.cc:5697] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:43.558635 13614 catalog_manager.cc:5697] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 10 to 11, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 11 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:43.559883 13614 catalog_manager.cc:5697] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:43.560956 13614 catalog_manager.cc:5697] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 12 to 14, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 14 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.562291 13614 catalog_manager.cc:5697] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:43.548116 13865 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:43.568248 14393 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:43.583588 17930 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:43.584091 17930 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:43.584483 17930 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:43.595009 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:43.595631 13782 raft_consensus.cc:3055] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:43.595937 13782 raft_consensus.cc:740] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:43.596666 13782 consensus_queue.cc:260] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:43.597711 13782 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:43.598693 14393 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:43.600977 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:43.594095 18193 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:43.605980 18193 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:43.608144 18193 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:43.609102 13790 raft_consensus.cc:3055] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:43.609462 13790 raft_consensus.cc:740] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:43.610185 13790 consensus_queue.cc:260] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:43.611436 13790 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.612851 13865 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:43.618037 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:43.618728 14401 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.628875 13782 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:07:43.631134 14366 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:43.629979 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:43.638775 13790 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
I20260709 13:07:43.617491 18175 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:43.644322 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:07:43.652212 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 112424us
I20260709 13:07:43.659720 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:43.659719 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:43.661043 13713 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:43.663014 14401 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
I20260709 13:07:43.680408 13710 raft_consensus.cc:2368] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19.
I20260709 13:07:43.685679 17916 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:43.686301 17916 raft_consensus.cc:697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:43.687189 17916 consensus_queue.cc:237] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:43.696332 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 101514us
W20260709 13:07:43.700307 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 98664.2us
I20260709 13:07:43.704293 18150 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:43.715566 18150 raft_consensus.cc:697] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 7 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:43.716511 18150 consensus_queue.cc:237] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:43.729199 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:43.729848 14401 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:07:43.734230 13788 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:07:43.740849 14401 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:07:43.741074 17930 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:43.748073 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 103878us
I20260709 13:07:43.748926 13713 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:07:43.756428 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:43.780375 18027 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:07:43.792212 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 130881us
I20260709 13:07:43.795327 14367 leader_election.cc:400] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19.
I20260709 13:07:43.795961 14367 leader_election.cc:403] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:43.802891 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:43.803785 13713 raft_consensus.cc:2393] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 11: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:43.813611 13786 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:43.824334 17930 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:43.839655 17916 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19.
I20260709 13:07:43.838414 18027 raft_consensus.cc:697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:43.840869 18027 consensus_queue.cc:237] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:43.852151 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:07:43.870311 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 54177.1us
W20260709 13:07:43.870544 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 49455.4us
I20260709 13:07:43.874074 13790 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:07:43.881085 18213 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:43.881258 13829 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:43.901777 14394 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:43.921705 17930 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:07:43.917696 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 94517us
I20260709 13:07:43.908712 18150 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:43.951898 18150 raft_consensus.cc:697] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:44.004310 18150 consensus_queue.cc:237] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:44.071894 18225 log.cc:927] Time spent T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:07:44.072567 18168 tablet_bootstrap.cc:492] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:44.073746 18168 tablet_bootstrap.cc:492] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:07:44.091969 18168 ts_tablet_manager.cc:1403] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.966s	user 0.034s	sys 0.028s
I20260709 13:07:44.104350 13710 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:44.104519 18168 raft_consensus.cc:359] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:44.105752 18168 raft_consensus.cc:740] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:07:44.106520 18168 consensus_queue.cc:260] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:44.109103 17916 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:44.113693 18168 ts_tablet_manager.cc:1434] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:07:44.117683 13801 tablet_copy_service.cc:342] P 35ecb005831740438d7537dd4b840e03: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-0b0054f48c4947acaea83521993a8f01 received from {username='slave'} at 127.0.0.1:45134
I20260709 13:07:44.118336 13801 tablet_copy_service.cc:434] P 35ecb005831740438d7537dd4b840e03: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-0b0054f48c4947acaea83521993a8f01 on tablet 0b0054f48c4947acaea83521993a8f01 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:44.150220 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:44.171816 13790 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:44.175964 17916 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:44.220443 14402 raft_consensus.cc:1217] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.7->[12.8-12.8]   Dedup: 12.8->[]
I20260709 13:07:44.261629 13786 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:44.263137 18207 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:44.283847 14402 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:07:44.285583 18177 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:44.290475 13612 catalog_manager.cc:5697] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 8 to 9, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 9 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:44.300951 14396 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:44.293166 13612 catalog_manager.cc:5697] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 4 to 9, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 9 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:44.319922 13612 catalog_manager.cc:5697] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 7 to 10, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 10 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:44.321796 18207 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:44.322075 13612 catalog_manager.cc:5697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 5 to 10, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 10 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.324098 13612 catalog_manager.cc:5697] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 10 to 13, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 13 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:44.350560 13612 catalog_manager.cc:5697] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 11 to 13, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 13 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:44.360625 13786 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:07:44.365590 18209 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:44.373333 13612 catalog_manager.cc:5697] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 12 to 13, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 13 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.375809 13612 catalog_manager.cc:5697] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 5 to 8, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 8 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:44.377835 13612 catalog_manager.cc:5697] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:07:44.380749 13614 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49436 (request call id 328) took 11284 ms (client timeout 15000 ms). Trace:
I20260709 13:07:44.382730 13612 catalog_manager.cc:5697] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 10 to 11, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 11 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:44.384326 13612 catalog_manager.cc:5697] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 7 to 8, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 8 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:44.385975 13612 catalog_manager.cc:5697] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 9 to 14, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 14 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:44.388031 13612 catalog_manager.cc:5697] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 8 to 10, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 10 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:44.390673 13612 catalog_manager.cc:5697] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 6 to 11, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 11 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
W20260709 13:07:44.381182 13614 rpcz_store.cc:269] 0709 13:07:33.096081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.097281 (+  1200us) service_pool.cc:224] Handling call
0709 13:07:44.380639 (+11283358us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:43.764786 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:43.822982 (+ 58196us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:43.824200 (+  1218us) write_op.cc:435] Acquired schema lock
0709 13:07:43.825333 (+  1133us) tablet.cc:662] Decoding operations
0709 13:07:43.841794 (+ 16461us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:43.841858 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:43.841888 (+    30us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:07:43.843181 (+  1293us) tablet.cc:701] Row locks acquired
0709 13:07:43.843203 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:07:43.843351 (+   148us) write_op.cc:270] Start()
0709 13:07:43.861478 (+ 18127us) write_op.cc:276] Timestamp: P: 1783602463843305 usec, L: 0
0709 13:07:43.861506 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:07:43.893667 (+ 32161us) log.cc:844] Serialized 6730 byte log entry
0709 13:07:44.009297 (+115630us) op_driver.cc:464] REPLICATION: finished
0709 13:07:44.036259 (+ 26962us) write_op.cc:301] APPLY: starting
0709 13:07:44.036383 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:44.097438 (+ 61055us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:44.097537 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:44.193409 (+ 95872us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:44.193695 (+   286us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:07:44.193739 (+    44us) write_op.cc:312] APPLY: finished
0709 13:07:44.194094 (+   355us) log.cc:844] Serialized 156 byte log entry
0709 13:07:44.194273 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:44.194471 (+   198us) write_op.cc:454] Released schema lock
0709 13:07:44.194525 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:44.195566 (+  1041us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:44.195592 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":184355,"reported_tablets":47,"spinlock_wait_cycles":5376,"child_traces":[["op",{"apply.queue_time_us":26647,"apply.run_cpu_time_us":24598,"apply.run_wall_time_us":159292,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75187,"num_ops":17,"prepare.queue_time_us":169855,"prepare.run_cpu_time_us":5697,"prepare.run_wall_time_us":137911,"replication_time_us":143757,"thread_start_us":101923,"threads_started":2}]]}
I20260709 13:07:44.440702 13788 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:44.442343 18213 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:44.478160 13713 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:44.481134 18217 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:44.528158 13613 catalog_manager.cc:5697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 10 to 12, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 12 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:44.529712 13613 catalog_manager.cc:5697] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 2 to 7, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 7 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:44.530998 13613 catalog_manager.cc:5697] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:44.541378 13613 catalog_manager.cc:5697] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:44.542953 13613 catalog_manager.cc:5697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:44.555018 13613 catalog_manager.cc:5697] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.556660 13613 catalog_manager.cc:5697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 11 to 17, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 17 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:44.574635 13613 catalog_manager.cc:5697] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 6 to 11, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 11 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:44.578637 13613 catalog_manager.cc:5697] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 10 to 11, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 11 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:44.583199 13613 catalog_manager.cc:5697] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:44.588761 13613 catalog_manager.cc:5697] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:44.590077 13613 catalog_manager.cc:5697] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 11 to 13, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 13 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:44.594002 13612 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49428 (request call id 329) took 6951 ms. Trace:
I20260709 13:07:44.598392 13613 catalog_manager.cc:5697] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 14 to 15, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 15 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:44.600348 13613 catalog_manager.cc:5697] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:44.595088 13612 rpcz_store.cc:276] 0709 13:07:37.642244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.642572 (+   328us) service_pool.cc:224] Handling call
0709 13:07:44.593923 (+6951351us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:44.404609 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:44.405202 (+   593us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:44.405247 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:07:44.405270 (+    23us) tablet.cc:662] Decoding operations
0709 13:07:44.406613 (+  1343us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:44.406688 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:44.406715 (+    27us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:07:44.430989 (+ 24274us) tablet.cc:701] Row locks acquired
0709 13:07:44.431008 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:07:44.431191 (+   183us) write_op.cc:270] Start()
0709 13:07:44.431307 (+   116us) write_op.cc:276] Timestamp: P: 1783602464431144 usec, L: 0
0709 13:07:44.431331 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:07:44.432885 (+  1554us) log.cc:844] Serialized 5557 byte log entry
0709 13:07:44.437217 (+  4332us) op_driver.cc:464] REPLICATION: finished
0709 13:07:44.437558 (+   341us) write_op.cc:301] APPLY: starting
0709 13:07:44.437637 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:44.460737 (+ 23100us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:44.460835 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:44.474823 (+ 13988us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:44.475065 (+   242us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:07:44.475108 (+    43us) write_op.cc:312] APPLY: finished
0709 13:07:44.475403 (+   295us) log.cc:844] Serialized 129 byte log entry
0709 13:07:44.477181 (+  1778us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:44.477340 (+   159us) write_op.cc:454] Released schema lock
0709 13:07:44.477394 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:44.477759 (+   365us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:44.477790 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1228893,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":109,"apply.run_cpu_time_us":16707,"apply.run_wall_time_us":40162,"cfile_cache_hit":56,"cfile_cache_hit_bytes":58520,"num_ops":14,"prepare.queue_time_us":6852,"prepare.run_cpu_time_us":4790,"prepare.run_wall_time_us":30579,"replication_time_us":5732,"spinlock_wait_cycles":1417472,"thread_start_us":9991,"threads_started":1}]]}
I20260709 13:07:44.604187 13613 catalog_manager.cc:5697] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.605783 13613 catalog_manager.cc:5697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 8 to 11, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 11 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:44.688014 13613 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57116 (request call id 230) took 1312 ms. Trace:
I20260709 13:07:44.701819 13711 consensus_queue.cc:237] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:44.688431 13613 rpcz_store.cc:276] 0709 13:07:43.373676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.381675 (+  7999us) service_pool.cc:224] Handling call
0709 13:07:44.686171 (+1304496us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:44.612273 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:44.612825 (+   552us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:44.612856 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:07:44.612869 (+    13us) tablet.cc:662] Decoding operations
0709 13:07:44.614034 (+  1165us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:44.614084 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:44.614113 (+    29us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:07:44.615249 (+  1136us) tablet.cc:701] Row locks acquired
0709 13:07:44.615263 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:07:44.615395 (+   132us) write_op.cc:270] Start()
0709 13:07:44.615542 (+   147us) write_op.cc:276] Timestamp: P: 1783602464615352 usec, L: 0
0709 13:07:44.615563 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:07:44.617631 (+  2068us) log.cc:844] Serialized 6278 byte log entry
0709 13:07:44.620154 (+  2523us) op_driver.cc:464] REPLICATION: finished
0709 13:07:44.620577 (+   423us) write_op.cc:301] APPLY: starting
0709 13:07:44.620652 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:44.640854 (+ 20202us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:44.640945 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:44.661537 (+ 20592us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:44.662054 (+   517us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:07:44.662166 (+   112us) write_op.cc:312] APPLY: finished
0709 13:07:44.662595 (+   429us) log.cc:844] Serialized 148 byte log entry
0709 13:07:44.662745 (+   150us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:44.662900 (+   155us) write_op.cc:454] Released schema lock
0709 13:07:44.662954 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:44.663247 (+   293us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:44.663272 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":20614,"reported_tablets":23,"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":211,"apply.run_cpu_time_us":16401,"apply.run_wall_time_us":42643,"cfile_cache_hit":64,"cfile_cache_hit_bytes":66880,"num_ops":16,"prepare.queue_time_us":115,"prepare.run_cpu_time_us":4309,"prepare.run_wall_time_us":5617,"replication_time_us":4470}]]}
I20260709 13:07:44.750660 14402 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:44.752666 18177 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:44.779503 13865 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:44.781154 18209 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:44.832031 17943 raft_consensus.cc:1064] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:07:44.834774 17943 consensus_queue.cc:237] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 6, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:44.836167 13613 catalog_manager.cc:5697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 12 to 13, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 13 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.838104 13613 catalog_manager.cc:5697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:44.839685 13613 catalog_manager.cc:5697] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 7 to 8, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 8 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:44.848606 18001 raft_consensus.cc:2955] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:44.853776 13865 raft_consensus.cc:2955] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:44.858300 13613 catalog_manager.cc:5697] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 6 to 7, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 7 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:44.860280 13613 catalog_manager.cc:5697] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index -1 to 8, term changed from 10 to 12, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130), NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 12 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:07:44.863868 14402 raft_consensus.cc:2955] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:44.877681 13600 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ac05b1933cb74e488759c38bd76d8d00 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:07:44.910678 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 70627.6us
I20260709 13:07:44.955193 14402 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 12 LEARNER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:07:44.953397 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 50982.7us
I20260709 13:07:44.957962 13609 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49444 (request call id 321) took 5451 ms. Trace:
I20260709 13:07:44.958453 13609 rpcz_store.cc:276] 0709 13:07:39.506954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.507265 (+   311us) service_pool.cc:224] Handling call
0709 13:07:44.957890 (+5450625us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10460,"reported_tablets":46}
I20260709 13:07:44.982682 18248 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
W20260709 13:07:45.095918 18124 log.cc:927] Time spent T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:07:45.123852 13709 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:45.125394 18246 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:45.138360 13862 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:45.142913 18249 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
W20260709 13:07:45.185673 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 85741.9us
I20260709 13:07:45.281284 13614 catalog_manager.cc:5697] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:45.289379 13614 catalog_manager.cc:5697] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 7 to 10, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 10 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:45.291492 13614 catalog_manager.cc:5697] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:45.299650 13614 catalog_manager.cc:5697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 5 to 8, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 8 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:45.301949 13614 catalog_manager.cc:5697] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 8 to 9, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 9 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
W20260709 13:07:45.303987 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 347244us
I20260709 13:07:45.308832 13614 catalog_manager.cc:5697] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:45.310379 13614 catalog_manager.cc:5697] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 4 to 8, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 8 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:45.312304 13614 catalog_manager.cc:5697] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 6 to 7, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 7 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:45.313648 13614 catalog_manager.cc:5697] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:45.315595 13614 catalog_manager.cc:5697] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 11 to 12, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 12 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
W20260709 13:07:45.409310 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 307549us
I20260709 13:07:45.429692 13859 raft_consensus.cc:2955] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:45.426230 18248 raft_consensus.cc:2955] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 8 to 9, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:45.439270 13609 catalog_manager.cc:5697] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 9 to 10, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New cstate: current_term: 10 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:45.474053 13777 tablet_service.cc:1558] Processing DeleteTablet for tablet ac05b1933cb74e488759c38bd76d8d00 with delete_type TABLET_DATA_TOMBSTONED (TS 35ecb005831740438d7537dd4b840e03 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:48902
I20260709 13:07:45.478377 14396 raft_consensus.cc:2955] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:45.528627 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:45.567155 13713 raft_consensus.cc:2955] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:45.568439 13609 catalog_manager.cc:5697] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 8 to 9, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } attrs { replace: true } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:45.557816 18270 tablet_replica.cc:333] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:07:45.619683 18270 raft_consensus.cc:2243] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:45.620584 18270 raft_consensus.cc:2272] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:45.624147 18270 ts_tablet_manager.cc:1916] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:45.635313 13614 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49436 (request call id 329) took 1047 ms. Trace:
I20260709 13:07:45.635751 13614 rpcz_store.cc:276] 0709 13:07:44.588115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.588277 (+   162us) service_pool.cc:224] Handling call
0709 13:07:45.635253 (+1046976us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:45.371906 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:45.372477 (+   571us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:45.372520 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:07:45.372536 (+    16us) tablet.cc:662] Decoding operations
0709 13:07:45.373516 (+   980us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:45.373567 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:45.373592 (+    25us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:07:45.374457 (+   865us) tablet.cc:701] Row locks acquired
0709 13:07:45.374478 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:07:45.374629 (+   151us) write_op.cc:270] Start()
0709 13:07:45.374741 (+   112us) write_op.cc:276] Timestamp: P: 1783602465374582 usec, L: 0
0709 13:07:45.374764 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:07:45.375490 (+   726us) log.cc:844] Serialized 4034 byte log entry
0709 13:07:45.377560 (+  2070us) op_driver.cc:464] REPLICATION: finished
0709 13:07:45.378113 (+   553us) write_op.cc:301] APPLY: starting
0709 13:07:45.378216 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:45.384864 (+  6648us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:45.385008 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:45.392382 (+  7374us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:45.392709 (+   327us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:07:45.392784 (+    75us) write_op.cc:312] APPLY: finished
0709 13:07:45.393202 (+   418us) log.cc:844] Serialized 97 byte log entry
0709 13:07:45.407358 (+ 14156us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:45.411147 (+  3789us) write_op.cc:454] Released schema lock
0709 13:07:45.414341 (+  3194us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:45.418222 (+  3881us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:45.418399 (+   177us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":91804,"reported_tablets":38,"spinlock_wait_cycles":7936,"child_traces":[["op",{"apply.queue_time_us":289,"apply.run_cpu_time_us":15348,"apply.run_wall_time_us":39240,"cfile_cache_hit":40,"cfile_cache_hit_bytes":41800,"num_ops":10,"prepare.queue_time_us":2786,"prepare.run_cpu_time_us":3885,"prepare.run_wall_time_us":3892,"replication_time_us":2659,"spinlock_wait_cycles":115072}]]}
I20260709 13:07:45.674364 13788 consensus_queue.cc:237] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:45.691164 14393 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:45.692904 18248 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:45.702414 18249 raft_consensus.cc:2955] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:45.707664 13862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:07:45.708253 13862 raft_consensus.cc:606] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:07:45.711103 13713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:07:45.711669 13713 raft_consensus.cc:606] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Received request to transfer leadership to TS ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:45.710906 14393 raft_consensus.cc:2955] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:45.716336 13711 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:45.717954 18246 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:45.722970 13862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:07:45.723613 13862 raft_consensus.cc:606] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:07:45.726450 13713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:07:45.726971 13713 raft_consensus.cc:606] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Received request to transfer leadership to TS ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:45.727550 13711 raft_consensus.cc:2955] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:45.741640 18256 raft_consensus.cc:993] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02: : Instructing follower ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:07:45.742202 18209 raft_consensus.cc:1081] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Signalling peer ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:07:45.743723 14396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:56570
I20260709 13:07:45.744302 14396 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:45.744668 14396 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.748741 13862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa2169d517e24498a35dae28da79c931"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:07:45.749418 13862 raft_consensus.cc:606] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Received request to transfer leadership to TS ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:45.750726 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:45.751659 14396 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:45.752413 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:45.757398 18270 ts_tablet_manager.cc:1929] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.9
I20260709 13:07:45.757849 18270 log.cc:1199] T ac05b1933cb74e488759c38bd76d8d00 P 35ecb005831740438d7537dd4b840e03: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-1-root/wals/ac05b1933cb74e488759c38bd76d8d00
I20260709 13:07:45.759641 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:45.760197 13858 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.761164 18260 raft_consensus.cc:993] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7: : Instructing follower 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:07:45.761608 18260 raft_consensus.cc:1081] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Signalling peer 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:07:45.762419 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:45.762951 13713 raft_consensus.cc:3055] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:45.763239 13782 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:48914
I20260709 13:07:45.763217 13713 raft_consensus.cc:740] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:45.763772 13599 catalog_manager.cc:5028] TS 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): tablet ac05b1933cb74e488759c38bd76d8d00 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:07:45.764740 13713 consensus_queue.cc:260] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:45.765769 13713 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.763835 13782 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:45.767832 13782 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:45.769253 13858 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:45.770438 14368 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:45.771271 18268 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:45.772498 18268 raft_consensus.cc:697] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 9 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:45.773346 18268 consensus_queue.cc:237] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:45.775645 13782 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:45.775739 14396 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:45.778177 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:45.778738 13710 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:45.786000 13710 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:07:45.787050 13782 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:45.788076 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:45.788686 13858 raft_consensus.cc:3055] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:45.789031 13858 raft_consensus.cc:740] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:45.789865 13858 consensus_queue.cc:260] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:45.790915 13858 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:45.800909 13713 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:45.805436 13613 catalog_manager.cc:5697] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 8 to 9, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 9 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:45.822832 13756 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:45.823848 18248 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:45.829653 13613 catalog_manager.cc:5697] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 9 to 10, VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131) evicted. New cstate: current_term: 12 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:45.824640 18248 raft_consensus.cc:697] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:45.831578 18248 consensus_queue.cc:237] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:45.839658 13599 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0b0054f48c4947acaea83521993a8f01 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:45.849587 13848 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b0054f48c4947acaea83521993a8f01 with delete_type TABLET_DATA_TOMBSTONED (TS b5029654a4384e43a68eb67b794949b7 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:59764
I20260709 13:07:45.853837 13858 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:07:45.893676 18272 tablet_replica.cc:333] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:07:45.894784 18272 raft_consensus.cc:2243] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:45.899019 13613 catalog_manager.cc:5697] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 10 to 11, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 11 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:45.899997 18272 raft_consensus.cc:2272] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:45.909479 18272 ts_tablet_manager.cc:1916] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:45.951203 18250 raft_consensus.cc:993] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02: : Instructing follower ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:07:45.951782 18209 raft_consensus.cc:1081] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Signalling peer ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:07:45.953322 18264 raft_consensus.cc:993] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7: : Instructing follower ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:07:45.953485 14394 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:56570
I20260709 13:07:45.953858 18150 raft_consensus.cc:1081] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Signalling peer ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:07:45.954059 14394 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:45.953099 18272 ts_tablet_manager.cc:1929] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.9
I20260709 13:07:45.954942 18272 log.cc:1199] T 0b0054f48c4947acaea83521993a8f01 P b5029654a4384e43a68eb67b794949b7: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-2-root/wals/0b0054f48c4947acaea83521993a8f01
I20260709 13:07:45.956243 14393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa2169d517e24498a35dae28da79c931"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:56558
I20260709 13:07:45.956854 14393 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:45.957239 14393 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.954459 14394 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:45.982465 13601 catalog_manager.cc:5028] TS b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): tablet 0b0054f48c4947acaea83521993a8f01 (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:07:45.987609 18264 raft_consensus.cc:993] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7: : Instructing follower 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:07:45.990608 18264 raft_consensus.cc:1081] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Signalling peer 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:07:45.993422 13782 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:48914
I20260709 13:07:45.996552 13782 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:45.997102 13782 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:46.003136 14393 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:46.011842 14394 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:46.015100 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:46.015746 13711 raft_consensus.cc:3055] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:46.016028 13711 raft_consensus.cc:740] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:46.016786 13711 consensus_queue.cc:260] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:46.018568 13711 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:46.034372 14394 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:46.036970 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:46.043476 13788 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:46.043335 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:46.044107 13859 raft_consensus.cc:3055] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:46.044425 13859 raft_consensus.cc:740] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:46.045186 13859 consensus_queue.cc:260] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:46.046310 13859 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:46.038434 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:46.048136 13858 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:46.057621 13788 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:46.059024 14366 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:46.059898 18268 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:46.060412 18268 raft_consensus.cc:697] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 9 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:46.061323 18268 consensus_queue.cc:237] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:46.062014 13858 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:07:46.063162 14368 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:46.064090 18261 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:46.075562 14393 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:46.114286 13711 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:07:46.114275 13859 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:46.117139 13782 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:46.121161 13782 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:46.121191 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:46.126739 13711 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:46.131858 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:46.134817 13711 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:07:46.134963 13859 raft_consensus.cc:3055] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:46.135620 13710 raft_consensus.cc:1240] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:46.135810 13859 raft_consensus.cc:740] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:46.137181 13756 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:46.137346 13859 consensus_queue.cc:260] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:46.138293 18248 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:46.155027 18248 raft_consensus.cc:697] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:46.155967 18248 consensus_queue.cc:237] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:46.150453 13859 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:46.141145 18261 raft_consensus.cc:697] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 11 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:46.172250 18261 consensus_queue.cc:237] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:46.220767 13613 catalog_manager.cc:5697] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 8 to 9, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 9 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:46.232712 13859 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:07:46.238605 13609 catalog_manager.cc:5697] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 11 to 12, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 12 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:46.247108 13613 catalog_manager.cc:5697] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 10 to 11, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 11 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:46.272504 13710 raft_consensus.cc:1275] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:46.274258 18248 consensus_queue.cc:1048] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:46.321503 13859 raft_consensus.cc:1275] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:46.323088 18253 consensus_queue.cc:1048] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:46.333719 13858 raft_consensus.cc:1275] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:46.335397 18278 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:46.357259 13711 raft_consensus.cc:1275] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:46.358657 18278 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:46.559206 13788 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:46.561398 18278 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:46.578770 13711 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:46.582497 18259 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:46.594515 13858 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:46.596146 18259 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:46.659687 13864 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:46.661973 18261 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:46.665449 13864 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:46.667902 18278 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:46.704555 13711 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:46.709595 18278 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:07:46.753419 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:46.780822 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 59241.3us
I20260709 13:07:47.019043 13711 consensus_queue.cc:237] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:47.040270 13858 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:07:47.043711 13680 consensus_peers.cc:597] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b7aeef8df5a945efb8666f30fe979ab7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:47.047333 13788 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:47.048264 18250 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:47.058562 18250 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:47.090610 18256 raft_consensus.cc:2955] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:07:47.102142 13782 raft_consensus.cc:2955] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:07:47.166946 13613 catalog_manager.cc:5697] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index -1 to 8, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 12 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:07:47.173225 13859 raft_consensus.cc:2955] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:07:47.177829 13858 consensus_queue.cc:237] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
W20260709 13:07:47.207958 13829 consensus_peers.cc:597] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 536b1fc131984687bf3b13417507e21d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:47.212443 13782 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:47.213963 18150 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:47.249815 18150 raft_consensus.cc:2955] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:07:47.254676 13710 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:47.258773 13782 raft_consensus.cc:2955] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:07:47.273969 18264 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:47.302783 13609 catalog_manager.cc:5697] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index -1 to 9, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 12 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
W20260709 13:07:47.367703 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 73259.1us
W20260709 13:07:47.402072 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 52434.1us
I20260709 13:07:47.417156 13710 raft_consensus.cc:2955] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:07:47.487957 13864 consensus_queue.cc:237] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
W20260709 13:07:47.562001 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 51500.4us
I20260709 13:07:47.603101 13782 raft_consensus.cc:1275] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:47.603837 13710 raft_consensus.cc:1275] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:47.606436 18317 consensus_queue.cc:1048] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:07:47.610286 13829 consensus_peers.cc:597] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 -> Peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Couldn't send request to peer ceb06175847b428ea8bd77055fcddf58. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c9e22f0634b34971aed9c5b948f3275e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:47.611470 18309 consensus_queue.cc:1048] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:47.679920 18318 raft_consensus.cc:2955] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:07:47.683460 13782 raft_consensus.cc:2955] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:07:47.684477 13710 raft_consensus.cc:2955] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } } }
I20260709 13:07:47.712769 13609 catalog_manager.cc:5697] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index -1 to 6, NON_VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) added. New cstate: current_term: 8 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:47.728307 18331 ts_tablet_manager.cc:933] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:47.747831 18331 tablet_copy_client.cc:323] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.131:46015
I20260709 13:07:47.749742 13875 tablet_copy_service.cc:140] P b5029654a4384e43a68eb67b794949b7: Received BeginTabletCopySession request for tablet 536b1fc131984687bf3b13417507e21d from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:42104)
I20260709 13:07:47.750301 13875 tablet_copy_service.cc:161] P b5029654a4384e43a68eb67b794949b7: Beginning new tablet copy session on tablet 536b1fc131984687bf3b13417507e21d from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:42104: session id = ceb06175847b428ea8bd77055fcddf58-536b1fc131984687bf3b13417507e21d
I20260709 13:07:47.759967 13875 tablet_copy_source_session.cc:215] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:47.770961 18331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 536b1fc131984687bf3b13417507e21d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.848030 18331 tablet_copy_client.cc:806] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:47.852339 18331 tablet_copy_client.cc:670] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:47.867482 18331 tablet_copy_client.cc:538] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:47.877151 18333 ts_tablet_manager.cc:933] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533)
I20260709 13:07:47.879240 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:47.905582 18331 tablet_bootstrap.cc:492] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:07:47.925709 18333 tablet_copy_client.cc:323] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.129:37533
I20260709 13:07:47.930267 13726 tablet_copy_service.cc:140] P b9d194f45e044e0988d5de1a99e5cd02: Received BeginTabletCopySession request for tablet b7aeef8df5a945efb8666f30fe979ab7 from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:58552)
I20260709 13:07:47.930871 13726 tablet_copy_service.cc:161] P b9d194f45e044e0988d5de1a99e5cd02: Beginning new tablet copy session on tablet b7aeef8df5a945efb8666f30fe979ab7 from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:58552: session id = ceb06175847b428ea8bd77055fcddf58-b7aeef8df5a945efb8666f30fe979ab7
I20260709 13:07:47.953900 13726 tablet_copy_source_session.cc:215] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:47.963055 18333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7aeef8df5a945efb8666f30fe979ab7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:48.298580 13599 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f09ef105d67b41dba510b44a6567d790 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 35ecb005831740438d7537dd4b840e03 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 10 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:48.313514 13710 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82e0eeb1582143a09acf311171812faa"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:07:48.314183 13710 raft_consensus.cc:606] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Received request to transfer leadership to TS ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:48.323102 13711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:07:48.323833 13711 raft_consensus.cc:606] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Received request to transfer leadership to TS ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:48.327545 13711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:07:48.328258 13711 raft_consensus.cc:606] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:07:48.331589 13710 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:07:48.332269 13710 raft_consensus.cc:606] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:07:48.333766 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:07:48.335628 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:48.335657 18341 ts_tablet_manager.cc:933] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58: Initiating tablet copy from peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:48.354261 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 86525.2us
I20260709 13:07:48.392973 18333 tablet_copy_client.cc:806] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:48.393559 18333 tablet_copy_client.cc:670] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:48.400696 18333 tablet_copy_client.cc:538] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:48.408149 18315 raft_consensus.cc:993] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02: : Instructing follower b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:07:48.408775 18250 raft_consensus.cc:1081] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Signalling peer b5029654a4384e43a68eb67b794949b7 to start an election
W20260709 13:07:48.413648 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 91213.3us
I20260709 13:07:48.422290 13858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:59792
I20260709 13:07:48.423082 13858 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:48.423436 13858 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:48.426527 18331 log.cc:927] Time spent T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.067s	user 0.001s	sys 0.003s
I20260709 13:07:48.435791 18315 raft_consensus.cc:993] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02: : Instructing follower ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:07:48.436329 18315 raft_consensus.cc:1081] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Signalling peer ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:07:48.438614 13858 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:48.458016 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:48.458611 13711 raft_consensus.cc:3055] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:48.458902 13711 raft_consensus.cc:740] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:48.465718 13711 consensus_queue.cc:260] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:48.466681 13711 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:48.473887 13858 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:48.475517 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:48.476086 13788 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:48.476841 18341 tablet_copy_client.cc:323] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58: tablet copy: Beginning tablet copy session from remote peer at address 127.12.76.131:46015
I20260709 13:07:48.479641 13875 tablet_copy_service.cc:140] P b5029654a4384e43a68eb67b794949b7: Received BeginTabletCopySession request for tablet c9e22f0634b34971aed9c5b948f3275e from peer ceb06175847b428ea8bd77055fcddf58 ({username='slave'} at 127.0.0.1:42104)
I20260709 13:07:48.480155 13875 tablet_copy_service.cc:161] P b5029654a4384e43a68eb67b794949b7: Beginning new tablet copy session on tablet c9e22f0634b34971aed9c5b948f3275e from peer ceb06175847b428ea8bd77055fcddf58 at {username='slave'} at 127.0.0.1:42104: session id = ceb06175847b428ea8bd77055fcddf58-c9e22f0634b34971aed9c5b948f3275e
I20260709 13:07:48.480302 18333 tablet_bootstrap.cc:492] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:07:48.480232 13711 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:48.481582 13830 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:48.484539 13788 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:48.486902 18318 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:48.487430 18318 raft_consensus.cc:697] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:48.487977 13782 raft_consensus.cc:1240] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:48.488246 18318 consensus_queue.cc:237] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:48.490304 13875 tablet_copy_source_session.cc:215] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:48.498776 18341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9e22f0634b34971aed9c5b948f3275e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.507474 18331 tablet_bootstrap.cc:492] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:48.508447 18331 tablet_bootstrap.cc:492] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:07:48.509137 18331 ts_tablet_manager.cc:1403] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.604s	user 0.041s	sys 0.031s
I20260709 13:07:48.520887 18331 raft_consensus.cc:359] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:48.523248 18331 raft_consensus.cc:740] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:07:48.525126 18331 consensus_queue.cc:260] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:48.529212 18331 ts_tablet_manager.cc:1434] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
W20260709 13:07:48.530222 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 97865.6us
I20260709 13:07:48.532430 13875 tablet_copy_service.cc:342] P b5029654a4384e43a68eb67b794949b7: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-536b1fc131984687bf3b13417507e21d received from {username='slave'} at 127.0.0.1:42104
I20260709 13:07:48.532950 13875 tablet_copy_service.cc:434] P b5029654a4384e43a68eb67b794949b7: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-536b1fc131984687bf3b13417507e21d on tablet 536b1fc131984687bf3b13417507e21d with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:48.544215 18341 tablet_copy_client.cc:806] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:48.544919 18341 tablet_copy_client.cc:670] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:48.551107 13614 catalog_manager.cc:5697] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 8 to 9, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 9 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:48.551788 18341 tablet_copy_client.cc:538] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:48.561760 18341 tablet_bootstrap.cc:492] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58: Bootstrap starting.
I20260709 13:07:48.596565 18343 raft_consensus.cc:993] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: : Instructing follower ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:07:48.597280 18338 raft_consensus.cc:1081] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Signalling peer ceb06175847b428ea8bd77055fcddf58 to start an election
I20260709 13:07:48.606225 14396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82e0eeb1582143a09acf311171812faa"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:56570
I20260709 13:07:48.606818 14396 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:48.607156 14396 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:48.614073 14396 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:48.616896 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:48.617591 13711 raft_consensus.cc:3055] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:48.618026 13711 raft_consensus.cc:740] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:48.618934 13711 consensus_queue.cc:260] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:48.622095 13711 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:48.629662 14396 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:48.630396 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:48.631206 13859 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:48.635484 13711 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:48.640426 14367 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:48.641582 18281 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:48.642311 18281 raft_consensus.cc:697] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:48.643186 18281 consensus_queue.cc:237] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:48.667315 14394 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:56570
I20260709 13:07:48.667953 14394 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:48.668289 14394 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:48.672735 18343 raft_consensus.cc:993] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: : Instructing follower 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:07:48.673214 18343 raft_consensus.cc:1081] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Signalling peer 35ecb005831740438d7537dd4b840e03 to start an election
I20260709 13:07:48.675194 14394 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:48.667284 13859 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:48.705457 13788 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:48928
I20260709 13:07:48.706044 13788 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:48.706386 13788 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:48.714823 18333 tablet_bootstrap.cc:492] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:48.714586 13788 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:48.728340 18333 tablet_bootstrap.cc:492] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:07:48.729185 18333 ts_tablet_manager.cc:1403] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.249s	user 0.038s	sys 0.000s
I20260709 13:07:48.736518 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:48.737193 13710 raft_consensus.cc:3055] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:48.737521 13710 raft_consensus.cc:740] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:48.738351 18341 tablet_bootstrap.cc:492] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:48.738308 13710 consensus_queue.cc:260] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:48.752166 13710 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:48.752291 18341 tablet_bootstrap.cc:492] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58: Bootstrap complete.
I20260709 13:07:48.753388 18341 ts_tablet_manager.cc:1403] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58: Time spent bootstrapping tablet: real 0.192s	user 0.071s	sys 0.038s
I20260709 13:07:48.745466 18333 raft_consensus.cc:359] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:48.757829 18333 raft_consensus.cc:740] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:07:48.732823 13614 catalog_manager.cc:5697] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 7 to 8, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 8 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:48.749399 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:48.758646 18333 consensus_queue.cc:260] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:48.761169 13790 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:48.769245 18333 ts_tablet_manager.cc:1434] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:07:48.775624 18341 raft_consensus.cc:359] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:48.788671 18341 raft_consensus.cc:740] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Initialized, Role: LEARNER
I20260709 13:07:48.789465 18341 consensus_queue.cc:260] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:48.791689 13726 tablet_copy_service.cc:342] P b9d194f45e044e0988d5de1a99e5cd02: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-b7aeef8df5a945efb8666f30fe979ab7 received from {username='slave'} at 127.0.0.1:58552
I20260709 13:07:48.792238 13726 tablet_copy_service.cc:434] P b9d194f45e044e0988d5de1a99e5cd02: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-b7aeef8df5a945efb8666f30fe979ab7 on tablet b7aeef8df5a945efb8666f30fe979ab7 with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:48.792546 18341 ts_tablet_manager.cc:1434] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58: Time spent starting tablet: real 0.039s	user 0.002s	sys 0.005s
I20260709 13:07:48.776225 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:48.793859 13711 raft_consensus.cc:3055] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:48.794803 13875 tablet_copy_service.cc:342] P b5029654a4384e43a68eb67b794949b7: Request end of tablet copy session ceb06175847b428ea8bd77055fcddf58-c9e22f0634b34971aed9c5b948f3275e received from {username='slave'} at 127.0.0.1:42104
I20260709 13:07:48.798161 13875 tablet_copy_service.cc:434] P b5029654a4384e43a68eb67b794949b7: ending tablet copy session ceb06175847b428ea8bd77055fcddf58-c9e22f0634b34971aed9c5b948f3275e on tablet c9e22f0634b34971aed9c5b948f3275e with peer ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:48.799223 13711 raft_consensus.cc:740] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:48.800285 13711 consensus_queue.cc:260] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:48.804778 13711 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:48.815996 14396 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:48.832646 13711 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 20.
I20260709 13:07:48.835870 14367 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:48.841969 18261 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:48.842540 18261 raft_consensus.cc:697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 20 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:48.846815 18261 consensus_queue.cc:237] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:48.862160 14396 raft_consensus.cc:1217] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.7->[12.8-12.8]   Dedup: 12.8->[]
I20260709 13:07:48.902043 13790 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 20.
I20260709 13:07:48.884121 14394 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:48.908772 13788 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:48.930066 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:48.930750 13858 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:48.945557 13858 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:49.561332 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:49.891773 13710 consensus_meta.cc:287] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 1.139s	user 0.012s	sys 0.018s
I20260709 13:07:49.894214 13710 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:49.895423 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 2814) took 1159 ms. Trace:
I20260709 13:07:49.895871 13710 rpcz_store.cc:276] 0709 13:07:48.736072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.736239 (+   167us) service_pool.cc:224] Handling call
0709 13:07:49.895276 (+1159037us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.961210 13713 raft_consensus.cc:1275] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:49.961905 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2361) took 1016 ms. Trace:
I20260709 13:07:49.962195 13713 rpcz_store.cc:276] 0709 13:07:48.945340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.960154 (+1014814us) service_pool.cc:224] Handling call
0709 13:07:49.960541 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.961692 (+  1151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.961855 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:50.143576 18361 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.144593 18361 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:50.151118 18360 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:50.151943 18361 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.152207 18360 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.159571 18361 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.160686 18361 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.167850 18365 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:50.169420 18365 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:50.173316 18365 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.186437 18360 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.191972 18363 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:50.221710 18361 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.233381 18363 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.235692 18361 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.236512 18361 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.239650 18377 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:50.228017 18368 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.230494 18362 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:50.241557 18361 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.256956 18375 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:50.258008 18375 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.261762 18375 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.268811 18377 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:50.240653 18363 leader_election.cc:290] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.267807 18367 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:50.275044 18362 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.303026 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2360) took 1370 ms. Trace:
I20260709 13:07:50.303618 13711 rpcz_store.cc:276] 0709 13:07:48.932884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.301806 (+1368922us) service_pool.cc:224] Handling call
0709 13:07:50.302228 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.302542 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.302570 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:50.302615 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:50.302647 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.302705 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.302817 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:50.305563 18367 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.307809 18327 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:50.308168 18367 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.308559 18327 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.310248 18362 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.312834 18377 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:50.333801 18368 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.337049 18368 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.327721 18367 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:50.343055 18367 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.345461 18364 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:50.349035 18370 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:50.349706 18380 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:50.317268 18360 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.368086 18250 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.369778 18250 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:50.371493 18360 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:50.373909 18360 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.350142 18361 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:50.378005 18356 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:50.377738 18370 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.378518 18357 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:50.382165 18373 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.382277 18369 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:50.382884 18355 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:50.383517 18380 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.384291 18360 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.384748 18374 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:50.380172 18338 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:07:50.419829 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 452245us
I20260709 13:07:50.434188 18373 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.435932 18382 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:50.436650 18373 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.436972 18370 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.437206 18373 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.437569 18357 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:50.437814 18373 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:50.440363 18357 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.440780 18362 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:50.441140 18379 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:50.441555 18362 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.441928 18379 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.442742 18376 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:50.436774 18382 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:50.450980 18385 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.451606 18356 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:50.452168 18373 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.456954 18327 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.457283 18250 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.428768 18364 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.478430 18250 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.479024 18250 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:50.479919 18364 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:50.479992 18360 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:50.457724 18343 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.480633 18376 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.459043 18366 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:50.481686 18382 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:50.482223 18366 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.427579 18361 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.477738 18359 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:50.483886 18359 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.484712 18361 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.484869 18366 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.460145 18383 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:50.485922 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:50.458539 18387 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:50.459657 18390 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:50.432996 18369 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.460831 18374 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.462172 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:50.421196 18372 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:50.477696 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:50.431548 18355 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.482736 18391 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.427366 18363 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:50.486631 18383 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.486886 18377 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:50.463605 18389 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:50.479321 18358 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.482908 18367 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.588117 18361 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.588469 18399 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.594003 18389 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.472043 18338 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:50.596503 18389 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.597344 18338 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.597223 18363 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:50.598135 18391 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.581929 18359 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.594880 18361 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:50.559877 18380 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:50.587458 18379 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:50.487278 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:50.543741 18371 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:50.481676 18343 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.495249 18394 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:50.600984 18358 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:50.600311 18363 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.496599 18392 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:50.494119 18388 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.601948 18377 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.543919 18370 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:50.593289 18360 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.490001 18356 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.600311 18391 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.485848 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:50.583436 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:50.486632 13859 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:07:50.706609 13857 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:50.716140 18392 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.711526 18386 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:50.711517 18372 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.718001 18386 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.719147 18392 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.699136 18361 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.713788 18250 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.719892 18388 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:50.594895 18399 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:50.700727 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:50.721029 13858 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:07:50.546440 18362 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.721673 18372 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:50.733613 18355 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.733899 18372 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:50.730507 18389 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.543690 18381 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:50.722002 18386 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.487720 18387 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.491791 18385 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:50.747051 18371 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.546820 18366 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.596237 18369 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.706156 18382 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:50.701334 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:50.474738 18357 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.731602 18390 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:50.732046 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 220314us
I20260709 13:07:50.732731 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:50.733213 18399 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.700268 18395 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:50.570674 18365 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.742976 13713 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:07:50.482909 18376 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.743817 18327 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:50.789259 18327 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:50.775380 18362 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:50.790603 18362 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.748315 18377 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.791615 18327 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.643986 18359 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.735121 18338 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.734650 18372 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.755594 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:50.775156 18357 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:50.781780 18379 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:50.830951 18379 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.833189 18379 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:50.782081 18381 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.761049 18383 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.782582 18371 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:50.783039 18395 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.784557 18390 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.786056 13757 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:50.788026 18386 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:50.917979 18386 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:50.919028 13784 raft_consensus.cc:1275] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:50.788110 18376 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:50.919759 18376 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.921646 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:50.921890 18376 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.788707 18378 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:50.755509 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:50.755267 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:50.922792 18378 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.923295 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:50.923867 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:50.925032 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:50.925423 18378 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.926028 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:50.926646 18386 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:50.927069 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:50.776981 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:50.927953 13711 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
W20260709 13:07:50.928717 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 142807us
I20260709 13:07:50.928834 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:50.929186 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:50.930047 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:50.734835 18389 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.792665 18358 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.823478 18387 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.823164 18366 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.931208 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:50.935071 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:50.819548 18359 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:50.740906 18356 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:50.933378 13757 leader_election.cc:304] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:50.748375 18385 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.916179 18372 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.752856 18374 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:50.825965 18338 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.826326 18363 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.751268 18343 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.749665 18405 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:50.815629 18382 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.868294 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:50.869108 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:50.866357 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:50.867121 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:50.783056 13710 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
W20260709 13:07:50.851346 14423 debug-util.cc:398] Leaking SignalData structure 0x7b080034a700 after lost signal to thread 12597
I20260709 13:07:50.875289 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:50.867741 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:50.875631 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:50.876222 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:50.876626 13786 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:07:50.877466 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:50.869254 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:50.841045 18403 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:50.883460 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:50.884191 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 53231.7us
I20260709 13:07:50.884418 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:50.877502 18395 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.877957 18383 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:07:50.795779 18369 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:50.891942 18380 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.892360 18371 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:50.892798 18250 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.892980 18381 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.894134 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:50.896345 18404 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:50.897132 18406 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.897563 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:50.898005 18327 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:50.899005 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:50.899297 18357 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.869732 18402 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:50.900859 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:50.901091 13612 catalog_manager.cc:5697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 19 to 20, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 20 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:50.903576 18379 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.905212 18390 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:50.908529 18362 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:50.909373 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:50.910987 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:50.911162 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:50.912413 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:50.914028 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:50.914656 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:50.914677 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:50.915035 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:50.943351 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:50.914728 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:50.870551 18400 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:51.092283 13859 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:07:50.916501 18377 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:51.093124 14395 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 6.
I20260709 13:07:50.756129 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:50.933372 18389 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:51.100585 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:50.935595 18366 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.824030 18365 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.105180 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:50.936398 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:50.754172 18388 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:50.824805 18394 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.023314 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.092569 13864 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
W20260709 13:07:51.071643 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 138304us
I20260709 13:07:51.093801 18385 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:51.093889 18397 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:51.092233 13785 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:51.094998 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:50.916236 18391 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:51.085067 14396 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:07:50.939209 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:50.939043 18392 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:51.092154 13857 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:07:50.941918 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.109392 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.102604 18400 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.139516 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.140455 18365 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:51.114751 18385 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:51.141156 18385 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:51.142424 13756 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:51.121657 14368 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:51.142836 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.143960 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.144543 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.144727 14368 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:51.145238 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.145640 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.145813 18366 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:51.146255 18366 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:51.146658 18366 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:51.122211 18397 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.145650 18398 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:51.150878 18397 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:51.151089 18398 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:51.105074 18371 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.151644 18398 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.152357 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.154027 18371 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:51.154515 18371 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:51.154807 18371 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:51.155138 18371 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:51.125806 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.159003 18392 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:50.745452 18370 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.162277 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.162976 13862 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:51.126459 18327 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.127540 18362 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:51.163995 18362 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:51.165439 18382 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:51.165944 18362 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:51.128382 13757 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:51.128973 18377 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:51.168567 18377 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:51.168955 18365 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:51.177030 18365 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:51.177232 14368 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:51.100219 18386 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.167373 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.178220 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.178643 18391 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:51.178956 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.136583 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.179601 13790 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:07:51.132977 18338 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:51.114949 18390 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.135843 18388 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.137902 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:50.940083 18356 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.140829 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.171473 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.110070 18379 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.192708 14398 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 7.
I20260709 13:07:51.193873 18379 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:51.194199 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.146730 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.123463 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.195851 14394 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:07:51.196414 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.170209 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.197468 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.180549 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.195330 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.174328 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.115154 18250 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:51.177444 18365 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:51.202152 14400 raft_consensus.cc:1217] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 8 LEARNER]: Deduplicated request from leader. Original: 8.5->[8.6-8.6]   Dedup: 8.6->[]
I20260709 13:07:51.173807 18385 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.184356 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.179060 18391 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:51.207672 18391 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:51.184587 18369 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.211606 18369 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:51.111297 18380 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.173763 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.180876 18388 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.184490 14402 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:51.180356 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.213864 18388 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:51.214560 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.185708 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.215842 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.216174 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.216518 14395 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:07:51.140565 18400 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:51.136439 18363 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:51.275573 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.275743 18380 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:51.276293 13861 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:51.277307 18363 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:51.277405 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.277938 18399 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:51.278528 18399 raft_consensus.cc:697] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:51.279104 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.279632 18399 consensus_queue.cc:237] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:51.279949 18391 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:51.281155 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 119856us
I20260709 13:07:51.281252 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.282013 13756 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:51.215271 14368 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:51.279127 18365 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:51.283861 18393 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:51.187476 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.285063 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.285486 18365 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:51.285808 13756 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:51.215864 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.286729 13756 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:51.237092 13713 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:07:51.283358 18380 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:51.188773 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.187613 18327 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:51.216547 14402 raft_consensus.cc:1217] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.8->[12.9-12.9]   Dedup: 12.9->[]
I20260709 13:07:51.184887 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.013209 18407 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:07:51.290619 14423 debug-util.cc:398] Leaking SignalData structure 0x7b080030dd00 after lost signal to thread 13648
I20260709 13:07:51.175035 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:51.283250 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 68180.2us
I20260709 13:07:51.196724 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.291923 13756 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:51.296517 14394 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:07:51.186923 13716 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:51.175999 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.170614 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.187790 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.181195 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.296553 13859 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:07:51.302734 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.307446 18361 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:51.204769 18385 leader_election.cc:290] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:51.307642 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.308367 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.302090 14368 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:51.318681 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.320199 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:51.314224 14423 debug-util.cc:398] Leaking SignalData structure 0x7b0800307d00 after lost signal to thread 13740
I20260709 13:07:51.108570 18359 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:51.315757 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:51.183281 18356 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:51.291987 18380 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:51.182667 18394 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:51.297281 18393 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:51.325802 18364 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:51.350196 14423 debug-util.cc:398] Leaking SignalData structure 0x7b080034baa0 after lost signal to thread 13815
I20260709 13:07:51.308014 18363 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:51.351882 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:51.355000 14423 debug-util.cc:398] Leaking SignalData structure 0x7b0800342ee0 after lost signal to thread 13889
W20260709 13:07:51.356844 14423 debug-util.cc:398] Leaking SignalData structure 0x7b08003b5240 after lost signal to thread 14426
W20260709 13:07:51.357147 14423 debug-util.cc:398] Leaking SignalData structure 0x7b08003240c0 after lost signal to thread 14427
I20260709 13:07:51.178258 18386 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.362272 18386 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:51.363160 14367 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:51.364111 13755 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:51.108326 18406 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:51.191042 18392 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:51.381232 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:51.382025 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.359526 18409 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:07:51.359992 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 55816us
I20260709 13:07:51.330855 18380 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:51.332015 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:51.379938 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 82960.4us
I20260709 13:07:51.356491 18390 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:51.411163 13715 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
I20260709 13:07:51.352788 18364 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:51.418557 18364 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.418015 18250 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:51.401575 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.349296 18393 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.250398 18402 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:51.433840 18406 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:51.420977 13708 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:51.296718 18405 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:51.301610 18404 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.446214 18405 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:51.116964 18403 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.447952 18404 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:51.448292 18403 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:51.398464 18381 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:51.450475 18372 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:51.452364 18387 raft_consensus.cc:1064] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:07:51.452533 18374 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:51.453675 18398 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:51.456384 18370 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:51.411754 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 97734.1us
I20260709 13:07:51.428534 18399 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:51.388265 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 60449.4us
I20260709 13:07:51.457748 18399 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:51.458204 18399 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:51.460631 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.457777 13755 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:51.463495 14368 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:51.464159 13755 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:51.464982 18413 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:51.465401 18413 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:51.465551 18381 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:51.465804 18413 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:51.466269 18361 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:51.466671 18361 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:51.467041 18361 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:51.468062 18396 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:51.468573 18396 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:51.417663 18371 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.354801 18363 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:51.472013 18363 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:51.472404 18391 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:51.456144 18387 consensus_queue.cc:237] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 6, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.431440 18382 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:51.432045 18409 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:51.433197 18393 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.438467 18402 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:51.478684 13755 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:51.480952 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:07:51.481863 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 60084.3us
I20260709 13:07:51.484351 18406 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:51.485111 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:51.484923 18406 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.486449 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.486936 18406 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:51.487636 18385 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:51.488132 18409 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:51.488191 18385 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:51.488894 18385 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:51.489197 18396 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:51.495085 18398 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:51.499913 18371 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:51.500900 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:51.501490 13860 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:51.501211 18380 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.502516 14398 raft_consensus.cc:1240] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:51.507972 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.509153 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.509914 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.510285 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.510982 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.511318 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.511713 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.511879 13865 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:51.512243 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.512312 13864 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:07:51.512739 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.513249 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.513373 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.514516 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.517194 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:51.517644 18364 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.520155 13860 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:07:51.521006 13862 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:51.513197 13680 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:51.521850 18404 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:51.522192 18404 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:51.522553 18404 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:51.523165 14368 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:51.523530 18380 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:51.524121 18371 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:51.524700 18371 raft_consensus.cc:697] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 11 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:51.524539 18413 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.446214 18366 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.525857 18371 consensus_queue.cc:237] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.526980 18413 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:51.527468 18366 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:51.326730 18407 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.528172 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:51.528855 14401 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:07:51.529822 18407 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:51.530876 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.533598 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.535256 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.535962 18393 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:51.536375 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.542025 14367 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:51.552996 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.562604 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.564304 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.564651 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:07:51.556407 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.556348 14367 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:51.574338 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:51.565529 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.578327 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.579591 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:51.585695 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 47288.4us
I20260709 13:07:51.586584 13755 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:51.584184 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.561357 18394 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:51.592062 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.593896 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:51.559290 18389 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:51.605755 14367 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:51.607515 18380 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:51.608487 18382 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:51.610787 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 190270us
I20260709 13:07:51.602475 13680 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:51.614200 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:51.558081 18398 consensus_queue.cc:1059] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:07:51.616922 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:51.584069 18366 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:51.609149 18382 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:51.641113 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.641753 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.595650 18364 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:51.644184 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 57722.5us
I20260709 13:07:51.644901 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.652328 13680 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:51.655171 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.617588 18365 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:51.657318 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:51.649277 13829 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:51.648546 18404 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.675737 18393 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:51.659248 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:51.643002 18406 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:51.659025 13860 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:51.679843 18387 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:51.638284 18389 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.658587 18419 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:51.722786 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 63612.9us
I20260709 13:07:51.705000 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:51.748620 13829 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:51.751248 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.752465 18395 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:51.753325 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.753671 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.755638 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.757992 18389 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:51.758421 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:51.750099 18413 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:51.759805 18413 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.761253 13829 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:51.761799 18413 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:51.761624 18361 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.763490 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.764108 13786 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:07:51.766173 18380 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:51.708352 18365 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.771394 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.772377 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.771727 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.773046 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.773931 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.774109 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.775815 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.707901 18402 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:51.776413 13785 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:07:51.787724 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.782063 13829 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:51.782819 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.792346 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.783937 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.784566 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.785190 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.785241 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.724834 18406 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.795609 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.741861 18387 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:51.801258 18387 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:51.802265 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.803802 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.804416 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.805974 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.807687 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.797272 18406 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.812167 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.748522 18419 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:51.821153 18361 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:51.822350 18404 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:51.822227 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:51.822908 13785 raft_consensus.cc:1240] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:51.824272 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.824848 13682 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:51.843848 18396 raft_consensus.cc:3055] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:51.844254 18396 raft_consensus.cc:740] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:51.845116 18396 consensus_queue.cc:260] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.844734 13682 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:51.846323 18396 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:51.847041 13682 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:51.847383 18250 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:51.847762 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.848114 18250 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:51.848433 13709 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
W20260709 13:07:51.834038 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 52037.6us
I20260709 13:07:51.850281 13682 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:51.826251 18382 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:51.796800 18395 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:51.852905 18395 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:51.853315 18395 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:51.853775 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.854226 18385 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.849656 18419 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.849730 18376 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:51.856335 18385 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:51.851248 18338 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:51.860006 18365 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:51.860631 14366 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:51.861570 18417 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:51.862655 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 111941us
I20260709 13:07:51.864739 18404 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:51.864244 14366 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:51.865216 18404 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:51.865572 18417 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:51.865654 18404 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.866917 14366 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:51.867697 18417 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:51.746678 18359 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:51.837719 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.837468 18399 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:51.839278 18416 log.cc:927] Time spent T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:07:51.841615 18363 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.850814 13829 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:51.871122 18399 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:51.877086 13682 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:51.876807 13829 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:51.880577 14366 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:51.878561 13829 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:51.887373 18415 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:51.887894 18376 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:51.888725 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.889110 18363 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:51.887763 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:51.890355 18395 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.892417 18395 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:51.876786 13830 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:51.898058 18376 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:51.898450 18376 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.898777 18376 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:51.898913 18415 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:51.900343 13829 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:51.901746 14366 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:51.906613 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:07:51.907608 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 54895.7us
I20260709 13:07:51.908291 13682 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:51.909482 13682 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:51.910826 14366 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:51.920047 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.908007 13829 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:51.926510 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.928750 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:51.920706 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.931645 13682 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:51.932829 14366 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:51.935176 13709 raft_consensus.cc:1240] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:51.935591 18390 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:51.929378 18250 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:51.934036 18369 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:51.938907 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.939862 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.941098 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.941996 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.944240 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.904699 18415 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:51.935930 18419 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:51.907007 18417 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:51.948810 14395 raft_consensus.cc:1240] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:51.948932 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:51.946373 13680 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:51.950573 13682 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:51.952378 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:51.953429 14396 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 11 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:51.954408 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:51.955535 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:51.953473 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:51.959443 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:51.960736 14366 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:51.964740 14366 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:51.938524 18356 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:51.964020 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:51.943166 18406 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:51.969379 18412 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:51.970366 18406 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:51.971201 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:51.939108 18250 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:51.970691 18362 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:51.971541 13829 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:51.974793 13710 raft_consensus.cc:1240] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:51.975708 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.976516 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:51.953169 18388 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:51.961997 18371 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:52.001436 13707 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:51.961596 18397 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:51.972847 18391 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:52.005108 14366 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:52.005415 18421 consensus_queue.cc:1059] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:07:51.945618 18387 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:52.005820 18412 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:51.977291 18250 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.001539 18338 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:52.007927 18433 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:52.009931 18419 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:52.017375 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 46032.1us
I20260709 13:07:52.018072 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:52.018304 18386 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:52.018762 18364 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:52.018925 14366 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:52.022687 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:07:52.013427 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 62879.1us
I20260709 13:07:52.041432 13711 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:51.999385 18406 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:52.045310 13785 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:52.046394 18327 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:52.048291 13682 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:52.068068 13829 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:52.072090 18387 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:52.043324 18433 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:52.076206 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:52.079123 18250 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:52.079909 13784 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:52.041603 18417 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:52.084525 13788 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:52.085721 13757 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:52.087086 13791 raft_consensus.cc:1240] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:52.089250 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:52.086961 13756 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:52.097918 18433 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:52.097488 18404 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:52.100909 13714 raft_consensus.cc:1240] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:52.102108 13757 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.102579 18385 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.103241 13757 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:52.104477 13757 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:52.105022 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 56806.8us
I20260709 13:07:52.106081 18365 raft_consensus.cc:3055] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:52.106025 13682 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:52.106628 18365 raft_consensus.cc:740] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:52.086721 18378 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:52.107765 18378 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:52.108556 18357 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:52.109223 18357 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:52.001818 18362 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:52.109897 13789 raft_consensus.cc:1240] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:52.107643 18365 consensus_queue.cc:260] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:52.112150 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 44174.3us
I20260709 13:07:52.113982 13829 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:52.116271 13756 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:52.119235 18428 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:52.119688 18428 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:52.120057 18428 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.115657 18425 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:52.123958 13682 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.113258 13757 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:52.113181 18385 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:52.128731 13829 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:52.126046 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 162053us
I20260709 13:07:52.113648 18421 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:52.136349 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.137145 13682 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:52.140434 13682 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.140697 13756 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.121538 18377 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.136011 18327 consensus_queue.cc:1059] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:07:52.123818 18405 consensus_queue.cc:1059] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:07:52.146730 18405 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:52.147264 18250 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:52.139760 18357 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:52.141364 18406 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:52.148386 18406 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:52.148761 18406 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:52.155565 18378 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:52.156490 18378 raft_consensus.cc:3055] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:52.138010 18433 consensus_queue.cc:1059] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:07:52.140209 18397 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:52.137895 18415 consensus_queue.cc:1059] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:07:52.156275 18376 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:52.159765 18338 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:52.160871 18415 raft_consensus.cc:3055] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:52.161281 18415 raft_consensus.cc:740] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:52.162156 18415 consensus_queue.cc:260] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:52.156973 18378 raft_consensus.cc:740] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:52.163682 18436 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:52.163813 18415 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:52.143487 18327 raft_consensus.cc:3055] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:52.169112 18327 raft_consensus.cc:740] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:52.170027 18327 consensus_queue.cc:260] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:52.171200 18378 consensus_queue.cc:260] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:52.172453 18365 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.173105 18378 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.173491 18385 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:52.175376 13756 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.176465 18433 raft_consensus.cc:3055] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:52.177230 18433 raft_consensus.cc:740] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:52.178107 18433 consensus_queue.cc:260] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:52.179544 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:52.180737 13756 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.182483 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:52.181949 13682 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.183054 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:52.142019 13680 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:52.201025 13859 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:07:52.202611 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 73934.8us
W20260709 13:07:52.203190 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 90050.3us
I20260709 13:07:52.206248 13757 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:52.207803 13757 leader_election.cc:304] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.209674 13829 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:52.210361 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 68424us
I20260709 13:07:52.210928 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:52.204347 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:52.211288 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.209282 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:52.213222 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:52.215731 13829 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:52.219362 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:52.221309 14366 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:52.203758 18327 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.204080 18396 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:52.201985 18419 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:52.200964 18433 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.222757 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:52.223233 13680 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:52.213258 18421 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:52.223748 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:52.221029 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:52.222601 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:52.211936 18425 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:52.222007 13757 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:52.244589 13789 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:52.245375 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:52.245550 13757 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:52.201417 18397 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:52.223301 18386 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:52.246171 13790 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:52.215040 18357 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:52.202071 18413 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:07:52.258209 13757 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:52.241657 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:52.218699 18436 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:52.222222 18385 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:52.224767 18338 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:52.244165 18358 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:52.263568 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:52.268523 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:52.240099 18421 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:52.246073 18404 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:52.290488 14393 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 12 LEARNER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:52.256001 18364 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:52.291447 13790 raft_consensus.cc:2393] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 10: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:52.295780 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:52.264456 13757 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:52.224961 18399 consensus_queue.cc:1059] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:07:52.306713 18385 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:52.308331 18423 raft_consensus.cc:3055] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:52.308729 18423 raft_consensus.cc:740] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:52.309715 18423 consensus_queue.cc:260] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:52.259897 18357 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:52.264394 18361 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.305789 13786 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:52.311369 13757 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.314015 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:52.264070 18409 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:52.268247 18419 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:52.316812 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 95565.8us
I20260709 13:07:52.290448 18421 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:52.318711 14366 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:52.320219 14366 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:52.315124 18385 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:52.324335 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 96017.4us
I20260709 13:07:52.313768 18357 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.324180 18407 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:52.346556 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 82701.3us
I20260709 13:07:52.348573 13680 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:52.373189 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 53092us
I20260709 13:07:52.347651 18440 consensus_queue.cc:1059] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:07:52.346223 18423 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.379786 18441 consensus_queue.cc:1059] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:52.380854 18441 raft_consensus.cc:3055] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:52.381176 18441 raft_consensus.cc:740] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:52.381871 18428 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:52.381958 18441 consensus_queue.cc:260] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:52.382686 18357 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:52.372875 18402 consensus_queue.cc:1059] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:07:52.387912 18440 raft_consensus.cc:3055] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:52.388266 18440 raft_consensus.cc:740] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:52.389032 18440 consensus_queue.cc:260] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:52.390156 18440 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:52.392149 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 207828us
I20260709 13:07:52.392979 13682 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.393522 13785 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:07:52.393242 14366 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:52.316196 18406 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:52.395735 18437 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:52.402920 18436 consensus_queue.cc:1059] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:52.401818 13787 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:07:52.401501 18362 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:52.402494 18428 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:52.348385 18380 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:52.404592 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.406844 13790 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:52.401440 18357 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:52.407096 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 58619.6us
I20260709 13:07:52.411669 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:52.414211 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:52.414736 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:52.416814 13782 raft_consensus.cc:1240] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:52.396268 18389 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:52.420710 13829 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.422354 13714 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:52.424011 13829 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.426040 18377 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:52.427745 18377 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:52.427702 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:52.407341 18364 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:52.429257 13829 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.430013 13782 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:52.430240 18377 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:52.432582 13716 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:52.431653 13829 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.433908 18377 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:52.434422 18444 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:52.435150 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.435972 18415 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:52.440750 13829 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.407722 18441 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.454281 18436 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:52.456220 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.462597 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:52.465301 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:52.465911 13713 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.466161 18406 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:52.468196 13710 raft_consensus.cc:1240] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:52.468636 13862 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:52.471356 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:52.473991 18362 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:52.474622 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:52.477710 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:52.479501 13862 raft_consensus.cc:2410] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:52.480340 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:52.480906 13857 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.487646 13612 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57116 (request call id 250) took 1590 ms. Trace:
I20260709 13:07:52.490484 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:52.491048 13712 raft_consensus.cc:1240] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:52.497169 18369 consensus_queue.cc:1059] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:52.498518 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:52.499387 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:52.499780 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:52.499389 13859 raft_consensus.cc:2410] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:52.499711 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:07:52.501781 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 77409.7us
I20260709 13:07:52.504405 13713 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:07:52.505272 13710 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:07:52.503379 13680 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.509280 13860 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:07:52.503379 14366 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:52.444876 18421 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:52.516165 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:52.516680 14366 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:52.518754 18389 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:52.520032 13857 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:52.520762 13613 catalog_manager.cc:5697] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 9 to 10, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 10 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.524394 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:07:52.523782 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 67636.1us
I20260709 13:07:52.526232 13829 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.529042 18377 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:52.527289 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:52.531847 13861 raft_consensus.cc:1240] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:52.533388 14366 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:52.534096 13682 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:07:52.536374 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.536468 13682 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:52.537427 13830 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:52.538352 13757 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.541211 14395 raft_consensus.cc:1240] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:52.543259 18377 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:52.488066 13612 rpcz_store.cc:276] 0709 13:07:50.896974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.898062 (+  1088us) service_pool.cc:224] Handling call
0709 13:07:52.487555 (+1589493us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:51.413757 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:51.414471 (+   714us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:51.414526 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:07:51.414559 (+    33us) tablet.cc:662] Decoding operations
0709 13:07:51.414990 (+   431us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:51.415093 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:51.415122 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:07:51.415428 (+   306us) tablet.cc:701] Row locks acquired
0709 13:07:51.415481 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:07:51.415627 (+   146us) write_op.cc:270] Start()
0709 13:07:51.415758 (+   131us) write_op.cc:276] Timestamp: P: 1783602471415570 usec, L: 0
0709 13:07:51.415790 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:07:51.416515 (+   725us) log.cc:844] Serialized 536 byte log entry
0709 13:07:52.046325 (+629810us) op_driver.cc:464] REPLICATION: finished
0709 13:07:52.296365 (+250040us) write_op.cc:301] APPLY: starting
0709 13:07:52.296469 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:52.298084 (+  1615us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:52.298207 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:52.298909 (+   702us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:52.299190 (+   281us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:07:52.299252 (+    62us) write_op.cc:312] APPLY: finished
0709 13:07:52.316053 (+ 16801us) log.cc:844] Serialized 25 byte log entry
0709 13:07:52.332180 (+ 16127us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:52.347674 (+ 15494us) write_op.cc:454] Released schema lock
0709 13:07:52.372906 (+ 25232us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:52.375323 (+  2417us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:52.375353 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":214172,"apply.run_cpu_time_us":4257,"apply.run_wall_time_us":83870,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":228100,"prepare.run_cpu_time_us":31720,"prepare.run_wall_time_us":227182,"raft.queue_time_us":168478,"raft.run_cpu_time_us":99407,"raft.run_wall_time_us":163251,"replication_time_us":630363,"thread_start_us":473453,"threads_started":4,"wal-append.queue_time_us":242267}]]}
I20260709 13:07:52.544732 18365 consensus_queue.cc:1059] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:52.548146 18428 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.549605 13757 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.529670 18444 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:52.553831 18404 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:52.539899 18407 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:52.556843 18407 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:52.557117 18363 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:52.557288 18407 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.560071 14395 raft_consensus.cc:1240] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:52.560155 13757 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:52.554884 18387 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:52.563743 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:52.564301 18433 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:52.535185 18412 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:52.565294 18412 raft_consensus.cc:697] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 9 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:52.561771 13785 raft_consensus.cc:1240] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:52.511463 18415 raft_consensus.cc:3055] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:52.568910 18359 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:52.573884 18415 raft_consensus.cc:740] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:52.574110 18359 raft_consensus.cc:697] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:52.574955 18415 consensus_queue.cc:260] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:52.575098 18359 consensus_queue.cc:237] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:52.576287 18415 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.578059 13829 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.532519 18446 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:07:52.566351 18412 consensus_queue.cc:237] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:52.563138 18365 raft_consensus.cc:3055] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:52.515532 18406 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.571399 13680 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:52.585714 13680 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:52.567308 13757 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:52.572602 18389 consensus_queue.cc:1059] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:52.573441 18404 raft_consensus.cc:697] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:52.587829 14366 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:52.590667 13790 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:52.587917 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:52.592356 18428 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:52.599593 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:52.600466 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 59339.2us
I20260709 13:07:52.603780 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:52.610909 13680 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:52.591537 18437 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.611577 18387 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:52.593952 18382 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:52.587080 18365 raft_consensus.cc:740] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:52.613397 13784 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:52.615844 18404 consensus_queue.cc:237] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:52.617947 18378 raft_consensus.cc:3055] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:52.618389 18421 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:52.620180 18356 consensus_queue.cc:1059] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:52.620373 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:52.591457 18377 raft_consensus.cc:697] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:52.605754 18417 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:52.625305 18376 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:52.594002 18442 consensus_queue.cc:1059] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:07:52.634642 18388 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:52.667742 18437 consensus_queue.cc:1059] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:52.669600 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.678973 13858 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
W20260709 13:07:52.684554 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 83234us
I20260709 13:07:52.633024 18378 raft_consensus.cc:740] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:52.688277 18448 consensus_queue.cc:1059] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:07:52.689515 18377 consensus_queue.cc:237] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:52.663194 18417 raft_consensus.cc:697] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:52.708889 18417 consensus_queue.cc:237] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:52.703986 18378 consensus_queue.cc:260] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:52.705482 18388 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:52.662704 18357 consensus_queue.cc:1059] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:07:52.724208 18445 raft_consensus.cc:3055] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:52.729810 18371 consensus_queue.cc:1059] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:07:52.730804 18371 raft_consensus.cc:3055] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:52.731317 18356 raft_consensus.cc:3055] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:52.731777 18356 raft_consensus.cc:740] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:52.732718 18356 consensus_queue.cc:260] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:52.734251 18356 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.729861 18407 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:52.739610 18445 raft_consensus.cc:740] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:52.731168 18371 raft_consensus.cc:740] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:52.749768 13614 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49428 (request call id 349) took 1087 ms. Trace:
I20260709 13:07:52.750162 13786 raft_consensus.cc:1240] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:52.750368 13614 rpcz_store.cc:276] 0709 13:07:51.655566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.660223 (+  4657us) service_pool.cc:224] Handling call
0709 13:07:52.743187 (+1082964us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:07:52.756716 13788 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:52.757840 18389 raft_consensus.cc:3055] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:52.758248 18389 raft_consensus.cc:740] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:52.758399 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:52.757853 18443 consensus_queue.cc:1059] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:52.759545 18415 raft_consensus.cc:3055] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:52.759621 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:52.760038 18415 raft_consensus.cc:740] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:52.748150 18378 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.758270 18445 consensus_queue.cc:260] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:52.762367 18445 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.765250 18390 consensus_queue.cc:1059] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:52.765502 18446 consensus_queue.cc:1059] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:52.759240 18389 consensus_queue.cc:260] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:52.766953 18389 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:52.768493 18365 consensus_queue.cc:260] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:52.760941 18415 consensus_queue.cc:260] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:52.769680 18365 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.759238 13714 raft_consensus.cc:2393] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 13: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:52.769789 18415 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.776491 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:52.777280 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.779354 18454 consensus_queue.cc:1059] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:52.779904 18371 consensus_queue.cc:260] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:52.780548 18454 consensus_queue.cc:1059] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:52.781311 18443 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:52.781327 18362 raft_consensus.cc:3055] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:52.781890 18362 raft_consensus.cc:740] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:52.782560 18443 raft_consensus.cc:3055] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:52.782951 18443 raft_consensus.cc:740] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:52.783865 18443 consensus_queue.cc:260] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:52.781384 18371 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:52.785108 18443 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.786624 18405 raft_consensus.cc:3055] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:52.787022 18405 raft_consensus.cc:740] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:52.787953 18425 consensus_queue.cc:1059] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:07:52.788564 18364 raft_consensus.cc:3055] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:52.788826 18425 raft_consensus.cc:3055] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:52.788954 18364 raft_consensus.cc:740] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:52.789319 18425 raft_consensus.cc:740] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:52.789988 18364 consensus_queue.cc:260] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:52.790262 18425 consensus_queue.cc:260] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:52.787278 13791 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:07:52.792091 18425 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.792973 14366 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:52.793855 18448 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:52.794373 18448 raft_consensus.cc:697] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:07:52.795293 18449 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.252s	user 0.000s	sys 0.007s
I20260709 13:07:52.795246 18448 consensus_queue.cc:237] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:52.797569 18405 consensus_queue.cc:260] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:52.798828 18405 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.772310 18407 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:52.807924 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:52.828270 13783 raft_consensus.cc:1240] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:52.782720 18362 consensus_queue.cc:260] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:52.836447 18362 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.850378 18444 raft_consensus.cc:3055] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:52.850878 18444 raft_consensus.cc:740] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:52.851820 18444 consensus_queue.cc:260] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:52.885944 14400 raft_consensus.cc:2955] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:52.874714 18444 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:52.891309 13783 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:07:52.893271 18388 consensus_queue.cc:1059] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:52.903836 13856 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:52.905488 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:52.905886 13861 raft_consensus.cc:1240] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:52.906708 13757 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:52.913345 13757 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:52.926654 13757 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:52.913651 18361 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:52.921389 18398 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:52.959029 13791 raft_consensus.cc:2410] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:52.934340 18411 consensus_queue.cc:1059] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:07:52.960527 18411 raft_consensus.cc:3055] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:52.960893 18411 raft_consensus.cc:740] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:52.961725 18411 consensus_queue.cc:260] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:52.932330 18399 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:52.969352 18364 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.979213 13786 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:52.987851 18411 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:52.992461 18406 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:07:52.977234 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 45988.6us
I20260709 13:07:52.999517 13757 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:53.002466 18425 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:53.011360 13784 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "ceb06175847b428ea8bd77055fcddf58"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:07:53.021772 13784 raft_consensus.cc:606] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Received request to transfer leadership to TS ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:53.022130 13784 raft_consensus.cc:614] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:53.027599 18386 raft_consensus.cc:1064] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:07:53.034948 18338 raft_consensus.cc:3055] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:53.035435 18338 raft_consensus.cc:740] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:53.036322 18338 consensus_queue.cc:260] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:53.037390 13791 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:53.037874 18338 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:53.040181 18407 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:53.046053 13865 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.046311 13858 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:53.054028 18397 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:07:53.081624 13865 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:53.017717 18425 raft_consensus.cc:697] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:53.091446 18455 raft_consensus.cc:1064] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7: attempting to promote NON_VOTER ceb06175847b428ea8bd77055fcddf58 to VOTER
I20260709 13:07:53.091930 18425 consensus_queue.cc:237] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:53.094229 18455 consensus_queue.cc:237] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 4, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:53.088611 18407 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:07:53.099699 13865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:57574
I20260709 13:07:53.100270 13865 raft_consensus.cc:606] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:07:53.100646 13865 raft_consensus.cc:614] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:53.104620 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:53.108063 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:53.110450 13609 catalog_manager.cc:5697] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 10 to 11, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 11 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:53.113334 13609 catalog_manager.cc:5697] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 10 to 11, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 11 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:53.152508 13613 catalog_manager.cc:5697] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 9 to 10, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 10 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.154815 13613 catalog_manager.cc:5697] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 13 to 14, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 14 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.169292 13864 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.204694 13864 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:53.213898 18386 consensus_queue.cc:237] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:53.214915 18366 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:07:53.228782 13783 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:53.232796 13713 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:53.236670 18407 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:53.244894 13783 raft_consensus.cc:1275] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:53.249432 18397 consensus_queue.cc:1048] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:53.253289 13612 catalog_manager.cc:5697] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 8 to 9, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:53.255069 13612 catalog_manager.cc:5697] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 9 to 10, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 10 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:53.257824 13612 catalog_manager.cc:5697] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 8 to 9, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 9 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:53.260100 13612 catalog_manager.cc:5697] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 12 to 13, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 13 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:53.268591 14401 raft_consensus.cc:1275] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 8 LEARNER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:53.289593 13788 raft_consensus.cc:1275] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:53.296981 13786 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:53.317651 18394 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:07:53.324076 14401 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 12 LEARNER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:53.297960 18456 consensus_queue.cc:1048] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:07:53.335294 18436 consensus_queue.cc:1048] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:53.344733 13862 raft_consensus.cc:1275] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:53.347054 13716 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:53.348665 13791 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:07:53.349026 13791 pending_rounds.cc:85] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 6
I20260709 13:07:53.349243 13791 pending_rounds.cc:107] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:07:53.349502 13791 raft_consensus.cc:2889] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:53.350054 18369 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:53.353212 18456 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:53.354030 13788 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:53.355927 18404 consensus_queue.cc:1048] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:53.362578 18380 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:53.385619 13609 catalog_manager.cc:5697] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 11 to 12, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 12 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.402881 13716 raft_consensus.cc:1275] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:53.402983 13789 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:53.414633 18369 consensus_queue.cc:1048] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:53.394547 18443 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:07:53.411085 18386 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:07:53.460955 13716 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:53.477854 18371 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.518853 18371 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:53.521644 18371 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:53.536733 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:53.552784 13708 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:53.474674 18443 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:07:53.564338 14367 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:53.582178 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:53.582878 13864 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:07:53.619452 18366 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:53.648208 18366 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.672119 18366 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.648443 18380 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.678036 18380 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:53.680591 18380 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:53.611797 18428 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
W20260709 13:07:53.710269 18484 log.cc:927] Time spent T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:07:53.718303 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:53.719062 13714 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:07:53.724184 13790 raft_consensus.cc:2955] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:53.732854 14367 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:07:53.732172 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 121336us
I20260709 13:07:53.762796 18494 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:53.763387 18494 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.763814 18494 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:53.764146 18496 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:53.764967 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:53.764848 18496 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:53.695307 18456 raft_consensus.cc:2955] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 6 to 7, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:53.785883 18436 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.786453 18436 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:53.788133 18405 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.788651 18405 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:53.790635 18405 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:53.792176 18436 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:53.793985 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:53.794600 13784 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
I20260709 13:07:53.795562 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:53.796387 13714 raft_consensus.cc:2393] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 21: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:53.796888 14396 raft_consensus.cc:2955] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:53.798194 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:53.798753 13784 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:53.803064 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:53.803699 14400 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
I20260709 13:07:53.801276 13829 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:53.805199 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:53.805557 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:53.805902 18362 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:53.806268 13710 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:53.806880 18436 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:53.807271 18436 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.807610 18436 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.806326 18362 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.810165 18362 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.818805 18362 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:53.828995 18362 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:53.830781 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:53.849483 13785 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.780550 18496 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:53.835016 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:53.851941 13713 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.852397 14396 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:53.907961 18436 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:53.909011 18399 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:53.915699 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 62901.1us
I20260709 13:07:53.917281 14396 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:07:53.919920 13785 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:53.950760 13829 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:53.951768 18456 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:53.952528 18456 raft_consensus.cc:697] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:53.921082 18407 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.953613 18456 consensus_queue.cc:237] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:53.928942 13713 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:53.916615 18399 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:53.940994 18369 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.944415 13716 raft_consensus.cc:2955] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:53.842701 18494 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:53.962630 18369 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:53.964532 18494 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:53.965018 18369 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:53.965523 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:53.953685 18407 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:53.920756 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:53.969498 14393 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
W20260709 13:07:53.966197 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 48703.7us
I20260709 13:07:53.977500 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:53.978191 13713 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:07:53.978317 18399 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:53.979324 18366 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:53.980291 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:53.980870 13712 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:53.981465 18366 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:53.983220 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:53.984563 13830 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:53.986032 18443 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:53.986408 18443 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.986765 18443 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:53.987326 18407 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:53.990623 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:53.991153 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:53.995294 13710 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.996376 13755 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:53.999327 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:53.999959 13785 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:07:54.002658 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:54.002314 18413 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:07:54.021114 18365 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:54.021541 18365 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:54.021881 18365 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:54.023027 13712 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:07:54.022661 13614 catalog_manager.cc:5697] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 reported cstate change: config changed from index 6 to 7, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:53.996089 18386 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:54.035972 18386 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:54.038350 18386 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:54.038910 18386 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.998064 18417 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:54.041934 18417 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:54.052151 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:54.053399 14393 raft_consensus.cc:2368] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12.
I20260709 13:07:54.050948 18369 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:54.054520 18369 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:54.055639 13829 leader_election.cc:400] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12.
I20260709 13:07:54.056140 13829 leader_election.cc:403] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:54.056761 18369 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:54.056864 18362 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.065135 18404 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:54.065907 18404 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:54.071090 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:54.071970 13790 raft_consensus.cc:2393] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 14: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:54.072855 18436 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:54.030793 18391 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.077374 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:54.078222 13864 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:54.080744 13682 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:54.082418 18492 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:54.082929 18492 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:54.083343 18492 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:54.083878 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:54.084535 13711 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:07:54.086081 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:54.086874 13714 raft_consensus.cc:2368] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12.
I20260709 13:07:54.090667 14367 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:54.091913 13830 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:54.093199 13830 leader_election.cc:400] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12.
I20260709 13:07:54.094329 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:54.094977 13790 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.095587 18391 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:54.094200 18455 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.097677 18455 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:54.030943 18338 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:54.098753 18338 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:54.100222 18455 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:54.100669 18338 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:54.101517 18455 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:54.102030 18455 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:54.102463 18455 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:54.102756 13710 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:54.093397 18407 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:54.104933 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:54.105178 18407 raft_consensus.cc:697] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 12 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:54.105608 18495 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:54.106078 18407 consensus_queue.cc:237] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:54.105491 14396 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.106235 18495 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:54.107964 18404 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:54.108939 18495 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:54.109856 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:54.110451 13785 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:07:54.111725 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:54.063403 18417 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:54.115231 18405 raft_consensus.cc:2955] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:54.121017 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:54.121876 13865 raft_consensus.cc:2393] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 7: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:54.122714 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:54.122784 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:54.123569 18494 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.124112 18494 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:54.124339 18369 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:54.124683 18417 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:54.124954 18369 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.125427 18369 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:54.125244 18417 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:54.126247 18494 leader_election.cc:290] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:54.126900 13710 raft_consensus.cc:2955] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:54.039372 18386 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:54.105474 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:54.133306 13864 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:54.134989 13682 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:54.135483 14367 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:54.136894 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:54.142781 14396 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:54.131713 13862 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:07:54.145437 13790 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:54.097645 18391 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:54.147614 18443 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:54.127399 18417 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:54.166173 18443 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:54.168223 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:54.168884 13708 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.170711 18362 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12.
I20260709 13:07:54.176899 13708 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:07:54.150257 18365 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:54.177911 18492 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:54.179045 18386 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:54.180097 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 44704.3us
I20260709 13:07:54.180310 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:54.184679 13830 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:07:54.185827 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 189518us
I20260709 13:07:54.187729 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:54.188330 14396 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:07:54.179247 18365 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:54.191915 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:07:54.192330 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 57424.6us
I20260709 13:07:54.212646 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:54.220252 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:54.221257 13790 raft_consensus.cc:2393] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 13: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:54.222820 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:54.228288 13788 raft_consensus.cc:2393] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 10: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:54.231204 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:54.232190 13790 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:07:54.188674 18493 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:54.227908 18365 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.216403 18362 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:54.241724 14400 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
I20260709 13:07:54.244087 13755 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:54.236320 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:54.247591 13790 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 9: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:54.236282 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:54.237061 18386 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:54.222972 18387 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:54.248162 13785 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:07:54.254251 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:54.254830 13785 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:07:54.248945 13755 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:54.249732 18385 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:54.274560 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:54.292363 13785 raft_consensus.cc:2393] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 12: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:54.266937 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:54.293534 13714 raft_consensus.cc:2393] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 21: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:54.299904 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:54.300695 14400 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:07:54.255735 18387 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:54.308107 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:54.323905 13785 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.313956 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:54.296242 18385 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.268378 18456 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.253190 18493 raft_consensus.cc:697] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 9 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:54.325500 13788 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:07:54.307205 18361 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:54.329458 14368 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:54.250036 18365 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:54.328972 18385 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:54.329576 18496 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.333808 18397 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:54.255666 18386 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:54.337890 18492 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:54.363713 18407 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:54.362421 18361 raft_consensus.cc:697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:54.364418 18362 raft_consensus.cc:697] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:54.335669 18387 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.335763 18456 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:54.378541 13785 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:07:54.386394 18505 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.388074 18407 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:54.376451 18496 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:54.443856 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 144422us
I20260709 13:07:54.458463 18513 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.459867 18361 consensus_queue.cc:237] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:54.461185 18362 consensus_queue.cc:237] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:54.378041 18397 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:54.463814 18399 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.449215 18443 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:54.472276 18365 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:54.447438 18493 consensus_queue.cc:237] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:54.477262 14366 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:54.477526 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:54.488509 13862 raft_consensus.cc:2410] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:07:54.450014 18407 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:54.493099 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 243153us
I20260709 13:07:54.401662 18369 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:54.493199 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:54.498648 13714 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:07:54.499641 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:54.501507 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:54.502151 13862 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:07:54.487695 18492 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:54.507076 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 116092us
I20260709 13:07:54.517015 13864 raft_consensus.cc:2368] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 12. Current term is 13.
I20260709 13:07:54.514276 14366 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:54.472203 18505 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:54.487095 18399 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:54.483952 18513 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:54.487548 18443 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:54.511684 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:07:54.586990 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 76428.5us
I20260709 13:07:54.588049 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:54.512161 18492 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:54.607002 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 100945us
W20260709 13:07:54.590173 18475 log.cc:927] Time spent T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:07:54.612622 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 303743us
W20260709 13:07:54.615170 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 100976us
I20260709 13:07:54.616110 14366 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:54.617861 18386 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:54.606699 18511 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:54.628674 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:54.629585 13714 raft_consensus.cc:2410] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:07:54.634908 18387 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:54.649312 18505 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:54.650693 18387 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:54.652596 18496 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:54.654435 18443 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:54.631342 18386 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:54.655328 18386 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.656160 18386 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:54.658942 13714 raft_consensus.cc:1275] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:54.660063 18369 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:54.662403 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:54.663158 13714 raft_consensus.cc:2368] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9.
W20260709 13:07:54.672044 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 57534.7us
I20260709 13:07:54.674170 13830 leader_election.cc:400] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9.
I20260709 13:07:54.624118 18517 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:54.674510 13830 leader_election.cc:403] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:54.682350 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:54.664131 18511 raft_consensus.cc:697] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:07:54.675678 18455 consensus_meta.cc:287] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.573s	user 0.012s	sys 0.000s
I20260709 13:07:54.686770 18417 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:54.687151 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:54.688956 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:54.678236 18443 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.690941 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:54.694860 13788 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 9: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:54.689184 13756 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:54.677103 18517 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.699038 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:54.689764 18455 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:54.676393 18523 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.708884 18523 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:54.669253 18369 consensus_queue.cc:1048] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:07:54.708235 18455 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:54.736639 18399 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:54.737259 18385 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:54.738137 18492 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:54.691726 18456 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:54.752210 18500 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.752947 18500 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:54.703233 18517 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:54.763254 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:54.766496 13861 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:07:54.691012 18513 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:54.767808 13757 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:07:54.768095 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 46701.5us
I20260709 13:07:54.772265 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:54.713364 13785 raft_consensus.cc:2393] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 10: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
W20260709 13:07:54.767722 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 78670.5us
I20260709 13:07:54.711181 18523 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:54.717533 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:54.718359 18511 consensus_queue.cc:237] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:54.788664 13865 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:54.773044 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:54.791790 18365 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:54.774559 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:54.714745 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:54.804891 13859 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
W20260709 13:07:54.780366 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 164316us
I20260709 13:07:54.786069 18397 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:54.785751 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:54.787799 18501 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:54.812000 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 223977us
I20260709 13:07:54.807564 13858 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:54.813078 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:54.813747 13708 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
W20260709 13:07:54.687172 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 65635.7us
I20260709 13:07:54.807586 14366 leader_election.cc:304] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:54.821542 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:54.822768 13708 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:54.776681 13861 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:07:54.805985 13860 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:07:54.775203 18522 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:54.820014 13757 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:54.830746 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:54.831791 13785 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 13: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:54.836078 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:54.836891 13785 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:07:54.838637 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:54.839375 13708 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:07:54.803584 18385 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:54.801281 18500 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:54.820473 18501 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.843734 13757 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:54.842847 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:54.846649 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 131131us
I20260709 13:07:54.848287 13788 raft_consensus.cc:1275] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:54.852857 13785 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
I20260709 13:07:54.853950 14368 leader_election.cc:400] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 12. Current term is 13.
I20260709 13:07:54.854331 14368 leader_election.cc:403] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:54.832654 18522 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:07:54.851761 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 147942us
I20260709 13:07:54.865141 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:54.867375 13785 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:54.864749 13682 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:54.869788 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:54.870086 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:54.870458 14396 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:07:54.871366 18365 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.872058 18365 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:54.867018 18417 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:07:54.854022 18501 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:54.856580 18385 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:54.881517 18385 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.842777 18396 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.850477 18398 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:54.903101 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:54.884080 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:54.855950 18522 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:54.922513 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:07:54.907737 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 57936.7us
W20260709 13:07:54.907141 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 53501.8us
I20260709 13:07:54.865384 13788 raft_consensus.cc:2955] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:54.859565 18380 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:54.926626 13829 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:07:54.933350 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 68734.7us
I20260709 13:07:54.934070 13682 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:54.881917 18385 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.937875 13682 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:54.938894 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:54.943084 13783 raft_consensus.cc:2368] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15.
I20260709 13:07:54.945174 14396 raft_consensus.cc:2955] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:54.922075 18398 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.955614 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:54.956799 13708 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:07:54.958570 13785 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:07:54.963340 13756 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:54.964324 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:54.965124 18362 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:54.965758 18362 raft_consensus.cc:697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:54.966578 18362 consensus_queue.cc:237] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:54.965183 18428 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:54.970208 18428 raft_consensus.cc:697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:54.971386 18428 consensus_queue.cc:237] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:54.960850 14395 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:07:54.984989 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:54.985702 14395 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:54.931854 18380 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.935958 18369 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:54.987708 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:54.936291 18436 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:54.988981 13829 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:54.990279 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:54.991086 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 44470us
I20260709 13:07:54.996282 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:54.996886 14397 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:07:54.922271 18396 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:55.007807 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:55.008677 18543 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:55.021806 18543 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.022185 18543 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:55.022432 18396 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:55.024745 18517 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:55.001581 18519 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:55.027707 13790 raft_consensus.cc:2393] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 14: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:55.027786 18519 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:55.009783 18443 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9.
I20260709 13:07:55.028357 18519 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:54.998544 18369 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.998327 18436 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.962682 18398 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.029690 14393 raft_consensus.cc:2393] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 15: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:54.936679 18506 consensus_queue.cc:1048] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:07:55.048133 18501 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:55.052809 13791 raft_consensus.cc:2393] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 14: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:54.985745 18527 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:07:55.058821 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 121026us
I20260709 13:07:54.990279 18380 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.992494 18537 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:55.064332 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 120662us
I20260709 13:07:55.027307 18517 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:55.035547 18397 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:55.036356 18369 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.078600 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:55.087467 13861 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:07:55.036543 18436 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:55.143990 18501 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:55.147814 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:07:55.161051 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 163928us
I20260709 13:07:55.165637 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:55.074640 18527 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:55.181119 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:55.187546 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:55.188503 13711 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:07:55.180959 18407 consensus_meta.cc:287] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.683s	user 0.014s	sys 0.011s
W20260709 13:07:55.185418 18386 consensus_meta.cc:287] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.008s
I20260709 13:07:55.215059 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:55.227734 13714 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
W20260709 13:07:55.230502 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 170953us
W20260709 13:07:55.241992 18544 log.cc:927] Time spent T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:07:55.242470 18417 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 12. Current term is 13.
W20260709 13:07:55.243789 18550 log.cc:927] Time spent T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:07:55.251857 18543 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:55.253412 13709 raft_consensus.cc:2393] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 14: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:55.253278 14398 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:07:55.254195 18543 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:55.255765 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:55.276434 13861 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:07:55.256381 18540 log.cc:927] Time spent T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:07:55.217664 18537 raft_consensus.cc:697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:55.258983 18365 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:55.372550 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 304500us
W20260709 13:07:55.301172 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 303940us
I20260709 13:07:55.374332 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:55.389434 18397 raft_consensus.cc:697] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:55.390389 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:55.393751 18397 consensus_queue.cc:237] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:55.413076 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:55.413923 13757 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:55.413810 13864 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:07:55.415256 18554 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:55.415750 18554 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.413998 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:55.416239 18554 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:55.230626 18386 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:55.341444 18387 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:55.218964 18407 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:55.303323 18385 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:55.440995 18555 log.cc:927] Time spent T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.085s	user 0.000s	sys 0.005s
W20260709 13:07:55.442128 18549 log.cc:927] Time spent T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:07:55.451462 18386 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:55.451671 18561 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:55.451781 18407 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:55.452173 18561 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.452543 14400 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:07:55.452804 18537 consensus_queue.cc:237] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:55.429533 18387 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:55.455875 18387 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:55.452579 18561 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:55.458585 18519 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:55.463668 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:55.464401 13791 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:55.470800 13862 raft_consensus.cc:2393] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 14: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:55.472251 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:55.482420 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:55.483568 13783 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 13: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:55.447222 18369 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:55.487211 18385 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:55.478185 18456 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:55.488324 18456 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:55.489712 18380 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:55.490393 18456 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:55.495729 18436 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:55.497936 18436 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:55.501822 18386 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:55.502413 18386 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:55.504890 18386 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:55.508764 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:55.511159 18560 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:55.511718 18560 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:55.512949 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:55.513494 13787 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.513598 13791 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:07:55.513723 18560 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:55.514696 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:55.515362 13783 raft_consensus.cc:2368] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14.
I20260709 13:07:55.518383 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:55.515231 18519 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:55.519279 13783 raft_consensus.cc:2393] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 11: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:55.520879 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:55.521425 14398 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.524662 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:55.487703 18369 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:55.526852 18534 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:55.527381 18534 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:55.529434 18534 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:55.531914 18539 log.cc:927] Time spent T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.522s	user 0.004s	sys 0.000s
I20260709 13:07:55.534348 13791 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:55.534267 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:55.535022 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:55.535542 14366 leader_election.cc:400] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14.
I20260709 13:07:55.535847 14366 leader_election.cc:403] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:07:55.536015 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:55.536517 14393 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:55.537550 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:55.538817 13757 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:55.539143 13791 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:55.540866 14398 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:07:55.543092 13861 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:07:55.544431 13682 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:55.550155 14396 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:55.550598 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:55.551281 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:55.552062 13783 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:55.551281 14393 raft_consensus.cc:2393] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 11: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:55.560349 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:55.561362 13861 raft_consensus.cc:2393] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 11: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:55.561429 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:55.564647 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:55.570966 14398 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:07:55.545396 18558 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:55.575465 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:55.575676 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:55.580597 14394 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.576357 13788 raft_consensus.cc:1275] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:55.545681 18534 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:55.593590 13783 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:07:55.586546 18527 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:55.588186 18542 log.cc:927] Time spent T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.452s	user 0.003s	sys 0.000s
I20260709 13:07:55.582319 13757 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:55.557993 18404 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:55.600078 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:55.605933 13788 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 13: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:55.606827 18404 raft_consensus.cc:697] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:55.601485 14394 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:07:55.608407 18523 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:55.607879 18404 consensus_queue.cc:237] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:55.579101 18558 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.610023 18558 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:55.612852 13829 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:55.613336 18530 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:55.600287 18553 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 13:07:55.613960 18530 raft_consensus.cc:697] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:55.615267 18362 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:55.615483 18405 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:55.616168 18519 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:55.617964 13829 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:55.602133 18380 leader_election.cc:290] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:55.581622 18456 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:07:55.567696 18495 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:07:55.629949 13710 raft_consensus.cc:1275] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:55.634258 13614 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49436 (request call id 348) took 1654 ms. Trace:
I20260709 13:07:55.635455 18528 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:55.636164 18528 raft_consensus.cc:697] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:55.637284 18528 consensus_queue.cc:237] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:55.640393 13830 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:55.643428 13613 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49428 (request call id 354) took 1567 ms. Trace:
I20260709 13:07:55.643913 13613 rpcz_store.cc:276] 0709 13:07:54.075905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.076066 (+   161us) service_pool.cc:224] Handling call
0709 13:07:55.643347 (+1567281us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:07:55.645300 18505 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:55.645846 18505 raft_consensus.cc:697] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:55.646157 13609 catalog_manager.cc:5697] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:55.542492 18398 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:55.637084 18558 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:55.665934 18398 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:55.669627 18558 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:55.581122 18510 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:55.670848 18510 raft_consensus.cc:697] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:55.671686 18510 consensus_queue.cc:237] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:55.673089 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:55.629834 18492 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:07:55.674710 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 284229us
I20260709 13:07:55.653371 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:55.653982 13787 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:55.614884 18530 consensus_queue.cc:237] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:55.559962 18501 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:07:55.675913 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:55.684860 13710 raft_consensus.cc:2393] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 15: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:55.677418 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:55.686496 13862 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.646732 18505 consensus_queue.cc:237] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:55.676908 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:55.689800 13858 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:55.691622 13680 leader_election.cc:400] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15.
I20260709 13:07:55.714617 13680 leader_election.cc:403] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:55.714916 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 55823.9us
I20260709 13:07:55.716264 13755 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:55.717532 14398 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:55.719748 14366 leader_election.cc:304] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:55.720613 13712 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:07:55.721589 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:55.723790 13787 raft_consensus.cc:2393] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 14: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:07:55.725168 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:55.732084 14394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82e0eeb1582143a09acf311171812faa"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:40042
I20260709 13:07:55.732684 14394 raft_consensus.cc:606] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:55.733513 13712 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:55.674183 18362 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:07:55.735597 18361 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:55.736200 18361 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:55.736457 18568 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:55.738564 18361 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:55.739161 18522 consensus_meta.cc:287] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.793s	user 0.009s	sys 0.000s
I20260709 13:07:55.739614 18522 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:55.739895 18518 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 13:07:55.731460 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 154269us
I20260709 13:07:55.723146 18558 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:55.741885 18554 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:55.742831 18567 log.cc:927] Time spent T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:55.742558 18558 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:55.683822 18492 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:55.744704 14402 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 7.
I20260709 13:07:55.745206 18558 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:55.745378 18492 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:55.748876 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:55.727638 18537 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15.
I20260709 13:07:55.634683 13614 rpcz_store.cc:276] 0709 13:07:53.979876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.980024 (+   148us) service_pool.cc:224] Handling call
0709 13:07:55.634198 (+1654174us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:54.455693 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:54.456306 (+   613us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:54.456344 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:07:54.456364 (+    20us) tablet.cc:662] Decoding operations
0709 13:07:54.456739 (+   375us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:54.456799 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:54.456830 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:07:54.457015 (+   185us) tablet.cc:701] Row locks acquired
0709 13:07:54.457032 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:07:54.457170 (+   138us) write_op.cc:270] Start()
0709 13:07:54.457299 (+   129us) write_op.cc:276] Timestamp: P: 1783602474457123 usec, L: 0
0709 13:07:54.457318 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:07:54.457987 (+   669us) log.cc:844] Serialized 599 byte log entry
0709 13:07:55.028271 (+570284us) op_driver.cc:464] REPLICATION: finished
0709 13:07:55.496031 (+467760us) write_op.cc:301] APPLY: starting
0709 13:07:55.496116 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:55.497234 (+  1118us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:55.497321 (+    87us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:55.498002 (+   681us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:55.498181 (+   179us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:07:55.498222 (+    41us) write_op.cc:312] APPLY: finished
0709 13:07:55.498384 (+   162us) log.cc:844] Serialized 25 byte log entry
0709 13:07:55.498556 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:55.498630 (+    74us) write_op.cc:454] Released schema lock
0709 13:07:55.498664 (+    34us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:55.498996 (+   332us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:55.499024 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16119,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":467470,"apply.run_cpu_time_us":2964,"apply.run_wall_time_us":2965,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":281734,"prepare.run_cpu_time_us":2636,"prepare.run_wall_time_us":9392,"replication_time_us":501634,"thread_start_us":522622,"threads_started":2}]]}
I20260709 13:07:55.748956 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:55.722690 18496 raft_consensus.cc:2764] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:07:55.757917 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:55.773836 13859 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 13: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:55.764745 13861 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:55.766633 18407 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:55.771986 13858 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:07:55.775856 13757 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:55.782581 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:55.783769 13785 raft_consensus.cc:2368] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8.
I20260709 13:07:55.733454 18444 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:55.791720 14366 leader_election.cc:400] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8.
I20260709 13:07:55.792173 14366 leader_election.cc:403] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:07:55.802253 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:55.802959 13860 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.782191 18407 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:55.810910 13860 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:55.789065 18501 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:55.816623 18380 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:55.822301 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:55.834098 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:55.834199 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:55.836702 13712 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 13: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:07:55.771023 18522 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:55.847103 13756 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:55.849073 14367 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:55.865904 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:55.867825 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:55.869889 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:55.839696 18444 raft_consensus.cc:697] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 9 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:55.874354 14367 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:55.844030 18501 raft_consensus.cc:697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:55.857016 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:55.854440 18496 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:55.882714 14367 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:55.881739 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 158538us
I20260709 13:07:55.855849 13680 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:07:55.883561 13716 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:55.884749 18526 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:55.877158 18521 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:07:55.889611 13830 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:55.890985 13830 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:07:55.893569 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:55.894217 13709 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:55.873816 18407 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:55.918485 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:55.919519 13756 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:55.921064 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:55.923796 18524 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:55.916625 18554 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:55.937575 18574 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:55.946012 18444 consensus_queue.cc:237] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:55.908694 18366 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:55.908377 18369 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:55.949100 13865 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:55.953248 18501 consensus_queue.cc:237] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:55.957937 18534 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14.
I20260709 13:07:55.962393 18558 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:55.920939 18405 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:55.919255 18456 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.995720 18405 raft_consensus.cc:697] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:55.990394 18558 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:07:56.057104 13862 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:07:55.990640 18456 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:56.053581 18561 consensus_meta.cc:287] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.594s	user 0.007s	sys 0.004s
I20260709 13:07:56.046335 18362 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:07:56.128470 18577 log.cc:927] Time spent T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:07:56.082125 18561 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:56.158524 13710 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:56.169231 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:56.174225 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:56.176892 13709 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:07:56.094223 18362 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:56.190514 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:56.211953 18582 log.cc:927] Time spent T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:07:56.219278 18407 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:56.219646 18444 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:56.142642 18405 consensus_queue.cc:237] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:56.290729 18530 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:56.290964 18369 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:56.291353 18530 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:56.291630 18369 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:56.295473 13756 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:56.260758 18456 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:56.290132 18590 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:56.302719 18558 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:56.305787 18558 raft_consensus.cc:697] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:56.306730 18558 consensus_queue.cc:237] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:56.310359 18591 log.cc:927] Time spent T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:56.312188 18380 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8.
I20260709 13:07:56.302953 18590 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:56.313982 13757 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:56.314394 18366 raft_consensus.cc:993] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58: : Instructing follower b9d194f45e044e0988d5de1a99e5cd02 to start an election
I20260709 13:07:56.314965 18366 raft_consensus.cc:1081] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Signalling peer b9d194f45e044e0988d5de1a99e5cd02 to start an election
I20260709 13:07:56.317552 18363 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:56.318125 18363 raft_consensus.cc:697] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:56.318213 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:56.318935 13785 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:07:56.305647 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:56.320595 13829 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:56.322818 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:56.319175 18363 consensus_queue.cc:237] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:56.305694 18561 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:56.314909 18590 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:56.328866 13716 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82e0eeb1582143a09acf311171812faa"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:58552
I20260709 13:07:56.333223 13716 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:56.333644 13716 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:56.348995 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:56.397624 13716 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:56.347920 18456 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:56.416612 13716 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:56.336311 18398 consensus_queue.cc:1059] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.070s
I20260709 13:07:56.402372 18494 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:56.429587 18522 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:56.431993 18369 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:56.432580 18362 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:56.431053 18455 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:56.418416 18456 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:07:56.468351 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 154455us
I20260709 13:07:56.471367 13714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:07:56.472254 13714 raft_consensus.cc:606] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:07:56.472878 13714 raft_consensus.cc:614] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:56.446835 18366 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:07:56.486284 18596 log.cc:927] Time spent T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
W20260709 13:07:56.487671 18594 log.cc:927] Time spent T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:07:56.491736 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:56.466708 18456 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:56.504426 13716 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:56.464867 18494 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:56.505896 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:56.506490 14397 raft_consensus.cc:3055] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:56.506820 14397 raft_consensus.cc:740] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:07:56.507665 14397 consensus_queue.cc:260] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:56.472205 18455 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:56.491783 18595 log.cc:927] Time spent T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:07:56.512439 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:56.510217 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:56.518157 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:56.518724 13864 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:56.508378 18494 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:56.467396 18522 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:56.530154 13865 raft_consensus.cc:1240] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:56.515794 13680 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:56.514027 18574 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:56.533660 18369 consensus_queue.cc:1059] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:07:56.547365 18369 raft_consensus.cc:3055] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:56.547874 18369 raft_consensus.cc:740] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:56.548852 18369 consensus_queue.cc:260] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:56.550220 18369 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:56.560223 18599 log.cc:927] Time spent T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:07:56.564268 13864 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
W20260709 13:07:56.568109 18592 log.cc:927] Time spent T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:07:56.570204 18455 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:56.499545 18366 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:56.571677 18397 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:56.573307 18574 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:56.575850 18522 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:56.587067 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:56.587893 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:56.611548 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:56.618602 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:56.624782 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:56.627698 13856 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:56.629197 14368 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:56.633307 13783 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:56.637527 18366 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:56.638217 18495 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:56.645937 18574 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:56.647738 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:56.648279 18534 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:56.635857 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:56.653108 14368 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:56.655257 13783 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15. Ops: []
W20260709 13:07:56.657486 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 141824us
I20260709 13:07:56.656952 13682 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:07:56.658025 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:56.659175 13680 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:56.661296 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:56.652346 18534 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:56.662484 18547 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:56.662861 18387 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:56.663192 18547 raft_consensus.cc:697] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:56.664312 18534 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:56.664222 18547 consensus_queue.cc:237] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:56.664746 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:56.667729 18522 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:07:56.658584 18380 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:56.670950 14368 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:56.671368 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:56.680735 18456 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:56.682587 13861 raft_consensus.cc:1240] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:56.684689 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:07:56.688686 18608 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:56.657754 18561 consensus_queue.cc:1059] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:07:56.695192 18561 raft_consensus.cc:3055] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:56.695596 18561 raft_consensus.cc:740] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:56.696322 18561 consensus_queue.cc:260] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:56.696848 13829 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:56.697449 18561 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:56.690656 18574 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:56.699349 18606 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:56.700511 18456 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:56.687176 18501 raft_consensus.cc:3055] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:56.701048 18501 raft_consensus.cc:740] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:07:56.701869 18501 consensus_queue.cc:260] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:56.703061 18501 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:56.707217 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 1103) took 1762 ms. Trace:
I20260709 13:07:56.707718 14402 rpcz_store.cc:276] 0709 13:07:54.945086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.945372 (+   286us) service_pool.cc:224] Handling call
0709 13:07:56.707041 (+1761669us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b5400594f54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:07:56.707133 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1733248384}
I20260709 13:07:56.708189 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:56.707801 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:56.709228 14397 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:56.709610 18380 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:56.711005 14398 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:56.678759 14368 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:07:56.723223 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 44553.1us
I20260709 13:07:56.727698 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:07:56.729400 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 70274.4us
I20260709 13:07:56.711102 18380 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:56.735198 13785 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:56.741284 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:56.742084 13786 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:56.746018 14400 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:56.757826 13829 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:56.759629 13829 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:56.725831 18522 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:56.779477 18601 log.cc:927] Time spent T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.295s	user 0.000s	sys 0.003s
I20260709 13:07:56.780318 18380 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:56.792021 14397 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:07:56.806185 13786 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
W20260709 13:07:56.815320 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 55784.2us
I20260709 13:07:56.817430 13829 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:56.760358 18548 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:07:56.861136 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 43840.6us
I20260709 13:07:56.813519 18456 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:56.820009 18535 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:56.873446 18535 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:56.875566 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.877573 18369 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:07:56.878233 18612 log.cc:927] Time spent T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:07:56.878852 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:56.854667 18506 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:56.860891 18548 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:56.894188 18548 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:56.898701 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:56.965894 13712 raft_consensus.cc:1240] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:56.984122 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 82376.2us
I20260709 13:07:56.866300 18518 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:57.001175 18534 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:56.859665 18528 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.149s
W20260709 13:07:57.020345 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.002585 18535 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:57.024015 18534 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:57.082504 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.086629 18534 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:57.087476 18506 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:57.088060 18506 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:57.090188 18506 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:57.090677 18506 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:57.068428 18366 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:57.092939 18366 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:57.095096 18366 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:57.099814 18517 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:57.117712 18517 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:57.119854 18517 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:57.110162 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:57.091127 18506 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:57.129326 18506 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:57.130051 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 268094us
I20260709 13:07:57.139281 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:57.141940 18604 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:57.142498 18604 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:57.144497 18604 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:57.134629 18428 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.163252 13786 raft_consensus.cc:1240] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:57.167759 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:07:57.168623 13785 raft_consensus.cc:2410] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:07:57.169279 13783 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:57.172986 13788 raft_consensus.cc:1240] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:57.173480 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:57.177336 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:57.183108 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:57.160285 18509 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:57.186220 18509 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:57.186782 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:57.190209 13829 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:57.185084 13860 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:57.192332 13864 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:57.193269 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:57.154604 18604 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:57.204550 18397 consensus_queue.cc:1059] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:57.204795 18604 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:57.212630 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:57.154742 18456 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:07:57.213924 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:57.205677 18626 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:57.228901 18626 raft_consensus.cc:697] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:07:57.229931 18626 consensus_queue.cc:237] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:57.156260 18428 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } }
I20260709 13:07:57.215304 18509 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:57.217046 18366 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:57.211563 18404 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
I20260709 13:07:57.236901 18528 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:57.376004 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:57.409722 18528 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:57.412681 18528 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:57.373261 18511 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:57.413571 18511 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:57.414947 18509 consensus_queue.cc:1059] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:57.415940 18509 raft_consensus.cc:3055] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:57.416271 18509 raft_consensus.cc:740] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:57.416975 18509 consensus_queue.cc:260] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:57.418045 18509 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:57.417963 18543 consensus_queue.cc:1059] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:57.418725 18543 consensus_queue.cc:1243] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer 35ecb005831740438d7537dd4b840e03 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:57.355669 18366 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:57.421778 18366 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:57.423254 18428 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:57.403376 18547 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:57.424355 18547 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:57.426399 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 52641.9us
I20260709 13:07:57.426851 18547 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:57.428370 18530 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:57.430546 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:57.439025 18398 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:57.446249 18398 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:57.440963 18428 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:57.463677 18604 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:57.450598 18511 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:57.479522 18398 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:57.465715 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 48769.6us
I20260709 13:07:57.466203 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:57.489178 18494 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.489741 18494 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:57.492313 18494 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:57.496992 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:57.505445 18531 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.506057 18531 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:57.508864 18531 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:57.511672 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:57.512326 13715 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 5.
I20260709 13:07:57.516247 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:07:57.517397 18633 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:07:57.518270 18564 raft_consensus.cc:3055] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:57.518668 18564 raft_consensus.cc:740] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:07:57.519492 18564 consensus_queue.cc:260] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:57.520797 18564 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:57.484259 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:57.526361 18529 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.526903 18529 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:57.529000 18529 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:57.529983 18524 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:07:57.531363 18631 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:07:57.537578 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:57.539032 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:57.486588 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:57.556496 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:57.557998 13612 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57116 (request call id 254) took 3513 ms. Trace:
I20260709 13:07:57.558462 13612 rpcz_store.cc:276] 0709 13:07:54.034040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.035650 (+  1610us) service_pool.cc:224] Handling call
0709 13:07:57.547545 (+3511895us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":362828,"reported_tablets":3}
I20260709 13:07:57.557610 13609 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49444 (request call id 346) took 3164 ms. Trace:
I20260709 13:07:57.549710 18496 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:57.575865 18496 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:57.576607 18501 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:57.577364 18501 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:57.578401 18496 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:57.580956 18604 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:57.583957 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:57.568974 13609 rpcz_store.cc:276] 0709 13:07:54.318606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.318787 (+   181us) service_pool.cc:224] Handling call
0709 13:07:57.483289 (+3164502us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:56.143815 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:56.188483 (+ 44668us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:56.189957 (+  1474us) write_op.cc:435] Acquired schema lock
0709 13:07:56.192604 (+  2647us) tablet.cc:662] Decoding operations
0709 13:07:56.203986 (+ 11382us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:56.204074 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:56.204125 (+    51us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:07:56.204399 (+   274us) tablet.cc:701] Row locks acquired
0709 13:07:56.204427 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:07:56.204638 (+   211us) write_op.cc:270] Start()
0709 13:07:56.204810 (+   172us) write_op.cc:276] Timestamp: P: 1783602476204571 usec, L: 0
0709 13:07:56.204846 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:07:56.205851 (+  1005us) log.cc:844] Serialized 541 byte log entry
0709 13:07:56.487464 (+281613us) op_driver.cc:464] REPLICATION: finished
0709 13:07:56.678640 (+191176us) write_op.cc:301] APPLY: starting
0709 13:07:56.717777 (+ 39137us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:56.879257 (+161480us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:56.879351 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:56.880136 (+   785us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:56.880343 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:07:56.880386 (+    43us) write_op.cc:312] APPLY: finished
0709 13:07:56.880551 (+   165us) log.cc:844] Serialized 25 byte log entry
0709 13:07:56.880756 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:56.880856 (+   100us) write_op.cc:454] Released schema lock
0709 13:07:56.880896 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:56.881305 (+   409us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:56.881345 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":182163,"apply.run_cpu_time_us":4117,"apply.run_wall_time_us":206785,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":415269,"prepare.run_cpu_time_us":3801,"prepare.run_wall_time_us":79671,"replication_time_us":261050,"spinlock_wait_cycles":31488,"thread_start_us":512981,"threads_started":2}]]}
I20260709 13:07:57.497049 18590 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.606462 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:57.615103 13829 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:57.621001 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:57.621815 13715 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
W20260709 13:07:57.623086 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 99070us
I20260709 13:07:57.636037 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:57.637614 13829 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:57.638996 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:57.655993 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:57.656668 13710 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:57.673638 13791 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:57.677369 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:57.677793 13789 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:57.679936 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:57.461320 18428 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:57.680382 13715 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:57.582412 18543 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:57.688351 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:57.691453 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:07:57.693655 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 56153.8us
I20260709 13:07:57.607511 18365 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:57.607671 18548 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:57.697270 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:57.703003 14400 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:07:57.697844 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:57.612530 18561 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:57.704358 13791 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:07:57.702047 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:57.708066 13712 raft_consensus.cc:2410] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:07:57.681752 13864 consensus_queue.cc:237] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:57.714471 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:57.716795 14400 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:57.718654 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:57.713228 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 132738us
I20260709 13:07:57.679387 18455 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:57.679239 18496 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.724704 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:57.608995 18604 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:57.728184 13829 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:57.740428 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:57.797900 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:57.798666 13711 raft_consensus.cc:2393] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 22: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:07:57.714099 18568 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:57.617008 18590 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:57.686817 18407 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:07:57.726722 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:57.795485 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 53458.4us
I20260709 13:07:57.804438 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:57.716123 18365 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:57.721115 18501 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:57.807274 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 79140.3us
I20260709 13:07:57.811829 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:57.861325 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:57.703446 18543 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:57.900394 13680 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:57.814467 14367 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:57.720813 18548 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:57.909745 13787 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:57.909951 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:57.727305 18561 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:57.735456 18496 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:57.807812 18632 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:57.815512 18535 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:57.813966 18606 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:57.915086 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:57.818732 18365 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:57.918236 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:57.895808 18568 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:57.921856 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:57.908242 18455 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:57.943750 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 129351us
I20260709 13:07:57.912756 18505 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 13:07:57.820748 18590 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:58.019466 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:57.930682 13614 catalog_manager.cc:5697] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 9 to 10, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 10 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:58.033351 13789 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
W20260709 13:07:57.910612 18626 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.044s	sys 0.123s
I20260709 13:07:58.038578 18534 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:57.910863 18636 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:58.036506 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:58.035926 13614 catalog_manager.cc:5697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 8 to 9, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 9 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:58.108871 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:58.109790 13784 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 22.
W20260709 13:07:58.016954 18642 log.cc:927] Time spent T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 13:07:58.037715 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 109459us
I20260709 13:07:58.039819 18543 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:58.041853 18496 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:58.033013 18568 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:58.016562 18428 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:58.017935 18548 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:58.018380 18632 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:58.037829 18529 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:07:58.046092 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 126173us
I20260709 13:07:58.049166 18561 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:58.050442 18604 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:57.946719 18535 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:58.069214 18627 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:07:57.812215 18407 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:58.117842 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 172531us
W20260709 13:07:58.118494 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 204724us
I20260709 13:07:58.076752 18547 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:58.214996 13614 catalog_manager.cc:5697] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 7 to 9, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 9 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:07:58.109932 18564 consensus_meta.cc:287] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.589s	user 0.013s	sys 0.000s
I20260709 13:07:58.255676 18495 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:07:58.257869 14366 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.500s (SENT)
I20260709 13:07:58.301083 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:58.256389 18574 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:58.267755 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:58.304035 18590 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.310333 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:58.314222 18629 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:58.314919 18629 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:58.318029 18629 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:58.305600 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:58.322470 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:07:58.328058 18638 log.cc:927] Time spent T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:58.331756 18407 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:07:58.334553 18646 log.cc:927] Time spent T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:07:58.345638 18535 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:58.310364 18590 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:58.349578 18590 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:58.350337 18649 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.350979 18649 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:58.351763 18632 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:58.353474 18649 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:58.354596 18568 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:58.340728 18495 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:58.365442 18509 consensus_meta.cc:287] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.947s	user 0.013s	sys 0.000s
W20260709 13:07:58.368144 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 65483.2us
I20260709 13:07:58.299645 13680 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:58.108997 18534 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:58.304762 18404 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:58.372846 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:58.283272 13614 catalog_manager.cc:5697] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:07:58.373317 18404 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:58.374441 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:58.374145 13614 catalog_manager.cc:5697] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: config changed from index 9 to 10, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:58.284250 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:58.300392 18547 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:58.303740 13711 raft_consensus.cc:1275] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:07:58.372726 18534 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:58.376384 13711 pending_rounds.cc:85] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 6
I20260709 13:07:58.376739 13711 pending_rounds.cc:107] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:07:58.377027 13711 raft_consensus.cc:2889] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:58.377472 18547 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:58.366586 18574 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:58.380043 18574 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:58.380465 18561 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.380954 18561 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:58.375339 18404 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:58.277509 18529 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:07:58.386890 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 87361.2us
I20260709 13:07:58.418143 13614 catalog_manager.cc:5697] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 12 to 14, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 14 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:58.470393 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 156521us
I20260709 13:07:58.472205 13680 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:07:58.476977 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 209610us
I20260709 13:07:58.477761 18547 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:07:58.480459 18428 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:58.480976 18428 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:58.482961 18428 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:58.483435 18548 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:58.464710 18519 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.465133 18404 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:58.474578 18574 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:58.487913 18649 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:58.503554 18649 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.503343 18574 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:58.504082 18649 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:58.505373 18574 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:58.490216 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:58.492238 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:58.492551 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:58.500735 18519 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:58.502489 18529 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:58.526412 13614 catalog_manager.cc:5697] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 10 to 12, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 12 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:58.556375 13614 catalog_manager.cc:5697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 13 to 15, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 15 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:07:58.559762 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:58.562626 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:07:58.563508 18519 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:07:58.566403 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 88056.9us
I20260709 13:07:58.567400 13756 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:58.573149 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 79774.9us
I20260709 13:07:58.596752 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:58.598310 13756 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:58.602138 13756 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:58.605172 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 347313us
I20260709 13:07:58.602967 18604 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:58.613878 13756 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:58.605899 18548 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:58.603591 18574 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.612339 18496 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:58.607637 18632 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:58.646513 18643 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:58.648011 18574 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:58.676276 18495 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:58.676884 18495 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:58.677350 18495 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:58.677934 18529 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:58.678493 18529 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:58.680541 18529 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:58.715914 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:58.679399 18495 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:58.711838 18516 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.203s	user 0.027s	sys 0.022s
I20260709 13:07:58.710096 18407 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:58.686929 18632 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:07:58.812366 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 71722.3us
I20260709 13:07:58.815682 18428 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:58.816426 18428 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:58.819017 18428 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:58.731645 18407 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:58.720455 18529 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:07:58.723651 18516 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.215s	user 0.028s	sys 0.022s
W20260709 13:07:58.828392 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 214948us
I20260709 13:07:58.721257 18534 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:58.827159 18407 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:58.811947 18651 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:58.834386 13757 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:58.825083 18650 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:58.847842 18632 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:58.838752 18604 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:58.833966 18548 consensus_queue.cc:1048] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:07:58.852864 18650 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:58.827711 18529 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:58.833812 18428 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:58.838052 18651 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:58.861939 18574 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:58.875613 18428 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:58.880685 18529 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:58.882331 18548 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.882891 18548 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:58.885066 18548 leader_election.cc:290] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:58.886112 18659 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:07:58.886754 18630 log.cc:927] Time spent T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 1.398s	user 0.027s	sys 0.061s
I20260709 13:07:58.886672 18659 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:58.888731 18659 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:58.889201 18651 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:58.855868 18649 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:58.891863 18649 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:58.892761 18650 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:58.893325 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:58.894961 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:58.895586 13785 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:07:58.878584 18428 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:58.897934 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:58.900563 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:58.901255 13783 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:07:58.898651 13785 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:07:58.969714 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1124) took 2574 ms. Trace:
I20260709 13:07:58.970359 13862 rpcz_store.cc:276] 0709 13:07:56.395651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.395833 (+   182us) service_pool.cc:224] Handling call
0709 13:07:56.396324 (+   491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.140859 (+744535us) spinlock_profiling.cc:243] Waited 7.15 ms on lock 0x7b18002e06c0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f52320864bc 00007f522f3d448b 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3ee455 00007f52324d6060 00007f52324d6bfb 00007f52324e164b
0709 13:07:57.140978 (+   119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.141002 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.141446 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.195552 (+ 54106us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:57.195586 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.195647 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.886045 (+1690398us) spinlock_profiling.cc:243] Waited 80.3 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:07:58.969387 (+ 83342us) raft_consensus.cc:1685] finished
0709 13:07:58.969417 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.969601 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11970,"raft.queue_time_us":21091,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":31826,"spinlock_wait_cycles":201126912,"thread_start_us":100265,"threads_started":2,"wal-append.queue_time_us":346790}
I20260709 13:07:58.974058 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:58.976892 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:59.041344 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:59.043052 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:59.044368 13862 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
W20260709 13:07:59.046229 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 210039us
W20260709 13:07:59.046005 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 232682us
I20260709 13:07:58.896819 18650 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:59.088967 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:59.089354 18650 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:59.094300 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:59.095067 13785 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:07:59.102413 18510 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:59.103019 18510 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:59.118731 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:59.120131 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:59.121616 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:59.145834 13829 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:07:59.192771 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:59.194568 13862 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:07:59.199611 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:59.199724 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:59.200300 14400 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:07:59.201148 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:59.201921 14398 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:07:59.267573 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:59.268826 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:59.271194 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:59.287781 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:59.289897 14402 raft_consensus.cc:1240] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:59.313315 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:07:59.314100 14398 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:59.332103 13682 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.118s	user 0.159s	sys 0.191s
W20260709 13:07:59.332559 13682 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.118s	user 0.159s	sys 0.191s
I20260709 13:07:59.337016 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:59.191620 18650 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:59.186945 18613 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:59.349972 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:59.311376 18548 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:59.352885 18548 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:59.355430 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:59.194416 18518 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:59.193630 18495 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:59.262102 18659 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:59.371025 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:59.377612 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:59.311125 18532 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:59.310904 18531 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:59.348992 18643 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:07:59.417936 13828 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.025s	sys 0.027s
W20260709 13:07:59.418793 13828 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.025s	sys 0.028s
I20260709 13:07:59.421787 14368 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:59.422212 18531 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:59.361953 18518 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:07:59.396001 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 190142us
I20260709 13:07:59.382465 18535 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:59.376279 18495 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:59.368505 18613 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:59.614516 18548 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:59.501268 14398 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
W20260709 13:07:59.617125 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.620554 13755 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:07:59.621166 13757 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.000s	sys 0.024s
I20260709 13:07:59.430512 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:59.388890 18666 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:59.626490 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:07:59.626600 13757 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.000s	sys 0.024s
W20260709 13:07:59.484411 18665 log.cc:927] Time spent T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:07:59.388244 18543 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:59.625888 13755 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:59.627036 13862 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:07:59.633571 13757 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:59.480571 18494 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:59.650177 14368 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:59.637585 13757 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:59.638576 13755 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:59.509430 18510 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:59.626463 18518 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:59.383498 18659 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:59.626542 18443 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:59.548234 18531 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:59.654129 13755 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:07:59.673359 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:59.692646 14396 raft_consensus.cc:2393] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 6: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:07:59.678503 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:59.626458 18506 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:59.629068 18548 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:59.660019 18658 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:59.689301 18428 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:59.652092 18494 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:59.652607 18669 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:59.397233 18532 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:59.689502 18650 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:59.708475 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:59.715406 18677 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:59.697659 18443 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:59.723935 18677 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:59.724220 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:59.725700 18443 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:59.725948 18677 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:59.726089 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:59.726419 18677 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:07:59.709830 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 55791.5us
I20260709 13:07:59.723328 18650 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.694684 18670 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:59.732972 18650 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.733225 18670 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:59.634855 18666 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:59.738066 18666 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:59.727073 18443 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:59.739051 18443 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:59.740545 18532 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:59.702978 18674 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:59.743783 18674 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:59.715065 18672 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:59.747268 18650 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:59.747995 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:59.748593 13784 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:59.748119 18672 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:59.749531 18650 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:59.719394 18658 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:59.659216 18543 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:59.729228 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:59.729671 13755 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:59.431089 18643 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:59.720914 18659 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:59.760732 18670 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:59.761682 18643 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:59.727461 13862 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:07:59.750972 18658 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:59.726905 18677 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:59.704629 18506 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:59.706332 18428 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:59.627847 18535 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:59.706022 18604 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:59.862963 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 134677us
I20260709 13:07:59.767668 18543 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:59.900872 18543 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:59.901547 18543 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:59.909521 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:59.910028 14396 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:07:59.758880 13860 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:07:59.902150 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:59.911013 13784 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:07:59.768108 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:59.711380 18494 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:59.906546 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:59.911975 13858 raft_consensus.cc:2410] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:07:59.915339 13757 leader_election.cc:304] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:59.915361 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:59.916326 18548 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:59.916544 18495 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:59.916791 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:07:59.917346 13858 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.918862 18685 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:59.920044 18685 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:07:59.912295 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 3316) took 1033 ms. Trace:
I20260709 13:07:59.922039 18685 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:59.921432 13860 rpcz_store.cc:276] 0709 13:07:58.878649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.729048 (+850399us) service_pool.cc:224] Handling call
0709 13:07:59.912249 (+183201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:59.763008 18576 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:07:59.923012 18543 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:59.924227 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:59.763664 18672 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:59.923132 18576 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:59.903669 18658 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:59.925324 14366 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:07:59.722811 18613 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:59.716756 18671 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.926623 18576 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:07:59.926688 18671 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:59.902402 18659 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:59.927281 13860 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:07:59.941007 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:59.941936 13860 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:07:59.762126 18561 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:07:59.948976 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 2.22066e+06us
I20260709 13:07:59.950511 13830 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:07:59.954238 18677 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:59.955785 13790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 1134) took 2054 ms. Trace:
I20260709 13:07:59.956321 13790 rpcz_store.cc:276] 0709 13:07:57.901342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.902447 (+  1105us) service_pool.cc:224] Handling call
0709 13:07:57.902737 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.928207 (+ 25470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.928235 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:57.928274 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:57.928307 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.955431 (+2027124us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b5400161a54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:59.955498 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.955671 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58176768}
I20260709 13:07:59.963045 18518 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:07:59.963908 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1159) took 1747 ms. Trace:
I20260709 13:07:59.964673 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:07:59.969141 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:07:59.969889 14398 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
I20260709 13:07:59.964696 13755 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:07:59.976774 13858 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:07:59.964388 13857 rpcz_store.cc:276] 0709 13:07:58.216106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.216431 (+   325us) service_pool.cc:224] Handling call
0709 13:07:59.962907 (+1746476us) spinlock_profiling.cc:243] Waited 927 us on lock 0x7b5800021698. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:07:59.963174 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.963401 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.963491 (+    90us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.963550 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:59.963595 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.963668 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.963806 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2133248}
I20260709 13:07:59.903940 18428 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:59.762591 18678 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:59.904106 18604 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:07:59.906935 18669 consensus_queue.cc:1059] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:07:59.934329 13786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2803) took 2293 ms. Trace:
I20260709 13:07:59.719101 18676 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:07:59.897418 18443 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:07:59.939131 13757 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:00.003194 13786 rpcz_store.cc:276] 0709 13:07:57.640914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.641095 (+   181us) service_pool.cc:224] Handling call
0709 13:07:57.641462 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.825882 (+184420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.825927 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:57.825983 (+    56us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:57.826046 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.934098 (+2108052us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54002ebb54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:59.934140 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.934250 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423578880}
I20260709 13:07:59.944124 14368 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:00.006534 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 62535.6us
I20260709 13:07:59.940016 18532 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:59.877494 18531 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:07:59.904788 18535 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:07:59.978477 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:59.983387 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1158) took 1856 ms. Trace:
I20260709 13:07:59.981572 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 1129) took 2249 ms. Trace:
I20260709 13:08:00.001394 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.002997 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:59.999765 18659 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:00.006716 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 163986us
I20260709 13:07:59.906594 18674 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:00.008795 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 1136) took 2453 ms. Trace:
I20260709 13:07:59.999974 18386 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:00.013274 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 3311) took 1135 ms. Trace:
I20260709 13:07:59.943107 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:07:59.955794 18506 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:00.031057 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 104366us
I20260709 13:08:00.004796 18604 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.020758 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1165) took 1186 ms. Trace:
W20260709 13:08:00.024238 18648 log.cc:927] Time spent T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 1.691s	user 0.010s	sys 0.023s
I20260709 13:08:00.009666 18495 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:00.017338 18659 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:00.006850 18589 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:08:00.015894 14397 rpcz_store.cc:276] 0709 13:07:57.550600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.550747 (+   147us) service_pool.cc:224] Handling call
0709 13:07:57.551029 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.551336 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.551364 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.572537 (+ 21173us) log.cc:844] Serialized 26 byte log entry
0709 13:07:59.623076 (+2050539us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b18000c9220. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e0d1 00007f5232499a0f
0709 13:07:59.876761 (+253685us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:59.876799 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.876884 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:59.975616 (+ 98732us) raft_consensus.cc:1685] finished
0709 13:07:59.975649 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.004111 (+ 28462us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":455,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":11971,"spinlock_wait_cycles":66956032,"thread_start_us":253414,"threads_started":1,"wal-append.queue_time_us":2371913}
I20260709 13:08:00.027930 18518 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:00.042687 18684 raft_consensus.cc:3055] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:00.043175 18684 raft_consensus.cc:740] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:00.044121 18684 consensus_queue.cc:260] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.031719 18671 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:00.013571 18531 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:00.037688 18495 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:00.047356 18495 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:00.015550 18676 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.038972 18659 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.009262 18678 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.061097 18531 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:00.061760 18645 log.cc:927] Time spent T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 1.778s	user 0.011s	sys 0.049s
I20260709 13:08:00.061607 18658 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.062098 18676 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:00.067654 18658 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:00.070825 18534 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:00.077099 18678 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:00.076922 18604 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.079123 18604 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:00.079497 18659 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.081357 18659 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:00.110419 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 241560us
I20260709 13:08:00.126106 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:00.131840 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.133949 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.134128 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.134827 13708 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:08:00.139472 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:00.149578 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 210393us
W20260709 13:08:00.149976 13789 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 2301) took 2462 ms (client timeout 2219 ms). Trace:
I20260709 13:08:00.017314 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1160) took 1553 ms. Trace:
I20260709 13:08:00.136725 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.152427 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2297) took 2535 ms. Trace:
I20260709 13:08:00.154443 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.153147 13788 rpcz_store.cc:276] 0709 13:07:57.616420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.618316 (+  1896us) service_pool.cc:224] Handling call
0709 13:07:57.618591 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.899644 (+281053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.899672 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.908156 (+  8484us) log.cc:844] Serialized 26 byte log entry
0709 13:07:58.266310 (+358154us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:58.266360 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.266463 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.023566 (+1757103us) spinlock_profiling.cc:243] Waited 9.32 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:00.151695 (+128129us) raft_consensus.cc:1685] finished
0709 13:08:00.151731 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.152140 (+   409us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":76998,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":12155,"spinlock_wait_cycles":21441280,"thread_start_us":610446,"threads_started":2,"wal-append.queue_time_us":413927}
I20260709 13:08:00.012708 13791 rpcz_store.cc:276] 0709 13:07:57.731819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.731938 (+   119us) service_pool.cc:224] Handling call
0709 13:07:57.792377 (+ 60439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.832622 (+ 40245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.832670 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:57.832727 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:57.832785 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.981251 (+2148466us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b540026ded4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:07:59.981324 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.981494 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92013952}
I20260709 13:08:00.155588 13707 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:08:00.138842 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2494) took 2434 ms. Trace:
I20260709 13:08:00.152189 13858 rpcz_store.cc:276] 0709 13:07:58.463749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.016511 (+1552762us) service_pool.cc:224] Handling call
0709 13:08:00.016838 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.017010 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.017040 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.017083 (+    43us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:00.017113 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.017162 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.017262 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.157238 13716 rpcz_store.cc:276] 0709 13:07:57.704435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.704581 (+   146us) service_pool.cc:224] Handling call
0709 13:07:57.704858 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.019008 (+314150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.019039 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:58.019075 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:58.019103 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.138325 (+2119222us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b54002639d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:00.138386 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.138639 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":722076416}
I20260709 13:08:00.137368 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.136229 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.160624 13710 raft_consensus.cc:2410] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:08:00.160673 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3306) took 1284 ms. Trace:
I20260709 13:08:00.162799 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:00.163512 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:00.029075 13856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3305) took 1153 ms. Trace:
I20260709 13:08:00.018597 13857 rpcz_store.cc:276] 0709 13:07:58.877366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.002286 (+1124920us) service_pool.cc:224] Handling call
0709 13:08:00.013218 (+ 10932us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.165547 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:00.166623 13786 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:08:00.026638 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1166) took 1191 ms. Trace:
I20260709 13:08:00.167691 13857 raft_consensus.cc:1275] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:00.167776 13860 rpcz_store.cc:276] 0709 13:07:58.835445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.025814 (+1190369us) service_pool.cc:224] Handling call
0709 13:08:00.026122 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.026314 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.026340 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.026383 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:00.026422 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.026476 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.026566 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.168586 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3307) took 1292 ms. Trace:
I20260709 13:08:00.168745 13859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3308) took 1292 ms. Trace:
I20260709 13:08:00.169045 13857 rpcz_store.cc:276] 0709 13:07:58.876350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.166309 (+1289959us) service_pool.cc:224] Handling call
0709 13:08:00.166912 (+   603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.168342 (+  1430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.168536 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.033828 13865 rpcz_store.cc:276] 0709 13:07:58.834601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.019877 (+1185276us) service_pool.cc:224] Handling call
0709 13:08:00.020202 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.020404 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.020437 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.020487 (+    50us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:00.020526 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.020588 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.020699 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.170004 13860 raft_consensus.cc:1275] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:00.170722 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3309) took 1293 ms. Trace:
I20260709 13:08:00.012526 13864 rpcz_store.cc:276] 0709 13:07:58.126654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.126974 (+   320us) service_pool.cc:224] Handling call
0709 13:07:59.982409 (+1855435us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b5800021698. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:07:59.982691 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.982949 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.982992 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.983054 (+    62us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:59.983104 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.983186 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.983318 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4338432}
I20260709 13:08:00.171926 13865 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:08:00.172365 13865 pending_rounds.cc:85] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 7
I20260709 13:08:00.172672 13865 pending_rounds.cc:107] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:08:00.173046 13865 raft_consensus.cc:2889] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:00.173959 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3312) took 1296 ms. Trace:
I20260709 13:08:00.169193 13859 rpcz_store.cc:276] 0709 13:07:58.876610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.167359 (+1290749us) service_pool.cc:224] Handling call
0709 13:08:00.167932 (+   573us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.168334 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.168356 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.168415 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:00.168443 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.168491 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.168583 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.165118 13856 rpcz_store.cc:276] 0709 13:07:58.875766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.028390 (+1152624us) service_pool.cc:224] Handling call
0709 13:08:00.028638 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.028786 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.028800 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.028833 (+    33us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:00.028901 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.028954 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.029037 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.174356 13865 rpcz_store.cc:276] 0709 13:07:58.877640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.170666 (+1293026us) service_pool.cc:224] Handling call
0709 13:08:00.171125 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.173750 (+  2625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.173912 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.036608 14366 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:00.185602 18397 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.186726 18397 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:00.187815 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 151183us
I20260709 13:08:00.188485 18516 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:00.189333 18516 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:00.189851 14366 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:00.192899 18516 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:00.193786 18516 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:00.007752 14368 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:00.197805 18524 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:00.198086 18509 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.199086 18509 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.195341 18494 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.198789 18524 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.199687 18508 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.201638 18509 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:00.202195 18509 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:00.201975 18508 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:00.203819 18531 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:00.204893 18508 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:00.204787 18531 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:00.205667 18508 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:08:00.206262 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.171131 13860 rpcz_store.cc:276] 0709 13:07:58.876865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.169205 (+1292340us) service_pool.cc:224] Handling call
0709 13:08:00.169576 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.170436 (+   860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.170652 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:00.207917 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 200122us
I20260709 13:08:00.209694 18532 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:00.210736 18532 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:00.211967 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:00.212224 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:00.212632 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.212874 13791 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:08:00.213476 18532 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:00.213824 18444 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:00.212989 14402 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.214694 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:00.214454 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:00.211088 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:00.215601 14398 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.213526 14397 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:00.216912 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:00.217819 13788 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:00.198912 14367 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:00.214514 18444 raft_consensus.cc:697] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:00.221287 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.221999 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.141168 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.161140 13858 rpcz_store.cc:276] 0709 13:07:58.876050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.158115 (+1282065us) service_pool.cc:224] Handling call
0709 13:08:00.158848 (+   733us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.159353 (+   505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.159376 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.160363 (+   987us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:00.160406 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.160481 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.160590 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.135068 13713 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
W20260709 13:08:00.150566 13789 rpcz_store.cc:269] 0709 13:07:57.687357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.691219 (+  3862us) service_pool.cc:224] Handling call
0709 13:08:00.149463 (+2458244us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b540023b4d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:00.149693 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":784798592}
I20260709 13:08:00.206722 18508 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.202936 18509 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.201666 18494 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:00.249589 18509 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:00.247061 13757 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:00.235962 18658 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.251178 18658 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.190578 18397 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:00.237355 18632 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:00.238011 18636 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:00.255963 18658 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:00.256513 18636 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.259665 18636 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:00.259882 18680 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:00.239951 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.222816 18444 consensus_queue.cc:237] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.261469 18680 consensus_queue.cc:1048] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:00.201999 18524 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:00.243432 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 53778.9us
I20260709 13:08:00.244545 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.234344 18547 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:00.234412 18535 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:00.239046 18501 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:00.235070 18561 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:00.194653 18516 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.231499 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3310) took 1351 ms. Trace:
I20260709 13:08:00.267170 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:00.271808 18501 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.272862 18547 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.275568 18561 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.276679 14366 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:00.277258 18547 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:00.278105 18561 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:00.278537 14366 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:00.279722 14397 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.281522 14366 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:00.282626 18494 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:00.283589 18494 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:00.283753 18535 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:00.271257 13857 rpcz_store.cc:276] 0709 13:07:58.877121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.170173 (+1293052us) service_pool.cc:224] Handling call
0709 13:08:00.170631 (+   458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.171093 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.171121 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.171187 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:00.171247 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.171314 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.228891 (+ 57577us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.287218 14366 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:00.291826 18444 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:00.292359 18444 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:00.292892 18444 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:00.294063 14366 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:00.295114 18533 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:00.296787 14366 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:00.297684 18533 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:00.299371 14366 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:00.300312 18533 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:00.300706 18533 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:00.290136 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 79117.5us
I20260709 13:08:00.301421 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.274869 18501 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:00.287827 18369 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.283663 18455 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:00.304467 18369 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:00.305161 18455 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:00.306617 18369 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:00.310927 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:00.312929 18508 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:00.314226 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.318321 18428 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:00.325668 13786 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:00.326786 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:00.327394 18428 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:00.329130 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.324627 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:00.323668 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:00.325362 18521 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:00.332151 18521 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.332595 13784 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:08:00.332823 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:00.333238 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 207358us
I20260709 13:08:00.333599 18535 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:00.334192 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:00.334309 18535 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.337155 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.338430 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.339026 13865 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:00.301070 18533 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.341199 18521 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:00.339705 18547 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:00.343802 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.345166 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:00.346177 18398 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:00.346448 18658 consensus_queue.cc:1048] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:00.349677 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.349962 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.350818 13713 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:08:00.351821 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.352567 13713 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
I20260709 13:08:00.352988 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.353168 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.353433 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.353581 13707 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:08:00.353750 13709 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:00.354048 13713 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 22.
I20260709 13:08:00.354480 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.350996 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:00.356348 13863 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:00.357542 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.287873 18516 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:00.360023 18535 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:00.364053 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:00.368330 13856 raft_consensus.cc:1240] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:08:00.355206 13707 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:08:00.334167 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.356343 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 3315) took 1477 ms. Trace:
I20260709 13:08:00.372654 13862 rpcz_store.cc:276] 0709 13:07:58.878419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.657773 (+779354us) service_pool.cc:224] Handling call
0709 13:08:00.355949 (+698176us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b5400387554. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:00.356126 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72107264}
I20260709 13:08:00.307202 18455 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:00.323020 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:00.376562 14398 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:08:00.378212 18604 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:00.332557 18531 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:00.380730 14397 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:08:00.383122 14402 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:00.386269 18632 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:00.387001 18632 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.390596 18684 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:00.390942 18632 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:00.392375 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:00.393033 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.393699 18564 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:00.395011 14397 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:00.393074 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.403448 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.411711 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.412360 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.413000 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.413908 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.414147 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.415557 18428 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:00.416249 18428 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.423614 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.424860 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:00.428695 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.429908 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.431917 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:00.433354 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:00.437863 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 115318us
I20260709 13:08:00.437988 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.438840 13713 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:00.439903 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:00.440725 18455 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:00.441229 18455 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:00.441810 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.436421 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:00.443845 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.444466 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.447818 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:00.449292 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 57008.7us
I20260709 13:08:00.450558 13757 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:00.450637 13680 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:00.451804 18643 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:00.452230 18643 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:00.452616 18643 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:00.456459 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 157267us
I20260709 13:08:00.457121 18604 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:00.457636 18604 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:00.457472 14366 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:00.459570 18521 raft_consensus.cc:2764] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:08:00.459813 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.463778 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.465034 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.466944 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.468623 13755 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:00.422210 18428 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:00.469726 13755 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:00.471647 18428 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:00.471817 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.472251 18428 raft_consensus.cc:697] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:00.473176 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.473443 18428 consensus_queue.cc:237] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.471061 13755 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:00.475649 13708 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:00.475906 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.477031 18678 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:00.477332 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.477612 18678 raft_consensus.cc:697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:00.469650 18496 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:00.479086 18678 consensus_queue.cc:237] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.479620 18425 consensus_queue.cc:1059] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:00.481133 18501 raft_consensus.cc:3055] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:00.481680 18501 raft_consensus.cc:740] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:00.483127 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.482681 18501 consensus_queue.cc:260] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.484071 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.484406 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.485213 18501 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:00.485841 13708 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:08:00.479990 18496 raft_consensus.cc:697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:00.488025 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.488252 18496 consensus_queue.cc:237] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.491550 18425 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:00.491710 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.492189 18425 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:00.493110 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.494386 18425 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:00.494526 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:00.496181 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 45681.9us
I20260709 13:08:00.495790 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:00.436626 13710 raft_consensus.cc:1275] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:08:00.497548 13710 pending_rounds.cc:85] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 5
I20260709 13:08:00.497867 13710 pending_rounds.cc:107] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:08:00.498171 13710 raft_consensus.cc:2889] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:00.465147 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.439805 13829 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:00.459398 14366 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:00.441727 18455 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.507033 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:00.509282 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.511788 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:00.514412 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 74775.4us
I20260709 13:08:00.508895 18547 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:00.516554 18547 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:00.517541 18547 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.523845 18510 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:00.524515 18510 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:00.525049 18510 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.415359 18533 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.529493 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.530910 14396 raft_consensus.cc:1240] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:00.531303 14401 raft_consensus.cc:1240] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:00.532110 14400 raft_consensus.cc:1240] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:00.469404 18495 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.541172 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.541965 14393 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:08:00.511842 18564 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:00.543391 13715 raft_consensus.cc:1275] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:00.543810 18698 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:00.544338 18698 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:00.544768 14367 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:00.545754 18521 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:00.546242 18521 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:00.546722 18521 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:00.549027 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.531252 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:00.543085 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 83848.9us
I20260709 13:08:00.557579 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.561393 13680 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:00.543138 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.563215 13680 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:00.566162 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.508407 18444 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.571573 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:00.577003 13784 raft_consensus.cc:2410] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:08:00.544808 18698 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.581821 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:00.582990 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:00.587316 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:00.588141 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.568524 18564 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:00.571282 18561 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:00.591728 14398 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 22.
I20260709 13:08:00.587713 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:00.594323 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 47121.8us
I20260709 13:08:00.572157 18533 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:00.586364 13783 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:08:00.603744 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:00.611603 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:00.595633 18564 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:00.620469 13829 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:00.620931 18516 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:00.621600 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.593492 18561 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:00.630486 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.642413 14399 raft_consensus.cc:2410] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:08:00.607559 18495 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:00.630093 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:00.630178 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:00.632634 14367 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:00.629994 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.650305 13709 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:08:00.645488 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:00.650748 14397 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:08:00.630617 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.639806 13680 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:00.645581 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.654502 14367 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:00.636734 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.625078 18564 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:00.661052 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:00.649850 13790 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:08:00.663065 13715 raft_consensus.cc:2393] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 22: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:00.663556 13791 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:08:00.664919 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.664721 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.629488 18561 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.667927 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:00.668109 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.636489 18444 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:00.671620 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:00.665518 13755 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:00.672233 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.677116 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.678031 13782 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:08:00.688634 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.689587 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.690699 18650 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:00.681221 18531 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:00.679440 18684 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:00.706951 18635 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:00.707597 18649 consensus_queue.cc:1059] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
W20260709 13:08:00.706996 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 206341us
I20260709 13:08:00.707706 18664 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:00.708364 13830 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:00.651943 18508 consensus_queue.cc:1059] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:08:00.707602 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2817) took 1270 ms. Trace:
I20260709 13:08:00.718863 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.656134 18524 consensus_queue.cc:1059] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:08:00.732916 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.762106 14400 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
W20260709 13:08:00.736326 18707 log.cc:927] Time spent T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:08:00.759333 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 139031us
I20260709 13:08:00.687204 18604 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:00.744385 18684 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.788676 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.744900 18531 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:00.800197 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.801182 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.760468 13787 rpcz_store.cc:276] 0709 13:07:59.357491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.357613 (+   122us) service_pool.cc:224] Handling call
0709 13:08:00.181833 (+824220us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.225169 (+ 43336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.225207 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.226015 (+   808us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.373666 (+147651us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:00.373702 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.377634 (+  3932us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.563831 (+186197us) raft_consensus.cc:1685] finished
0709 13:08:00.563849 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.615005 (+ 51156us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b540023b4d0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:00.627642 (+ 12637us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16728,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":191,"spinlock_wait_cycles":1883427712,"thread_start_us":147078,"threads_started":1,"wal-append.queue_time_us":196274}
I20260709 13:08:00.799536 18501 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:00.805732 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.811542 13707 raft_consensus.cc:1240] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:00.823066 14398 raft_consensus.cc:1240] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:00.824601 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:00.793850 18684 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:00.800719 18531 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.827787 13829 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:00.816656 18501 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.830825 18362 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:00.872225 18710 log.cc:927] Time spent T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:08:00.858359 18664 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:00.872915 18664 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:00.873306 18664 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:00.873777 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 44964us
I20260709 13:08:00.874490 18510 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.875008 13756 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:00.876543 13756 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:00.878886 14400 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:00.880326 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:00.869266 18455 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:00.891997 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 142539us
I20260709 13:08:00.912438 18531 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:00.916296 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 234367us
I20260709 13:08:00.915210 18531 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:00.942338 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:00.945142 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.948457 14393 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:00.952103 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 75651.5us
I20260709 13:08:00.952715 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:00.955757 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:00.958009 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:00.960268 18715 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:00.963403 18715 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:00.963835 18715 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:08:00.963907 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 223127us
I20260709 13:08:00.964244 18715 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:00.965410 13682 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:00.966679 18547 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:00.967242 13830 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:00.968762 13830 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:00.969434 18667 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:00.969892 18667 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:00.970273 18667 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.970778 13830 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:08:00.972216 18643 consensus_meta.cc:287] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.001s
I20260709 13:08:00.972610 18643 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.973966 18715 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:00.974645 18643 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:00.963835 18669 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:00.948549 18524 consensus_queue.cc:1243] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer ceb06175847b428ea8bd77055fcddf58 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:08:00.980429 18547 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:00.981151 18524 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:00.982079 14401 raft_consensus.cc:1275] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:00.982968 13756 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:00.984095 18604 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:00.941870 18496 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:00.984447 18398 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:00.985080 18496 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:00.985159 18398 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:00.985600 18496 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.985853 18398 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.987671 18362 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:00.988236 18510 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:00.989490 18531 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:00.989490 18501 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:00.984400 13756 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:00.993345 13756 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:00.997460 18455 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:00.917459 18521 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:01.000841 18521 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:01.001825 14395 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 16: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:01.003149 18669 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:01.003683 18669 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.004068 18669 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.007853 18501 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:01.008400 18501 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:01.008795 18501 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:01.003168 18664 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:01.026438 18703 log.cc:927] Time spent T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.426s	user 0.000s	sys 0.001s
I20260709 13:08:01.026623 18664 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:01.028997 18702 log.cc:927] Time spent T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
I20260709 13:08:01.029490 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:01.037734 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:01.041779 13862 raft_consensus.cc:1240] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:01.093827 14367 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:01.048035 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 54764.9us
I20260709 13:08:01.048959 18455 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:01.049214 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 78551.6us
I20260709 13:08:01.053763 14398 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:01.063853 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:01.065130 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:01.096628 13857 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:01.066066 18561 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:01.070236 18564 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:01.058437 18684 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:01.103832 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:01.104072 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:01.110176 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:01.112835 13862 raft_consensus.cc:3055] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:01.108489 13713 raft_consensus.cc:3055] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:01.113358 13862 raft_consensus.cc:740] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:01.116714 13713 raft_consensus.cc:740] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:01.099027 18455 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:01.126228 14367 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:01.136567 14395 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:08:01.138630 13830 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:01.139695 13829 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:01.128286 18455 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.116420 18635 consensus_queue.cc:1059] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:08:01.145334 18635 raft_consensus.cc:3055] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:01.145704 18635 raft_consensus.cc:740] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:01.146550 18635 consensus_queue.cc:260] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:01.132083 18535 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:01.163089 14367 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:01.157927 13713 consensus_queue.cc:260] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:01.167184 13713 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:01.173197 13712 raft_consensus.cc:1240] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:01.173791 18510 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:01.174250 18510 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:01.174623 18510 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:01.175604 18366 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:01.176007 13865 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:01.181988 18436 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:01.184245 13829 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:01.185704 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:01.187575 18664 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:01.188026 18649 raft_consensus.cc:3055] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:01.188402 18649 raft_consensus.cc:740] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:01.189235 18649 consensus_queue.cc:260] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:01.190411 18649 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:01.170696 13862 consensus_queue.cc:260] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:01.192107 13862 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:01.192799 18635 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:01.194651 18698 consensus_meta.cc:287] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.600s	user 0.011s	sys 0.000s
I20260709 13:08:01.195458 18561 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:01.191964 18669 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:01.203054 18669 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:01.203725 18496 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:01.204699 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:01.206331 18496 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:01.208817 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:01.180907 18699 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:01.223109 13862 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:01.195055 18698 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:01.233383 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:01.236958 18659 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
W20260709 13:08:01.237557 18716 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:08:01.239856 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 267232us
I20260709 13:08:01.240931 13857 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:01.242573 13713 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:08:01.243109 13713 pending_rounds.cc:85] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 9
I20260709 13:08:01.243356 13713 pending_rounds.cc:107] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:08:01.240566 13680 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:01.243722 13713 raft_consensus.cc:2889] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:01.217918 18444 consensus_queue.cc:1059] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:08:01.235812 18699 raft_consensus.cc:697] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:08:01.246456 18636 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
W20260709 13:08:01.252796 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 127211us
I20260709 13:08:01.249270 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:01.251231 13680 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:01.241868 18664 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:01.258268 18643 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:01.264050 18679 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:01.265182 18666 raft_consensus.cc:3055] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:01.273762 14397 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:01.260382 13757 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:01.265300 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:01.256080 18561 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:01.284526 14396 raft_consensus.cc:2393] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 12: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:01.288764 13830 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:01.276297 18632 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:01.273485 18666 raft_consensus.cc:740] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:01.310951 13857 raft_consensus.cc:1240] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:01.253921 18534 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:08:01.275964 18684 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:01.320868 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 355528us
I20260709 13:08:01.321863 13865 raft_consensus.cc:1240] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:01.286952 18561 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.286588 18659 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:01.328867 14396 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:01.264123 18643 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:01.287796 18564 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:01.248311 18667 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:01.336055 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:01.339512 13791 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:01.336721 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:01.340152 13790 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:01.337275 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.307356 18679 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:01.321480 18632 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:01.349642 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:08:01.350713 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.351646 14398 raft_consensus.cc:1240] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:01.348909 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:01.328625 18561 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.357595 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:01.366137 13682 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:01.370524 13680 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:01.366425 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:01.357295 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:01.373008 14396 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:01.373112 13785 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.376976 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:01.355831 18632 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:01.376327 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:01.321650 18398 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:01.382380 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 103331us
I20260709 13:08:01.357231 18659 raft_consensus.cc:697] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:01.379030 18679 consensus_queue.cc:1059] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:08:01.388829 18664 raft_consensus.cc:3055] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:01.389003 18508 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:01.389233 18664 raft_consensus.cc:740] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:01.389855 18508 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:01.390256 18664 consensus_queue.cc:260] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:01.391522 18664 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:01.391655 18667 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:01.394066 18715 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:01.358374 18366 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
W20260709 13:08:01.383467 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 267197us
I20260709 13:08:01.396239 14396 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 23.
I20260709 13:08:01.405695 13756 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:01.409272 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.410566 13713 raft_consensus.cc:1240] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:01.411943 18666 consensus_queue.cc:260] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:01.416747 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:01.470254 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 64647.2us
I20260709 13:08:01.431041 18698 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:01.478574 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:01.376057 18699 consensus_queue.cc:237] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:01.484135 18643 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:01.385658 18501 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:01.489097 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:01.489671 13784 raft_consensus.cc:1240] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:01.491812 13791 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:01.492655 13756 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:01.500159 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 128144us
I20260709 13:08:01.497697 18724 raft_consensus.cc:2764] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:08:01.514521 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 144070us
I20260709 13:08:01.518309 13830 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:01.515636 13680 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:01.527662 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:01.528909 13788 raft_consensus.cc:1240] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:01.497043 18521 raft_consensus.cc:3055] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:01.530941 13783 raft_consensus.cc:2393] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 10: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:01.532051 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:01.531955 13755 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:01.534861 13787 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:01.538874 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:01.527536 18636 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:01.516672 18425 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:01.530093 18494 consensus_queue.cc:1059] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:08:01.552178 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:01.511979 18664 consensus_queue.cc:1048] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:08:01.552958 13756 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:01.520047 18698 consensus_queue.cc:1059] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:08:01.581610 13755 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:01.588785 13784 raft_consensus.cc:1240] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 13:08:01.589152 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.586886 18669 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:08:01.553512 18636 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:01.599475 18428 consensus_queue.cc:1048] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:08:01.601049 18398 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:01.580597 18643 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:01.644024 13858 raft_consensus.cc:1240] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:01.646420 13784 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:01.647672 18712 consensus_queue.cc:1059] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:01.648779 18712 raft_consensus.cc:3055] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:01.649112 18712 raft_consensus.cc:740] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:01.530747 18362 consensus_queue.cc:1059] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 13:08:01.599604 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 250255us
I20260709 13:08:01.650045 18362 raft_consensus.cc:3055] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:01.650002 18712 consensus_queue.cc:260] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:01.650633 18362 raft_consensus.cc:740] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:01.651868 13682 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:01.654434 18720 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:01.655200 18720 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:01.639606 18725 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:01.536878 18521 raft_consensus.cc:740] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:01.656664 18521 consensus_queue.cc:260] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:01.657838 18521 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.660959 13710 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:01.661826 13682 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:01.617609 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:01.618399 13785 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:08:01.521018 18510 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:01.663975 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.665552 18510 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:01.544874 18679 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:01.666188 18679 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:01.666574 18679 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.667065 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:01.620568 18719 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:08:01.621095 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:01.669677 14401 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:01.621335 18636 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:01.623211 14398 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:01.623956 18698 raft_consensus.cc:3055] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:01.623847 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:01.514019 18659 consensus_queue.cc:237] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:01.631778 18494 raft_consensus.cc:3055] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:08:01.631764 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 77523.4us
I20260709 13:08:01.633136 13787 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
W20260709 13:08:01.634423 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:01.637166 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 84272.1us
I20260709 13:08:01.732872 13756 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:01.733986 13756 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:01.735054 18678 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:01.553958 18564 consensus_queue.cc:1059] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.173s
I20260709 13:08:01.654949 18455 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:01.635211 18496 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:01.639734 13680 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:01.742098 18496 raft_consensus.cc:697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 23 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:01.723325 18698 raft_consensus.cc:740] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:01.743114 18496 consensus_queue.cc:237] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:01.641013 18501 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:01.663363 13715 raft_consensus.cc:1240] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:01.615862 13790 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:08:01.546475 18667 consensus_queue.cc:1059] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 13:08:01.729552 13609 catalog_manager.cc:5697] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 6 to 8, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 8 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:01.638459 14396 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
W20260709 13:08:01.749095 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 109455us
I20260709 13:08:01.674130 18712 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:01.738993 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 77619.1us
I20260709 13:08:01.744212 18698 consensus_queue.cc:260] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:01.749511 13609 catalog_manager.cc:5697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:01.756601 13609 catalog_manager.cc:5697] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:01.754285 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:01.750444 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:01.757894 13830 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:01.758565 13680 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:01.667179 18632 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:01.730857 18494 raft_consensus.cc:740] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:01.745280 18725 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:01.765012 13609 catalog_manager.cc:5697] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:01.755434 18721 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:01.752709 18547 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:01.776681 13682 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:01.774266 18664 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:01.781389 18732 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:01.781930 18494 consensus_queue.cc:260] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:01.782896 18649 raft_consensus.cc:3055] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:01.783495 18649 raft_consensus.cc:740] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:01.784246 13713 raft_consensus.cc:1240] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:01.755290 18495 consensus_queue.cc:1059] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:08:01.784891 18649 consensus_queue.cc:260] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:01.783587 18632 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:01.771733 18616 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:01.737480 18444 consensus_queue.cc:1059] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:08:01.783198 18494 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:01.829819 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:01.830397 13785 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:01.826577 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 92655.9us
I20260709 13:08:01.826202 18495 raft_consensus.cc:3055] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:01.827700 18561 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:01.834812 18495 raft_consensus.cc:740] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:01.828984 18698 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:01.845705 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:01.844466 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 77661us
W20260709 13:08:01.848887 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 108993us
I20260709 13:08:01.928014 14401 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:08:01.928709 18721 raft_consensus.cc:697] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:01.746984 18362 consensus_queue.cc:260] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:01.931921 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:01.949532 13785 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:08:01.931922 18508 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:01.957173 18508 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:01.957739 18508 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:01.959561 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:01.961067 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:01.962320 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:01.955827 14393 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:08:01.967912 13830 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:01.971609 18751 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:01.974270 13791 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:01.981607 13784 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:01.988744 18666 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.992055 18734 raft_consensus.cc:3055] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:01.992749 18734 raft_consensus.cc:740] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:01.994087 18734 consensus_queue.cc:260] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:01.996758 18734 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:02.003804 18751 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:02.004453 18751 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.006768 18751 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:01.954535 13680 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:01.938050 18649 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:02.010241 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 65860.6us
I20260709 13:08:01.934975 18732 raft_consensus.cc:697] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:08:02.015268 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 60813.2us
I20260709 13:08:02.015178 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:02.016399 13709 raft_consensus.cc:2393] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 12: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:02.016875 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:02.016424 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.014823 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:01.937428 18664 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:08:02.028970 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:02.041021 13707 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:02.029281 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:02.041769 13710 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:02.027521 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:02.023870 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 90963.5us
W20260709 13:08:02.044186 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.046226 13711 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:08:02.045794 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 77981.1us
I20260709 13:08:02.008991 18508 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:02.009569 18667 consensus_queue.cc:1059] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 13:08:02.008960 18495 consensus_queue.cc:260] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.021183 18732 consensus_queue.cc:237] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.022819 18516 consensus_queue.cc:1048] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:08:02.065743 18495 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:02.067549 18749 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:02.068598 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:02.069216 13789 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
W20260709 13:08:02.072695 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 296123us
I20260709 13:08:02.081990 18508 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:02.085875 13715 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
W20260709 13:08:02.091542 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.091239 13609 catalog_manager.cc:5697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 20 to 21, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 21 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:02.110721 13829 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:02.112324 13829 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:02.113730 13829 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:02.117950 13682 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:02.096853 13609 catalog_manager.cc:5697] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:02.115862 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:02.120239 13714 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:02.119632 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:02.070891 18496 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.127632 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:02.116174 18664 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:02.132009 18664 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:02.139801 13714 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 23.
I20260709 13:08:02.139801 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:02.103974 18455 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:02.104617 18749 raft_consensus.cc:697] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:02.160532 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:02.163547 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:02.164294 13787 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.021306 18721 consensus_queue.cc:237] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.174088 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:02.136528 18666 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:02.170810 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 47705.5us
I20260709 13:08:02.180269 18726 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:02.180807 18726 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:02.176894 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:02.105054 18679 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.187690 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:02.189182 13789 raft_consensus.cc:1240] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:02.192626 13710 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:02.185997 13707 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:08:02.194859 18753 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:02.196658 18664 consensus_queue.cc:1059] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:02.018782 18616 raft_consensus.cc:697] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:02.221119 18616 consensus_queue.cc:237] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.151563 18496 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.235886 18755 raft_consensus.cc:3055] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:02.236467 18755 raft_consensus.cc:740] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:02.237417 18755 consensus_queue.cc:260] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:02.238023 18496 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:02.217553 18740 log.cc:927] Time spent T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:02.238812 18755 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:02.247860 18736 log.cc:927] Time spent T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 13:08:02.256036 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:02.184998 18744 consensus_queue.cc:1059] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.173s
I20260709 13:08:02.260557 18732 raft_consensus.cc:3055] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:02.260934 18732 raft_consensus.cc:740] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:02.261710 18732 consensus_queue.cc:260] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:02.262974 18732 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:02.269949 13783 raft_consensus.cc:1240] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:02.271526 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:02.272599 18516 consensus_queue.cc:1059] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:02.273352 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:02.274025 18753 raft_consensus.cc:3055] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:02.274520 18753 raft_consensus.cc:740] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:02.199692 13682 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:02.274945 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:02.272923 13707 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:02.215080 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 166841us
W20260709 13:08:02.276229 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 76665.5us
I20260709 13:08:02.277047 13682 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:02.278071 18732 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.278791 18732 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:02.282085 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.283056 18521 consensus_meta.cc:287] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.625s	user 0.006s	sys 0.002s
I20260709 13:08:02.283679 18749 consensus_queue.cc:237] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.286911 13783 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:02.193979 13757 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:02.278997 13682 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:02.311403 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 119972us
I20260709 13:08:02.319350 13782 raft_consensus.cc:1240] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:02.323871 13783 raft_consensus.cc:1240] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:02.324410 13864 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:02.323742 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:02.326633 13713 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:08:02.344077 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:02.345351 13790 raft_consensus.cc:1240] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:02.346649 13784 raft_consensus.cc:1240] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:08:02.348722 13756 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:02.350565 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 71620.5us
I20260709 13:08:02.354255 13682 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:02.355125 13787 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:08:02.356070 13785 raft_consensus.cc:1240] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:02.287070 18362 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:02.362496 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.363536 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 165823us
I20260709 13:08:02.364125 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:02.364575 13829 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:02.364776 13713 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:08:02.319023 18436 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:02.325302 18669 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:02.350494 18666 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:02.373497 13682 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:02.351046 18726 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:02.359040 18425 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.219537 18636 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:02.385506 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.390852 13789 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:08:02.374059 18755 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:02.397445 13791 raft_consensus.cc:1275] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:02.398469 14397 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:08:02.404809 18366 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:02.405401 18366 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:02.379160 18524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.008s	sys 0.011s
I20260709 13:08:02.416281 13682 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:02.447373 18632 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:02.417181 13708 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 13: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:02.392117 18744 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.416429 18664 consensus_queue.cc:1059] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:08:02.422533 18366 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:02.423343 13859 raft_consensus.cc:1240] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:02.424966 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:02.431937 18712 consensus_meta.cc:287] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.676s	user 0.010s	sys 0.000s
I20260709 13:08:02.360898 18753 consensus_queue.cc:260] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:02.437531 13786 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:08:02.456231 13682 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:02.460148 18649 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.468848 18366 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.469259 18649 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.469488 18366 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.441383 18741 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:02.474571 13829 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:02.441773 18699 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:02.457019 18524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.008s	sys 0.011s
I20260709 13:08:02.483873 18720 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:02.488433 13682 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:02.472342 18534 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:02.498258 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.499049 13682 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:02.468605 18755 raft_consensus.cc:697] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:02.505828 13682 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:02.506925 18366 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:02.507841 18649 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:02.516772 13682 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:02.521935 13682 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:02.502403 18720 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:02.503887 18534 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:02.526342 18764 log.cc:927] Time spent T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:02.544975 18561 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:02.548311 18636 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:02.549253 18649 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:02.518349 18366 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:02.552731 18366 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.524080 18632 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.517974 18531 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:02.502481 18664 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:02.565506 18664 raft_consensus.cc:697] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:02.566644 13614 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49428 (request call id 355) took 6009 ms. Trace:
I20260709 13:08:02.566460 18664 consensus_queue.cc:237] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.513489 18743 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:02.514907 18524 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.486948 18699 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.484714 18741 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.571796 13609 catalog_manager.cc:5697] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:02.576519 18455 raft_consensus.cc:3055] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:02.576963 18455 raft_consensus.cc:740] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:02.518615 18734 consensus_queue.cc:1059] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:08:02.577889 13756 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:02.577765 18455 consensus_queue.cc:260] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.578794 18766 raft_consensus.cc:3055] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:08:02.537230 18770 log.cc:927] Time spent T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:02.555205 18366 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:02.612813 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:02.581796 18747 log.cc:927] Time spent T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.650s	user 0.003s	sys 0.000s
I20260709 13:08:02.586225 18680 consensus_queue.cc:1059] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 13:08:02.601646 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:02.587563 18699 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:02.656816 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 1560) took 1045 ms. Trace:
I20260709 13:08:02.625746 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:02.582020 18643 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:02.566992 13614 rpcz_store.cc:276] 0709 13:07:56.557113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.557342 (+   229us) service_pool.cc:224] Handling call
0709 13:07:56.888637 (+331295us) spinlock_profiling.cc:243] Waited 92.1 ms on lock 0x7b54003edd54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232448090 00007f52324e6f3a 00007f523829d1cc 00007f523839b37e 00007f523685c2a4 00007f523685c232 00007f523685c161 00007f523685c0dc 00007f523685b392 00007f523081948c 00007f52308188c6
0709 13:08:02.566452 (+5677815us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:58.841250 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:58.844006 (+  2756us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:58.844042 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:07:58.844060 (+    18us) tablet.cc:662] Decoding operations
0709 13:07:58.845092 (+  1032us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:58.845186 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:58.845246 (+    60us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:07:58.845892 (+   646us) tablet.cc:701] Row locks acquired
0709 13:07:58.845910 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:07:58.846052 (+   142us) write_op.cc:270] Start()
0709 13:07:58.846169 (+   117us) write_op.cc:276] Timestamp: P: 1783602478846010 usec, L: 0
0709 13:07:58.846192 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:07:58.879248 (+ 33056us) log.cc:844] Serialized 3301 byte log entry
0709 13:08:00.067344 (+1188096us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b18003aa200. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f13f3 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
0709 13:08:00.082750 (+ 15406us) op_driver.cc:464] REPLICATION: finished
0709 13:08:00.083956 (+  1206us) write_op.cc:301] APPLY: starting
0709 13:08:00.084018 (+    62us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:00.442730 (+358712us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b18003aa200. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f52320864bc 00007f522f3d448b 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3ee455 00007f523245b190 00007f5232454ae7 00007f5232453dd9
0709 13:08:00.495836 (+ 53106us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:00.495895 (+    59us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:00.622095 (+126200us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:00.630052 (+  7957us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:08:00.630117 (+    65us) write_op.cc:312] APPLY: finished
0709 13:08:00.630708 (+   591us) log.cc:844] Serialized 81 byte log entry
0709 13:08:00.630934 (+   226us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:00.631155 (+   221us) write_op.cc:454] Released schema lock
0709 13:08:00.631219 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:00.631933 (+   714us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:00.631973 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":637503,"reported_tablets":9,"spinlock_wait_cycles":211878144,"child_traces":[["op",{"apply.queue_time_us":1013,"apply.run_cpu_time_us":15657,"apply.run_wall_time_us":547844,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37567,"num_ops":8,"prepare.queue_time_us":187431,"prepare.run_cpu_time_us":13144,"prepare.run_wall_time_us":488977,"raft.queue_time_us":11910,"raft.run_cpu_time_us":1329,"raft.run_wall_time_us":1359,"replication_time_us":1236370,"spinlock_wait_cycles":117188864,"thread_start_us":692217,"threads_started":4,"wal-append.queue_time_us":481434,"wal-append.run_cpu_time_us":17223,"wal-append.run_wall_time_us":1564740}]]}
I20260709 13:08:02.609349 13756 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:02.638307 14399 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:08:02.601403 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:02.579110 18455 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:02.577898 18698 consensus_meta.cc:287] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.654s	user 0.010s	sys 0.000s
I20260709 13:08:02.592854 18666 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:02.691754 13707 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:08:02.588318 18755 consensus_queue.cc:237] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.579159 18766 raft_consensus.cc:740] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:08:02.585263 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.663239 18669 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:08:02.591902 18650 raft_consensus.cc:3055] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:02.697238 18650 raft_consensus.cc:740] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:02.697609 18495 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.697991 18650 consensus_queue.cc:260] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.698134 18495 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.588651 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:02.700088 13789 raft_consensus.cc:2393] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 12: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:02.625325 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:02.700917 18495 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:02.652369 18534 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:02.669313 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.703760 13830 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:02.704589 18436 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:02.706022 13830 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:02.705720 18766 consensus_queue.cc:260] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.626556 18679 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:02.599431 13713 raft_consensus.cc:1240] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:02.684386 18680 raft_consensus.cc:3055] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:02.707986 18680 raft_consensus.cc:740] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:02.633358 13708 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:02.625571 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.624899 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:02.684285 13709 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:08:02.689049 18643 raft_consensus.cc:697] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:02.712495 18425 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:02.712574 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:02.713107 18425 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:02.642204 18753 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:02.713629 18425 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.713156 18643 consensus_queue.cc:237] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:02.717803 13856 raft_consensus.cc:1240] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:02.689783 13710 raft_consensus.cc:1240] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 13:08:02.694283 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 172432us
I20260709 13:08:02.699086 18366 consensus_queue.cc:1059] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:08:02.728276 18691 raft_consensus.cc:3055] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:02.600147 13714 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:02.728822 18691 raft_consensus.cc:740] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:08:02.728387 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 117372us
I20260709 13:08:02.580294 18730 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.106s
I20260709 13:08:02.729630 13755 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:02.576987 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 60497.7us
I20260709 13:08:02.730151 18691 consensus_queue.cc:260] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.688731 14397 rpcz_store.cc:276] 0709 13:08:01.611461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.611586 (+   125us) service_pool.cc:224] Handling call
0709 13:08:02.656611 (+1045025us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b540052bcd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:02.656729 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1485211904}
I20260709 13:08:02.635113 18751 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.731526 13713 raft_consensus.cc:1240] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:02.731590 18436 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.732101 18751 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:02.735857 18751 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:02.699038 18650 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.737179 18719 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:02.736807 13755 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:02.738458 14367 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:02.730736 14366 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:02.739276 18771 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:02.581612 18741 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:02.739816 18771 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.740317 18771 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.740373 18741 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:02.740607 14366 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:02.741496 18495 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:02.741885 14366 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:02.743007 14366 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:02.743613 18534 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:02.731617 18691 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:02.687093 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:02.748558 13707 raft_consensus.cc:1240] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:02.748383 18658 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:02.764617 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:02.710705 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 101553us
I20260709 13:08:02.768033 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:02.768605 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:02.769068 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.711719 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 268728us
W20260709 13:08:02.761456 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.590896 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:02.619012 13712 raft_consensus.cc:3055] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:02.771238 13712 raft_consensus.cc:740] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:02.772101 13712 consensus_queue.cc:260] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:02.772415 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:02.796308 13712 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:02.772964 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 295149us
I20260709 13:08:02.776962 18366 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:02.805791 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:02.806689 13860 raft_consensus.cc:2410] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:02.777523 14366 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:02.778872 13856 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:02.779747 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:02.780629 18425 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:02.780992 13710 raft_consensus.cc:1275] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:02.781304 18751 consensus_queue.cc:1059] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:02.782284 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:02.766482 18678 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:02.787358 13756 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:02.786970 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:02.803874 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:02.816823 13714 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:02.818557 14366 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:02.808614 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.816883 13856 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:02.804003 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:02.820851 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:02.791496 18749 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.001s	sys 0.031s
I20260709 13:08:02.827176 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:02.828720 13862 raft_consensus.cc:1240] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:08:02.836923 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:08:02.826207 18749 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.002s	sys 0.031s
I20260709 13:08:02.846488 14399 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:02.807312 18724 consensus_queue.cc:1059] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:08:02.845364 14366 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:02.822927 18534 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.815934 18669 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 13:08:02.848591 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:02.826879 18760 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:02.844722 18643 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:02.843060 13830 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:02.857064 18495 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.844997 18510 consensus_queue.cc:1059] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:08:02.855206 18698 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:08:02.868563 13830 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:02.869205 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:02.847677 18712 consensus_queue.cc:1048] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:08:02.872161 18666 consensus_queue.cc:1059] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:08:02.856655 18680 consensus_queue.cc:260] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:02.866770 18679 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:02.865310 18533 consensus_queue.cc:1059] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:08:02.877151 18362 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:02.877728 13682 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:02.863763 18760 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:02.908138 18533 raft_consensus.cc:3055] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:02.908622 18533 raft_consensus.cc:740] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:02.909582 18760 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:02.860723 18751 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.861707 18643 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.910444 18643 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:02.910403 18751 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.912127 18425 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:02.890234 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 102968us
I20260709 13:08:02.891996 13786 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:02.914947 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:02.915817 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:02.915942 13785 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:08:02.916486 13710 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:02.917508 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:02.918663 13786 raft_consensus.cc:2393] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 13: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:02.901844 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:02.909428 18533 consensus_queue.cc:260] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.922463 13756 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:02.921476 13864 raft_consensus.cc:2393] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 10: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:02.871217 18455 consensus_queue.cc:1059] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:08:02.928427 18455 raft_consensus.cc:3055] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:02.928785 18455 raft_consensus.cc:740] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:02.929778 18766 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:02.929876 18719 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:02.930452 18719 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:02.930790 18719 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.931579 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:02.931821 18751 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:02.933652 18743 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:02.933774 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 56135.5us
I20260709 13:08:02.934468 18658 raft_consensus.cc:3055] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:02.934543 13682 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:02.934953 18658 raft_consensus.cc:740] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:02.936096 18749 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.936367 13682 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:02.936764 18743 consensus_queue.cc:1059] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:02.937734 18743 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:02.938218 18749 raft_consensus.cc:3055] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:02.938604 18524 consensus_queue.cc:1059] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:02.940186 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:02.940379 18680 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:02.941615 13861 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:02.929649 18455 consensus_queue.cc:260] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.947619 18455 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.950048 14399 raft_consensus.cc:1275] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:02.951671 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:02.952309 13714 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:08:02.952677 14401 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:02.953336 18753 raft_consensus.cc:3055] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:02.953975 18753 raft_consensus.cc:740] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:02.942588 18632 raft_consensus.cc:3055] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:02.954890 18632 raft_consensus.cc:740] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:02.955768 14401 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:02.955861 18632 consensus_queue.cc:260] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.957397 18632 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:02.957468 18524 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:02.958256 13829 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:02.959051 18524 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:02.959666 18616 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:02.960163 18679 consensus_queue.cc:1059] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:02.961149 18679 raft_consensus.cc:3055] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:02.961156 18773 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:02.961555 18679 raft_consensus.cc:740] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:02.961786 18773 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.962143 18773 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:02.953239 18719 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:02.938616 18749 raft_consensus.cc:740] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:02.953393 13830 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:02.964200 14366 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:02.935757 18658 consensus_queue.cc:260] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:02.965956 13710 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:08:02.972196 13712 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:08:02.975592 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 174282us
I20260709 13:08:02.978606 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:02.979283 14400 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:02.975503 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:02.981092 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:02.981951 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:02.978551 13680 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:02.983840 13680 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:02.962460 18679 consensus_queue.cc:260] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:02.988019 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:02.984867 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:02.990661 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:02.991710 13785 raft_consensus.cc:2410] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:08:02.993409 14366 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:02.996681 13784 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:02.997736 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:03.001474 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:02.954795 18753 consensus_queue.cc:260] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:02.981374 18734 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:03.004938 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 176191us
I20260709 13:08:03.008021 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:03.044493 13829 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:03.013406 14366 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:03.050304 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:02.987599 18649 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:03.040004 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:02.982795 18669 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.068s
I20260709 13:08:02.973225 18678 raft_consensus.cc:697] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:02.983106 18712 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:02.987401 18658 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:03.058740 13782 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 13: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:03.063077 13787 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:08:03.063002 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 49702.7us
I20260709 13:08:02.985059 18635 consensus_queue.cc:1048] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:08:03.008142 18699 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:03.007782 18531 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:08:03.053287 18776 log.cc:927] Time spent T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:03.096092 13864 raft_consensus.cc:1240] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:03.056850 18679 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:03.061105 18533 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:03.061446 18495 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.057881 18734 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:03.068269 18534 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.004861 18771 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:03.112959 18616 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.116775 18547 raft_consensus.cc:3055] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:03.155483 13782 raft_consensus.cc:1275] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:03.117233 18712 raft_consensus.cc:697] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:03.106796 18521 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.159178 13680 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:03.068415 18366 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:03.131135 18753 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:03.182716 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 57574.5us
W20260709 13:08:03.046850 18751 consensus_queue.cc:1175] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b9d194f45e044e0988d5de1a99e5cd02" responder_term: 11 status { last_received { term: 11 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 11 index: 7 } }
I20260709 13:08:03.187608 18712 consensus_queue.cc:237] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:03.002368 18428 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.157s
I20260709 13:08:03.182593 18725 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.193495 18725 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:03.195582 18725 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:03.195768 18531 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:03.195962 18521 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:03.198169 18521 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:03.198930 18761 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:03.199105 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:03.209748 14398 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:08:03.212285 18782 log.cc:927] Time spent T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:08:03.156252 18495 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:03.219933 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:03.177999 18398 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.227977 18398 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:03.230430 18398 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:03.237969 14396 raft_consensus.cc:1240] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:08:03.219249 18495 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:03.149528 18666 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 13:08:03.181823 18547 raft_consensus.cc:740] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:03.275852 18495 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.182549 18720 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:08:03.132541 18749 consensus_queue.cc:260] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:03.296311 18749 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:03.302356 18773 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:03.306358 18790 log.cc:927] Time spent T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:08:03.306910 13788 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:08:03.309180 18789 log.cc:927] Time spent T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:08:03.276186 18787 log.cc:927] Time spent T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:08:03.318958 18771 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:03.181113 18534 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:03.291795 18719 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:03.292795 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:03.324680 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:03.156311 18734 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:03.335683 13788 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:03.335767 14402 raft_consensus.cc:2393] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 12: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:08:03.337054 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 209940us
I20260709 13:08:03.337754 14368 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:03.345573 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:03.346411 13709 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:08:03.347548 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:03.350715 13861 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 15: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:03.350476 14368 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:03.356417 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:03.356992 13787 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:08:03.358233 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:03.360813 13756 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:03.361564 18719 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:03.361932 18719 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.362247 18719 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.363997 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:03.367745 14398 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:08:03.332911 18524 consensus_queue.cc:1175] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "35ecb005831740438d7537dd4b840e03" responder_term: 14 status { last_received { term: 14 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 14 index: 9 } }
I20260709 13:08:03.342199 18766 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:03.365948 14366 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:03.348843 18771 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:03.282218 18616 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:03.276469 18495 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:03.377030 14366 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:03.380682 13756 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:03.373479 14368 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:03.381692 13709 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:03.385128 18495 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:03.386498 13712 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:08:03.388423 18616 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:03.341822 18669 consensus_queue.cc:1059] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:08:03.393684 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:03.354562 18761 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:08:03.404115 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:03.349363 18643 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:03.410133 13713 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
W20260709 13:08:03.405805 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 246698us
I20260709 13:08:03.404083 18366 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:03.391551 18699 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:03.399441 18698 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:03.376371 18664 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:08:03.280048 18678 consensus_queue.cc:237] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:03.428182 13788 raft_consensus.cc:1240] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:08:03.429719 14367 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:03.414386 18771 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:03.381680 18766 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:03.481958 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:03.482589 13856 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:03.470345 18516 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:08:03.473141 18632 consensus_meta.cc:287] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.515s	user 0.012s	sys 0.000s
W20260709 13:08:03.475373 18680 consensus_meta.cc:287] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.000s
I20260709 13:08:03.476490 18534 leader_election.cc:290] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:03.379994 18547 consensus_queue.cc:260] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:03.419759 18788 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:03.477205 18770 log.cc:927] Time spent T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:03.477517 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:03.420644 18699 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.469883 18658 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.485045 18698 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:03.504999 13856 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:03.505605 14399 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:03.569799 13787 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:03.502178 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:03.570451 13857 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:08:03.499680 13858 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:03.513468 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:03.512643 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:03.567687 13713 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:03.562282 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:03.516043 13863 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:08:03.571663 14397 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:08:03.575227 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:03.585446 14367 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:03.506351 18362 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:03.516451 18534 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.570619 18699 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:03.506919 18720 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:08:03.573735 18643 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:03.574002 18698 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.598978 13756 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:03.581768 18800 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:03.642617 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 43966.4us
I20260709 13:08:03.559973 18531 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:08:03.594633 18547 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:03.661476 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 62580.7us
W20260709 13:08:03.662752 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 82651.9us
I20260709 13:08:03.580828 18658 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:03.664186 13680 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:03.667506 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:03.642478 18698 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:03.594403 18362 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:03.676074 13711 raft_consensus.cc:1275] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:03.678603 13859 raft_consensus.cc:1275] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:08:03.681151 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 95780.5us
I20260709 13:08:03.680030 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:03.685523 13713 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:03.684751 13784 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:08:03.663779 18712 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:03.666554 18496 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:03.596729 18534 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:03.683384 18679 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.663995 18800 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:03.689947 18712 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:03.706772 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.714915 18766 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:03.716202 18362 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:03.717546 18799 log.cc:927] Time spent T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:08:03.701076 18720 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:03.719446 18794 log.cc:927] Time spent T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:08:03.719695 18720 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.719812 18534 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:03.720224 18720 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:03.720481 18803 log.cc:927] Time spent T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:08:03.708766 18712 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:03.700645 18496 raft_consensus.cc:697] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:08:03.728899 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.732210 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:03.724432 18533 consensus_meta.cc:287] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.575s	user 0.008s	sys 0.002s
I20260709 13:08:03.745080 18810 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.746012 18810 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:03.751542 18719 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:03.701815 18679 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:03.754185 18719 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:03.754819 18679 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:03.704846 18807 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:08:03.758939 18800 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:03.761417 18698 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:03.764076 18806 log.cc:927] Time spent T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:08:03.764075 18698 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:03.766305 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:03.766984 13711 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:03.768122 18658 leader_election.cc:290] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:03.772954 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:03.773783 13711 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:03.753805 18720 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:03.776292 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:03.778831 13707 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:08:03.774930 14367 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:03.759255 18805 log.cc:927] Time spent T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:08:03.781272 14393 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:08:03.779882 13830 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:03.784487 18679 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:03.784886 18679 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.785216 18679 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:03.788580 18521 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:03.789038 18521 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.789132 18771 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:03.789420 18521 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.801108 18773 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:03.809929 13714 raft_consensus.cc:2368] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9.
I20260709 13:08:03.810745 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:03.811360 13791 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:03.812350 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:03.813012 13788 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:08:03.815891 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:03.816613 13784 raft_consensus.cc:2393] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 8: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:08:03.818331 18749 consensus_meta.cc:287] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.521s	user 0.007s	sys 0.003s
I20260709 13:08:03.824012 18720 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:03.824359 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:03.825186 18810 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:03.825337 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:03.825521 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:03.825882 13861 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:08:03.826117 13862 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:03.828779 13711 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:03.831300 13863 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:03.831226 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:03.833990 13861 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:08:03.834456 13715 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:08:03.835146 13682 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:08:03.836205 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 154640us
I20260709 13:08:03.837105 13791 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:03.830536 14368 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:03.838493 14367 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:03.838553 13829 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:03.840863 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:03.841235 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:03.845487 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:03.844516 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:03.856822 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:03.865509 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:03.848606 14394 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:08:03.868954 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:03.869652 13856 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:03.868594 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:03.873875 13757 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:03.883188 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:03.894217 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:03.895462 13862 raft_consensus.cc:2410] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:08:03.847937 18720 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:03.873632 18699 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:03.863711 18760 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:03.867602 18800 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:03.903491 18788 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:03.878589 18810 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:03.885680 18679 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:03.863451 18658 consensus_queue.cc:1048] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:08:03.914358 18797 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:03.914398 18788 raft_consensus.cc:697] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:03.914983 18797 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:03.915513 18788 consensus_queue.cc:237] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:03.912228 18760 raft_consensus.cc:697] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 15 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:03.917286 18797 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:03.917162 18760 consensus_queue.cc:237] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:03.824258 18496 consensus_queue.cc:237] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:03.926165 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 242097us
I20260709 13:08:03.940689 13756 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:03.944416 13863 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:03.945734 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:03.905956 18720 raft_consensus.cc:697] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:03.948354 14366 leader_election.cc:304] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:03.954964 13862 raft_consensus.cc:2393] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 12: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:03.911212 18800 raft_consensus.cc:697] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:03.959754 18698 consensus_queue.cc:1059] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:08:03.965471 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:03.966140 13713 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.967176 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:03.967859 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:03.968482 13787 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:08:03.970033 13784 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:03.946079 18755 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:03.956460 18726 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:08:03.959504 18734 consensus_meta.cc:287] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.605s	user 0.005s	sys 0.007s
I20260709 13:08:03.958189 18635 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:03.924399 18761 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:08:03.988090 13713 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:03.926419 18521 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:03.994983 13756 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:03.997005 13856 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:03.958038 18659 consensus_queue.cc:1048] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:08:03.993294 18635 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.989903 18712 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:04.031854 18521 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:03.996214 18734 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:04.035665 18800 consensus_queue.cc:237] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:04.038352 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:04.010697 18635 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.042402 18734 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:04.044065 18679 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:04.045081 18810 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:04.040019 18678 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:04.048905 13712 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.054705 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:04.055505 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:04.056591 13787 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:04.059545 14401 raft_consensus.cc:2368] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9.
I20260709 13:08:04.074584 18712 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:04.007426 18720 consensus_queue.cc:237] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:04.083387 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:04.072151 13712 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:04.086414 13787 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:08:04.088130 14367 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:04.089613 13829 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:04.099472 18784 raft_consensus.cc:3055] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:04.099598 18678 raft_consensus.cc:697] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:04.099938 18784 raft_consensus.cc:740] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:04.100685 18678 consensus_queue.cc:237] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:04.126893 14400 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
W20260709 13:08:04.138767 18828 log.cc:927] Time spent T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:08:04.096617 18797 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:04.142956 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 50951.6us
I20260709 13:08:04.102412 18679 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:04.145531 18684 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:04.145678 18679 raft_consensus.cc:697] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:04.146195 18684 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:04.146660 18679 consensus_queue.cc:237] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:04.148926 18684 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:04.132865 18521 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:08:04.156929 18822 log.cc:927] Time spent T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:04.152899 18797 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:04.191875 18496 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.192700 18496 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:04.195966 18797 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:04.163878 18521 raft_consensus.cc:697] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:04.197899 18496 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:04.199575 18521 consensus_queue.cc:237] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:04.204564 18734 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.205397 18734 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:04.208154 18734 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:04.212930 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:04.226454 18533 raft_consensus.cc:3055] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:04.226903 18533 raft_consensus.cc:740] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:04.227788 18533 consensus_queue.cc:260] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:04.229174 18533 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:04.228972 18784 consensus_queue.cc:260] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:04.230214 18784 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.250314 18635 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:04.274925 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:04.276077 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 1173) took 1294 ms. Trace:
I20260709 13:08:04.276800 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:04.278350 13782 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.277336 14393 rpcz_store.cc:276] 0709 13:08:02.977731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.984738 (+  7007us) service_pool.cc:224] Handling call
0709 13:08:04.271490 (+1286752us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b54007aab54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:04.271617 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1595022720}
I20260709 13:08:04.283282 14393 raft_consensus.cc:1240] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:08:04.283658 14366 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:04.289772 13829 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:04.338690 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 49052.3us
I20260709 13:08:04.347939 18760 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:04.349502 18760 raft_consensus.cc:697] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:04.351145 18760 consensus_queue.cc:237] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:04.281335 18650 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:04.359840 14398 raft_consensus.cc:1240] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:08:04.275822 18755 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.365649 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:04.366353 13856 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.366954 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:04.367698 13863 raft_consensus.cc:2393] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 9: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:04.367730 18720 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:04.375451 13856 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:04.353964 18635 leader_election.cc:290] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:04.380736 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:04.381614 14402 raft_consensus.cc:2393] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 11: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:04.382799 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:04.383453 13861 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.385541 18755 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:04.387867 18755 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:04.389744 18845 log.cc:927] Time spent T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:08:04.390298 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.398854 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:04.399849 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:04.400449 13791 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:08:04.401115 13861 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:08:04.406220 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:04.308032 18771 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 13:08:04.419982 14368 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:04.362097 18650 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:04.410717 18366 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:04.407912 18425 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.411463 18659 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.420985 18679 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.442265 18521 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:08:04.433099 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:04.465591 13862 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
W20260709 13:08:04.420888 18804 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.004s	sys 0.009s
I20260709 13:08:04.442245 14368 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:04.444551 18650 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:04.422681 18755 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:04.422003 18516 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:04.447082 18531 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:04.439927 18362 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:04.448290 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:04.448788 18659 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:04.449851 13755 leader_election.cc:304] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:04.452669 13782 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:08:04.428049 18669 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:04.434551 18495 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:04.471318 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:04.527992 13856 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:08:04.487675 14368 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:04.477707 18804 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.004s	sys 0.009s
I20260709 13:08:04.480373 18521 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:08:04.524771 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 74991.2us
I20260709 13:08:04.442401 18425 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:04.463340 18679 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:04.440255 18366 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:04.480110 18698 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:08:04.542084 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 126762us
I20260709 13:08:04.519942 18650 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:04.522261 18771 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:04.657882 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:04.654614 13680 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:04.660193 14398 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:08:04.505177 18755 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:04.539110 18669 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:04.661057 18832 log.cc:927] Time spent T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:08:04.587423 18730 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.507171 18516 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:04.648612 18800 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:04.663308 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 217417us
I20260709 13:08:04.584496 18829 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.651724 18816 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:04.522969 18531 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:04.523937 18362 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:04.688669 13682 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:08:04.774681 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 86107us
I20260709 13:08:04.779059 18659 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:04.783712 18800 raft_consensus.cc:697] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 11 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:04.784978 18800 consensus_queue.cc:237] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:04.789898 13830 leader_election.cc:400] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9.
I20260709 13:08:04.790391 13830 leader_election.cc:403] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:04.803041 18760 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9.
I20260709 13:08:04.804744 18669 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:04.805464 18669 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:04.806059 18669 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:04.667878 18771 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:04.668740 18650 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:04.669020 18698 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:04.853286 18849 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:08:04.799657 18616 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:04.876322 18650 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:04.877753 18366 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:04.876366 18531 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:04.880383 18679 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:04.893981 18698 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:04.894560 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 83228.9us
I20260709 13:08:04.886704 18425 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:04.888468 18755 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:04.798079 18816 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:04.889886 18669 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:04.890733 18667 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:04.884766 18362 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:04.774178 18829 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:04.891207 18616 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:04.927352 18865 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:08:04.928045 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 152112us
I20260709 13:08:04.941277 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:04.950515 14402 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:04.938930 18667 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:04.940922 18865 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:04.957223 18667 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:04.958041 18865 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:04.939271 18616 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:04.963330 18829 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:04.929647 18531 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:04.969753 18816 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:04.970996 18857 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.971517 18857 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:04.973568 18857 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:04.977890 18857 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.978466 18857 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:04.982234 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:04.982896 13863 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:04.984326 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:04.984647 18857 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:04.985188 18857 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:04.985140 13864 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:04.986595 13682 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:04.992221 18771 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:04.985831 18857 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:04.996212 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 44796.7us
I20260709 13:08:05.000206 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:05.002513 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:05.003422 13856 raft_consensus.cc:2393] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 12: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:05.002206 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:05.004698 14402 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 12: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:08:05.022562 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 368015us
I20260709 13:08:04.999579 18531 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.004242 18857 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:05.074625 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:05.007998 18684 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:05.041306 13785 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:05.077416 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:05.078904 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:05.079388 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:05.082402 13790 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:05.027002 18819 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:05.083233 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:05.083885 13791 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:05.079996 13788 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:05.084810 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:05.086458 13791 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:08:05.091456 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:05.073267 18771 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.092440 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:04.966120 18669 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:05.073647 18814 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.077912 18829 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.101789 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:05.102754 13856 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 13: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:05.107481 18814 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:05.107999 18796 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.108548 18796 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:05.109550 18814 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:05.111740 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:05.112684 14397 raft_consensus.cc:2393] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 12: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:05.113114 18796 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:05.114876 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:05.115471 14396 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:08:05.004985 18855 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:05.095347 13858 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:05.008121 18496 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:08:05.025156 18516 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:05.030514 18531 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:05.093694 18854 log.cc:927] Time spent T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:08:05.098280 18857 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.106084 18669 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:05.092587 18684 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:05.138695 18684 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:05.118428 18829 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:05.075232 18761 consensus_queue.cc:1059] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:08:05.127676 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:05.142222 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:05.140019 18649 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.142992 13713 raft_consensus.cc:2368] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14.
I20260709 13:08:05.142136 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:05.143249 18649 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:05.144162 13862 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:05.145430 18863 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:05.146034 18863 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:05.147902 18749 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.148250 18863 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:05.148418 18749 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:05.150555 18749 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:05.152223 14400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 1184) took 1308 ms (client timeout 1505 ms). Trace:
W20260709 13:08:05.152632 14400 rpcz_store.cc:269] 0709 13:08:03.844117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.844255 (+   138us) service_pool.cc:224] Handling call
0709 13:08:05.152083 (+1307828us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b5400943ed4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:05.152173 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":503934720}
I20260709 13:08:05.153748 14401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 1180) took 1313 ms. Trace:
I20260709 13:08:05.153855 18730 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:05.154129 14401 rpcz_store.cc:276] 0709 13:08:03.840405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.840564 (+   159us) service_pool.cc:224] Handling call
0709 13:08:05.153544 (+1312980us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54008c41d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:05.153691 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":500832512}
I20260709 13:08:05.154651 13713 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:05.145783 18649 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:05.155779 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 633322us
I20260709 13:08:05.156021 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:05.156790 13713 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 13: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:05.157800 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:05.159476 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:05.160874 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:05.161607 13713 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 12: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:05.101830 18771 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:05.164155 18771 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:05.165652 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:05.167826 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:05.154708 13786 raft_consensus.cc:1240] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:05.168524 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:05.168568 14398 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:05.169561 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:05.171542 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:05.171489 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:05.172305 13712 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:08:05.172526 14396 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:08:05.173377 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:05.174134 13712 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:08:05.174901 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:05.168440 13789 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:05.184724 14368 leader_election.cc:304] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:05.184927 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:05.185555 14401 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:08:05.186249 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:05.187481 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:05.188383 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:05.188647 14368 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:05.190176 13713 raft_consensus.cc:2393] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 16: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:05.190793 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:05.124523 18855 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.194736 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:05.197891 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:05.198509 13714 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.198490 13713 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:08:05.199623 14400 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:05.202771 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:05.226684 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:05.207269 18616 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:05.229739 13715 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:05.229984 13709 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:08:05.192399 18366 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:05.231379 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:05.231761 18871 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:05.232328 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:05.232559 18871 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:05.224403 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:05.234165 13712 raft_consensus.cc:2393] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 12: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:05.235482 13708 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:05.236577 18495 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:05.211771 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:05.177740 18751 raft_consensus.cc:3055] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:05.247362 13714 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:08:05.247875 13708 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:08:05.248919 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 173125us
I20260709 13:08:05.254501 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:05.251132 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 151800us
I20260709 13:08:05.258111 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:05.259366 13757 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.028s	sys 0.056s
W20260709 13:08:05.259788 13757 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.028s	sys 0.056s
I20260709 13:08:05.141242 18857 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:05.197912 18855 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:05.250705 14368 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:05.261221 13713 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:05.232658 18616 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:05.264415 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:05.265990 13789 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 13: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:05.268810 13829 leader_election.cc:400] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9.
I20260709 13:08:05.272053 13829 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:05.275030 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:05.207573 18771 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:05.271521 13680 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:05.296061 13829 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:05.293044 13862 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:05.302065 13829 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:05.316807 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 45398.5us
I20260709 13:08:05.317720 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:05.317950 13680 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:05.322098 13707 raft_consensus.cc:1275] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:08:05.323063 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 52095.7us
I20260709 13:08:05.325449 14366 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:05.251821 18751 raft_consensus.cc:740] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:05.328850 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:05.329536 13782 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:08:05.330681 13711 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:05.333209 13829 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:05.334841 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:05.335566 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:05.335767 13859 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:05.336292 13856 raft_consensus.cc:2393] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 15: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:05.337146 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:05.337082 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:05.337991 13865 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:05.338186 13858 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:05.296705 18698 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:05.321547 18362 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:05.358728 13829 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:05.326707 18666 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:05.347457 18876 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:05.357931 18698 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:05.322297 18679 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:05.326714 18649 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:05.387593 18669 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:05.387137 18751 consensus_queue.cc:260] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:05.359627 18362 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.388680 18751 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:05.388895 18649 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.389365 18649 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:05.356134 18691 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:08:05.380951 18650 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:05.391930 18650 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:05.392365 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:05.388638 18362 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:05.398586 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:05.399855 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:05.400583 13791 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:08:05.402623 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:05.406942 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:05.418229 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:05.407378 13680 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:05.321764 18760 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:08:05.360018 18871 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:05.424754 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 65980.6us
I20260709 13:08:05.368906 18876 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:05.364095 18861 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.533098 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:05.564553 13782 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:05.366166 18667 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:05.369172 18698 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:05.360288 18866 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:05.536252 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 123454us
I20260709 13:08:05.368512 18616 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:05.382649 18679 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:05.545318 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 119463us
I20260709 13:08:05.590355 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:05.422782 18650 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:05.423951 18699 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:05.431774 18872 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.533298 18867 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:05.533955 18734 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.564043 18876 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.647107 13680 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:05.645341 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:05.657829 13791 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:08:05.583134 18667 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:05.667785 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 79566.4us
I20260709 13:08:05.582777 18863 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:05.670208 13757 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:05.670150 18863 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:05.586383 18865 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:05.613130 18679 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.540778 18531 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:05.581789 18664 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:08:05.634967 18867 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.585817 18773 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:08:05.753455 18730 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.754163 18730 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:05.756608 18730 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:05.768814 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 98726.1us
I20260709 13:08:05.667685 18749 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:05.801676 18659 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:05.768676 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 89621.1us
I20260709 13:08:05.668617 18876 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.676919 18667 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:05.681941 18547 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:05.675954 18829 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:05.729516 18867 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.665747 18734 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:05.633090 13707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:08:06.013861 13707 raft_consensus.cc:606] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:08:06.014434 13707 raft_consensus.cc:614] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:05.632797 18616 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:05.805799 18699 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.059746 18699 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.062412 18699 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:05.665141 18872 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.065181 18872 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.035955 18874 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:06.040143 18882 log.cc:927] Time spent T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.406s	user 0.000s	sys 0.000s
I20260709 13:08:06.044371 18863 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:05.949229 18871 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:05.693542 18865 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:06.050223 18855 consensus_meta.cc:287] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.729s	user 0.006s	sys 0.001s
I20260709 13:08:05.955339 18749 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:06.058519 18531 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:05.948132 18659 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:05.962576 18547 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.990585 18829 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:06.091109 13789 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.005s	sys 0.015s
I20260709 13:08:06.092763 13682 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:06.096899 13713 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:06.106485 13707 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:08:06.107935 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 304157us
W20260709 13:08:06.108438 13789 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.005s	sys 0.016s
W20260709 13:08:06.099287 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.098443 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:06.096175 18691 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:06.106102 18547 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:06.085850 18863 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.086380 18699 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.103778 18659 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:06.072815 18874 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.116182 18664 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:06.134197 18398 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:06.137742 18650 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.084699 18871 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.128449 18531 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:06.141474 18877 log.cc:927] Time spent T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 13:08:06.126825 18870 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:08:06.162880 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 392702us
I20260709 13:08:06.134399 18884 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:06.120983 18829 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.170442 13757 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:06.101727 18855 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:06.153021 18398 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.185325 18398 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.166720 18531 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:06.162863 18771 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:06.187901 18771 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.163460 18650 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.194599 18650 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:06.200829 18749 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:06.201773 18891 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:06.203298 18734 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:06.204027 18884 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.209723 18871 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:06.210948 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 118275us
I20260709 13:08:06.213021 13682 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:06.181102 13757 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:08:06.127140 13679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.020s	sys 0.016s
W20260709 13:08:06.216228 13679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.020s	sys 0.016s
W20260709 13:08:06.217828 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 85702.3us
I20260709 13:08:06.218848 13830 leader_election.cc:400] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14.
I20260709 13:08:06.219187 13830 leader_election.cc:403] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:08:06.225123 18749 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:06.137697 18691 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.139526 18863 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.139755 18699 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:06.171706 18649 consensus_meta.cc:287] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.782s	user 0.010s	sys 0.001s
I20260709 13:08:06.241197 18616 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:06.241921 18880 log.cc:927] Time spent T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:08:06.238512 18734 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:06.153590 18664 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:06.243829 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 62828.7us
I20260709 13:08:06.256913 14395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
mode: GRACEFUL
new_leader_uuid: "35ecb005831740438d7537dd4b840e03"
 from {username='slave'} at 127.0.0.1:40042
I20260709 13:08:06.243965 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:06.214741 18771 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:06.248198 13715 raft_consensus.cc:2368] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16.
I20260709 13:08:06.243978 13830 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:06.257594 14395 raft_consensus.cc:606] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Received request to transfer leadership to TS 35ecb005831740438d7537dd4b840e03
I20260709 13:08:06.263823 14395 raft_consensus.cc:614] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:06.224188 18894 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:06.179886 18870 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.248684 18761 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:06.248909 18895 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:06.240518 18876 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:06.278620 18874 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.282352 18876 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:06.277588 18895 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.283670 18895 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.286216 18855 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:06.287169 18879 log.cc:927] Time spent T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
W20260709 13:08:06.265754 18751 consensus_meta.cc:287] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.877s	user 0.010s	sys 0.003s
I20260709 13:08:06.265095 18888 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:06.265400 18866 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:06.265583 18889 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:06.289412 18876 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:06.269506 18894 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.265944 18885 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:06.259811 18734 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:06.300829 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 56945.8us
I20260709 13:08:06.257997 18649 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.304786 13830 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:06.296681 18531 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:06.317960 14394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:40042
I20260709 13:08:06.318854 14394 raft_consensus.cc:606] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 11 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:08:06.313997 18751 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:06.320544 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1245) took 1227 ms. Trace:
I20260709 13:08:06.305881 18889 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.320995 13863 rpcz_store.cc:276] 0709 13:08:05.093492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.094088 (+   596us) service_pool.cc:224] Handling call
0709 13:08:05.094329 (+   241us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:05.094607 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.094629 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:05.107089 (+ 12460us) log.cc:844] Serialized 26 byte log entry
0709 13:08:05.296082 (+188993us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:05.296148 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.296247 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.320326 (+1024079us) raft_consensus.cc:1685] finished
0709 13:08:06.320347 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.320465 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32178,"raft.queue_time_us":27195,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":27697,"thread_start_us":171307,"threads_started":1,"wal-append.queue_time_us":979915}
I20260709 13:08:06.322431 18649 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.322865 18889 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.323731 18691 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:06.324558 18884 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.323551 18876 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:06.327287 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:06.302953 18894 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:06.330432 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 72976.4us
I20260709 13:08:06.325497 18829 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.305828 18885 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:06.340597 18643 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.331396 18751 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:08:06.340873 18887 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:06.341171 18643 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.341485 18887 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.342365 18885 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:06.343189 18643 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.344218 18667 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:06.344668 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:06.345286 14394 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:08:06.345389 18659 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:06.346700 13755 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:06.339625 18664 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:06.347820 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:06.348395 13857 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:06.352368 18666 consensus_meta.cc:287] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.986s	user 0.012s	sys 0.000s
I20260709 13:08:06.352787 18666 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:06.353698 13711 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:06.347359 18659 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:06.297816 18888 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:06.357244 18888 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:06.358212 13857 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:08:06.358685 18829 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:06.359354 18362 consensus_meta.cc:287] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.965s	user 0.012s	sys 0.000s
I20260709 13:08:06.359251 18829 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.359838 18362 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.361948 18362 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.362713 13862 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:06.362546 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:06.363992 18863 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.365142 18699 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:06.365115 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:06.368317 13857 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:08:06.371802 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:06.299047 18866 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:06.372570 13707 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:08:06.374544 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:06.375653 18887 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.376833 18867 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:06.379040 18867 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:06.379808 13714 raft_consensus.cc:2393] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 13: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:06.358790 18895 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:06.383694 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:06.384564 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:06.390532 13713 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:08:06.384925 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:06.390581 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:06.386102 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:06.389154 13830 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:06.354962 18547 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:06.368749 18698 consensus_meta.cc:287] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.724s	user 0.003s	sys 0.004s
I20260709 13:08:06.392549 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:06.389531 14395 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:06.392946 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:06.392712 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:06.395058 14401 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:06.394145 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 47518.6us
I20260709 13:08:06.390635 13707 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:08:06.393843 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:06.401131 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:06.402271 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:06.403822 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:06.404769 13789 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:08:06.405848 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:06.408116 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:06.409626 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:06.410926 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:06.412227 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:06.413996 18901 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.414532 18901 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.417110 18901 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.417936 18659 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:06.418404 18659 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.418766 18659 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:06.366932 18667 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:06.423852 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:06.424346 18761 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14.
I20260709 13:08:06.424667 13716 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:06.430476 18861 consensus_meta.cc:287] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.837s	user 0.010s	sys 0.000s
I20260709 13:08:06.431044 18861 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:06.431699 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:06.436177 14401 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:08:06.432749 18547 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:06.432754 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:06.435242 18875 log.cc:927] Time spent T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 1.179s	user 0.019s	sys 0.000s
I20260709 13:08:06.435494 18698 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.436039 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:06.442196 13708 raft_consensus.cc:2368] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17.
I20260709 13:08:06.418648 18870 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.442384 13782 raft_consensus.cc:2393] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 13: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:06.437273 18664 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:06.439702 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:06.441336 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:06.441790 13859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3413) took 1016 ms. Trace:
I20260709 13:08:06.433185 18895 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:06.442471 13857 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:06.434751 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:06.440883 13830 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:06.437299 18902 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.445158 18664 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.455590 18664 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.451030 13709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 2553) took 1265 ms. Trace:
I20260709 13:08:06.451694 14402 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:08:06.456449 18698 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:06.456583 18819 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:06.457075 18819 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:06.457204 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 1597) took 1060 ms. Trace:
I20260709 13:08:06.457620 14402 rpcz_store.cc:276] 0709 13:08:05.396401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.417900 (+ 21499us) service_pool.cc:224] Handling call
0709 13:08:06.457063 (+1039163us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54006883d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:06.457154 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2374721280}
I20260709 13:08:06.454571 18751 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:06.458518 18679 consensus_meta.cc:287] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.722s	user 0.011s	sys 0.000s
I20260709 13:08:06.458776 18751 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:06.459249 18751 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:06.458940 18679 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.456450 13709 rpcz_store.cc:276] 0709 13:08:05.185819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.187163 (+  1344us) service_pool.cc:224] Handling call
0709 13:08:06.450824 (+1263661us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b540034d5d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:06.450933 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96119680}
I20260709 13:08:06.453997 13830 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:06.466190 13830 leader_election.cc:400] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17.
I20260709 13:08:06.466569 13830 leader_election.cc:403] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:08:06.468580 18760 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:06.468984 18760 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.469352 18760 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:06.470993 13784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2876) took 1447 ms. Trace:
I20260709 13:08:06.471598 18905 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:06.476866 13786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2389) took 1439 ms. Trace:
I20260709 13:08:06.477324 13786 rpcz_store.cc:276] 0709 13:08:05.037315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.041527 (+  4212us) service_pool.cc:224] Handling call
0709 13:08:05.041884 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.176973 (+135089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.476610 (+1299637us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b540033b154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:06.476779 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":259031936}
I20260709 13:08:06.480464 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1594) took 1369 ms. Trace:
I20260709 13:08:06.480840 14398 rpcz_store.cc:276] 0709 13:08:05.110777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.116391 (+  5614us) service_pool.cc:224] Handling call
0709 13:08:05.168258 (+ 51867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.169443 (+  1185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.480252 (+1310809us) spinlock_profiling.cc:243] Waited 51.6 ms on lock 0x7b54008c41d0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:06.480384 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118642432}
I20260709 13:08:06.453118 18902 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.484015 18902 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.471364 13784 rpcz_store.cc:276] 0709 13:08:05.023917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.024062 (+   145us) service_pool.cc:224] Handling call
0709 13:08:05.024348 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.201240 (+176892us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:05.327039 (+125799us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.671748 (+344709us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:05.671802 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:05.671855 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.196829 (+524974us) spinlock_profiling.cc:243] Waited 56.8 ms on lock 0x7b18003f2380. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f1522 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
0709 13:08:06.469733 (+272904us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b18003f2380. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3bf2a6 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419
0709 13:08:06.470793 (+  1060us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b540033b654. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:06.470835 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.470944 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87231,"prepare.queue_time_us":448687,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":39066,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":15659,"spinlock_wait_cycles":544264448,"thread_start_us":404767,"threads_started":2,"wal-append.queue_time_us":664691}
I20260709 13:08:06.496158 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:06.496454 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:06.496836 13864 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:08:06.497670 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:06.497679 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:06.500221 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:06.498787 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:06.500833 13710 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:08:06.501359 13864 raft_consensus.cc:2368] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 12. Current term is 13.
I20260709 13:08:06.501641 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:06.502074 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:06.487241 13680 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:06.503525 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2877) took 1470 ms. Trace:
I20260709 13:08:06.503744 18547 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:06.504302 18547 raft_consensus.cc:697] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:06.503911 13787 rpcz_store.cc:276] 0709 13:08:05.032927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.033087 (+   160us) service_pool.cc:224] Handling call
0709 13:08:05.033409 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:05.033753 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.033779 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:05.034238 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:08:05.114190 (+ 79952us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:05.262400 (+148210us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.262676 (+   276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.262768 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.434712 (+1171944us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:06.503233 (+ 68521us) raft_consensus.cc:1685] finished
0709 13:08:06.503340 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.503474 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5525,"prepare.queue_time_us":467766,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":1012,"raft.queue_time_us":39536,"raft.run_cpu_time_us":6534,"raft.run_wall_time_us":54080,"spinlock_wait_cycles":270847360,"thread_start_us":161876,"threads_started":2,"wal-append.queue_time_us":92302}
I20260709 13:08:06.505295 18547 consensus_queue.cc:237] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:06.506778 14366 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:06.507597 18699 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:06.507982 18699 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.508291 18699 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.508630 13856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3411) took 1096 ms. Trace:
I20260709 13:08:06.509016 13856 rpcz_store.cc:276] 0709 13:08:05.412288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.507882 (+1095594us) service_pool.cc:224] Handling call
0709 13:08:06.508156 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.508331 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.508358 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.508397 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:06.508432 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.508483 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.508580 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.510151 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:06.490859 18819 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.512776 13708 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:06.513090 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:06.514043 18905 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17.
I20260709 13:08:06.514775 13864 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:08:06.516067 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:06.516500 13856 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:06.517903 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:06.500221 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:06.518975 13862 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:08:06.519085 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:06.519150 13716 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:08:06.519939 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:06.516489 13857 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:06.522217 13830 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:06.515941 13680 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:06.525269 13863 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 13: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:06.525899 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:06.527469 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:06.529735 14401 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.538669 14401 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:08:06.540102 14402 raft_consensus.cc:2393] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 11: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:06.524356 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:06.506927 18751 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.541043 14399 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:06.545822 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:06.547219 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:06.514580 18865 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.550091 13756 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:06.546941 13757 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:06.551319 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:06.552075 13791 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:06.552127 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:06.556540 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:06.557264 13787 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:08:06.558249 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:06.559774 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:06.561338 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:06.524541 18666 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:06.563385 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:06.565140 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:06.561203 18902 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.573150 18902 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.573585 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:06.575873 18902 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.576181 18684 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:06.539862 18796 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:06.571556 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:06.572371 13791 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:06.543735 18905 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:06.582545 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:06.572414 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:06.583379 13782 raft_consensus.cc:2393] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 7: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:06.584585 13791 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:06.542506 18889 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:08:06.597244 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:06.600646 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:06.601450 13787 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:06.581653 18796 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.613700 13791 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:06.626389 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:06.627215 13788 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:06.627238 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 77256.6us
I20260709 13:08:06.591243 18819 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:06.595124 18905 raft_consensus.cc:697] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:06.631724 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:06.629372 13756 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:06.623183 18796 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.635262 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:06.637586 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:06.638801 14401 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:08:06.642107 13787 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
W20260709 13:08:06.630826 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 83969.5us
I20260709 13:08:06.624297 18861 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:06.648069 18904 log.cc:927] Time spent T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:08:06.653097 18547 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:06.653682 18547 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.656785 18547 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.643261 18895 raft_consensus.cc:2764] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:08:06.644750 18496 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:08:06.665488 18861 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.667758 18861 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:06.667861 18867 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:06.668428 18915 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:06.669322 18679 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.669924 18725 consensus_queue.cc:1059] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:06.670856 18725 consensus_queue.cc:1243] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer b5029654a4384e43a68eb67b794949b7 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:06.671633 18893 raft_consensus.cc:3055] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:08:06.672322 18873 log.cc:927] Time spent T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 1.304s	user 0.000s	sys 0.025s
I20260709 13:08:06.676083 18734 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.677703 18751 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.678432 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:06.674669 18699 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.679209 13709 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:06.682649 18760 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.684160 18751 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:06.685343 18866 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:06.678612 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3410) took 1292 ms. Trace:
I20260709 13:08:06.686162 13865 rpcz_store.cc:276] 0709 13:08:05.386406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.677851 (+1291445us) service_pool.cc:224] Handling call
0709 13:08:06.678144 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.678319 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.678347 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.678388 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:06.678420 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.678472 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.678560 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.688019 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3407) took 1352 ms. Trace:
I20260709 13:08:06.688422 13858 rpcz_store.cc:276] 0709 13:08:05.335389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.687137 (+1351748us) service_pool.cc:224] Handling call
0709 13:08:06.687470 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.687672 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.687701 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.687749 (+    48us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:06.687788 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.687850 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.687960 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.672199 18893 raft_consensus.cc:740] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:06.695775 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:06.668390 18867 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:06.705961 13713 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:06.707958 13709 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:08:06.707263 13708 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:06.711329 13716 raft_consensus.cc:1240] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:06.711848 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:06.713546 13830 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:06.705850 18894 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:06.716085 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:06.716747 14401 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 23.
I20260709 13:08:06.717757 13789 raft_consensus.cc:2368] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17.
I20260709 13:08:06.717478 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:06.718242 13756 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:06.726954 13857 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:08:06.727660 13756 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:06.728647 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:06.729645 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:06.731971 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:06.734285 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:06.736543 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:06.741425 14401 raft_consensus.cc:2410] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:08:06.744217 14367 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:06.746147 13756 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:06.746506 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.747980 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:06.707839 18889 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:06.706769 18508 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:06.747783 13680 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:06.758366 14401 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:06.745271 18915 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:06.708109 18863 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:06.766813 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:06.727377 18547 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:06.727283 18366 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:06.763890 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:06.741832 18531 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:06.768333 13756 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:06.738221 18751 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:06.825878 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:06.733274 18834 consensus_queue.cc:1048] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:08:06.808279 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:06.765479 18891 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:08:06.832999 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 64779.9us
W20260709 13:08:06.824671 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 63225.9us
I20260709 13:08:06.823853 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:06.834111 13709 raft_consensus.cc:2410] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:08:06.767620 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:06.765865 18915 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:06.831635 14401 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:06.766299 18643 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:06.799351 18872 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:06.764602 18649 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:06.813937 18712 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:06.446434 13859 rpcz_store.cc:276] 0709 13:08:05.425042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.380901 (+955859us) service_pool.cc:224] Handling call
0709 13:08:06.381205 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.381436 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:06.399259 (+ 17823us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.441439 (+ 42180us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.441491 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:06.441536 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.441597 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.441738 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37507,"prepare.queue_time_us":17904,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":32,"raft.queue_time_us":39488,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":3223,"spinlock_wait_cycles":33664,"thread_start_us":21596,"threads_started":2,"wal-append.queue_time_us":4573}
I20260709 13:08:06.769655 18664 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:06.819073 18531 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:06.837467 13756 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.129:37533 timed out after 1.733s (SENT) [suppressed 2 similar messages]
I20260709 13:08:06.787135 18658 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:08:06.850883 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:06.817572 18366 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.766486 18861 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:08:06.768157 18889 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.841187 18915 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:06.872603 13861 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:06.839170 18870 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:06.818008 18863 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.762676 18905 consensus_queue.cc:237] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.789019 18508 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:06.870993 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:06.878939 13709 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:06.841581 18751 raft_consensus.cc:697] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:06.844709 18891 raft_consensus.cc:697] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:06.860112 18531 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.847805 18679 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:06.881402 14401 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
W20260709 13:08:06.883985 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 139848us
I20260709 13:08:06.851666 18649 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:06.886181 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:06.863541 18773 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:06.838963 18547 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:06.851999 18914 consensus_queue.cc:1059] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:08:06.893220 14367 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:06.852212 18872 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.889569 18810 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.905717 14366 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:06.872066 18659 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.896056 18691 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:06.894106 18916 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:06.917539 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:06.902808 18494 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:06.923453 13709 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:08:06.923233 14367 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:06.925101 13830 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:06.890103 18699 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:06.903179 18760 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.926905 18366 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:06.935534 18667 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:06.935695 18867 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:06.936352 18891 consensus_queue.cc:237] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:06.965000 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 59400.7us
W20260709 13:08:06.967209 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 128595us
I20260709 13:08:06.968365 14368 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:06.937162 18547 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:06.919034 18810 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.939685 18829 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.975739 13859 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:06.976744 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:06.940693 18889 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.896548 18679 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.919303 18894 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:06.973143 18760 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:06.988905 18796 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.989002 18760 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.990051 13712 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 13: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:06.970525 18494 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:06.990629 18494 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:06.991005 18494 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.972926 18887 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:06.992022 18887 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.994082 18887 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.924717 18691 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:06.996935 18796 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.998034 18691 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:06.998871 18659 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:07.000735 18508 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:07.001482 18664 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:07.002731 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:07.003331 14399 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.006368 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:07.007002 13858 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:08:07.014127 18810 leader_election.cc:290] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:06.949895 18861 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:08:07.015245 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:07.016367 13858 raft_consensus.cc:2410] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:08:07.016459 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:07.017565 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:07.018214 13858 raft_consensus.cc:2393] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 13: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:08:06.946044 18917 log.cc:927] Time spent T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:08:06.945335 18918 log.cc:927] Time spent T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:08:06.954339 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:07.019934 13707 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:08:07.020220 18829 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:07.014143 14399 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:06.944280 18649 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:06.969760 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:07.022327 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:07.023917 13755 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:07.029340 13830 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:07.034607 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:07.036170 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:06.906093 18773 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:06.970184 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 47072.9us
I20260709 13:08:06.978909 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:07.075150 13709 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:07.076012 18857 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:07.080663 18496 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.081204 18496 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:07.082094 18773 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.979808 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:06.975292 13680 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:07.083817 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 108596us
I20260709 13:08:07.084398 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:07.084729 13680 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:07.085049 14398 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:08:06.972544 18699 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:07.085886 18699 raft_consensus.cc:697] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 12 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:07.084431 18810 raft_consensus.cc:993] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58: : Instructing follower b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:08:07.086418 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:07.086815 18810 raft_consensus.cc:1081] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 11 LEADER]: Signalling peer b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:08:06.980602 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:07.087222 18796 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:06.985227 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:06.975657 18667 raft_consensus.cc:697] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:06.988265 18923 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:07.000442 18494 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:07.088599 13864 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:42104
I20260709 13:08:07.089251 13864 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:07.089751 13864 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.089219 18667 consensus_queue.cc:237] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:07.090322 18494 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:06.949858 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 487791us
I20260709 13:08:07.092227 18547 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:07.093346 18547 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:07.093667 18547 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:07.094013 18547 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:06.956923 13786 raft_consensus.cc:2368] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12.
I20260709 13:08:07.092171 13755 leader_election.cc:304] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:07.095731 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:07.096338 14399 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:07.096544 18869 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:07.097105 18869 raft_consensus.cc:697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:07.097956 18869 consensus_queue.cc:237] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:07.099772 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:07.101032 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:07.102380 18428 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:07.102761 18428 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.103107 18428 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.103487 18896 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:07.102985 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:07.095530 18796 raft_consensus.cc:697] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:07.107874 18796 consensus_queue.cc:237] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:07.108395 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:07.111297 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:08:07.112334 13715 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 3014) took 1881 ms (client timeout 1733 ms). Trace:
I20260709 13:08:07.116303 14399 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:08:07.123250 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:07.124534 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:07.084630 14367 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:07.125680 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:07.126518 13682 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:07.127254 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:07.128163 13682 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:07.122916 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:07.129137 14399 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:08:06.963546 13788 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:07.051594 18679 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.981331 18751 consensus_queue.cc:237] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:07.053908 13757 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:07.112876 13715 rpcz_store.cc:269] 0709 13:08:05.230768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.231153 (+   385us) service_pool.cc:224] Handling call
0709 13:08:07.112085 (+1880932us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001b8d54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:07.112245 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2336365824}
I20260709 13:08:07.020720 18829 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:07.055846 18872 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:06.991317 18760 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:07.056493 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:07.056226 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:07.061071 18915 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:07.086725 18699 consensus_queue.cc:237] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:07.066556 18863 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:07.066849 18893 consensus_queue.cc:260] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:07.071395 18913 log.cc:927] Time spent T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 13:08:07.083256 18496 leader_election.cc:290] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:07.146376 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 92563.1us
I20260709 13:08:07.169744 13757 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:07.170617 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 141404us
I20260709 13:08:07.159204 13716 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:08:07.173903 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:07.176214 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:07.147073 13709 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:08:07.150993 13680 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:07.177323 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:07.177968 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:07.161062 18915 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:07.178987 18664 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:07.179510 18664 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.179605 18865 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:07.179975 18664 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.181322 18863 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:07.176281 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:07.183028 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:07.187278 13829 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:07.189069 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:07.193521 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:07.194144 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:07.194645 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:07.195549 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:07.162247 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:07.196112 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:07.196825 14402 raft_consensus.cc:2368] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 13.
W20260709 13:08:07.152168 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 77399.9us
I20260709 13:08:07.198873 14367 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:07.199968 14367 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:07.201365 14367 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:07.196583 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:07.195778 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 67726.8us
I20260709 13:08:07.203630 13682 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:07.204993 13757 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:07.206914 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:07.208395 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:07.209709 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:07.210568 13858 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 13: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:07.150650 18896 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.145474 18508 raft_consensus.cc:2764] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:08:07.206930 13830 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:07.212131 18863 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:07.214236 18829 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:07.145474 18797 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:07.169240 18533 consensus_queue.cc:1059] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:08:07.215687 18797 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:07.217710 18797 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:07.220237 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3409) took 1842 ms. Trace:
I20260709 13:08:07.220631 13861 rpcz_store.cc:276] 0709 13:08:05.377857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.673493 (+1295636us) service_pool.cc:224] Handling call
0709 13:08:06.673812 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.873107 (+199295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.220007 (+346900us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b540004b854. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:07.220176 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456659328}
I20260709 13:08:07.224108 18923 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:07.225411 13829 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:07.226519 13829 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:07.228065 18516 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.228767 18516 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.229390 18800 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.230796 13755 leader_election.cc:400] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 13.
I20260709 13:08:07.231103 13755 leader_election.cc:403] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:08:07.231882 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:07.232199 13829 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:07.232829 13860 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:07.211628 18494 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.234475 13716 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:08:07.235324 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:07.237113 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:07.237864 13709 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:08:07.238873 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:07.240774 13709 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:07.151119 18725 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.237682 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:07.244139 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 46200.4us
I20260709 13:08:07.247337 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:07.251281 13712 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:07.255285 14367 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:07.263314 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 59748.4us
I20260709 13:08:07.267284 13682 leader_election.cc:400] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 12. Current term is 13.
I20260709 13:08:07.248546 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:07.157873 13863 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:07.149063 13862 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
W20260709 13:08:07.275784 13711 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.005s	sys 0.011s
W20260709 13:08:07.277351 13711 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.006s	sys 0.011s
I20260709 13:08:07.299950 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:07.304528 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:07.169780 18861 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:07.163431 18893 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:07.164945 18679 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.163486 18743 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:07.315671 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:07.320901 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 483409us
I20260709 13:08:07.345496 13787 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:08:07.346472 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:07.346979 13711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54232
I20260709 13:08:07.347748 13711 raft_consensus.cc:606] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:08:07.348512 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:07.243719 18915 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:07.392270 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:07.393040 13714 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.393194 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:07.394238 13708 raft_consensus.cc:2393] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 17: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:08:07.395947 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 189061us
I20260709 13:08:07.396816 13830 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:07.398232 13709 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:08:07.395283 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:07.401324 13682 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:07.402854 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:07.250510 18658 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:07.321456 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 89339.8us
I20260709 13:08:07.358515 13712 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:07.349628 18743 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:07.350378 18870 consensus_queue.cc:1059] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:08:07.384298 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:07.350163 18819 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.387729 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:07.250357 18834 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:07.428658 13715 raft_consensus.cc:1240] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:08:07.319569 14367 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:07.407124 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:07.305702 18760 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:07.416505 13864 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:07.432266 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:07.432785 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 254871us
I20260709 13:08:07.310628 18863 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.344235 18888 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:07.161408 18531 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:07.440474 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:07.451445 13864 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:07.440711 13714 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:07.254894 18547 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:07.414358 18829 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:07.459084 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:07.460716 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:07.462714 14399 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:08:07.413470 18773 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:07.464826 18922 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:07.465690 14402 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 13: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:07.428356 18743 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:07.343989 18867 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 13:08:07.254226 18896 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:07.471694 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:07.469774 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:07.472493 13713 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 13: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:07.473188 14393 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 13: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:07.474385 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:07.390012 18679 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:07.479156 13707 raft_consensus.cc:2410] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:08:07.461481 18911 log.cc:927] Time spent T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:08:07.456149 18819 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.452281 18865 raft_consensus.cc:697] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:07.502928 14400 raft_consensus.cc:1240] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 12 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:07.503021 13865 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:07.466745 18829 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:07.472100 18888 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:07.512395 13856 raft_consensus.cc:1240] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:07.516800 13863 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:08:07.476574 18773 raft_consensus.cc:697] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:07.507814 18829 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:07.530344 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 129128us
I20260709 13:08:07.536034 13682 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:07.536356 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 102949us
I20260709 13:08:07.551334 13682 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:07.551607 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.552139 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 232693us
I20260709 13:08:07.557097 13682 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:07.521912 18725 consensus_queue.cc:1059] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 13:08:07.616454 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 59040.9us
I20260709 13:08:07.621124 14367 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:07.618127 13680 leader_election.cc:400] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12.
I20260709 13:08:07.623138 13680 leader_election.cc:403] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:07.624805 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 67808.9us
I20260709 13:08:07.625793 13682 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:07.619100 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 105678us
W20260709 13:08:07.622496 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 182105us
I20260709 13:08:07.633973 13682 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:07.622608 14367 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:07.639732 13682 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:07.642045 13829 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:07.650904 13829 leader_election.cc:400] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17.
I20260709 13:08:07.554908 18863 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:07.653192 13829 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:07.655055 13682 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:07.554714 18691 consensus_queue.cc:1059] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 13:08:07.623853 18508 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:07.657444 18362 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:07.650086 18428 consensus_meta.cc:287] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.546s	user 0.004s	sys 0.006s
I20260709 13:08:07.648876 18861 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:07.659965 13829 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:07.643698 18699 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:07.648535 18867 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:07.630636 18666 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:07.650691 18761 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:07.618934 18819 consensus_queue.cc:1059] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:08:07.670305 14366 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:07.672374 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:07.695087 13829 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:07.663676 18679 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:07.693892 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 137729us
I20260709 13:08:07.687088 13682 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:07.665465 18937 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.700562 14366 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:07.666255 18891 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12.
I20260709 13:08:07.671103 18857 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:07.672238 18699 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:07.676072 18755 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:07.692740 18939 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:07.672160 18861 raft_consensus.cc:697] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:07.707875 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:07.655316 18773 consensus_queue.cc:237] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:07.698949 13680 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:07.714869 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:07.697288 18531 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:07.704722 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:07.715761 13864 raft_consensus.cc:1240] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:07.716749 13782 raft_consensus.cc:1240] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:07.710495 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:07.670890 18649 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:07.665637 18428 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:07.720584 14399 raft_consensus.cc:3055] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:07.721314 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:07.708783 18755 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:07.725725 14395 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:08:07.723021 14399 raft_consensus.cc:740] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:07.662523 18865 consensus_queue.cc:237] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:07.727193 13829 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:07.740975 13829 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:07.742980 13829 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:07.727963 13680 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:07.744764 13829 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:07.745342 18934 log.cc:927] Time spent T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:08:07.724020 18929 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:08:07.709897 18819 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.709357 18699 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.731391 18896 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:07.720396 18857 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.712350 18712 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.707912 18761 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.735455 18866 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.735219 18944 consensus_queue.cc:1059] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:08:07.729480 18861 consensus_queue.cc:237] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:07.751379 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:07.758898 13756 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:07.795576 14395 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 13: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:07.760360 13865 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:07.773600 13789 raft_consensus.cc:2393] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 12: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
W20260709 13:08:07.774624 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 46713.1us
I20260709 13:08:07.721781 18867 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:07.752331 14399 consensus_queue.cc:260] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:07.787544 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:07.799353 14402 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 14: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:07.761543 18516 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:07.788821 14394 raft_consensus.cc:3055] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:07.789664 14396 raft_consensus.cc:1275] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:07.727577 18755 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:07.792779 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:07.759589 18948 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:07.796981 13680 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:07.802101 13783 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 14: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:07.802749 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:07.800259 14394 raft_consensus.cc:740] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:07.825086 14394 consensus_queue.cc:260] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:07.790040 18952 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:07.797689 18888 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:07.830721 14394 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:07.856818 18905 raft_consensus.cc:2955] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 15 LEADER]: Committing config change with OpId 12.9: config changed from index 8 to 9, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:08:07.862239 18893 consensus_meta.cc:287] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.001s
I20260709 13:08:07.829933 18948 raft_consensus.cc:697] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:07.843554 18947 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:07.845577 18932 log.cc:927] Time spent T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 13:08:07.846555 18664 consensus_meta.cc:287] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.666s	user 0.007s	sys 0.002s
I20260709 13:08:07.835265 13756 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:07.871555 18888 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.854960 13710 raft_consensus.cc:1240] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:07.835788 18944 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:07.842236 18834 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 13.
W20260709 13:08:07.846477 18946 log.cc:927] Time spent T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:08:07.863665 18428 leader_election.cc:290] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:07.936570 18743 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:07.938611 13786 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:07.900839 14394 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:08:07.862689 13858 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:08:07.939267 14394 pending_rounds.cc:85] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 11
I20260709 13:08:07.939627 14394 pending_rounds.cc:107] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:08:07.940017 14394 raft_consensus.cc:2889] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.916824 18947 consensus_queue.cc:1059] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:08:07.941694 18947 consensus_queue.cc:1243] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer ceb06175847b428ea8bd77055fcddf58 log is divergent from this leader: its last log entry 12.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:07.942207 18947 raft_consensus.cc:3055] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:07.942534 18947 raft_consensus.cc:740] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:07.916888 18755 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:07.828743 18867 raft_consensus.cc:697] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:07.945530 18867 consensus_queue.cc:237] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:07.946038 18755 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:07.914513 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 79331.1us
I20260709 13:08:07.803953 18942 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:07.916030 13757 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:07.917623 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.951886 13757 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:07.826764 18866 consensus_queue.cc:1048] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:08:07.913466 18664 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:07.954949 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:08:07.929278 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.957095 18664 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:07.957724 18659 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:07.957839 13857 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:07.958316 18659 raft_consensus.cc:697] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:07.930303 18819 consensus_queue.cc:1059] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:07.959165 18659 consensus_queue.cc:237] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:07.961381 18829 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:07.955274 14394 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:07.963363 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:07.938951 18743 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:07.966203 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:07.944430 13858 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:07.970753 13784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 1192) took 1425 ms. Trace:
I20260709 13:08:07.908685 18761 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:07.918582 18888 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.974308 13864 raft_consensus.cc:1240] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:08.001184 14394 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:08.001065 13784 rpcz_store.cc:276] 0709 13:08:06.545848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.547557 (+  1709us) service_pool.cc:224] Handling call
0709 13:08:06.547841 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.547994 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:06.564402 (+ 16408us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.441230 (+876828us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b1800463660. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e23a 00007f52324e8a2a
0709 13:08:07.970419 (+529189us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:07.970478 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:07.970527 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.970586 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.970691 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8974,"prepare.queue_time_us":16381,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":1861,"raft.queue_time_us":39917,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":15622,"spinlock_wait_cycles":14507904,"thread_start_us":528926,"threads_started":2,"wal-append.queue_time_us":989188}
I20260709 13:08:07.973798 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:08.008267 13785 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:08.012084 13787 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:07.920924 18915 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:07.964951 18725 raft_consensus.cc:2764] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:08:07.972718 18902 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:08.001279 18942 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:08.126514 14394 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
W20260709 13:08:08.137143 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 128533us
I20260709 13:08:08.142253 13785 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:08:07.974236 18664 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.156s
I20260709 13:08:08.147193 13829 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:08.002368 18952 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.136s
I20260709 13:08:08.020925 18954 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:08.012101 18761 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:07.943374 18947 consensus_queue.cc:260] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:08.229669 18949 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:08:08.229393 18934 log.cc:927] Time spent T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:08:08.193122 18945 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:08.193840 18956 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:08.138044 18942 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.137331 18948 consensus_queue.cc:237] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.318053 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58552 (request call id 1281) took 1623 ms. Trace:
I20260709 13:08:08.250480 18947 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:08.320165 14366 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:08.323978 13713 rpcz_store.cc:276] 0709 13:08:06.694141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.767378 (+ 73237us) service_pool.cc:224] Handling call
0709 13:08:08.317854 (+1550476us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b54001c43d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:08.317998 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1466100992}
I20260709 13:08:08.230456 18954 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.253549 18866 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.330758 18866 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:08.333015 18866 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:08.329808 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2411) took 1084 ms. Trace:
I20260709 13:08:08.333690 13791 rpcz_store.cc:276] 0709 13:08:07.245764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.247930 (+  2166us) service_pool.cc:224] Handling call
0709 13:08:07.306708 (+ 58778us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:07.468329 (+161621us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:07.468362 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:07.468906 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 13:08:07.798872 (+329966us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:07.801451 (+  2579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.318384 (+516933us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54001e8554. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:08.318428 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:08.318472 (+    44us) raft_consensus.cc:1685] finished
0709 13:08:08.318485 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.329721 (+ 11236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25018,"raft.queue_time_us":899,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":6671,"spinlock_wait_cycles":370855808,"thread_start_us":296384,"threads_started":1,"wal-append.queue_time_us":438772}
I20260709 13:08:08.341161 18888 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:08.342737 18699 consensus_meta.cc:287] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.551s	user 0.006s	sys 0.002s
I20260709 13:08:08.345650 18968 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.115s
I20260709 13:08:08.351193 18968 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:08.351444 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:08.351518 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:08.351699 18968 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.352272 13791 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:08.354300 18968 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:08.347209 18761 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:08.356968 18699 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:08.349886 18963 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:08:08.309419 18956 raft_consensus.cc:697] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:08.374035 18699 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:08.374820 18888 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:08.382469 18922 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:08.393177 18922 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:08.385653 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.387580 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:08.396337 14401 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:08.400249 18924 raft_consensus.cc:3055] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:08.401304 18924 raft_consensus.cc:740] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:08:08.401697 18962 log.cc:927] Time spent T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:08:08.402300 18924 consensus_queue.cc:260] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:08.405292 18829 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:08.389243 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:08.392352 14400 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:08.406373 18924 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:08.251120 18945 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.423748 13715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 3037) took 1033 ms. Trace:
I20260709 13:08:08.424439 13715 rpcz_store.cc:276] 0709 13:08:07.390002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.395490 (+  5488us) service_pool.cc:224] Handling call
0709 13:08:07.420989 (+ 25499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:07.437889 (+ 16900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.423557 (+985668us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b540012e150. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:08.423689 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57953024}
I20260709 13:08:08.423647 14401 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:08.415174 18684 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:08.429003 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:08.431083 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:08.432072 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:08.426254 18684 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.408936 18819 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:08.440572 13791 raft_consensus.cc:1240] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:08.443864 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:08.444597 13791 raft_consensus.cc:2393] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 7: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:08.445662 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:08.445991 13782 raft_consensus.cc:1275] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:08.442975 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:08.453540 13783 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 13: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:08.458205 18956 consensus_queue.cc:237] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.435726 18895 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:08.495990 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 48144.8us
I20260709 13:08:08.459331 18684 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:08.473045 18945 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:08.439265 18819 raft_consensus.cc:697] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:08.502422 13755 leader_election.cc:304] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:08.482708 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:08.484901 18905 consensus_meta.cc:287] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.626s	user 0.012s	sys 0.000s
I20260709 13:08:08.475809 18942 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:08.506817 18893 consensus_queue.cc:1059] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:08:08.507802 18971 log.cc:927] Time spent T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.280s	user 0.002s	sys 0.002s
I20260709 13:08:08.513259 18922 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.537509 18894 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:08.538254 18894 raft_consensus.cc:697] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:08.538452 18922 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:08.501648 18954 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:08.523144 18948 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:08.501855 18834 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:08.524593 18945 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:08.525295 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 3429) took 1226 ms. Trace:
I20260709 13:08:08.555747 13863 rpcz_store.cc:276] 0709 13:08:07.299299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.299737 (+   438us) service_pool.cc:224] Handling call
0709 13:08:08.525034 (+1225297us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b540035af54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:08.525189 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":497047424}
I20260709 13:08:08.532641 18819 consensus_queue.cc:237] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.560976 18954 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.561476 18954 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.539767 18894 consensus_queue.cc:237] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:08.534175 18965 log.cc:927] Time spent T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.307s	user 0.000s	sys 0.002s
I20260709 13:08:08.541994 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:08.563552 18954 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:08.504168 18895 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.553633 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:08.564527 14400 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:08.559103 18924 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:08.565860 18924 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:08.567225 18931 log.cc:927] Time spent T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.925s	user 0.005s	sys 0.012s
I20260709 13:08:08.555262 18829 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:08.568447 18924 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:08.568830 18829 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.559222 18945 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.569690 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 2728) took 1396 ms. Trace:
I20260709 13:08:08.570220 13865 rpcz_store.cc:276] 0709 13:08:07.173097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.177042 (+  3945us) service_pool.cc:224] Handling call
0709 13:08:08.569483 (+1392441us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54002fb2d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:08.569618 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":747320064}
I20260709 13:08:08.571103 18945 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:08.565382 18895 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:08.577353 13856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1268) took 1594 ms. Trace:
I20260709 13:08:08.577790 13856 rpcz_store.cc:276] 0709 13:08:06.982545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.983340 (+   795us) service_pool.cc:224] Handling call
0709 13:08:06.983649 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.513090 (+529441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.577138 (+1064048us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b54000d1bd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:08.577294 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1215533696}
I20260709 13:08:08.572858 13790 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:08:08.579092 13790 pending_rounds.cc:85] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 7
W20260709 13:08:08.572959 18933 log.cc:927] Time spent T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 1.019s	user 0.000s	sys 0.003s
I20260709 13:08:08.579259 18942 raft_consensus.cc:3055] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:08.579860 18942 raft_consensus.cc:740] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:08.580685 13859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1275) took 1479 ms. Trace:
I20260709 13:08:08.581049 18942 consensus_queue.cc:260] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.581115 13859 rpcz_store.cc:276] 0709 13:08:07.101665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.101805 (+   140us) service_pool.cc:224] Handling call
0709 13:08:07.102081 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:07.102492 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:07.102517 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:07.102944 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:08:07.456636 (+353692us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:07.456674 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.456737 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:08.572245 (+1115508us) spinlock_profiling.cc:243] Waited 7.27 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:08.580364 (+  8119us) raft_consensus.cc:1685] finished
0709 13:08:08.580390 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.580604 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2424,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":16729344,"thread_start_us":353330,"threads_started":1,"wal-append.queue_time_us":417509}
W20260709 13:08:08.561906 18800 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:08:08.573801 18667 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:08.583742 18829 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:08.583914 18667 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.589859 18667 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:08.592433 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:08.557737 18834 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.579345 13790 pending_rounds.cc:107] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:08:08.587489 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:08.594800 13790 raft_consensus.cc:2889] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:08.596267 18834 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:08.544427 14368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.000s	sys 0.015s
W20260709 13:08:08.597024 14368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.002s	sys 0.015s
W20260709 13:08:08.597972 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 597200us
I20260709 13:08:08.602228 18834 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:08.602375 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:08.603276 18810 raft_consensus.cc:3055] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:08.602864 18834 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.603766 18810 raft_consensus.cc:740] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:08.604753 18810 consensus_queue.cc:260] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.605918 18810 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:08.607689 18760 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.607770 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:08.608330 18760 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:08.608470 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:08.609163 13859 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 6.
I20260709 13:08:08.616441 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:08.617054 13859 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:08.617673 18863 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:08.618403 18863 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:08.606004 18834 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:08.622043 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:08.622726 14396 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:08:08.622669 18508 consensus_queue.cc:1059] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:08.623641 18939 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.628947 13715 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:08.629522 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:08.598425 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3408) took 3239 ms. Trace:
I20260709 13:08:08.632115 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:08.633353 13708 raft_consensus.cc:1275] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:08.639199 13859 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:08:08.634130 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:08.623044 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:08.602149 13680 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:08.640837 13865 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:08:08.641070 13860 rpcz_store.cc:276] 0709 13:08:05.359104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.950422 (+1591318us) service_pool.cc:224] Handling call
0709 13:08:06.950726 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.233275 (+282549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.598153 (+1364878us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54002d96d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:08.598357 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":647995648}
I20260709 13:08:08.641760 18952 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:08.642761 13865 raft_consensus.cc:1240] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:08.646374 13789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1202) took 1247 ms. Trace:
W20260709 13:08:08.644603 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 324543us
I20260709 13:08:08.646744 13789 rpcz_store.cc:276] 0709 13:08:07.384475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.406844 (+ 22369us) service_pool.cc:224] Handling call
0709 13:08:08.631658 (+1224814us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b540033b154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:08.631774 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":763833216}
I20260709 13:08:08.649430 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:08.649739 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:08.650504 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:08.651237 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:08.651866 13785 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:08:08.650573 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:08.653347 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:08.634349 13755 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:08.655827 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:08.663581 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:08.664079 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:08.665925 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.664180 13707 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:08.667443 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:08.667053 13713 raft_consensus.cc:2955] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:08.658492 13829 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:08.670806 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:08.671502 13858 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:08.676811 18945 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:08.642771 18923 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:08.665011 18888 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:08.688072 13710 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:08:08.688449 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.695891 13788 raft_consensus.cc:1240] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:08.696477 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:08.684646 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 50364us
I20260709 13:08:08.685045 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:08.701438 13708 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:08.667554 18896 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.555963 18948 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:08.711144 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 52722.9us
W20260709 13:08:08.702239 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 100226us
I20260709 13:08:08.719475 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:08.725334 14366 leader_election.cc:304] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:08.720168 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:08.720311 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:08.721151 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:08.712929 13830 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:08.724439 13755 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:08.695626 18643 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:08.726897 14400 raft_consensus.cc:2393] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 12: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:08.741638 14402 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 11: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:08.728909 18866 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:08.729141 18829 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:08:08.662302 18952 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.684224 18978 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:08.756275 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:08.757000 14400 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
W20260709 13:08:08.729828 18974 log.cc:927] Time spent T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:08:08.685192 18698 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:08.710350 18953 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:08.763104 14402 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:08.761729 14366 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:08.761909 13856 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:08.654754 18939 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.763127 18895 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:08.775897 18895 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:08.776403 18895 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:08.762720 18664 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:08.779783 18664 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:08.780270 18664 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:08.780650 13755 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:08.781523 18975 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:08.781919 18975 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:08.781944 18954 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:08.782401 18975 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:08.782480 18954 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.795733 18954 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:08.798780 18428 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:08.799526 18863 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:08.800643 18939 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:08.800760 18922 consensus_queue.cc:1059] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:08.801914 18957 raft_consensus.cc:3055] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:08.802307 18957 raft_consensus.cc:740] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:08.802688 13714 raft_consensus.cc:1275] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:08.803107 18957 consensus_queue.cc:260] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.752904 18643 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:08.811673 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 87023.5us
I20260709 13:08:08.727967 18761 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:08:08.728816 18755 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:08:08.702953 18945 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.739029 18712 consensus_queue.cc:1059] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:08:08.708727 18923 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.763708 18968 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:08.804322 18957 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:08.762856 18978 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.731388 18896 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:08.740715 13680 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:08.841598 13829 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:08.884631 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 68919us
I20260709 13:08:08.814838 18643 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:08.880971 14368 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:08:08.890213 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 149611us
I20260709 13:08:08.891278 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:08.898562 13707 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:08:08.900205 13830 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:08.886075 13829 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:08.891158 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 278016us
I20260709 13:08:08.909438 14368 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:08.835340 18924 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.888801 18829 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:08.864048 18428 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:08.932605 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:08.934712 14401 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:08.904865 18666 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:08.813668 18698 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.906481 18494 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:08.947602 18494 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:08.948194 18494 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:08.938210 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:08.939013 14397 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:08:08.944013 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:08.906329 18667 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:08.908174 18956 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:08.944032 14401 raft_consensus.cc:2955] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:08.965838 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:08.917861 18751 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:08:08.969252 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:08.937409 18973 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:08.950778 18755 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.929533 18985 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:08.990015 14396 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:08:08.987867 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 46455.7us
I20260709 13:08:09.017141 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:08.942126 18953 consensus_queue.cc:1059] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:08:08.955094 18829 raft_consensus.cc:697] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:09.021129 13786 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:09.022120 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:09.022372 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:09.016458 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1285) took 1051 ms. Trace:
I20260709 13:08:09.113176 13858 rpcz_store.cc:276] 0709 13:08:07.965173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.119834 (+154661us) service_pool.cc:224] Handling call
0709 13:08:08.147019 (+ 27185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.697012 (+549993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.016138 (+319126us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b54000d0cd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:09.016386 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1205456640}
I20260709 13:08:08.959993 18667 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.944160 18760 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:08.952157 18857 consensus_queue.cc:1048] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:08:08.945034 18428 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:08.971962 18948 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:08.939184 18924 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:08.980481 18863 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:08.994356 18666 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:08.982056 18973 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:09.145941 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:08.968822 18659 consensus_queue.cc:1059] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.162s
I20260709 13:08:09.120646 18667 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:09.128894 18985 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:08:09.157893 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:09.020211 18664 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:09.164958 13784 raft_consensus.cc:2410] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:08:09.170771 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:09.193171 13859 raft_consensus.cc:2393] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 12: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:09.117841 18755 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:09.134997 18952 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:09.205384 18956 raft_consensus.cc:697] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:08:09.209566 18940 log.cc:927] Time spent T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 1.654s	user 0.008s	sys 0.054s
I20260709 13:08:09.158991 18986 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:09.147331 18973 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:09.217264 13859 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:09.210685 13863 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:09.221207 13861 raft_consensus.cc:1240] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 13:08:09.218695 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 239561us
I20260709 13:08:09.226397 18948 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:09.220064 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:09.218411 18933 log.cc:927] Time spent T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:08:09.227367 18987 log.cc:927] Time spent T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:08:09.234413 13829 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:09.226154 18494 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:09.229646 18810 consensus_meta.cc:287] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.623s	user 0.013s	sys 0.000s
I20260709 13:08:09.147650 18666 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:09.210196 18976 log.cc:927] Time spent T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:09.247243 13829 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:09.218699 18997 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:09.228093 18923 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:09.222262 18751 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:09.244222 18896 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:09.265007 13829 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:09.237317 18945 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:09.263788 18679 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:09.267992 18755 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:09.269598 18924 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:09.270502 18984 log.cc:927] Time spent T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
W20260709 13:08:09.271936 18981 log.cc:927] Time spent T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 13:08:09.283882 18956 consensus_queue.cc:237] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:09.285768 19009 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:09.277941 18771 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:09.271298 18989 log.cc:927] Time spent T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:08:09.292706 18983 log.cc:927] Time spent T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.347s	user 0.001s	sys 0.000s
I20260709 13:08:09.273048 18914 raft_consensus.cc:3055] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:09.295581 18914 raft_consensus.cc:740] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:08:09.295827 18990 log.cc:927] Time spent T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:08:09.278086 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:09.281272 18991 log.cc:927] Time spent T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:08:09.272848 18698 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:09.235901 18939 consensus_queue.cc:1059] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:08:09.236145 18986 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:09.302120 18986 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:09.304383 18985 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.306654 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:09.306962 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:09.290392 18666 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:09.308020 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:09.307329 13709 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:08:09.242770 18953 consensus_queue.cc:1059] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:08:09.246397 18948 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:09.336509 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.315457 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 50807.5us
I20260709 13:08:09.341073 13829 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:09.341804 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:09.296506 18914 consensus_queue.cc:260] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:09.337042 18895 consensus_meta.cc:287] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.547s	user 0.012s	sys 0.000s
I20260709 13:08:09.348613 13858 raft_consensus.cc:1275] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:09.357971 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:09.349722 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:09.351347 13710 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:09.343492 18755 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:09.348559 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 185195us
I20260709 13:08:09.353125 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:09.364173 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:09.354708 14394 raft_consensus.cc:1275] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:09.276063 18751 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:09.340351 19009 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:09.347952 18914 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:09.363521 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:09.258047 18829 consensus_queue.cc:237] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:09.365320 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:09.365710 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:09.366395 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:09.369385 14399 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:09.370311 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:09.361008 18954 consensus_meta.cc:287] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.001s
I20260709 13:08:09.340605 18643 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:09.360735 18895 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:09.356375 18896 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:09.372542 18760 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:09.345660 18985 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:09.361884 13789 raft_consensus.cc:2955] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:08:09.477823 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 106664us
I20260709 13:08:09.483656 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:09.593176 13785 raft_consensus.cc:2393] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 13: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:09.486714 13710 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 23. Current term is 24. Ops: []
W20260709 13:08:09.594125 18957 consensus_meta.cc:287] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.694s	user 0.010s	sys 0.001s
I20260709 13:08:09.484686 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:09.498862 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:09.265970 18997 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:09.363436 18975 consensus_meta.cc:287] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.000s
I20260709 13:08:09.287166 18771 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:09.500205 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.495050 13680 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:09.524039 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:09.531838 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:09.394791 18755 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:09.478125 18698 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
W20260709 13:08:09.643688 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 148736us
W20260709 13:08:09.492398 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 124254us
I20260709 13:08:09.484190 18547 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:09.545641 18954 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:09.526820 19004 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.643929 13708 raft_consensus.cc:2393] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 24: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:09.649822 19001 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:09.638341 18952 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.532094 18863 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.126s
I20260709 13:08:09.651111 18771 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:09.592192 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 61671.3us
I20260709 13:08:09.660988 14399 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:08:09.661511 18712 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.661698 13756 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:09.661976 18712 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:09.663914 14399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 1224) took 1951 ms (client timeout 1792 ms). Trace:
I20260709 13:08:09.666016 18895 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:09.666326 18698 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:09.651525 18857 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:09.672348 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:09.671473 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:09.664353 14399 rpcz_store.cc:269] 0709 13:08:07.712177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.714553 (+  2376us) service_pool.cc:224] Handling call
0709 13:08:09.363935 (+1649382us) spinlock_profiling.cc:243] Waited 94.8 ms on lock 0x7b58007196d0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f523243a0aa 00007f52324bc447 00007f52324d4fe7 00007f52324d67de 00007f52324e227c 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c
0709 13:08:09.663813 (+299878us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218052864}
I20260709 13:08:09.674302 13783 raft_consensus.cc:1240] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:09.678131 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 307871us
I20260709 13:08:09.651345 18755 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:09.672139 18930 log.cc:927] Time spent T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 1.986s	user 0.012s	sys 0.004s
I20260709 13:08:09.666877 18698 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:09.666628 19001 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:09.651739 18973 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:09.667402 18952 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:09.644014 18975 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:09.817785 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 156166us
I20260709 13:08:10.119720 13756 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:09.817982 18667 consensus_meta.cc:287] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.002s
I20260709 13:08:09.818507 13786 raft_consensus.cc:1275] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:09.819442 18643 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:09.821162 18954 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:09.651129 18867 raft_consensus.cc:3055] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:09.823331 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:09.809549 18956 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.006s	sys 0.015s
I20260709 13:08:09.824916 18751 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:09.671825 19010 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:10.054126 19006 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:09.829371 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:09.831543 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:09.831961 18977 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.829234 18889 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:09.836935 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:09.855274 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 181552us
I20260709 13:08:09.847767 18948 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:09.903324 14367 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:09.892584 18938 raft_consensus.cc:3055] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:09.906243 18834 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.072933 18957 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:09.913645 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:09.892664 18888 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:09.660332 19004 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.019745 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:10.035883 14401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 1245) took 1093 ms. Trace:
I20260709 13:08:10.043285 13862 raft_consensus.cc:1240] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:10.073524 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:10.085624 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 72524.8us
I20260709 13:08:10.052896 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:10.013903 18923 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:10.092870 18994 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:09.892046 18760 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:10.118381 18985 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:10.660461 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 1296) took 3423 ms. Trace:
I20260709 13:08:10.662222 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:10.661049 13716 rpcz_store.cc:276] 0709 13:08:07.237064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.237173 (+   109us) service_pool.cc:224] Handling call
0709 13:08:07.237449 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:07.250926 (+ 13477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:07.250955 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:07.256532 (+  5577us) log.cc:844] Serialized 26 byte log entry
0709 13:08:07.855056 (+598524us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b4800080358. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5237407aa1 00007f52373feb37 00007f52373fe9ca 00007f52374f626f 00007f52374f5f37 00007f523750a55c 00007f523750a508 00007f523750a488 00007f523750a443 00007f52375096ec 00007f5236433a96
0709 13:08:09.666834 (+1811778us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b18004b38e0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e0d1 00007f5232499a0f
0709 13:08:09.829081 (+162247us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:09.829119 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.830118 (+   999us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.178571 (+348453us) raft_consensus.cc:1685] finished
0709 13:08:10.178618 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.660280 (+481662us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13100,"raft.queue_time_us":14620,"raft.run_cpu_time_us":3184,"raft.run_wall_time_us":594834,"spinlock_wait_cycles":150530176,"thread_start_us":162057,"threads_started":1,"wal-append.queue_time_us":2558275}
I20260709 13:08:10.173650 13790 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:10.664644 14401 rpcz_store.cc:276] 0709 13:08:08.942364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.943477 (+  1113us) service_pool.cc:224] Handling call
0709 13:08:08.943741 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.943922 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:09.138781 (+194859us) log.cc:844] Serialized 14 byte log entry
0709 13:08:09.533205 (+394424us) log.cc:844] Serialized 14 byte log entry
0709 13:08:10.035362 (+502157us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:10.035472 (+   110us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:10.035535 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.035623 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.035797 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":160675,"prepare.queue_time_us":508825,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":257851,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":11834,"thread_start_us":750607,"threads_started":3}
I20260709 13:08:10.178243 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 1221) took 2508 ms. Trace:
I20260709 13:08:10.668486 14393 rpcz_store.cc:276] 0709 13:08:07.669961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.670095 (+   134us) service_pool.cc:224] Handling call
0709 13:08:07.670453 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:07.824616 (+154163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:07.824650 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:09.501156 (+1676506us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b2c00012878. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5230dd7a11 00007f5230de7372 00007f5232519a01 00007f52324de43a 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2
0709 13:08:09.501577 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 13:08:09.639163 (+137586us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:09.909879 (+270716us) log.cc:844] Serialized 14 byte log entry
0709 13:08:10.012279 (+102400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.012357 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.177836 (+165479us) raft_consensus.cc:1685] finished
0709 13:08:10.177976 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.178138 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":172128,"prepare.queue_time_us":375694,"prepare.run_wall_time_us":37,"raft.queue_time_us":137966,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":46677,"spinlock_wait_cycles":11660928,"thread_start_us":542617,"threads_started":3,"wal-append.queue_time_us":591034}
W20260709 13:08:10.667799 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 548151us
I20260709 13:08:10.681268 13756 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:10.157469 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:10.700045 14399 raft_consensus.cc:2368] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8.
I20260709 13:08:10.700040 13857 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:10.105612 18684 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:10.709923 14394 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:08:10.714422 13783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2933) took 1041 ms. Trace:
I20260709 13:08:10.703992 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:10.715085 13783 rpcz_store.cc:276] 0709 13:08:09.673046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.823053 (+150007us) service_pool.cc:224] Handling call
0709 13:08:10.714353 (+891300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:10.717423 13784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 2935) took 1043 ms. Trace:
I20260709 13:08:10.720943 13784 rpcz_store.cc:276] 0709 13:08:09.673534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.836671 (+163137us) service_pool.cc:224] Handling call
0709 13:08:10.717320 (+880649us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:10.705327 13861 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:10.686913 18857 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.262605 18925 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:10.175153 18975 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:10.264354 18954 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:10.165225 19007 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:10.645560 18659 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:10.114146 18771 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:10.647394 18997 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:10.450785 18945 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:08:10.709409 18956 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.414s	user 0.008s	sys 0.036s
I20260709 13:08:10.743016 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:10.664213 18867 raft_consensus.cc:740] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:10.172508 18667 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:10.511884 18863 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:10.750607 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:10.750948 18925 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:10.729329 18857 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:10.751071 19024 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:10.751679 18751 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:10.752573 18888 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:10.753113 18948 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:10.753636 18679 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:10.753952 18973 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:10.325425 18643 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:10.699704 19008 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:10.706638 18698 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:10.512236 19002 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:10.720652 18684 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:10.703341 19006 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.185348 18952 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:10.263168 18914 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.485s
I20260709 13:08:10.716531 18957 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.703685 18889 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.703555 18977 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.720710 18923 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.794646 18867 consensus_queue.cc:260] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.778996 19025 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:10.770172 19001 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:10.707063 18938 raft_consensus.cc:740] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:08:10.850980 13829 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.008s	sys 0.025s
I20260709 13:08:10.851608 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2931) took 1179 ms. Trace:
I20260709 13:08:10.853166 13864 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:10.781445 18751 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.770143 18771 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.926290 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1643) took 1255 ms. Trace:
I20260709 13:08:10.770536 13861 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:10.926843 14402 rpcz_store.cc:276] 0709 13:08:09.670571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.670688 (+   117us) service_pool.cc:224] Handling call
0709 13:08:09.670974 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.155672 (+484698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.155702 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:10.155747 (+    45us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:10.155778 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.925484 (+769706us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b540052d0d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:10.925574 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.926004 (+   430us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1114239360}
I20260709 13:08:10.930840 14395 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:10.785954 18888 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.932446 19004 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:10.933151 19001 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:08:10.934216 18888 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:10.860792 18366 raft_consensus.cc:3055] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:10.863832 18997 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.934913 18366 raft_consensus.cc:740] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:10.935357 18997 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.800508 19016 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:10.936784 18366 consensus_queue.cc:260] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.809608 19038 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:10.864398 18508 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:10.940136 18508 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.808506 19008 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.944159 18684 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:10.809186 19002 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.946101 19008 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:10.800540 18679 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.948024 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:54232 (request call id 24) took 3601 ms. Trace:
I20260709 13:08:10.782323 19024 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.952203 19006 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:10.952602 18751 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:10.954217 19024 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:10.955477 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:10.956444 18957 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:10.956519 13856 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42104 (request call id 1289) took 2333 ms (client timeout 1652 ms). Trace:
I20260709 13:08:10.957104 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:08:10.957165 13856 rpcz_store.cc:269] 0709 13:08:08.622697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.622827 (+   130us) service_pool.cc:224] Handling call
0709 13:08:10.955996 (+2333169us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54002d8cd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:10.956226 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":278268672}
I20260709 13:08:10.957955 14394 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.958853 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:10.872061 18643 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.957501 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:10.959721 13861 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:08:10.960476 13859 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:08:10.767944 18659 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.873795 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2590) took 2245 ms. Trace:
I20260709 13:08:10.715795 18725 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:08:10.703233 18834 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:10.968434 18659 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:10.970508 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2934) took 1297 ms. Trace:
I20260709 13:08:10.971884 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:10.974196 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 292936us
I20260709 13:08:10.808172 18977 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:10.707254 19010 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.961534 19016 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.726580 18994 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:10.984442 19016 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:10.777545 14368 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.002s	sys 0.010s
I20260709 13:08:10.774487 18954 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.992455 18954 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:10.993714 18923 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:10.994902 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2917) took 2563 ms. Trace:
I20260709 13:08:10.995311 13787 rpcz_store.cc:276] 0709 13:08:08.431220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.431327 (+   107us) service_pool.cc:224] Handling call
0709 13:08:08.438050 (+  6723us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.439538 (+  1488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.439568 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:08.439613 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:08.439653 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.994388 (+2554735us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b54001b62d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:10.994463 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.994721 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2905472}
I20260709 13:08:10.778611 18863 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:10.891531 18667 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:10.997450 19008 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:10.998302 19008 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.896807 18938 consensus_queue.cc:260] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:11.000171 18938 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:11.000519 18939 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:11.001343 18939 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:11.002543 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 45166.7us
I20260709 13:08:10.773396 18945 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.003949 13680 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:11.006472 18945 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:10.918560 18952 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.920230 19048 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:08:10.920501 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 200949us
I20260709 13:08:10.920591 18985 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:10.924165 13829 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.009s	sys 0.025s
I20260709 13:08:10.938702 18366 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:10.726809 18760 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.921937 13782 rpcz_store.cc:276] 0709 13:08:09.672393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.673375 (+   982us) service_pool.cc:224] Handling call
0709 13:08:09.673661 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.673971 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.674003 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:09.705660 (+ 31657us) log.cc:844] Serialized 26 byte log entry
0709 13:08:10.355936 (+650276us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:10.356014 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.356129 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.850566 (+494437us) raft_consensus.cc:1685] finished
0709 13:08:10.850665 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.851219 (+   554us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":144977,"raft.queue_time_us":831,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":55701,"thread_start_us":456568,"threads_started":1,"wal-append.queue_time_us":953373}
W20260709 13:08:10.870021 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 966540us
I20260709 13:08:10.948683 19040 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:10.950526 18679 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:10.963835 18643 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:10.948486 13711 rpcz_store.cc:276] 0709 13:08:07.346132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.346836 (+   704us) service_pool.cc:224] Handling call
0709 13:08:09.832846 (+2486010us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400215820. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f523245b520 00007f52324d8652 00007f52374a660a 00007f5230a2c7d4 00007f5230a2c762 00007f5230a2c691 00007f5230a2c60c 00007f5230a2b8c2 00007f523081948c 00007f52308188c6
0709 13:08:10.944601 (+1111755us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b5400215820. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324595e7 00007f52324d8c68 00007f52324d884a 00007f52374a660a 00007f5230a2c7d4 00007f5230a2c762 00007f5230a2c691 00007f5230a2c60c 00007f5230a2b8c2 00007f523081948c
0709 13:08:10.947760 (+  3159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410631808}
I20260709 13:08:10.958003 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:10.964558 13714 rpcz_store.cc:276] 0709 13:08:08.627794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.629941 (+  2147us) service_pool.cc:224] Handling call
0709 13:08:08.630178 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.803057 (+172879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.873040 (+2069983us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54002e6dd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:10.873492 (+   452us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":395987712}
I20260709 13:08:10.970563 18834 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:10.796456 18857 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:10.970554 13789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2432) took 1618 ms. Trace:
I20260709 13:08:10.966673 18771 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:11.028573 19042 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:11.028294 19049 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:10.807688 19025 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.817555 19015 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:10.949563 18508 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:10.979872 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:10.984246 19010 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:10.971192 13788 rpcz_store.cc:276] 0709 13:08:09.673323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.729541 (+1056218us) service_pool.cc:224] Handling call
0709 13:08:10.730255 (+   714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.854343 (+124088us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.854454 (+   111us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:10.854522 (+    68us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:10.854596 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.970080 (+115484us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54002ebb54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:10.970132 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.970306 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":283620736}
I20260709 13:08:10.976423 19038 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:10.988363 14368 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.003s	sys 0.010s
I20260709 13:08:10.989681 18997 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:10.995951 18994 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:10.935405 19001 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:10.796952 18948 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:10.999244 18863 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:11.032117 18857 consensus_queue.cc:1059] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:11.033141 14367 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:11.029816 19042 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.035740 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.037147 18939 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:11.008034 18952 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.040370 19051 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:11.038012 19040 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.028246 13789 rpcz_store.cc:276] 0709 13:08:09.351559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.353537 (+  1978us) service_pool.cc:224] Handling call
0709 13:08:09.355957 (+  2420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.356170 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:09.845137 (+488967us) log.cc:844] Serialized 14 byte log entry
0709 13:08:10.736609 (+891472us) log.cc:844] Serialized 14 byte log entry
0709 13:08:10.969632 (+233023us) log.cc:844] Serialized 14 byte log entry
0709 13:08:10.969973 (+   341us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:10.970032 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:10.970099 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.970193 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.970375 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93045,"prepare.queue_time_us":702317,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":88,"raft.queue_time_us":16538,"raft.run_cpu_time_us":458,"raft.run_wall_time_us":17730,"thread_start_us":931910,"threads_started":3,"wal-append.queue_time_us":950335}
I20260709 13:08:11.043910 14393 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:08:11.048065 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.052472 19048 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:11.056427 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 790882us
I20260709 13:08:11.056584 19008 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:11.057562 19001 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:11.058480 18948 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:11.059808 18667 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:11.061151 18760 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:11.062258 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:11.055230 18985 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:11.067619 19002 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:11.068794 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 61747.7us
I20260709 13:08:11.054255 18997 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:11.073011 19025 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:11.029920 19049 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.078538 19038 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:11.078890 18952 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:11.079025 18819 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.463s	user 0.027s	sys 0.031s
I20260709 13:08:11.080353 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.082129 14397 raft_consensus.cc:1240] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:11.083207 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:08:11.088999 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.089726 18942 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:11.084555 18867 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.083797 19052 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:11.108071 18658 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.108322 13829 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:11.109133 19048 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:11.112025 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:11.113364 19053 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:08:11.120967 14402 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:11.101398 13757 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:11.123261 18819 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.561s	user 0.028s	sys 0.031s
W20260709 13:08:11.130818 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 100619us
I20260709 13:08:11.132915 19042 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:11.140357 19002 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:11.142086 18985 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:11.140411 14396 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.141781 18428 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:11.158205 14394 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
W20260709 13:08:11.151922 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 81655.8us
I20260709 13:08:11.159437 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:11.161392 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:11.162055 14393 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:11.162930 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:11.163527 18428 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:11.163667 18968 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:11.164430 18428 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:11.166218 13861 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:11.167624 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.168222 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.169008 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.169713 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.169932 13861 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:08:11.170665 13856 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:08:11.120646 18997 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:11.172009 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.139077 19038 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.141673 13613 catalog_manager.cc:5697] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 13 to 15, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 15 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:11.183108 14393 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
I20260709 13:08:11.142283 18667 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.185488 13714 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:11.185923 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.186496 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.162379 18712 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:11.187137 18834 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:11.187891 18834 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:11.185190 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.179087 14368 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:11.174691 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:11.188235 18947 raft_consensus.cc:2955] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:08:11.201761 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.202729 18658 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.202785 14367 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:11.187348 18667 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:11.149184 19010 consensus_queue.cc:1059] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.055s
I20260709 13:08:11.209930 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:11.213042 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3430) took 1989 ms. Trace:
I20260709 13:08:11.213586 13863 rpcz_store.cc:276] 0709 13:08:09.166090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.167224 (+  1134us) service_pool.cc:224] Handling call
0709 13:08:09.167571 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.233296 (+ 65725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.114007 (+1880711us) spinlock_profiling.cc:243] Waited 42.8 ms on lock 0x7b540004ae54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:11.152757 (+ 38750us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98484480}
I20260709 13:08:11.216581 13861 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:08:11.138792 19051 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.203934 19038 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.227977 18712 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:11.219051 18948 consensus_queue.cc:1048] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:08:11.229837 18819 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:11.230304 18819 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:11.230708 18819 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.233237 13755 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:11.234208 13755 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:11.237613 14402 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:08:11.226424 14394 raft_consensus.cc:1240] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:11.235144 13755 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:11.240049 19040 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:11.247490 18959 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:11.248027 18959 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:11.248438 18959 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:11.253141 18861 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.619s	user 0.015s	sys 0.022s
W20260709 13:08:11.262745 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 154639us
I20260709 13:08:11.265410 18712 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.265967 18712 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.267599 18428 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:11.269487 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 100424us
W20260709 13:08:11.262243 18861 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.701s	user 0.015s	sys 0.022s
I20260709 13:08:11.257398 19049 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:11.272877 13757 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:11.238399 19044 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:08:11.259332 18834 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:11.279320 14396 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:11.280158 13757 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:11.269748 18428 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:11.269481 18870 consensus_queue.cc:1059] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:08:11.285880 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.286075 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.286569 18870 raft_consensus.cc:3055] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:11.286935 13711 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:08:11.287181 18870 raft_consensus.cc:740] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:11.287864 18997 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:11.288035 19016 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:11.286636 18978 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:11.288465 19016 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.288898 19016 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.288744 18870 consensus_queue.cc:260] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.289371 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2748) took 2363 ms. Trace:
I20260709 13:08:11.289727 13864 rpcz_store.cc:276] 0709 13:08:08.925987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.926489 (+   502us) service_pool.cc:224] Handling call
0709 13:08:08.926812 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.925701 (+1998889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.289087 (+363386us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b5400120cd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:11.289298 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4428420864}
I20260709 13:08:11.282059 18902 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:11.291611 18902 raft_consensus.cc:697] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:11.291879 18658 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:11.292836 18902 consensus_queue.cc:237] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.284358 18428 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:11.296260 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3435) took 2126 ms. Trace:
I20260709 13:08:11.295481 18870 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:11.297969 18863 raft_consensus.cc:3055] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:11.298410 18863 raft_consensus.cc:740] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:11.299446 19001 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:11.300040 18994 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:11.300473 18994 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:11.301059 18994 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:11.301194 14395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 1644) took 1630 ms (client timeout 1734 ms). Trace:
I20260709 13:08:11.301828 18712 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:11.299378 18863 consensus_queue.cc:260] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.300395 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.303546 18863 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:11.296661 13860 rpcz_store.cc:276] 0709 13:08:09.169856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.170002 (+   146us) service_pool.cc:224] Handling call
0709 13:08:10.963452 (+1793450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.963877 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.963906 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:10.963965 (+    59us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:10.964002 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.964071 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.295970 (+331899us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54002d8cd0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:11.296089 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4118946048}
W20260709 13:08:11.307744 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 111670us
W20260709 13:08:11.301649 14395 rpcz_store.cc:269] 0709 13:08:09.670875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.671132 (+   257us) service_pool.cc:224] Handling call
0709 13:08:11.300944 (+1629812us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54009169d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:11.301108 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":569145600}
I20260709 13:08:11.304396 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:11.305172 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.317371 13757 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:11.319027 19051 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:11.319268 13864 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:08:11.321458 18664 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:11.324553 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 45205.5us
W20260709 13:08:11.326269 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 43666.1us
I20260709 13:08:11.329950 13757 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:11.329793 13858 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:08:11.337574 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:11.338416 14399 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:11.340664 14367 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:11.339718 18834 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:11.342981 19038 leader_election.cc:290] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:11.325923 19010 consensus_queue.cc:1059] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:08:11.385016 13757 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:11.385713 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.387837 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:11.388662 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.391048 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.394311 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1304) took 1309 ms. Trace:
I20260709 13:08:11.395016 18494 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:11.395633 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 70378.8us
I20260709 13:08:11.344674 18658 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:11.399710 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.401247 18678 consensus_queue.cc:1059] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:11.403332 18398 raft_consensus.cc:3055] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:08:11.407738 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.408439 18698 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:11.413748 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.415940 18973 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:11.416313 18978 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:11.339406 18819 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.418560 18968 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:11.422540 13862 rpcz_store.cc:276] 0709 13:08:10.084842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.663540 (+578698us) service_pool.cc:224] Handling call
0709 13:08:10.663877 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.051879 (+388002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:11.051930 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:11.051992 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:11.052053 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.393942 (+341889us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b540024f254. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:11.393986 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.394157 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":880713472}
I20260709 13:08:11.402961 19016 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:11.431311 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 46370.6us
W20260709 13:08:11.431170 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 53722.7us
I20260709 13:08:11.448666 14402 raft_consensus.cc:1240] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:11.427115 18398 raft_consensus.cc:740] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:08:11.485163 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 48124.6us
I20260709 13:08:11.491958 13860 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:11.498543 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.499366 14395 raft_consensus.cc:1240] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:11.499951 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.494336 13711 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:08:11.499259 13858 raft_consensus.cc:2393] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 15: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:11.495090 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:11.506006 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 55288us
I20260709 13:08:11.481335 18834 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:11.428820 18978 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:11.525916 19009 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.625s	user 0.020s	sys 0.011s
W20260709 13:08:11.526432 19009 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.703s	user 0.020s	sys 0.011s
I20260709 13:08:11.526266 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:11.528103 14394 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:11.528734 14400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1808) took 2770 ms. Trace:
I20260709 13:08:11.529350 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:11.532418 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:11.532848 19016 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:11.499872 18698 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.533730 13785 raft_consensus.cc:2410] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:11.534512 19051 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:11.491706 18968 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:11.497184 18894 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.932s	user 0.027s	sys 0.026s
W20260709 13:08:11.556836 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.550611 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:11.556103 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:11.536947 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.585098 13785 raft_consensus.cc:1240] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:11.614365 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.536154 13789 raft_consensus.cc:1240] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 12. Current term is 14. Ops: [12.9-12.9]
I20260709 13:08:11.582907 13829 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:11.547878 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.566689 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.563783 13790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2926) took 2545 ms. Trace:
I20260709 13:08:11.585995 13791 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:08:11.528131 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.617591 13790 rpcz_store.cc:276] 0709 13:08:09.018345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.019254 (+   909us) service_pool.cc:224] Handling call
0709 13:08:09.019528 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.664764 (+1645236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.492075 (+827311us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400161a54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:11.563575 (+ 71500us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2653831552}
I20260709 13:08:11.529131 14400 rpcz_store.cc:276] 0709 13:08:08.757803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.758583 (+   780us) service_pool.cc:224] Handling call
0709 13:08:08.758943 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.969039 (+210096us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.969087 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:08.969140 (+    53us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:08:08.969181 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.505600 (+2536419us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b540044fcd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:11.514964 (+  9364us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.528555 (+ 13591us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482575232}
I20260709 13:08:11.513896 18834 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:11.547070 18997 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 13:08:11.633898 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:11.634164 18834 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:11.634744 13784 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:11.550837 18985 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:11.635845 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:11.635878 18985 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.637249 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:11.574353 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:11.638948 18985 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:11.580487 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:11.537273 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:11.535266 19051 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:11.638370 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:11.640672 13784 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
W20260709 13:08:11.640784 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 58012.8us
I20260709 13:08:11.641304 18428 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.641781 19051 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:11.547780 19056 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:08:11.644210 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.645825 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:11.646523 13713 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:11.648286 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.649591 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.556173 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:11.650640 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.563391 18643 raft_consensus.cc:3055] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:11.556854 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:11.651757 18643 raft_consensus.cc:740] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:11.651814 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.652719 13707 raft_consensus.cc:2410] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:08:11.652915 18643 consensus_queue.cc:260] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.654012 18643 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:11.654088 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:11.654887 14397 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:08:11.536732 18819 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:11.655789 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:11.537761 18398 consensus_queue.cc:260] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.551029 19002 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:11.643548 19016 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.656782 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.656091 18664 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:11.615928 18894 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.051s	user 0.028s	sys 0.027s
I20260709 13:08:11.583343 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:11.556628 19061 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:11.656741 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.586210 18978 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:11.566138 18889 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:11.545090 18755 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.123s
I20260709 13:08:11.667569 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:11.667564 18973 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:11.673347 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:11.535334 18698 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:11.662184 13713 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:08:11.584594 18994 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.820096 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:11.777475 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:11.701140 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.820976 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.838428 13789 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:11.825374 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 63490.3us
I20260709 13:08:11.738718 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.836640 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.542694 18896 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:11.778891 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:11.770299 13609 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57116 (request call id 255) took 11571 ms (client timeout 15000 ms). Trace:
I20260709 13:08:11.762704 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:11.836874 14397 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:11.702875 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:11.749243 13755 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:11.712153 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.724606 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:11.820590 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 58111.7us
I20260709 13:08:11.784899 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:11.850703 13708 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:11.837954 13715 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:11.854462 13860 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:08:11.551128 18952 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:08:11.858739 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 308201us
W20260709 13:08:11.859988 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 195864us
I20260709 13:08:11.862015 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:11.773221 13613 catalog_manager.cc:5697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 9 to 10, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 10 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:11.864640 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:11.680236 18664 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:11.868120 13712 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:08:11.700670 18428 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:11.771268 19045 raft_consensus.cc:3055] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:11.739981 18997 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:11.874693 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:11.591301 18959 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.877863 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.879801 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.880026 13682 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:11.881745 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:11.882313 18944 raft_consensus.cc:3055] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:11.854442 18863 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.887403 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.890793 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:11.771598 19002 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:11.818262 18834 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:11.892729 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:11.888948 14368 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:11.886746 13707 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:11.897305 13712 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:11.897949 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.898543 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.898772 13707 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:08:11.877717 19045 raft_consensus.cc:740] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:11.900322 19045 consensus_queue.cc:260] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:11.900861 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.901374 19045 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:11.901849 18994 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:11.902070 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.902464 18902 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:11.903093 18902 raft_consensus.cc:697] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:08:11.903601 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 44057.1us
I20260709 13:08:11.904088 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.904378 13682 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:11.904726 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.903299 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.893874 14393 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:08:11.905414 13713 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:11.906040 13712 raft_consensus.cc:2410] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:08:11.906040 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:11.896447 13784 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:08:11.908118 13785 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:11.894505 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:11.871850 18664 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:11.882475 14366 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 2.125s (SENT) [suppressed 6 similar messages]
I20260709 13:08:11.910459 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.821803 18968 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:11.916181 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:11.916431 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:11.916548 14398 raft_consensus.cc:1240] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:11.916729 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.916873 13787 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:08:11.917143 14393 raft_consensus.cc:2393] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 10: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:11.890910 18944 raft_consensus.cc:740] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:11.918015 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1793) took 3531 ms. Trace:
I20260709 13:08:11.917862 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.918447 14398 rpcz_store.cc:276] 0709 13:08:08.386574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.386736 (+   162us) service_pool.cc:224] Handling call
0709 13:08:08.387158 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.912528 (+3525370us) spinlock_profiling.cc:243] Waited 880 us on lock 0x7b5400147420. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f5232455dc0 00007f52324e01c0 00007f52324e1231 00007f52324ddd8f 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c
0709 13:08:11.917067 (+  4539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.917785 (+   718us) spinlock_profiling.cc:243] Waited 2.95 s on lock 0x7b54005145d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:11.917959 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6792995968}
I20260709 13:08:11.919040 13716 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:08:11.910871 19001 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:11.919692 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.919960 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.919715 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.920532 13713 raft_consensus.cc:2410] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:08:11.922427 18398 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:11.922641 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:11.922704 13712 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:11.922835 14397 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 23.
I20260709 13:08:11.920188 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:11.917886 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:11.925949 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:11.929066 13788 raft_consensus.cc:1240] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:11.932473 14400 raft_consensus.cc:2393] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 11: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:11.933462 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:11.918215 18944 consensus_queue.cc:260] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.934556 18944 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:11.934960 14397 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:08:11.936389 14397 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:11.937467 14397 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:11.904161 18902 consensus_queue.cc:237] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.940829 13755 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:11.888288 18952 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:11.943141 18942 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:11.943795 18942 raft_consensus.cc:697] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:11.943536 18863 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.944954 18952 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:11.944797 18942 consensus_queue.cc:237] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.945616 13711 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:08:11.946193 18863 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:11.919759 19001 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:11.947356 19001 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.950062 19002 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:11.950627 14401 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.002s	sys 0.021s
W20260709 13:08:11.950985 14401 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.003s	sys 0.021s
I20260709 13:08:11.868880 18973 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.952601 18834 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:11.952726 18894 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.953524 18973 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:11.953326 18894 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.946275 13715 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:11.919132 18959 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:11.766501 19016 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:11.956950 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:11.961670 14393 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
W20260709 13:08:11.843292 13609 rpcz_store.cc:269] 0709 13:08:00.199166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.199521 (+   355us) service_pool.cc:224] Handling call
0709 13:08:11.770080 (+11570559us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:02.774195 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:02.775054 (+   859us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:02.775115 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:08:02.775141 (+    26us) tablet.cc:662] Decoding operations
0709 13:08:02.776265 (+  1124us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:02.776372 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:02.776403 (+    31us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:08:02.854295 (+ 77892us) tablet.cc:701] Row locks acquired
0709 13:08:02.864604 (+ 10309us) write_op.cc:260] PREPARE: finished
0709 13:08:02.888606 (+ 24002us) write_op.cc:270] Start()
0709 13:08:02.888819 (+   213us) write_op.cc:276] Timestamp: P: 1783602482871605 usec, L: 0
0709 13:08:02.888843 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:08:02.898442 (+  9599us) log.cc:844] Serialized 2835 byte log entry
0709 13:08:03.664144 (+765702us) op_driver.cc:464] REPLICATION: finished
0709 13:08:04.220469 (+556325us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f522f3d40ac 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f5235f14ef0
0709 13:08:04.652467 (+431998us) write_op.cc:301] APPLY: starting
0709 13:08:04.669051 (+ 16584us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:05.144906 (+475855us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:05.144934 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:06.247081 (+1102147us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:06.270824 (+ 23743us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:08:06.275974 (+  5150us) write_op.cc:312] APPLY: finished
0709 13:08:06.312992 (+ 37018us) log.cc:844] Serialized 73 byte log entry
0709 13:08:06.548901 (+235909us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:06.555336 (+  6435us) write_op.cc:454] Released schema lock
0709 13:08:06.566669 (+ 11333us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:06.617080 (+ 50411us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:06.621527 (+  4447us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1309919,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":858507,"apply.run_cpu_time_us":103555,"apply.run_wall_time_us":2039933,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33387,"num_ops":7,"prepare.queue_time_us":179885,"prepare.run_cpu_time_us":28512,"prepare.run_wall_time_us":300362,"raft.queue_time_us":302965,"raft.run_cpu_time_us":18969,"raft.run_wall_time_us":994297,"replication_time_us":706975,"spinlock_wait_cycles":25212288,"thread_start_us":1511567,"threads_started":5,"wal-append.queue_time_us":550373,"wal-append.run_cpu_time_us":78701,"wal-append.run_wall_time_us":2391187}]]}
I20260709 13:08:11.954504 13613 catalog_manager.cc:5697] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 10 to 11, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 11 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:11.969734 14400 raft_consensus.cc:1240] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:11.972769 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:11.974108 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:11.975724 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 86885.1us
I20260709 13:08:11.977540 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:11.982777 13788 raft_consensus.cc:1240] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:11.955955 19012 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:11.991008 13784 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:12.000875 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:11.993605 14394 raft_consensus.cc:2376] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12. Re-sending same reply.
I20260709 13:08:11.998202 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:12.009930 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:12.010751 13859 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.013856 13785 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:11.983299 18994 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:12.005822 13680 leader_election.cc:400] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8.
I20260709 13:08:12.017021 13680 leader_election.cc:403] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:08:12.019121 13791 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 2429) took 3408 ms (client timeout 1605 ms). Trace:
I20260709 13:08:12.024788 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:12.024364 13791 rpcz_store.cc:269] 0709 13:08:08.585821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.587224 (+  1403us) service_pool.cc:224] Handling call
0709 13:08:11.981638 (+3394414us) spinlock_profiling.cc:243] Waited 2.99 s on lock 0x7b54000b1b54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:11.993645 (+ 12007us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6878348672}
I20260709 13:08:12.033143 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:11.989714 18968 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.036738 13708 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:08:12.040393 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:12.046034 13788 raft_consensus.cc:2393] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 9: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:12.006637 18755 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.043258 13682 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:12.037174 13708 pending_rounds.cc:85] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 8
I20260709 13:08:12.044692 18994 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:12.048611 13864 raft_consensus.cc:2393] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 17: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:12.054590 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:12.050709 13682 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:12.056919 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:12.060135 18664 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:12.062467 18664 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:12.063114 13858 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
W20260709 13:08:12.064086 19072 log.cc:927] Time spent T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:12.040567 18944 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 7. Current term is 8.
I20260709 13:08:12.067224 18894 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:12.067979 18994 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:12.068809 18755 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:12.055011 14368 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:12.085566 14399 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.030s	sys 0.024s
W20260709 13:08:12.087894 14399 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.031s	sys 0.025s
I20260709 13:08:12.087021 13785 raft_consensus.cc:2393] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 15: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:12.051906 13708 pending_rounds.cc:107] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:08:12.090360 13708 raft_consensus.cc:2889] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:12.074774 18947 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.024s	sys 0.023s
I20260709 13:08:12.088084 13682 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:12.097910 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:12.072265 18863 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:12.106101 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.112498 13862 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:12.084968 18944 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:12.048293 19002 consensus_queue.cc:1059] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 13:08:12.092374 18947 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.024s	sys 0.023s
W20260709 13:08:12.085182 19009 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.025s	sys 0.054s
I20260709 13:08:12.120791 14367 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:12.117093 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:12.114025 18755 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:12.123044 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:12.122202 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:12.098640 19012 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:12.128989 14400 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:12.130869 14396 raft_consensus.cc:1240] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:12.131999 19016 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:12.133642 13783 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 24.
W20260709 13:08:12.128137 19009 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.027s	sys 0.054s
I20260709 13:08:12.125795 18952 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:12.137909 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:12.139726 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:12.139842 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:12.140609 13858 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.143683 13709 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:08:12.146222 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 217670us
W20260709 13:08:12.148600 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.108363 18863 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:12.075311 18968 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:12.150353 13757 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:12.154487 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 66496.4us
I20260709 13:08:12.156867 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:12.162456 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:12.166491 13785 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:12.115200 18944 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:08:12.174407 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.153192 18961 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:12.220747 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 58048.8us
I20260709 13:08:12.157155 18863 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:12.216791 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 45012.8us
I20260709 13:08:12.216414 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:12.229002 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:12.229836 14394 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:12.156826 19012 raft_consensus.cc:697] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 11 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:12.232702 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:12.245236 14367 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:12.248749 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:12.248831 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:12.250180 13708 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:12.253922 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:12.259502 14395 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:08:12.219961 18944 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.145995 18959 consensus_queue.cc:1059] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.085s
I20260709 13:08:12.272655 13789 raft_consensus.cc:2410] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
W20260709 13:08:12.284196 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 62519.5us
I20260709 13:08:12.285157 14367 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:12.286774 13859 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:12.222004 18947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59764 (request call id 92) took 14680 ms. Trace:
I20260709 13:08:12.308305 18959 raft_consensus.cc:3055] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:12.308900 18959 raft_consensus.cc:740] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:12.309944 18959 consensus_queue.cc:260] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:12.314504 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:12.315099 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.315320 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:12.317682 14367 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:12.318293 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:12.319829 13789 raft_consensus.cc:1240] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:12.320040 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:12.322994 18952 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:12.323657 18952 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:12.324250 18952 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:12.333391 14367 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:12.338814 14367 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:12.339977 14400 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:08:12.340361 14367 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:12.353730 14398 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:12.351900 14367 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:12.338450 18961 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:12.376564 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:12.370965 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:12.371961 14394 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:12.338366 18973 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:12.351141 18698 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:12.375772 13755 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:12.388053 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 134228us
I20260709 13:08:12.379830 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:12.360167 19017 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:12.398110 19002 consensus_queue.cc:1059] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:12.387277 18810 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:12.410283 13755 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:12.380600 18973 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.381116 18968 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:12.417788 13755 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:12.389221 18698 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:12.392747 18959 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.424456 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:12.428748 13791 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 24.
I20260709 13:08:12.394750 19017 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:12.382244 19001 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:12.422842 18658 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:12.414711 18678 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.423671 18973 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.433238 13680 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:12.433864 18658 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.428551 18698 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:12.430042 19045 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:12.450152 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:12.451072 13709 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:08:12.432719 19017 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.453193 13858 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:08:12.463821 13787 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:12.444489 18658 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.471709 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:12.489979 13782 consensus_meta.cc:287] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.001s
I20260709 13:08:12.389362 19012 consensus_queue.cc:237] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:12.490510 13782 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:08:12.493980 13790 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
W20260709 13:08:12.497205 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:12.497649 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:12.490185 14366 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.006s	sys 0.022s
W20260709 13:08:12.499979 14366 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.006s	sys 0.022s
W20260709 13:08:12.500336 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 617850us
W20260709 13:08:12.489606 19075 log.cc:927] Time spent T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 13:08:12.501190 13713 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.002s	sys 0.065s
W20260709 13:08:12.505999 13829 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.007s	sys 0.022s
W20260709 13:08:12.506196 13713 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.002s	sys 0.065s
W20260709 13:08:12.506580 13829 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.008s	sys 0.023s
W20260709 13:08:12.507285 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 622814us
I20260709 13:08:12.460526 19045 raft_consensus.cc:697] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:12.446710 19016 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
W20260709 13:08:12.513139 13714 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.011s	sys 0.017s
W20260709 13:08:12.517838 13714 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.012s	sys 0.017s
W20260709 13:08:12.516363 13716 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.015s	sys 0.014s
I20260709 13:08:12.538728 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:12.539821 13716 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.015s	sys 0.015s
W20260709 13:08:12.536026 14397 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.009s	sys 0.024s
W20260709 13:08:12.541208 14397 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.009s	sys 0.024s
W20260709 13:08:12.550500 18902 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.019s	sys 0.017s
W20260709 13:08:12.557053 18902 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.019s	sys 0.017s
I20260709 13:08:12.559579 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:12.568462 19073 log.cc:927] Time spent T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:12.570446 14399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1648) took 1152 ms. Trace:
I20260709 13:08:12.312492 18947 rpcz_store.cc:276] 0709 13:07:57.495222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.514984 (+ 19762us) service_pool.cc:224] Handling call
0709 13:07:57.625276 (+110292us) spinlock_profiling.cc:243] Waited 53.6 ms on lock 0x7b2c000cc698. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5230dd7a11 00007f5230de6a0a 00007f5230de6693 00007f5230de6631 00007f5232519902 00007f52325196dd 00007f52324e4f3f 00007f52324e46b3 00007f52324dc9fa 00007f52374a44c9 00007f5230a20c54
0709 13:07:57.726638 (+101362us) log.cc:844] Serialized 501 byte log entry
0709 13:07:59.935349 (+2208711us) spinlock_profiling.cc:243] Waited 8.06 ms on lock 0x7b54001dac20. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f523245eb26 00007f523245849a 00007f5232457714 00007f5232437eaa 00007f523243ed53 00007f523243ecd9 00007f523243ec69 00007f523243ec31 00007f523243ddfd 000000000038f354
0709 13:08:00.062356 (+127007us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b54001dac20. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f5232457142 00007f5232437eaa 00007f523243ed53 00007f523243ecd9 00007f523243ec69 00007f523243ec31 00007f523243ddfd 000000000038f354 000000000038f199 00007f522f3f1475
0709 13:08:12.161041 (+12098685us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4294,"raft.queue_time_us":7318,"raft.run_cpu_time_us":246190,"raft.run_wall_time_us":4315616,"spinlock_wait_cycles":149438464,"thread_start_us":181451,"threads_started":1,"wal-append.queue_time_us":487784,"wal-append.run_cpu_time_us":2431,"wal-append.run_wall_time_us":1119058}
I20260709 13:08:12.575338 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:12.570973 14399 rpcz_store.cc:276] 0709 13:08:11.417565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.417686 (+   121us) service_pool.cc:224] Handling call
0709 13:08:11.418033 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:11.418457 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:11.418487 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:11.419026 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:08:12.091048 (+672022us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:12.091088 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.091151 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.570122 (+478971us) raft_consensus.cc:1685] finished
0709 13:08:12.570140 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.570356 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":249,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":671259,"threads_started":1,"wal-append.queue_time_us":1017348}
W20260709 13:08:12.595690 13784 consensus_meta.cc:287] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.000s
I20260709 13:08:12.596405 13784 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:08:12.610136 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:12.610760 19078 log.cc:927] Time spent T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:08:12.617782 14393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.010s	sys 0.023s
W20260709 13:08:12.621766 13715 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.000s	sys 0.021s
W20260709 13:08:12.634579 13715 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.000s	sys 0.021s
W20260709 13:08:12.632843 14393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.011s	sys 0.024s
I20260709 13:08:12.642172 13790 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
W20260709 13:08:12.653571 13788 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.002s	sys 0.030s
I20260709 13:08:12.577666 18944 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:12.654804 13788 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.002s	sys 0.030s
W20260709 13:08:12.638823 18894 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.002s	sys 0.026s
W20260709 13:08:12.657532 14366 leader_election.cc:336] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.534s (SENT)
I20260709 13:08:12.661087 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:12.658699 18894 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.002s	sys 0.026s
W20260709 13:08:12.658983 13710 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.015s	sys 0.013s
W20260709 13:08:12.666574 13710 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.015s	sys 0.013s
W20260709 13:08:12.671572 13786 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.072s	user 0.010s	sys 0.036s
W20260709 13:08:12.672013 13786 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.089s	user 0.010s	sys 0.036s
I20260709 13:08:12.674249 18944 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:12.676112 18398 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:12.677541 18398 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:12.678072 18398 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:12.619217 18952 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:12.705562 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 48060.9us
I20260709 13:08:12.707310 13790 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:08:12.615976 19045 consensus_queue.cc:237] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:12.658002 19001 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:12.743800 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:12.733800 19001 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:12.759341 13830 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.025s	sys 0.021s
W20260709 13:08:12.759897 13830 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.025s	sys 0.022s
W20260709 13:08:12.760648 14401 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.004s	sys 0.010s
W20260709 13:08:12.760972 14401 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.004s	sys 0.010s
I20260709 13:08:12.737851 18948 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:12.776048 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:12.752847 18942 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.000s	sys 0.070s
I20260709 13:08:12.783807 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:12.786742 14396 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:12.775520 14401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1824) took 1703 ms. Trace:
I20260709 13:08:12.788877 14400 raft_consensus.cc:1240] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:12.752260 18679 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:12.791438 13865 raft_consensus.cc:1240] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:12.791307 18679 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:12.791895 19081 log.cc:927] Time spent T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:08:12.840046 14402 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:12.850768 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:12.778779 18810 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:12.778813 18942 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.000s	sys 0.070s
I20260709 13:08:12.852032 14396 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.757897 19001 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:12.863574 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:12.864401 13787 raft_consensus.cc:2376] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7. Re-sending same reply.
W20260709 13:08:12.852195 18863 consensus_meta.cc:287] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.010s
I20260709 13:08:12.856549 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:12.856784 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:12.852391 13613 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.012s	sys 0.019s
W20260709 13:08:12.920585 13613 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.013s	sys 0.019s
I20260709 13:08:12.924991 13864 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 11: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:12.788022 14401 rpcz_store.cc:276] 0709 13:08:11.072156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.072304 (+   148us) service_pool.cc:224] Handling call
0709 13:08:11.072645 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.072990 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:11.122834 (+ 49844us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.771108 (+1648274us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.775140 (+  4032us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:12.775202 (+    62us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:12.775251 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.775324 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.775461 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43570,"prepare.queue_time_us":144662,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":12682,"raft.queue_time_us":55747,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":18371,"thread_start_us":1603720,"threads_started":3,"wal-append.queue_time_us":996689}
I20260709 13:08:12.777429 18948 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:12.934659 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:12.855146 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 421967us
I20260709 13:08:12.937000 13680 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:12.866096 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:12.940055 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:12.940122 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 1255) took 1065 ms. Trace:
I20260709 13:08:12.942734 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:12.943372 13782 raft_consensus.cc:2376] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8. Re-sending same reply.
I20260709 13:08:12.934798 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:12.946165 13679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.019s	sys 0.033s
W20260709 13:08:12.947088 13679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.019s	sys 0.034s
I20260709 13:08:12.958050 13680 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:12.957446 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 1331) took 1057 ms. Trace:
I20260709 13:08:12.964236 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:12.929569 18952 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:12.963474 13716 rpcz_store.cc:276] 0709 13:08:11.881176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.920927 (+ 39751us) service_pool.cc:224] Handling call
0709 13:08:11.921267 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:11.921496 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:11.921521 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:11.922048 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:08:12.540402 (+618354us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:12.540460 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.540554 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.938526 (+397972us) raft_consensus.cc:1685] finished
0709 13:08:12.938554 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.938716 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":617891,"threads_started":1,"wal-append.queue_time_us":813721}
I20260709 13:08:12.940714 14397 rpcz_store.cc:276] 0709 13:08:11.874467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.938884 (+ 64417us) service_pool.cc:224] Handling call
0709 13:08:11.939102 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.939378 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:12.543475 (+604097us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.939730 (+396255us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:12.939786 (+    56us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:12.939848 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.939918 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.940057 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":820426,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"thread_start_us":976099,"threads_started":2}
I20260709 13:08:12.977728 14397 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:12.980180 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:12.852665 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 500841us
W20260709 13:08:12.982856 19068 log.cc:927] Time spent T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:08:12.942401 18658 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:12.988677 13784 raft_consensus.cc:2393] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 11: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:12.991174 18679 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:12.924436 18863 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:12.957252 18978 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:12.965126 18997 raft_consensus.cc:3055] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:08:13.007447 14366 leader_election.cc:336] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.654s (SENT)
I20260709 13:08:13.008018 14366 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:13.020217 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 62258.3us
I20260709 13:08:13.022365 13680 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:13.029925 14396 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
W20260709 13:08:12.992282 18961 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.012s	sys 0.036s
I20260709 13:08:13.046573 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:13.044813 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:13.010288 18997 raft_consensus.cc:740] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:08:13.038210 18961 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.012s	sys 0.036s
W20260709 13:08:13.060992 13711 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.007s	sys 0.010s
W20260709 13:08:13.061410 13711 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.007s	sys 0.010s
I20260709 13:08:13.062374 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:13.066761 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 94347.9us
I20260709 13:08:13.068249 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1835) took 1125 ms. Trace:
I20260709 13:08:13.041643 18968 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.109758 13830 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:13.058306 18961 raft_consensus.cc:697] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:13.060315 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2452) took 1177 ms. Trace:
I20260709 13:08:13.111888 13830 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:13.052723 14367 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:13.116801 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 71965.7us
W20260709 13:08:13.068743 19002 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.007s	sys 0.025s
I20260709 13:08:13.135898 13680 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:13.131204 13715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2615) took 1122 ms. Trace:
I20260709 13:08:13.148401 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:13.149277 13782 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:08:13.145219 13715 rpcz_store.cc:276] 0709 13:08:11.995193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.995406 (+   213us) service_pool.cc:224] Handling call
0709 13:08:12.012069 (+ 16663us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.036184 (+ 24115us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:12.644201 (+608017us) log.cc:844] Serialized 14 byte log entry
0709 13:08:13.117437 (+473236us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:13.117504 (+    67us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:13.117546 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.117615 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.117728 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":697018,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"thread_start_us":1033494,"threads_started":2}
I20260709 13:08:13.118073 13788 rpcz_store.cc:276] 0709 13:08:11.883223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.053647 (+170424us) service_pool.cc:224] Handling call
0709 13:08:12.069796 (+ 16149us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.070005 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:12.659731 (+589726us) log.cc:844] Serialized 14 byte log entry
0709 13:08:13.056632 (+396901us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:13.056710 (+    78us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:13.060057 (+  3347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.060144 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.060261 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":862077,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":13580,"raft.queue_time_us":10197,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":15649,"thread_start_us":965166,"threads_started":2}
I20260709 13:08:13.184782 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:13.073781 18952 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:13.158694 19094 log.cc:927] Time spent T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:08:13.127375 18942 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:13.141095 19002 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.009s	sys 0.025s
I20260709 13:08:13.203323 13755 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:08:13.207355 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 154664us
W20260709 13:08:13.210600 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 98769.7us
I20260709 13:08:13.211361 13830 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:13.071571 14393 rpcz_store.cc:276] 0709 13:08:11.942865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.962336 (+ 19471us) service_pool.cc:224] Handling call
0709 13:08:11.962673 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:12.001843 (+ 39170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.001884 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:12.028520 (+ 26636us) log.cc:844] Serialized 52 byte log entry
0709 13:08:12.651886 (+623366us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:13.047978 (+396092us) log.cc:844] Serialized 14 byte log entry
0709 13:08:13.067797 (+ 19819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.067927 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:13.067976 (+    49us) raft_consensus.cc:1685] finished
0709 13:08:13.067987 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.068175 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61629,"prepare.queue_time_us":276906,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":42,"raft.queue_time_us":38557,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":4154,"thread_start_us":859034,"threads_started":2,"wal-append.queue_time_us":887599}
I20260709 13:08:13.176496 19099 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:13.129246 18968 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:13.257681 14367 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:13.260516 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:13.261349 13712 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.262616 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:13.211992 18679 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:13.264261 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2612) took 1378 ms. Trace:
W20260709 13:08:13.265820 13714 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.006s	sys 0.014s
W20260709 13:08:13.267035 13714 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.006s	sys 0.014s
W20260709 13:08:13.272059 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 136418us
I20260709 13:08:13.266459 13713 rpcz_store.cc:276] 0709 13:08:11.886043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.921123 (+ 35080us) service_pool.cc:224] Handling call
0709 13:08:11.921410 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.921602 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:12.506907 (+585305us) log.cc:844] Serialized 14 byte log entry
0709 13:08:13.263662 (+756755us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:13.263776 (+   114us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:13.263851 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.263979 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.264175 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39343,"prepare.queue_time_us":800955,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":1519,"spinlock_wait_cycles":20096,"thread_start_us":1258373,"threads_started":3,"wal-append.queue_time_us":662336}
I20260709 13:08:13.276217 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:13.276851 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 65559us
I20260709 13:08:13.277642 13830 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:13.280144 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2614) took 1319 ms. Trace:
I20260709 13:08:13.282523 13709 raft_consensus.cc:2955] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:13.245568 19001 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:13.287904 14401 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:08:13.301532 13716 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:13.280668 13714 rpcz_store.cc:276] 0709 13:08:11.960931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.961067 (+   136us) service_pool.cc:224] Handling call
0709 13:08:11.968781 (+  7714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.969005 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:12.519842 (+550837us) log.cc:844] Serialized 14 byte log entry
0709 13:08:13.279682 (+759840us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:13.279753 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:13.279819 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.279907 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.280058 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2256,"prepare.queue_time_us":755747,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"thread_start_us":1248543,"threads_started":2}
W20260709 13:08:13.307144 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 49695.4us
I20260709 13:08:13.254134 18658 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:13.299713 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 292296us
I20260709 13:08:13.286157 19108 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:08:13.319638 18893 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.001s	sys 0.015s
I20260709 13:08:13.317473 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:13.309321 19099 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:13.265913 18679 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:13.306495 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 65583.3us
I20260709 13:08:13.270820 19097 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:13.377439 13707 raft_consensus.cc:2393] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 8: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:08:13.365053 18973 consensus_meta.cc:287] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.909s	user 0.013s	sys 0.000s
I20260709 13:08:13.268637 19104 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:13.356926 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 1336) took 1357 ms. Trace:
I20260709 13:08:13.361886 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:13.352990 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:13.365847 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 47687.5us
I20260709 13:08:13.300822 18948 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:13.315528 19001 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:08:13.355762 18398 consensus_meta.cc:287] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.677s	user 0.005s	sys 0.010s
I20260709 13:08:13.323032 19002 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:08:13.300606 18961 consensus_queue.cc:237] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:13.380641 19103 log.cc:927] Time spent T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
I20260709 13:08:13.381449 13708 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:13.377795 18679 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:13.374395 18893 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.003s	sys 0.022s
W20260709 13:08:13.387949 19110 log.cc:927] Time spent T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 13:08:13.400555 18968 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:13.452385 18398 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:13.481494 19132 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.104s
I20260709 13:08:13.482792 18968 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.482933 19132 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:13.406030 18959 consensus_meta.cc:287] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.970s	user 0.009s	sys 0.001s
I20260709 13:08:13.269767 18942 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:13.413142 13712 raft_consensus.cc:2410] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 13:08:13.417964 19120 log.cc:927] Time spent T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:08:13.417876 19108 raft_consensus.cc:697] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:13.358024 19089 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:13.371341 19086 log.cc:927] Time spent T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.356s	user 0.001s	sys 0.000s
I20260709 13:08:13.356595 19125 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:13.436534 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 58014.8us
I20260709 13:08:13.452745 19002 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.438634 19001 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:13.420644 19012 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.483398 18968 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:13.413338 13711 rpcz_store.cc:276] 0709 13:08:12.000023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.000533 (+   510us) service_pool.cc:224] Handling call
0709 13:08:12.016032 (+ 15499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.027995 (+ 11963us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:12.425418 (+397423us) log.cc:844] Serialized 14 byte log entry
0709 13:08:13.356460 (+931042us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:13.356533 (+    73us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:13.356606 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.356695 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.356852 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":709756,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":233675,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":18851,"thread_start_us":1282918,"threads_started":3}
W20260709 13:08:13.496800 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.465056 19099 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:13.502241 18948 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:08:13.502467 19118 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:08:13.527661 19012 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:13.428210 18973 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:13.545002 19118 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:08:13.548568 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.504582 19002 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:13.518297 19001 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:13.552112 19102 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.503046 19129 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:13.533914 19099 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.565851 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:13.537786 18398 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:13.563859 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:13.579372 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:13.575476 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 302735us
I20260709 13:08:13.576756 14393 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:13.583038 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:13.583796 14394 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:13.578071 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:13.517813 19132 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:13.585956 13782 raft_consensus.cc:2376] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11. Re-sending same reply.
W20260709 13:08:13.586117 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.575500 14366 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:13.587822 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 1237) took 1156 ms. Trace:
W20260709 13:08:13.569370 18698 consensus_meta.cc:287] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 1.079s	user 0.014s	sys 0.000s
I20260709 13:08:13.596868 19133 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:13.596710 18698 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:13.597337 19133 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.597762 19133 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.598317 18968 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:13.598788 18698 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:13.599607 19017 consensus_meta.cc:287] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 1.109s	user 0.013s	sys 0.000s
I20260709 13:08:13.600066 19017 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:13.602201 19017 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:13.602372 18973 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:13.555371 19125 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:08:13.591851 13791 rpcz_store.cc:276] 0709 13:08:12.431168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.431756 (+   588us) service_pool.cc:224] Handling call
0709 13:08:12.437090 (+  5334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.448640 (+ 11550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.448682 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:12.460225 (+ 11543us) log.cc:844] Serialized 26 byte log entry
0709 13:08:12.938484 (+478259us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:12.938537 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.938628 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:13.587538 (+648910us) raft_consensus.cc:1685] finished
0709 13:08:13.587566 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.587748 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":469985,"threads_started":1,"wal-append.queue_time_us":576217}
I20260709 13:08:13.612287 14398 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:13.578281 19099 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:13.575294 18643 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:13.581230 19129 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:13.553185 19005 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:08:13.630291 14393 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:08:13.592352 19137 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:08:13.651598 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 76203.2us
I20260709 13:08:13.652634 14366 leader_election.cc:304] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:13.655404 14366 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:13.659198 14394 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:13.628110 19119 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:08:13.661326 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 160479us
I20260709 13:08:13.668620 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:13.660764 18428 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:13.591231 19127 consensus_queue.cc:1059] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:08:13.671669 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:13.630407 18643 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:13.588874 19102 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:13.677443 19096 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:13.668629 19119 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:13.677724 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:13.678244 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:13.685628 14394 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 11: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:13.664987 18959 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.686333 14366 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:13.686252 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:13.669747 19012 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:13.690857 14397 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.013s	sys 0.046s
W20260709 13:08:13.691377 14397 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.014s	sys 0.046s
I20260709 13:08:13.645409 19108 consensus_queue.cc:237] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:13.691111 13710 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.022s	sys 0.036s
W20260709 13:08:13.743937 13710 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.027s	sys 0.053s
I20260709 13:08:13.735493 13680 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:13.678287 18942 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:13.662532 19137 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:13.746326 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 245146us
I20260709 13:08:13.678395 19017 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:13.690171 14366 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:13.763584 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:13.763657 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 76876.1us
I20260709 13:08:13.766274 13830 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:13.692468 18698 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:13.691114 19123 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:13.775095 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 85031.3us
I20260709 13:08:13.776645 18889 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:08:13.777573 13816 heartbeater.cc:646] Failed to heartbeat to 127.12.76.190:43389 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.12.76.190:43389 timed out after 15.000s (SENT)
I20260709 13:08:13.778595 18643 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:13.679807 18428 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:13.794127 13783 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:13.794729 18428 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:13.734751 18959 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:13.794783 19123 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:13.796680 19111 log.cc:927] Time spent T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:08:13.797180 19123 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:13.797195 18959 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:13.785293 14366 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:13.787550 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 52143.5us
I20260709 13:08:13.798506 19096 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:13.798722 19102 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:13.798957 19096 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:13.799037 13680 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:13.800343 14366 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:13.799376 19096 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.800742 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:13.801616 19144 consensus_queue.cc:1059] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:13.808511 19144 raft_consensus.cc:3055] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:13.808957 19144 raft_consensus.cc:740] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:13.809957 19144 consensus_queue.cc:260] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:13.790248 19132 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:13.802508 19123 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:13.811789 19123 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:13.688604 19145 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:13.812330 19107 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:13.812703 19145 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:13.814471 19144 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.774096 19017 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:13.689400 19045 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.116s
I20260709 13:08:13.812351 19123 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:13.826719 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1847) took 1387 ms. Trace:
I20260709 13:08:13.782574 19139 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:13.827543 19145 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:13.833670 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:13.834287 19137 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:13.834517 14397 raft_consensus.cc:2393] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 16: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:08:13.785318 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 153463us
I20260709 13:08:13.827160 14398 rpcz_store.cc:276] 0709 13:08:12.438867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.439041 (+   174us) service_pool.cc:224] Handling call
0709 13:08:12.452791 (+ 13750us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:13.612947 (+1160156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.826454 (+213507us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54009169d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:13.826653 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2666000128}
I20260709 13:08:13.817447 14366 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:13.813933 13680 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:13.784535 18961 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:13.815665 19017 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:13.847975 14397 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:13.858026 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 91796.7us
I20260709 13:08:13.859071 13830 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:13.859112 13709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2626) took 1365 ms. Trace:
I20260709 13:08:13.736806 19089 consensus_queue.cc:1059] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
I20260709 13:08:13.862303 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:13.862696 14397 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:13.864197 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 125328us
I20260709 13:08:13.864776 13791 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:13.864388 13757 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:13.865800 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:13.866416 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:13.867866 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:13.868839 13787 raft_consensus.cc:2393] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 15: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:08:13.868896 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 44752.4us
I20260709 13:08:13.869776 19145 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:08:13.870517 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 95907.5us
I20260709 13:08:13.870325 19145 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:13.860050 13709 rpcz_store.cc:276] 0709 13:08:12.493821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.493949 (+   128us) service_pool.cc:224] Handling call
0709 13:08:12.509773 (+ 15824us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:12.928179 (+418406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.928211 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:12.974094 (+ 45883us) log.cc:844] Serialized 527 byte log entry
0709 13:08:13.282346 (+308252us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:13.629128 (+346782us) log.cc:844] Serialized 14 byte log entry
0709 13:08:13.858118 (+228990us) log.cc:844] Serialized 14 byte log entry
0709 13:08:13.858692 (+   574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.858801 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:13.858859 (+    58us) raft_consensus.cc:1685] finished
0709 13:08:13.858876 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.859047 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":510805,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":26765,"thread_start_us":871182,"threads_started":3,"wal-append.queue_time_us":530187}
I20260709 13:08:13.815557 19119 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:13.835057 19132 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:13.866623 13788 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:08:13.943565 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:13.944545 13787 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:08:13.865041 18698 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:13.937451 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:13.861070 19147 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:13.857456 18961 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:13.931998 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 81352.3us
I20260709 13:08:13.875401 13757 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:08:13.937088 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 119593us
I20260709 13:08:13.876919 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:13.936573 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 64165.8us
I20260709 13:08:13.857066 19107 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:13.947988 13791 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:08:13.872478 19128 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:13.877449 19125 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:13.932703 18894 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:13.872483 19001 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:13.834519 19123 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:13.945880 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 76404.7us
I20260709 13:08:13.957401 18698 raft_consensus.cc:697] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:13.958750 13756 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:08:13.956570 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 91044.7us
I20260709 13:08:13.996337 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:13.963912 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:13.950891 19126 log.cc:927] Time spent T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:08:13.963008 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 87645us
I20260709 13:08:13.955065 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:13.963320 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:13.952140 18961 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.984572 13680 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:13.955639 19129 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:13.982396 13830 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:13.981451 18894 raft_consensus.cc:697] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:13.986902 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:14.023459 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:13.987857 19001 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:13.988478 19077 log.cc:927] Time spent T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 1.508s	user 0.005s	sys 0.001s
I20260709 13:08:14.045981 14399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 1261) took 1284 ms. Trace:
W20260709 13:08:14.046466 19130 log.cc:927] Time spent T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.543s	user 0.001s	sys 0.004s
I20260709 13:08:14.046968 13786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2943) took 2466 ms. Trace:
I20260709 13:08:13.990703 19139 consensus_queue.cc:1059] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:13.994383 14398 raft_consensus.cc:1240] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:14.047633 13786 rpcz_store.cc:276] 0709 13:08:11.580414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.580609 (+   195us) service_pool.cc:224] Handling call
0709 13:08:11.581072 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:11.581577 (+   505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:11.581615 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:11.582236 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 13:08:12.672416 (+1090180us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:12.672473 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.672573 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:13.987749 (+1315176us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:14.046695 (+ 58946us) raft_consensus.cc:1685] finished
0709 13:08:14.046715 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:14.046915 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2803,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":3295104,"thread_start_us":1089682,"threads_started":1,"wal-append.queue_time_us":897507}
I20260709 13:08:14.002775 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:14.002875 18978 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:14.000317 14397 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:08:14.050186 18978 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:14.004146 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:14.004701 19089 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:14.030833 19096 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:14.055001 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 50932.3us
I20260709 13:08:14.005188 18944 raft_consensus.cc:3055] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:14.055429 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:14.055716 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:14.056130 13709 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:08:14.056890 19125 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:14.057258 19125 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:14.057611 19125 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:14.057832 13829 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:14.058450 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:14.058880 19122 raft_consensus.cc:2764] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:08:14.059121 13712 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:08:14.059616 19122 consensus_queue.cc:1059] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:14.000496 18679 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:14.063482 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:14.008054 13863 raft_consensus.cc:3055] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:14.009270 14401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 1267) took 1226 ms. Trace:
I20260709 13:08:14.064244 14401 rpcz_store.cc:276] 0709 13:08:12.783095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.935494 (+152399us) service_pool.cc:224] Handling call
0709 13:08:14.009057 (+1073563us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b5400595bd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:14.009186 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":552738560}
I20260709 13:08:14.065035 19147 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:14.010890 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:14.064002 13863 raft_consensus.cc:740] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:08:14.065038 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 106372us
I20260709 13:08:14.056448 19096 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:13.985651 14366 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:14.015784 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 3074) took 2438 ms. Trace:
W20260709 13:08:14.015939 13784 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1247) took 1261 ms (client timeout 1517 ms). Trace:
I20260709 13:08:14.016515 19123 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:14.070647 13784 rpcz_store.cc:269] 0709 13:08:12.754540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.754760 (+   220us) service_pool.cc:224] Handling call
0709 13:08:14.015728 (+1260968us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b540026ded4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:14.015858 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":485473536}
I20260709 13:08:14.027921 18961 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.027963 19155 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:14.028188 18698 consensus_queue.cc:237] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.059924 18947 consensus_queue.cc:1059] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:08:14.023851 13755 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:14.029819 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:14.031232 18863 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:14.032215 18894 consensus_queue.cc:237] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:14.033159 18810 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:14.007241 19133 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.046591 14399 rpcz_store.cc:276] 0709 13:08:12.762076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.771399 (+  9323us) service_pool.cc:224] Handling call
0709 13:08:12.788528 (+ 17129us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.839624 (+ 51096us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.839652 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:12.856432 (+ 16780us) log.cc:844] Serialized 26 byte log entry
0709 13:08:13.037225 (+180793us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:13.056159 (+ 18934us) log.cc:844] Serialized 14 byte log entry
0709 13:08:13.065535 (+  9376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.065651 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:14.034971 (+969320us) spinlock_profiling.cc:243] Waited 8.63 ms on lock 0x7b1800055f60. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f13f3 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
0709 13:08:14.045602 (+ 10631us) raft_consensus.cc:1685] finished
0709 13:08:14.045704 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:14.045879 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22770,"prepare.queue_time_us":15461,"prepare.run_cpu_time_us":8803,"prepare.run_wall_time_us":43172,"raft.queue_time_us":178112,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":26957,"spinlock_wait_cycles":19840256,"thread_start_us":95403,"threads_started":1,"wal-append.queue_time_us":215340}
I20260709 13:08:14.055589 18944 raft_consensus.cc:740] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:13.956202 19099 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.060253 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:14.060897 13829 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:14.062165 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:14.012163 19002 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.013401 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:14.002231 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:14.102487 14396 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:08:14.071558 14367 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:14.066390 14402 raft_consensus.cc:1813] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Handling vote request from an unknown peer 35ecb005831740438d7537dd4b840e03
I20260709 13:08:13.995647 19153 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:14.101817 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:14.073381 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:14.105288 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:14.063267 19102 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:14.088889 13756 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:14.070570 13710 rpcz_store.cc:276] 0709 13:08:11.576917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.621897 (+ 44980us) service_pool.cc:224] Handling call
0709 13:08:11.639884 (+ 17987us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:11.765526 (+125642us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:12.667013 (+901487us) log.cc:844] Serialized 14 byte log entry
0709 13:08:13.744292 (+1077279us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:13.768021 (+ 23729us) log.cc:844] Serialized 26 byte log entry
0709 13:08:13.768182 (+   161us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:13.768213 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.768289 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:14.013676 (+245387us) spinlock_profiling.cc:243] Waited 6.76 ms on lock 0x7b18004c21c0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f13f3 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
0709 13:08:14.015482 (+  1806us) raft_consensus.cc:1685] finished
0709 13:08:14.015592 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:14.015726 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":160390,"prepare.queue_time_us":886796,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":460921,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":14582,"spinlock_wait_cycles":15554432,"thread_start_us":1921409,"threads_started":3,"wal-append.queue_time_us":639780}
W20260709 13:08:14.092765 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 107167us
W20260709 13:08:14.087931 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 64171.7us
I20260709 13:08:14.066239 19146 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:14.110172 13714 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 14: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:14.096161 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2774) took 1310 ms. Trace:
I20260709 13:08:14.110617 13860 rpcz_store.cc:276] 0709 13:08:12.785649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.785787 (+   138us) service_pool.cc:224] Handling call
0709 13:08:12.791490 (+  5703us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:13.014523 (+223033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:13.014578 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:13.036103 (+ 21525us) log.cc:844] Serialized 26 byte log entry
0709 13:08:13.193186 (+157083us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:13.193232 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.193308 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:14.045720 (+852412us) spinlock_profiling.cc:243] Waited 8.99 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:14.090112 (+ 44392us) raft_consensus.cc:1685] finished
0709 13:08:14.090128 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:14.096092 (+  5964us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":199927,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":15202,"spinlock_wait_cycles":20678016,"thread_start_us":342996,"threads_started":2,"wal-append.queue_time_us":353316}
I20260709 13:08:14.110918 19096 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:14.115455 19096 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.115832 19096 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.117063 18997 consensus_queue.cc:260] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:14.095247 18810 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.118148 18997 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:14.080355 19017 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.123754 18889 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:14.124267 18889 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:14.080844 19155 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:14.125224 19155 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:14.126374 18978 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.129276 19017 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:14.129935 13756 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:14.130708 18902 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:14.131106 18902 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:14.131528 18902 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:14.135171 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:14.102371 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:14.135506 18863 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:14.098436 13708 raft_consensus.cc:2393] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 16: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:14.024240 19107 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:14.105934 13712 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:08:14.136492 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:14.136968 13708 raft_consensus.cc:1240] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:14.108701 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:14.103578 14402 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 11: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:14.136464 19107 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:14.138319 19107 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.109448 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:14.138752 18961 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:14.140547 14395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 1844) took 2026 ms. Trace:
I20260709 13:08:14.140954 14395 rpcz_store.cc:276] 0709 13:08:12.114674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.281477 (+166803us) service_pool.cc:224] Handling call
0709 13:08:14.140355 (+1858878us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400147654. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:14.140491 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3269655936}
I20260709 13:08:14.142542 18973 raft_consensus.cc:3055] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:14.142802 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:14.143013 18973 raft_consensus.cc:740] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:14.144111 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:14.146135 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:14.149874 19099 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:14.153224 14394 raft_consensus.cc:2393] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 13: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:08:14.109229 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 48400.8us
I20260709 13:08:14.092104 19138 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:14.092453 19137 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:14.136653 19097 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:14.135356 19145 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:14.108336 14366 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:14.154630 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:14.175455 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 173274us
I20260709 13:08:14.147293 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:14.155776 14367 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:14.143899 18973 consensus_queue.cc:260] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.156773 13712 raft_consensus.cc:1275] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:14.169478 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:14.177089 13862 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:08:14.169917 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:14.179127 13859 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
W20260709 13:08:14.174675 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 66403.9us
I20260709 13:08:14.170811 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:14.180955 13861 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:08:14.184070 19154 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:14.180084 19106 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:08:14.186544 13710 raft_consensus.cc:2368] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 24. Current term is 25.
I20260709 13:08:14.187572 19153 raft_consensus.cc:697] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:14.188526 19153 consensus_queue.cc:237] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:14.167689 19160 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:14.189985 19160 raft_consensus.cc:697] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 15 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:14.191145 19119 raft_consensus.cc:3055] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:14.191630 19119 raft_consensus.cc:740] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:14.191056 19160 consensus_queue.cc:237] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:14.192435 19119 consensus_queue.cc:260] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.193066 18658 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.193922 19142 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:14.194482 19142 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.110656 19102 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:14.196727 19142 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:14.196790 19102 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.198441 13755 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:14.199797 13755 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:14.200742 19133 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:14.203531 19137 raft_consensus.cc:697] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:14.204535 19137 consensus_queue.cc:237] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.193646 18658 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:14.212970 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.229293 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 121029us
I20260709 13:08:14.230894 13860 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:14.234529 14393 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:14.168318 19138 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:14.225510 19159 log.cc:927] Time spent T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:08:14.183305 19097 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.193657 19119 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.249415 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:14.238840 14368 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:14.239607 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:14.240314 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:14.241912 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:14.225783 19099 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:14.243073 13783 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1241) took 1691 ms (client timeout 1980 ms). Trace:
W20260709 13:08:14.243546 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 47966.6us
I20260709 13:08:14.254256 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:14.255614 13680 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:14.245486 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:14.242705 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:14.252110 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:14.257339 13713 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:08:14.249879 13756 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:14.253114 13783 rpcz_store.cc:269] 0709 13:08:12.551380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.552841 (+  1461us) service_pool.cc:224] Handling call
0709 13:08:14.242921 (+1690080us) spinlock_profiling.cc:243] Waited 934 ms on lock 0x7b54003bcc54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:14.243022 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2147831168}
I20260709 13:08:14.247092 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:14.173152 18398 consensus_queue.cc:1059] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 13:08:14.230340 18942 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:14.255873 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:14.234874 19154 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:14.261300 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:14.228960 19017 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:14.244630 19138 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.263494 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:14.264503 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 110531us
I20260709 13:08:14.260727 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:14.277586 13680 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:08:14.266052 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 190855us
I20260709 13:08:14.263022 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:14.142488 18944 consensus_queue.cc:260] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.257287 19144 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.263803 19099 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.285041 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:14.271399 19145 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:14.271030 19045 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.333427 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:14.333529 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:14.333514 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:14.348201 13789 raft_consensus.cc:1275] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:14.348426 13713 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.272835 19154 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:14.235551 19132 consensus_queue.cc:1175] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b5029654a4384e43a68eb67b794949b7" responder_term: 11 status { last_received { term: 11 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 11 index: 11 } }
I20260709 13:08:14.340731 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:14.271198 18942 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:08:14.451644 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 212832us
I20260709 13:08:14.341661 13708 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:08:14.344800 19099 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.346589 19001 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:14.341863 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:14.345911 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 92865.1us
I20260709 13:08:14.460912 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:14.262496 19133 consensus_queue.cc:1059] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:08:14.350632 13787 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:14.333415 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:14.314317 18961 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:08:14.449486 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 54177.5us
I20260709 13:08:14.265561 19127 consensus_queue.cc:1048] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:08:14.452152 18942 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.272256 19123 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.466385 13755 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:14.453429 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:14.341658 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 64179.2us
I20260709 13:08:14.454838 14368 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:14.340090 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 90281.4us
I20260709 13:08:14.310940 19128 consensus_queue.cc:1059] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.137s
I20260709 13:08:14.356626 18959 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:14.453262 18978 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:14.464453 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:14.470949 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:14.359478 19154 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.475560 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:14.475833 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:14.471076 14368 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:14.451462 19108 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:14.470641 13680 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:14.463691 14367 leader_election.cc:400] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 24. Current term is 25.
I20260709 13:08:14.344449 19144 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.484871 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:14.455603 19153 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.357146 19045 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.460032 18679 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:14.485872 13708 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:08:14.477427 13863 consensus_queue.cc:260] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.488534 14367 leader_election.cc:403] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:08:14.461063 19001 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:14.492441 13782 raft_consensus.cc:2393] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 14: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:14.467456 19101 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:14.448655 19145 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:14.530681 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.358400 19156 consensus_queue.cc:1059] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.127s
I20260709 13:08:14.656791 13713 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:14.484650 18947 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:14.577690 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 89069us
I20260709 13:08:14.484833 18948 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:14.558669 18961 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:14.697710 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 236299us
I20260709 13:08:14.492429 19161 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:14.492180 19002 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:14.700799 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.493345 19124 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:14.493080 19005 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.209s
I20260709 13:08:14.689922 18978 raft_consensus.cc:3055] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:14.488528 18959 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.711525 18961 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.760962 19169 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:14.769280 19164 log.cc:927] Time spent T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.424s	user 0.001s	sys 0.000s
I20260709 13:08:14.769428 19045 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:14.769958 19175 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:14.770370 19167 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:14.771381 19168 log.cc:927] Time spent T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
I20260709 13:08:14.771255 19118 consensus_queue.cc:1059] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:14.771976 19001 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:14.772655 13786 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:14.698734 19101 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.777428 19144 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:14.778090 19184 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:14.798329 18947 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.752200 19002 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:14.835626 19002 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:14.836076 19002 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:14.728093 18948 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:14.806804 19169 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:14.831252 19167 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:14.779333 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:14.736985 13601 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c9e22f0634b34971aed9c5b948f3275e with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:14.779956 13865 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:08:14.837781 18947 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:14.783797 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:14.855314 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:14.856124 18889 consensus_meta.cc:287] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.731s	user 0.012s	sys 0.002s
I20260709 13:08:14.856631 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:14.856868 18889 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:14.784500 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:14.784804 18959 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:14.785174 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:14.872437 13859 raft_consensus.cc:2393] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 10: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:14.785669 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:14.873200 13864 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.785807 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:14.786156 13789 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:08:14.787773 18643 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.576831 18902 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:14.570007 19153 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:14.740151 18810 consensus_meta.cc:287] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.001s
I20260709 13:08:14.788904 13716 raft_consensus.cc:1240] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:14.789304 19107 consensus_meta.cc:287] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.651s	user 0.008s	sys 0.000s
W20260709 13:08:14.790621 19102 consensus_meta.cc:287] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.593s	user 0.007s	sys 0.000s
I20260709 13:08:14.886262 19107 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:14.886415 19102 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:14.791517 18997 consensus_meta.cc:287] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.673s	user 0.009s	sys 0.006s
I20260709 13:08:14.888013 13710 raft_consensus.cc:2393] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 14: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:14.888578 13782 raft_consensus.cc:1240] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:14.888713 19102 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:14.792788 19145 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:14.889878 13715 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
W20260709 13:08:14.795149 19096 consensus_meta.cc:287] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.679s	user 0.002s	sys 0.006s
I20260709 13:08:14.890268 19107 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:14.890597 19096 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.892961 19096 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:14.796800 19100 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:08:14.744185 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 260879us
I20260709 13:08:14.799834 13784 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 24.
I20260709 13:08:14.894812 13829 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:14.842296 19097 consensus_meta.cc:287] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.577s	user 0.006s	sys 0.000s
I20260709 13:08:14.895812 13829 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:14.845276 19122 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:14.896704 19122 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.897758 19153 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:14.898801 19122 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:14.736969 19161 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.896190 19097 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:14.855020 19155 consensus_meta.cc:287] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.729s	user 0.011s	sys 0.003s
I20260709 13:08:14.856304 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:14.857271 13865 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:14.738015 18978 raft_consensus.cc:740] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:14.857311 19184 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.800164 18961 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.783921 18679 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.837894 19101 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:14.746711 18658 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:14.878665 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 385787us
W20260709 13:08:14.880906 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.853813 13860 raft_consensus.cc:2393] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 14: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:14.853332 19167 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:14.854322 13601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 378229us
W20260709 13:08:14.882472 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.850699 19169 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:14.885118 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:14.885725 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:14.899973 13787 raft_consensus.cc:1240] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:14.930164 13864 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
W20260709 13:08:14.931090 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.914911 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:14.913800 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:14.905548 13756 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:14.934547 13756 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:14.937511 13858 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 11: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:14.938009 13716 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 19: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:14.939754 19096 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:14.940538 19096 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:14.899492 19125 consensus_meta.cc:287] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.841s	user 0.010s	sys 0.000s
I20260709 13:08:14.845758 18948 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:14.915604 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:14.919641 13707 raft_consensus.cc:2393] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 18: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:14.919761 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:14.920009 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:14.902029 18947 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:14.913075 19138 consensus_meta.cc:287] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.001s
I20260709 13:08:14.906153 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:14.938933 14366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.004s	sys 0.004s
I20260709 13:08:14.964780 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:14.965413 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:14.965874 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:14.903641 19183 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.908463 19097 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:14.905670 19108 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.943630 18658 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:14.976617 14366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.004s	sys 0.004s
I20260709 13:08:14.996065 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:14.943377 19096 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:14.907393 19119 consensus_meta.cc:287] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.000s
W20260709 13:08:14.936561 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 229737us
I20260709 13:08:15.004771 13680 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:14.917133 19175 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 24. Current term is 25.
I20260709 13:08:14.899681 18902 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:14.996562 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 760437us
I20260709 13:08:14.936956 18959 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:14.899783 19186 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:14.913481 19123 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:14.901245 19161 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:14.953017 18889 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:14.917601 19184 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:14.900071 18810 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.970160 18947 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.899381 19122 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 13:08:14.916471 18978 consensus_queue.cc:260] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.944638 19100 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:08:14.918496 18679 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:15.017464 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:14.915580 19001 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:14.999751 18658 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:08:15.018963 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 84516.2us
I20260709 13:08:14.916909 19155 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.022078 14366 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:14.994961 19129 consensus_queue.cc:1059] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:08:15.027034 13680 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:14.981962 19138 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:14.967300 19125 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.036855 14397 raft_consensus.cc:1240] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:15.038710 14367 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:15.039721 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:15.040016 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:15.040282 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:15.001596 19108 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:15.023039 19186 raft_consensus.cc:697] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:14.998251 19154 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:15.032158 18893 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.009s	sys 0.028s
W20260709 13:08:15.052615 18942 consensus_meta.cc:287] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.001s
W20260709 13:08:15.100941 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 46628.5us
W20260709 13:08:14.976899 18428 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.008s	sys 0.004s
W20260709 13:08:15.035585 13755 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.007s	sys 0.015s
I20260709 13:08:15.031991 19097 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:15.053001 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:15.102180 13755 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.008s	sys 0.015s
I20260709 13:08:14.995230 19183 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:15.102536 13860 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:08:15.054570 13861 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 6.
I20260709 13:08:15.056129 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:15.103627 13859 raft_consensus.cc:2393] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 18: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:15.056725 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:15.057950 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:15.056035 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:15.104981 13714 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.061481 13682 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:08:15.106307 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 44864.3us
I20260709 13:08:15.106549 14393 raft_consensus.cc:1240] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:15.106850 14394 raft_consensus.cc:1240] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:15.042585 18658 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:15.040673 19127 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:15.031175 19002 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:15.064270 13857 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:08:15.029546 18947 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:15.102839 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 636542us
I20260709 13:08:15.107133 13682 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:15.108866 13858 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:15.117013 13755 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:15.112999 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:08:15.100095 18893 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.009s	sys 0.029s
I20260709 13:08:15.114099 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:15.115196 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:15.115229 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:15.111876 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:15.118134 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.118521 14400 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:08:15.118876 13859 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:15.114655 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:15.120076 14394 raft_consensus.cc:2368] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11.
I20260709 13:08:15.112653 18942 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.120247 18810 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:15.107941 18428 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.009s	sys 0.005s
I20260709 13:08:15.118606 14401 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:08:15.101747 19191 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:15.064329 19123 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:15.120919 13785 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 12: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:15.121989 14393 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 19: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:08:15.113610 19099 consensus_meta.cc:287] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.641s	user 0.010s	sys 0.000s
I20260709 13:08:15.123171 14395 raft_consensus.cc:1240] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:15.120893 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:15.123594 13757 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:15.128228 14396 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 14: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:15.128422 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:15.128985 14402 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:15.130236 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:15.131644 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 109678us
I20260709 13:08:15.133419 13680 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:15.130319 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:15.135643 13682 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:15.137912 13682 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:15.138080 13755 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:15.111505 19190 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:15.103577 18902 consensus_queue.cc:1059] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:08:15.139633 13757 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:15.143534 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:15.143635 13682 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:15.143458 14366 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:08:15.145336 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 106733us
I20260709 13:08:15.133584 19100 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:15.170984 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 119988us
I20260709 13:08:15.176124 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:15.177117 19001 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:15.177237 18643 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:15.189483 19199 log.cc:927] Time spent T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:08:15.190052 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:15.190214 19177 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:15.190650 19177 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.184929 19097 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:15.191128 19177 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:15.191632 19154 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:15.183178 14402 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:15.165071 19153 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:08:15.196975 19108 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:15.144304 19106 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:15.185343 19155 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:15.185472 19206 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:15.186020 19100 raft_consensus.cc:697] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:15.187039 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:15.172254 19145 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:15.187628 19138 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:15.139544 19101 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:15.134675 18810 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:15.218803 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:15.219158 18810 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.139585 18959 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:15.137099 18889 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:15.142045 19190 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:15.141976 19107 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:15.144865 19133 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:15.188437 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:15.189071 18428 raft_consensus.cc:3055] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:15.190798 14401 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 11: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:15.185242 14366 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:15.166153 14367 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:15.165889 19104 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.144629 19180 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:15.209918 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:15.212035 14396 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 25.
W20260709 13:08:15.213742 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 70157.7us
I20260709 13:08:15.132301 19099 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.212591 13680 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:15.220768 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 81145.6us
I20260709 13:08:15.114981 19127 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.228998 14394 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.212904 19106 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:15.230034 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 44877.4us
I20260709 13:08:15.178061 18997 consensus_queue.cc:1059] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:08:15.235482 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:15.237038 14366 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:15.232858 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 66793.2us
I20260709 13:08:15.240885 14366 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:15.243556 14366 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:15.228127 19190 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:15.234288 19138 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:15.230628 18428 raft_consensus.cc:740] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:15.236020 19133 raft_consensus.cc:697] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:15.179332 19186 consensus_queue.cc:237] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.251724 19133 consensus_queue.cc:237] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:15.237600 19106 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.260185 18679 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:15.264317 18942 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:15.264712 19208 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:15.265475 19208 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:15.266078 19099 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:15.270037 18658 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:15.270999 19177 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.272280 19002 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:15.273514 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 3097) took 1024 ms. Trace:
I20260709 13:08:15.264681 18947 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.273918 19127 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:15.274516 13864 raft_consensus.cc:2393] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 11: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:15.275043 19125 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:15.264891 18961 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.275905 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:15.242926 19145 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:15.277040 19100 consensus_queue.cc:237] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.277498 18961 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:15.278523 18947 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:15.273187 19177 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:15.244935 19175 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:15.273880 13716 rpcz_store.cc:276] 0709 13:08:14.249286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.995636 (+746350us) service_pool.cc:224] Handling call
0709 13:08:15.012982 (+ 17346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.013323 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.013350 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:15.017448 (+  4098us) log.cc:844] Serialized 26 byte log entry
0709 13:08:15.132814 (+115366us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:15.132851 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.132911 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:15.273305 (+140394us) raft_consensus.cc:1685] finished
0709 13:08:15.273323 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:15.273459 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2925,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":12289,"thread_start_us":82669,"threads_started":1,"wal-append.queue_time_us":187941}
I20260709 13:08:15.297073 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:15.277558 14394 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:08:15.284854 13714 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:08:15.297628 13680 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:15.244805 19191 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:15.295614 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:15.304581 13860 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:15.305172 13680 leader_election.cc:400] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11.
I20260709 13:08:15.306053 13680 leader_election.cc:403] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:15.275897 18810 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:15.242945 19180 consensus_queue.cc:1059] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:08:15.312103 18428 consensus_queue.cc:260] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:15.319497 19145 consensus_queue.cc:1059] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:15.322077 19180 raft_consensus.cc:3055] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:15.322520 19180 raft_consensus.cc:740] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:15.295122 18942 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:15.323392 19180 consensus_queue.cc:260] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:15.323992 18942 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.324810 19180 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:15.326977 13715 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 3078) took 2083 ms (client timeout 1535 ms). Trace:
W20260709 13:08:15.327432 13715 rpcz_store.cc:269] 0709 13:08:13.244039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.244244 (+   205us) service_pool.cc:224] Handling call
0709 13:08:15.326787 (+2082543us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54001b8d54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:15.326895 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3740932352}
I20260709 13:08:15.327970 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:15.328727 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:15.329321 13715 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.328898 13716 raft_consensus.cc:2393] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 12: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:08:15.333995 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 90508.3us
I20260709 13:08:15.334084 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:15.335398 14366 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:15.327123 18942 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:15.337183 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:15.337802 13859 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:08:15.338779 13680 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:15.343984 19218 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:15.348523 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:15.349422 14366 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:15.348032 13860 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:15.333498 19133 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:15.353206 13680 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:15.355094 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:15.340770 19002 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 10. Current term is 11.
I20260709 13:08:15.354488 13860 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:15.357151 14367 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:15.331780 19144 consensus_queue.cc:1059] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:08:15.361380 14366 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:15.362895 13680 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:15.364068 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:15.352344 19133 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:15.367929 14366 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:15.370070 13859 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
I20260709 13:08:15.370843 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:15.358899 19189 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:15.377624 13680 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:15.366065 18810 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:15.380918 19106 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.362087 19218 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:15.382877 19189 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.376994 19097 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:15.360996 19145 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:15.382015 19190 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:15.366796 19099 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:15.376544 18889 raft_consensus.cc:3055] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:15.391443 13786 raft_consensus.cc:2368] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13.
I20260709 13:08:15.377169 19133 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.367291 19138 raft_consensus.cc:697] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:15.392518 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:15.385509 19127 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:15.393782 18973 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:15.399736 13680 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:15.366119 19001 consensus_queue.cc:1059] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:08:15.415310 13782 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:15.418285 13716 raft_consensus.cc:2393] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 15: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:15.390790 19189 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.377864 19208 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:08:15.391335 19002 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.401171 19107 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:15.401598 18889 raft_consensus.cc:740] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:15.432410 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:15.392545 19174 consensus_queue.cc:1048] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:08:15.424712 18810 raft_consensus.cc:697] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 11 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:15.442555 14394 raft_consensus.cc:1240] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:15.435216 13782 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:08:15.444010 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:15.444340 14394 raft_consensus.cc:1240] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:15.441097 19145 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:15.450719 13680 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:15.454401 13715 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:08:15.442696 19001 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:15.457135 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:15.458918 14394 raft_consensus.cc:1240] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:08:15.460245 19001 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:15.460999 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:15.462647 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:15.470162 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.470937 18893 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.471506 18893 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.473740 18893 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:15.455765 18810 consensus_queue.cc:237] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.433844 19107 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.471307 14399 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:15.448676 18942 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:15.477694 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:15.483085 13715 raft_consensus.cc:2368] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11.
I20260709 13:08:15.478016 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:15.485111 13782 raft_consensus.cc:2368] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 7. Current term is 8.
I20260709 13:08:15.466725 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:15.480013 14401 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:15.480641 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:15.488035 13791 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:15.489176 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:15.490118 19125 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:15.490629 19125 raft_consensus.cc:697] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:15.491509 19125 consensus_queue.cc:237] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.497825 14401 raft_consensus.cc:1240] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:08:15.489933 13715 raft_consensus.cc:2393] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 25: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:15.505291 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:15.499037 18889 consensus_queue.cc:260] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.507683 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:15.507910 19106 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:15.508433 13715 raft_consensus.cc:2393] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 11: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:15.509199 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:15.509639 19107 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:15.513005 19101 raft_consensus.cc:3055] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:15.513407 19101 raft_consensus.cc:740] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:15.488188 18942 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.514169 19101 consensus_queue.cc:260] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.516352 18942 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:15.479688 19186 consensus_queue.cc:1059] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:08:15.467319 19138 consensus_queue.cc:237] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.519093 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:15.526121 13714 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:15.520663 13784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1266) took 1276 ms. Trace:
I20260709 13:08:15.527714 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:15.523940 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:15.524296 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:15.521461 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:15.527036 13784 rpcz_store.cc:276] 0709 13:08:14.244553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.284670 (+ 40117us) service_pool.cc:224] Handling call
0709 13:08:15.520502 (+1235832us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54003bdb54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:15.520605 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":527548672}
I20260709 13:08:15.500213 19104 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:15.521039 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:15.536852 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.536060 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:15.538549 13859 raft_consensus.cc:1275] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:15.539837 13859 raft_consensus.cc:1275] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:15.539901 13862 raft_consensus.cc:3055] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:15.540341 13862 raft_consensus.cc:740] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:08:15.523343 19171 log.cc:927] Time spent T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 1.046s	user 0.007s	sys 0.009s
I20260709 13:08:15.542305 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:15.542838 13860 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.542884 13856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2777) took 2685 ms. Trace:
I20260709 13:08:15.544057 19189 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.546249 19189 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:15.547508 13788 raft_consensus.cc:2393] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 14: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:15.548379 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:15.517467 19186 raft_consensus.cc:3055] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:15.549402 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:15.549623 19186 raft_consensus.cc:740] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:15.550328 18658 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:15.550982 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:15.551782 18894 raft_consensus.cc:3055] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:15.552320 18894 raft_consensus.cc:740] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:15.543350 13856 rpcz_store.cc:276] 0709 13:08:12.857676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.857815 (+   139us) service_pool.cc:224] Handling call
0709 13:08:12.915930 (+ 58115us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.958277 (+ 42347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.958309 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:12.974142 (+ 15833us) log.cc:844] Serialized 26 byte log entry
0709 13:08:14.149551 (+1175409us) spinlock_profiling.cc:243] Waited 5.35 ms on lock 0x7b180028dfe0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e0d1 00007f5232499a0f
0709 13:08:14.230636 (+ 81085us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:14.230687 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.230756 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:15.522740 (+1291984us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:15.542699 (+ 19959us) raft_consensus.cc:1685] finished
0709 13:08:15.542720 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:15.542834 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89512,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":12488,"spinlock_wait_cycles":19774464,"thread_start_us":80912,"threads_started":1,"wal-append.queue_time_us":1292822}
I20260709 13:08:15.553246 18894 consensus_queue.cc:260] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.554276 18894 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:15.555539 19101 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:15.555985 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 3090) took 1393 ms. Trace:
I20260709 13:08:15.556361 13710 rpcz_store.cc:276] 0709 13:08:14.162483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.229016 (+ 66533us) service_pool.cc:224] Handling call
0709 13:08:15.555808 (+1326792us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b54000c5b54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:15.555931 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1449214720}
I20260709 13:08:15.557374 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:15.558023 13710 raft_consensus.cc:2393] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 11: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:15.558743 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:15.550532 19186 consensus_queue.cc:260] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:15.559978 19186 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:15.560755 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:15.561443 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1858) took 1700 ms. Trace:
I20260709 13:08:15.562037 13782 raft_consensus.cc:1240] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:15.562541 18997 raft_consensus.cc:3055] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:15.562928 18997 raft_consensus.cc:740] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:15.552083 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:15.563948 13784 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 8.
I20260709 13:08:15.563735 18997 consensus_queue.cc:260] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.564819 18997 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:15.566484 13784 raft_consensus.cc:1240] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:15.568001 19212 raft_consensus.cc:3055] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:15.568415 19212 raft_consensus.cc:740] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:15.569325 13680 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:15.569223 19212 consensus_queue.cc:260] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.570499 13680 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:15.572470 13680 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:15.573452 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:15.563259 13782 raft_consensus.cc:1275] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:15.573962 18978 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.575884 19139 raft_consensus.cc:3055] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:15.576407 19139 raft_consensus.cc:740] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:15.575947 13862 consensus_queue.cc:260] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.550484 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:15.577036 13862 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.577183 19139 consensus_queue.cc:260] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:15.578369 19139 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.580163 14399 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:15.509245 19190 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:15.583446 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:15.584496 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:15.585141 14400 raft_consensus.cc:2368] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11.
I20260709 13:08:15.585819 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:15.586756 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:15.588109 14402 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:08:15.590299 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:15.590895 14401 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:08:15.591686 13715 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:15.591864 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:15.594731 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 57182us
I20260709 13:08:15.596864 13757 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:15.596803 19106 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:15.598384 19200 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:15.598933 19200 raft_consensus.cc:697] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 8 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:15.599385 19133 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.599820 19200 consensus_queue.cc:237] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.601912 13861 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:15.602023 18834 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.603297 13791 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:15.578053 13788 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:15.561826 14397 rpcz_store.cc:276] 0709 13:08:13.861329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.051597 (+190268us) service_pool.cc:224] Handling call
0709 13:08:14.051845 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:15.059807 (+1007962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.561219 (+501412us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b5400147154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:15.561385 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2264921984}
I20260709 13:08:15.570535 19212 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:15.609323 13860 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:08:15.596979 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42104 (request call id 1341) took 1455 ms. Trace:
I20260709 13:08:15.609865 13857 rpcz_store.cc:276] 0709 13:08:14.141285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.143837 (+  2552us) service_pool.cc:224] Handling call
0709 13:08:15.596806 (+1452969us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b540006ed54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:15.596902 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2114625792}
I20260709 13:08:15.615576 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:15.616781 13710 raft_consensus.cc:2393] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 13: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:15.617591 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:15.602885 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:15.626509 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:15.627154 13859 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:08:15.617538 13714 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:15.629506 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:15.591790 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:08:15.647894 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.648126 13791 raft_consensus.cc:1240] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:15.647825 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:15.599391 19162 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 1.255s	user 0.008s	sys 0.029s
I20260709 13:08:15.652251 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:15.655609 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 50176.8us
I20260709 13:08:15.602551 18834 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.658728 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:08:15.647104 19142 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.296s	user 0.025s	sys 0.011s
I20260709 13:08:15.662644 14400 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 12: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:15.662997 13715 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:15.664434 13829 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:15.640595 19107 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:15.667342 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:15.668159 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:15.668926 14397 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:15.650190 19190 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:15.674705 13682 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:15.675381 13680 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:15.674966 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:15.680531 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.685217 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:15.659842 19133 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:15.688777 14400 raft_consensus.cc:2393] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 25: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:15.661965 19205 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.684759 19155 consensus_queue.cc:1059] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:08:15.727837 19205 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:15.728369 19155 raft_consensus.cc:3055] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:15.728847 19155 raft_consensus.cc:740] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:15.729995 19205 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:15.729748 19155 consensus_queue.cc:260] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.730952 19155 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:15.692090 19202 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:15.731109 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:15.731846 19002 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:15.732043 14401 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 16: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:15.692517 19225 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:15.732884 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:15.695603 19204 consensus_queue.cc:1059] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:15.696292 19107 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:15.733844 19107 raft_consensus.cc:697] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:15.734092 19204 raft_consensus.cc:3055] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:15.733937 19208 consensus_queue.cc:1059] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:15.734510 19204 raft_consensus.cc:740] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:15.673539 19089 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:15.734799 19107 consensus_queue.cc:237] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.665869 19203 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.735911 19096 raft_consensus.cc:3055] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:15.736351 19096 raft_consensus.cc:740] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:15.736414 19203 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.737270 19096 consensus_queue.cc:260] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.738330 19096 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:15.738663 19203 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:15.740569 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:15.741926 13709 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:08:15.742439 13709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2630) took 1388 ms. Trace:
I20260709 13:08:15.742502 14401 raft_consensus.cc:1240] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:15.742794 13709 rpcz_store.cc:276] 0709 13:08:14.353878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.741445 (+1387567us) service_pool.cc:224] Handling call
0709 13:08:15.741715 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.742241 (+   526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.742392 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:15.677450 19190 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.744385 19190 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:15.746013 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:15.748819 19172 log.cc:927] Time spent T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 1.063s	user 0.003s	sys 0.000s
I20260709 13:08:15.749825 19102 consensus_queue.cc:1048] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:15.750277 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:15.751384 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:15.752746 14399 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:15.755348 13829 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:15.756186 19155 consensus_queue.cc:1059] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:15.756837 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:15.757231 19155 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:15.757961 19210 consensus_queue.cc:1059] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:15.758625 19169 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:15.758931 19210 raft_consensus.cc:3055] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:15.759352 19210 raft_consensus.cc:740] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:15.760260 19210 consensus_queue.cc:260] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.761018 18428 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:15.761565 19210 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:15.763603 13682 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:08:15.765303 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.765694 19001 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:15.766094 19202 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:15.766283 19001 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:15.766618 19202 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.766759 19001 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.768893 19202 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:15.701138 19228 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:15.703445 18944 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:15.770445 19228 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.772346 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 3096) took 1548 ms. Trace:
I20260709 13:08:15.772608 19228 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:15.679862 19005 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:15.772727 13713 rpcz_store.cc:276] 0709 13:08:14.223972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.771572 (+1547600us) service_pool.cc:224] Handling call
0709 13:08:15.771865 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:15.772022 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.772046 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:15.772088 (+    42us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:15.772127 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.772196 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:15.772291 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:15.739262 19156 consensus_queue.cc:1048] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:08:15.774050 18810 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:15.774673 18810 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:15.702335 19229 log.cc:927] Time spent T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:08:15.776770 18810 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:15.777236 18810 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:15.777659 18810 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.735487 19089 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.779338 13712 raft_consensus.cc:1240] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:08:15.779983 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2633) took 1425 ms. Trace:
I20260709 13:08:15.780216 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2457) took 1318 ms. Trace:
I20260709 13:08:15.780283 13712 rpcz_store.cc:276] 0709 13:08:14.354925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.778849 (+1423924us) service_pool.cc:224] Handling call
0709 13:08:15.779126 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.779751 (+   625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.779929 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:15.780674 13787 rpcz_store.cc:276] 0709 13:08:14.461803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.462181 (+   378us) service_pool.cc:224] Handling call
0709 13:08:14.483610 (+ 21429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:14.936278 (+452668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.779998 (+843720us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54000ed3d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:15.780161 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":957142912}
I20260709 13:08:15.781744 13712 raft_consensus.cc:1240] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:15.706920 13710 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:08:15.782272 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2634) took 1427 ms. Trace:
I20260709 13:08:15.782585 13712 rpcz_store.cc:276] 0709 13:08:14.355226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.781366 (+1426140us) service_pool.cc:224] Handling call
0709 13:08:15.781603 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:15.782066 (+   463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.782227 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:15.708323 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:15.681454 19145 consensus_queue.cc:1059] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:08:15.711632 18834 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:15.713241 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:15.713881 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:15.719803 19175 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:15.720095 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:15.796068 13861 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 12: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:15.796188 13858 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.721035 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1257) took 1483 ms. Trace:
I20260709 13:08:15.722332 13707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 2635) took 1366 ms. Trace:
I20260709 13:08:15.723658 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:15.724377 13789 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 2456) took 1263 ms (client timeout 1599 ms). Trace:
I20260709 13:08:15.725435 13830 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:15.798868 13789 rpcz_store.cc:269] 0709 13:08:14.461404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.461513 (+   109us) service_pool.cc:224] Handling call
0709 13:08:15.724235 (+1262722us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54003bd654. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:15.724324 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":685729664}
I20260709 13:08:15.733184 13859 raft_consensus.cc:1240] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:15.735291 19204 consensus_queue.cc:260] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.758100 19155 raft_consensus.cc:3055] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:15.774166 13713 raft_consensus.cc:1240] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:15.685504 18948 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:15.704751 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:15.802551 14400 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.756865 13716 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:08:15.786875 13829 leader_election.cc:400] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11.
I20260709 13:08:15.803989 13829 leader_election.cc:403] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:08:15.735090 13757 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:15.787422 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:15.804384 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 79012us
I20260709 13:08:15.789260 13714 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
W20260709 13:08:15.790203 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 320340us
I20260709 13:08:15.800290 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2632) took 1445 ms. Trace:
W20260709 13:08:15.805301 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 70274.7us
I20260709 13:08:15.805414 13713 rpcz_store.cc:276] 0709 13:08:14.354616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.773733 (+1419117us) service_pool.cc:224] Handling call
0709 13:08:15.774008 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:15.800096 (+ 26088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.800244 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:15.807647 13830 leader_election.cc:400] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11.
I20260709 13:08:15.807925 14397 raft_consensus.cc:2393] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 12: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:15.809013 13830 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:15.809688 13829 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:15.674535 19142 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.333s	user 0.026s	sys 0.012s
I20260709 13:08:15.797418 13785 rpcz_store.cc:276] 0709 13:08:14.237193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.237311 (+   118us) service_pool.cc:224] Handling call
0709 13:08:15.720843 (+1483532us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b54000b1b54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:15.720977 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1975488384}
I20260709 13:08:15.798010 13707 rpcz_store.cc:276] 0709 13:08:14.374809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.463125 (+ 88316us) service_pool.cc:224] Handling call
0709 13:08:15.722158 (+1259033us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b5400041854. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:15.722278 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":978064768}
I20260709 13:08:15.788879 13712 raft_consensus.cc:1240] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:15.815557 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2636) took 1365 ms. Trace:
I20260709 13:08:15.815873 13712 rpcz_store.cc:276] 0709 13:08:14.450540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.783208 (+1332668us) service_pool.cc:224] Handling call
0709 13:08:15.788727 (+  5519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:15.815289 (+ 26562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.815504 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:15.800580 13788 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 25.
I20260709 13:08:15.785903 19212 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:15.818903 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:15.810654 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2631) took 1456 ms. Trace:
I20260709 13:08:15.820791 13716 rpcz_store.cc:276] 0709 13:08:14.354264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.756356 (+1402092us) service_pool.cc:224] Handling call
0709 13:08:15.756672 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.810413 (+ 53741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.810600 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:15.820398 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:15.824980 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:15.836319 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:15.837165 13791 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 12: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:15.821882 18679 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:15.812954 19205 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:15.802062 19155 raft_consensus.cc:740] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:15.840986 13713 raft_consensus.cc:1240] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:15.849262 13713 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:15.842760 13830 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:15.821957 19167 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:15.846484 13862 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:15.812702 18893 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:15.840966 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:15.851212 13789 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:15.856055 14400 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:08:15.879704 13858 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:08:15.822494 19212 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:08:15.914742 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.802227 19175 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.816313 19203 consensus_queue.cc:1059] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:08:15.926090 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:15.881994 18679 raft_consensus.cc:2764] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:08:15.891681 19124 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11.
I20260709 13:08:15.905469 19212 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:15.924767 19204 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:15.923352 18893 raft_consensus.cc:697] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 13 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:15.907581 19017 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.930277 19125 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:15.976825 19017 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.982338 19174 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.983037 19174 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:15.985682 19174 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:15.985951 19017 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:15.991861 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:15.992688 13784 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
W20260709 13:08:16.001147 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 325811us
I20260709 13:08:16.002633 13790 raft_consensus.cc:1240] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:08:16.002592 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:16.022006 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:15.971331 19125 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:16.024330 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:16.027855 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.034533 13787 raft_consensus.cc:1240] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 8 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:15.999804 19118 raft_consensus.cc:3055] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:16.036733 13755 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:16.038262 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:16.041020 13755 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:16.042939 13755 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:16.044420 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.960920 19155 consensus_queue.cc:260] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:16.032529 19125 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:16.071406 13713 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:16.072621 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.072767 13680 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:08:16.099354 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.027535 19101 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:08:16.073956 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:16.040162 19118 raft_consensus.cc:740] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:16.111173 13716 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:16.114955 13864 pending_rounds.cc:85] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 9
I20260709 13:08:16.117115 13864 pending_rounds.cc:107] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:08:16.117282 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:16.118775 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:16.117431 13864 raft_consensus.cc:2889] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:16.105006 18398 consensus_queue.cc:1059] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:08:16.114497 18997 consensus_queue.cc:1059] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:08:16.110507 18893 consensus_queue.cc:237] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:16.128729 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 3099) took 1024 ms. Trace:
I20260709 13:08:16.129125 13716 rpcz_store.cc:276] 0709 13:08:15.103921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.047648 (+943727us) service_pool.cc:224] Handling call
0709 13:08:16.106570 (+ 58922us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.128464 (+ 21894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.128673 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:16.130633 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 3100) took 1022 ms. Trace:
I20260709 13:08:16.130927 13716 rpcz_store.cc:276] 0709 13:08:15.108472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.129884 (+1021412us) service_pool.cc:224] Handling call
0709 13:08:16.130170 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.130328 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.130351 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:16.130393 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:16.130428 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.130475 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.130584 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:16.132923 13716 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:16.133709 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2644) took 1021 ms. Trace:
I20260709 13:08:16.116039 13680 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:16.116878 13755 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:16.138551 19231 log.cc:927] Time spent T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 13:08:16.044648 19196 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:16.143764 13756 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:16.144313 13709 raft_consensus.cc:1275] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:08:16.145414 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.145267 14367 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:16.101130 19102 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:16.147033 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.134761 18889 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:16.106097 19097 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:16.151537 19106 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:16.152714 18997 raft_consensus.cc:3055] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:16.153221 19104 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:16.153659 13756 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:16.172020 13756 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:16.149567 18810 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:16.162505 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 342154us
I20260709 13:08:16.044126 19200 consensus_queue.cc:1059] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.106s
I20260709 13:08:16.083894 18834 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:16.111433 19001 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:16.168663 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 325984us
I20260709 13:08:16.173506 13756 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:16.147668 19101 raft_consensus.cc:697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 25 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:08:16.182654 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.155097 14367 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:16.168538 18997 raft_consensus.cc:740] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:16.165442 19137 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:16.155330 19155 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:16.204793 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:16.204993 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:16.136806 13716 rpcz_store.cc:276] 0709 13:08:15.112421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.132294 (+1019873us) service_pool.cc:224] Handling call
0709 13:08:16.132708 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.133418 (+   710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.133647 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:16.189656 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:16.192589 14367 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:16.207888 14367 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:16.209409 14367 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:16.205503 14398 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:16.179831 19097 raft_consensus.cc:697] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:16.217751 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:16.218246 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:16.175233 18398 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:16.196429 14395 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:16.179262 19196 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:16.167095 18698 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:16.195019 19200 raft_consensus.cc:3055] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:16.189904 19175 leader_election.cc:290] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:16.194325 19107 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.244351 19196 raft_consensus.cc:697] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:16.200924 19142 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:16.258199 19196 consensus_queue.cc:237] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:16.254608 18997 consensus_queue.cc:260] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:16.263903 19234 log.cc:927] Time spent T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260709 13:08:16.266484 19233 log.cc:927] Time spent T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:08:16.222461 19106 consensus_queue.cc:1059] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:08:16.228932 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:16.273468 13716 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:16.200440 18810 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:08:16.230347 18894 consensus_meta.cc:287] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.676s	user 0.011s	sys 0.000s
I20260709 13:08:16.212131 19096 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:16.188431 19146 consensus_queue.cc:1059] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:08:16.186209 18947 consensus_queue.cc:1059] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:08:16.185020 18679 consensus_queue.cc:1059] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:08:16.216620 19100 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:16.245734 19230 log.cc:927] Time spent T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:08:16.253443 18398 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:16.254078 18948 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:16.223939 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:16.299917 13715 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:16.234403 19200 raft_consensus.cc:740] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:16.280385 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 1356) took 1431 ms. Trace:
I20260709 13:08:16.242682 18698 raft_consensus.cc:697] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 11 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:16.272364 19183 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:16.263202 19190 consensus_meta.cc:287] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.518s	user 0.006s	sys 0.001s
W20260709 13:08:16.295151 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 85813.3us
I20260709 13:08:16.197566 19118 consensus_queue.cc:260] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:16.295887 19012 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:16.298256 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:16.302623 13710 rpcz_store.cc:276] 0709 13:08:14.848660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.783469 (+934809us) service_pool.cc:224] Handling call
0709 13:08:15.783734 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:15.783917 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:15.784142 (+   225us) log.cc:844] Serialized 14 byte log entry
0709 13:08:16.276506 (+492364us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:16.277290 (+   784us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:16.277354 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.279623 (+  2269us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.280329 (+   706us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":943,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":637,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":1431,"thread_start_us":490602,"threads_started":1}
I20260709 13:08:16.270007 19107 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:16.194144 13829 leader_election.cc:400] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 7. Current term is 8.
I20260709 13:08:16.319372 13829 leader_election.cc:403] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:16.308955 14367 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:16.312834 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:16.313166 13860 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:16.304004 18942 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:16.314611 13716 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 12: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:16.322005 13710 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:16.301191 18889 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:16.340020 19242 log.cc:927] Time spent T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:08:16.340735 19244 log.cc:927] Time spent T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:08:16.341383 19240 log.cc:927] Time spent T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:08:16.311949 19190 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:16.310077 19097 consensus_queue.cc:237] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:16.343438 19146 raft_consensus.cc:3055] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:16.360944 19146 raft_consensus.cc:740] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:08:16.344901 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 154102us
I20260709 13:08:16.361821 19146 consensus_queue.cc:260] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:16.362639 19246 consensus_queue.cc:1059] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:16.362867 19146 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:16.347625 19236 log.cc:927] Time spent T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:08:16.363597 19155 consensus_queue.cc:1048] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:08:16.353597 19186 consensus_meta.cc:287] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.793s	user 0.007s	sys 0.003s
I20260709 13:08:16.347374 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:16.363224 13829 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:16.365571 19186 consensus_queue.cc:1059] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:16.352061 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:16.366396 13829 leader_election.cc:400] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13.
I20260709 13:08:16.366750 13716 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:16.367285 19107 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:16.352303 18889 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:16.367835 19246 raft_consensus.cc:3055] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:16.368242 19246 raft_consensus.cc:740] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:16.368116 19200 consensus_queue.cc:260] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:16.369143 19246 consensus_queue.cc:260] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:16.369534 18889 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:16.309623 19249 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:16.370306 19246 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:16.370178 19249 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:16.369436 19200 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.347103 19204 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 7. Current term is 8.
I20260709 13:08:16.357620 13708 raft_consensus.cc:1240] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:08:16.372162 19204 raft_consensus.cc:3055] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:16.365859 13715 raft_consensus.cc:2393] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 10: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:16.372581 19204 raft_consensus.cc:740] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:16.372888 18810 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:16.373302 18810 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.370913 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:16.373706 18810 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.370882 14393 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:16.373443 19204 consensus_queue.cc:260] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:16.277426 19101 consensus_queue.cc:237] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:16.357396 19190 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:16.376065 19204 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:16.376412 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:16.377568 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:16.378456 13716 raft_consensus.cc:2410] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 15 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:08:16.366796 19186 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:16.360446 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:16.383087 13710 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:16.337015 14367 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:16.373414 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:16.385907 13715 raft_consensus.cc:2393] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 11: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:08:16.552419 19167 consensus_meta.cc:287] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.646s	user 0.010s	sys 0.000s
W20260709 13:08:16.552593 19210 consensus_meta.cc:287] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.791s	user 0.004s	sys 0.007s
I20260709 13:08:16.584127 13710 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:16.584837 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 3102) took 1470 ms. Trace:
I20260709 13:08:16.554176 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:16.585191 13710 rpcz_store.cc:276] 0709 13:08:15.114287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.580977 (+1466690us) service_pool.cc:224] Handling call
0709 13:08:16.581389 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.584558 (+  3169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.584778 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:16.590793 19210 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:16.591430 19210 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:16.591921 19210 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:16.342381 19212 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:16.609831 19212 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:16.583806 19167 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:16.612032 19167 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:16.613328 19167 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:16.583930 19125 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:16.617004 19100 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:16.617566 19125 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:16.641012 13680 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:16.556563 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 219670us
I20260709 13:08:16.685705 14367 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:08:16.555207 19205 consensus_meta.cc:287] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.506s	user 0.003s	sys 0.007s
W20260709 13:08:16.729915 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 89012.9us
I20260709 13:08:16.588699 19012 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:08:16.723925 18893 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.025s	sys 0.030s
I20260709 13:08:16.382649 19186 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:16.750952 19186 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.751329 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2642) took 1694 ms. Trace:
I20260709 13:08:16.751868 13713 rpcz_store.cc:276] 0709 13:08:15.056877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.850108 (+793231us) service_pool.cc:224] Handling call
0709 13:08:15.913516 (+ 63408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.098867 (+185351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.750989 (+652122us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400260554. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:16.751245 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358379776}
I20260709 13:08:16.756790 19096 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:16.757244 19096 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:16.757606 19096 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.754280 13709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 3098) took 1905 ms. Trace:
I20260709 13:08:16.762900 13709 rpcz_store.cc:276] 0709 13:08:14.848990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.787562 (+938572us) service_pool.cc:224] Handling call
0709 13:08:15.787850 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.149257 (+361407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.754052 (+604795us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54002e81d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:16.754226 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":818840832}
I20260709 13:08:16.764391 13709 raft_consensus.cc:1240] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:16.742313 13707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 1360) took 1501 ms. Trace:
W20260709 13:08:16.743498 13789 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.040s	sys 0.017s
W20260709 13:08:16.783486 13789 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.041s	sys 0.017s
I20260709 13:08:16.784409 13790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2458) took 2306 ms. Trace:
I20260709 13:08:16.784864 13790 rpcz_store.cc:276] 0709 13:08:14.478324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.478447 (+   123us) service_pool.cc:224] Handling call
0709 13:08:14.478736 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:16.026339 (+1547603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.784141 (+757802us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b540026ded4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:16.784348 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3504014208}
I20260709 13:08:16.776664 13707 rpcz_store.cc:276] 0709 13:08:15.241244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.730246 (+1489002us) service_pool.cc:224] Handling call
0709 13:08:16.741654 (+ 11408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.741870 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.741908 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:16.741965 (+    57us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:16.742009 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.742082 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.742240 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:16.746111 13858 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.013s	sys 0.049s
I20260709 13:08:16.748922 13715 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:16.795476 13858 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.013s	sys 0.049s
I20260709 13:08:16.795933 13715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 3106) took 1663 ms. Trace:
I20260709 13:08:16.796489 13715 rpcz_store.cc:276] 0709 13:08:15.132545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.731455 (+1598910us) service_pool.cc:224] Handling call
0709 13:08:16.748738 (+ 17283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.795640 (+ 46902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.795874 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:16.800285 13755 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.010s	sys 0.021s
I20260709 13:08:16.734485 19228 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:08:16.801666 13755 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.011s	sys 0.021s
W20260709 13:08:16.802567 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 662051us
I20260709 13:08:16.737578 19205 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:16.783466 18893 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.025s	sys 0.031s
I20260709 13:08:16.365938 18698 consensus_queue.cc:237] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:16.739645 19012 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.808015 13861 raft_consensus.cc:1275] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:08:16.816727 13791 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.017s	sys 0.034s
W20260709 13:08:16.830863 13791 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.017s	sys 0.034s
I20260709 13:08:16.818944 13713 raft_consensus.cc:1240] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:16.839222 14395 raft_consensus.cc:3055] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:16.840814 13711 raft_consensus.cc:1275] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:08:16.841364 13711 pending_rounds.cc:85] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 8
I20260709 13:08:16.841692 13711 pending_rounds.cc:107] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 12.9
W20260709 13:08:16.822592 13756 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.033s	sys 0.055s
W20260709 13:08:16.863451 13756 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.034s	sys 0.055s
W20260709 13:08:16.863884 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 680335us
I20260709 13:08:16.823221 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:16.839695 14395 raft_consensus.cc:740] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:16.864990 13756 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:08:16.853576 19196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.006s	sys 0.021s
I20260709 13:08:16.834992 19012 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:16.861959 19247 log.cc:927] Time spent T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:16.835355 19228 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:16.866572 13862 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.007s	sys 0.027s
I20260709 13:08:16.876190 14395 consensus_queue.cc:260] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:16.882414 13862 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.007s	sys 0.027s
I20260709 13:08:16.883033 14395 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:16.868991 19196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.006s	sys 0.022s
I20260709 13:08:16.819555 13707 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:16.864500 19249 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:16.863292 13711 raft_consensus.cc:2889] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:16.870059 18863 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:16.898795 18947 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.022s	sys 0.004s
W20260709 13:08:16.903497 13831 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.007s	sys 0.016s
W20260709 13:08:16.904066 13831 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.007s	sys 0.016s
W20260709 13:08:16.905022 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.905476 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.905944 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.914032 13707 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:16.919363 13711 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:16.890163 19228 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:16.894254 19210 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:16.907577 18947 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.023s	sys 0.004s
W20260709 13:08:16.914983 19101 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.005s	sys 0.020s
W20260709 13:08:16.911834 19097 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.013s	sys 0.011s
W20260709 13:08:16.926565 18679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.028s	sys 0.036s
W20260709 13:08:16.930354 19101 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.005s	sys 0.020s
W20260709 13:08:16.928910 19097 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.013s	sys 0.011s
W20260709 13:08:16.958806 19251 log.cc:927] Time spent T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:08:16.961877 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 1277) took 1082 ms. Trace:
I20260709 13:08:16.962291 13788 rpcz_store.cc:276] 0709 13:08:15.879754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.879886 (+   132us) service_pool.cc:224] Handling call
0709 13:08:15.880313 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.880654 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.880681 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:15.881119 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:08:16.280147 (+399028us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:16.303174 (+ 23027us) log.cc:844] Serialized 14 byte log entry
0709 13:08:16.303390 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.303492 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:16.961662 (+658170us) raft_consensus.cc:1685] finished
0709 13:08:16.961680 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.961817 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15390,"prepare.queue_time_us":58397,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":75,"raft.queue_time_us":761,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":23698,"thread_start_us":321926,"threads_started":1,"wal-append.queue_time_us":985472}
I20260709 13:08:16.937186 19257 raft_consensus.cc:2764] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:08:16.968295 19212 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.968833 19212 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:16.970983 19212 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:16.957254 19155 consensus_queue.cc:1059] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
W20260709 13:08:16.973268 13830 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.129:37533 timed out after 1.888s (SENT) [suppressed 17 similar messages]
I20260709 13:08:16.973977 13856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3524) took 1129 ms. Trace:
I20260709 13:08:16.974550 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1886) took 1383 ms. Trace:
I20260709 13:08:16.974959 14397 rpcz_store.cc:276] 0709 13:08:15.590801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.808488 (+217687us) service_pool.cc:224] Handling call
0709 13:08:15.832585 (+ 24097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:15.956080 (+123495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.956127 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:15.956186 (+    59us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:15.956237 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.974341 (+1018104us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400383954. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:16.974384 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.974489 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252556032}
W20260709 13:08:16.977262 13860 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 3522) took 1231 ms (client timeout 1579 ms). Trace:
W20260709 13:08:16.977823 13860 rpcz_store.cc:269] 0709 13:08:15.745425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.745806 (+   381us) service_pool.cc:224] Handling call
0709 13:08:16.977103 (+1231297us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b54001ad1d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:16.977205 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1302868224}
I20260709 13:08:16.978870 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2648) took 1563 ms. Trace:
W20260709 13:08:16.977265 18810 consensus_meta.cc:287] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.603s	user 0.011s	sys 0.000s
W20260709 13:08:16.975309 19246 consensus_meta.cc:287] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.604s	user 0.004s	sys 0.004s
I20260709 13:08:16.983824 18978 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:16.988613 13682 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:16.975281 19261 log.cc:927] Time spent T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:17.012826 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3527) took 1167 ms. Trace:
I20260709 13:08:16.974385 13856 rpcz_store.cc:276] 0709 13:08:15.844520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.844687 (+   167us) service_pool.cc:224] Handling call
0709 13:08:15.892289 (+ 47602us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.892626 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.892683 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:15.926129 (+ 33446us) log.cc:844] Serialized 26 byte log entry
0709 13:08:16.295617 (+369488us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:16.295657 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.295724 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:16.973769 (+678045us) raft_consensus.cc:1685] finished
0709 13:08:16.973787 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.973919 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":64864,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":12208,"thread_start_us":365690,"threads_started":1,"wal-append.queue_time_us":918853}
I20260709 13:08:16.979379 13713 rpcz_store.cc:276] 0709 13:08:15.415312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.752976 (+1337664us) service_pool.cc:224] Handling call
0709 13:08:16.753399 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.833875 (+ 80476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.978622 (+144747us) spinlock_profiling.cc:243] Waited 65.3 ms on lock 0x7b54001536d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:16.978812 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150227200}
I20260709 13:08:17.000406 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:16.970783 19096 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:16.935678 18679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.028s	sys 0.036s
I20260709 13:08:17.003955 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:17.009581 19186 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.011529 19118 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.013190 13858 rpcz_store.cc:276] 0709 13:08:15.845589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.905542 (+ 59953us) service_pool.cc:224] Handling call
0709 13:08:15.906001 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:16.165943 (+259942us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.166318 (+   375us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:16.169236 (+  2918us) log.cc:844] Serialized 26 byte log entry
0709 13:08:16.796018 (+626782us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:16.796085 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.796176 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:17.012588 (+216412us) raft_consensus.cc:1685] finished
0709 13:08:17.012613 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.012767 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2438,"raft.queue_time_us":61551,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":7430,"thread_start_us":863697,"threads_started":2,"wal-append.queue_time_us":714168}
I20260709 13:08:16.998553 19212 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:17.036623 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.006999 18810 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.029986 18679 consensus_queue.cc:1243] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer ceb06175847b428ea8bd77055fcddf58 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:17.018529 18978 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.045264 18978 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:17.038538 19212 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.049585 14395 raft_consensus.cc:1275] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:08:17.050081 14395 pending_rounds.cc:85] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 8
I20260709 13:08:17.050374 14395 pending_rounds.cc:107] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:08:17.050668 14395 raft_consensus.cc:2889] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:17.035758 19104 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:17.046543 19101 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.036043 19097 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:17.062162 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.036854 18889 consensus_queue.cc:1048] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 13:08:17.061276 19146 consensus_meta.cc:287] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.698s	user 0.011s	sys 0.000s
I20260709 13:08:17.078843 18948 raft_consensus.cc:3055] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:17.063475 19097 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.090003 19156 raft_consensus.cc:3055] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:17.088893 18948 raft_consensus.cc:740] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:17.062604 19101 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.091024 18810 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:17.105758 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 240856us
I20260709 13:08:17.092022 19210 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:17.109491 13863 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:17.076054 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 1276) took 1227 ms. Trace:
I20260709 13:08:17.109740 13756 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:17.092218 19012 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.092995 19186 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:17.115564 18658 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:17.101107 19204 consensus_meta.cc:287] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.724s	user 0.010s	sys 0.003s
I20260709 13:08:17.113101 13791 rpcz_store.cc:276] 0709 13:08:15.848826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.857310 (+  8484us) service_pool.cc:224] Handling call
0709 13:08:15.882563 (+ 25253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:15.882744 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:16.197231 (+314487us) log.cc:844] Serialized 14 byte log entry
0709 13:08:17.075466 (+878235us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.075549 (+    83us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:17.075613 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.075800 (+   187us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.075964 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":43571,"prepare.run_cpu_time_us":2938,"prepare.run_wall_time_us":10676,"raft.queue_time_us":76553,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":4719,"thread_start_us":1149912,"threads_started":3,"wal-append.queue_time_us":758574}
I20260709 13:08:17.119637 13756 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:17.098644 19156 raft_consensus.cc:740] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:17.129441 13788 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:17.130597 13791 raft_consensus.cc:1275] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:17.133077 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:17.133946 13788 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:08:17.135866 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:17.138135 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:17.138880 13788 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:17.140645 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:17.141908 13789 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
W20260709 13:08:17.125916 19264 log.cc:927] Time spent T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:08:17.142954 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:17.145592 19271 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.146152 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:17.148082 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:17.149400 18978 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.145444 13756 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:17.155819 13680 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:17.157871 13788 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:08:17.116755 19228 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:17.161029 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.163182 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 189929us
W20260709 13:08:17.164091 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 478499us
I20260709 13:08:17.143847 18810 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.143550 19259 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:17.153456 19212 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:17.140116 18658 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.144219 19096 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:17.173947 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.180198 14401 raft_consensus.cc:1240] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:17.180521 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.184031 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:17.181182 14395 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:08:17.176319 19228 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:17.164311 18863 consensus_queue.cc:1048] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:08:17.177376 19206 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.196647 14397 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:17.162927 19104 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:08:17.164474 18978 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.201803 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:17.187966 19204 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.178555 19273 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:08:17.201856 13715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 3119) took 1017 ms. Trace:
I20260709 13:08:17.185395 18658 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.203742 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:17.163365 19271 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.240649 13715 rpcz_store.cc:276] 0709 13:08:16.185682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.855433 (+669751us) service_pool.cc:224] Handling call
0709 13:08:16.855800 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.856057 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:08:17.112831 (+256774us) log.cc:844] Serialized 14 byte log entry
0709 13:08:17.201500 (+ 88669us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.201568 (+    68us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:17.201620 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.201689 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.201797 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":339653,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":891,"raft.queue_time_us":804,"thread_start_us":332810,"threads_started":2}
I20260709 13:08:17.206032 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:17.207085 19200 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:17.207501 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:08:17.208544 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.209010 14400 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:17.239809 19280 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.241245 19204 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:17.208877 19124 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:17.209623 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:17.164745 18948 consensus_queue.cc:260] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:17.209930 19270 consensus_queue.cc:1059] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:17.212342 19146 consensus_queue.cc:1059] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:17.214068 19210 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:17.215004 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2810) took 1011 ms. Trace:
I20260709 13:08:17.215575 19268 consensus_queue.cc:1059] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:17.217670 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:17.258028 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:17.183324 19156 consensus_queue.cc:260] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:17.254645 14368 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:17.218261 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:17.219880 19169 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.220254 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:17.255718 13862 rpcz_store.cc:276] 0709 13:08:16.203535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.224670 (+ 21135us) service_pool.cc:224] Handling call
0709 13:08:16.224982 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.225206 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:16.883088 (+657882us) log.cc:844] Serialized 14 byte log entry
0709 13:08:17.214674 (+331586us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.214732 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:17.214778 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.214843 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.214951 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31281,"prepare.queue_time_us":773778,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":9352,"raft.queue_time_us":31454,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":916984,"threads_started":2}
I20260709 13:08:17.221204 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:17.226413 13829 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:17.249322 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:17.258550 13856 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:08:17.261875 13715 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.228860 14399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1874) took 1641 ms. Trace:
I20260709 13:08:17.233397 19191 consensus_queue.cc:1059] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:17.236361 19246 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:17.238158 19266 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:17.267900 19266 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.268536 18978 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:17.269392 18948 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:17.270232 19266 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:17.273720 19012 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:17.265934 19169 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:17.277709 19169 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:17.277457 19265 consensus_queue.cc:1059] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:17.279556 18658 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:17.247779 19280 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.266661 19124 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.281805 19280 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:17.238737 18679 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:17.191114 19228 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.181440 18810 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.205775 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:17.196468 19275 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:17.243875 14393 raft_consensus.cc:2393] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 13: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:17.244457 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:17.298321 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:17.247360 13756 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:17.248576 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:17.300696 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 53425.1us
I20260709 13:08:17.253720 13788 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:17.302393 13862 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:17.252842 13707 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:17.248001 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:08:17.250241 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.256142 13716 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:17.247519 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:17.250164 14402 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:17.291381 18947 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:17.200349 19206 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.257648 13790 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:17.297405 19228 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:17.259981 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:17.310647 13860 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
W20260709 13:08:17.260579 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 104831us
I20260709 13:08:17.262555 14399 rpcz_store.cc:276] 0709 13:08:15.587850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.754168 (+166318us) service_pool.cc:224] Handling call
0709 13:08:15.754421 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.175818 (+1421397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.175845 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.175890 (+    45us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:17.175925 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.228560 (+ 52635us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54006b5154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:17.228623 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.228787 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3268457856}
I20260709 13:08:17.301190 19270 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.262512 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:17.265821 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:17.267040 19246 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.284727 13709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 3107) took 1116 ms. Trace:
I20260709 13:08:17.251497 19200 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:17.283306 13861 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:17.293912 13715 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:17.312665 13680 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:17.329860 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:17.296726 13863 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:17.299351 13713 raft_consensus.cc:2393] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 13: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:17.198184 18698 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:17.253367 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:17.305162 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:17.307696 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:17.336439 13716 raft_consensus.cc:2393] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 18: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:17.335194 19288 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:17.310161 13757 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:17.251349 19097 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:17.312821 13709 rpcz_store.cc:276] 0709 13:08:16.168051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.765970 (+597919us) service_pool.cc:224] Handling call
0709 13:08:16.766227 (+   257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:16.766405 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.766430 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:16.808742 (+ 42312us) log.cc:844] Serialized 26 byte log entry
0709 13:08:17.109501 (+300759us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:17.109554 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.109644 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:17.284515 (+174871us) raft_consensus.cc:1685] finished
0709 13:08:17.284533 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.284674 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":198156,"threads_started":1,"wal-append.queue_time_us":309752}
W20260709 13:08:17.284869 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 58657.9us
I20260709 13:08:17.298714 19275 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:17.348341 19275 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.301172 18658 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:17.312251 13856 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:08:17.353840 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:17.354226 19206 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:17.331041 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3483) took 3334 ms. Trace:
I20260709 13:08:17.311793 18893 consensus_queue.cc:1059] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:08:17.340287 18698 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.355914 18893 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:17.356329 18893 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.332583 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:17.356667 18893 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:17.330583 13715 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:17.355034 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:17.358510 13856 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:08:17.359078 18810 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:17.306197 19272 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
W20260709 13:08:17.361433 19277 log.cc:927] Time spent T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:17.362224 13856 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:17.330472 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:17.365540 19101 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:17.366746 19097 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:17.367152 19097 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:17.367565 19097 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.368371 19186 raft_consensus.cc:3055] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:17.368755 19186 raft_consensus.cc:740] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:17.371454 13864 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:17.371899 13711 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:08:17.373291 19124 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:17.373943 13714 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 2646) took 2141 ms (client timeout 1996 ms). Trace:
I20260709 13:08:17.374178 13710 raft_consensus.cc:1275] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:08:17.374323 13714 rpcz_store.cc:269] 0709 13:08:15.232214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.629290 (+397076us) service_pool.cc:224] Handling call
0709 13:08:17.373769 (+1744479us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54001f7054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:17.373881 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365958528}
I20260709 13:08:17.375110 13864 raft_consensus.cc:3055] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:17.376067 13864 raft_consensus.cc:740] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:17.376964 13864 consensus_queue.cc:260] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.378201 13864 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.378711 19273 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.334290 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:17.307066 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 52495.3us
I20260709 13:08:17.382647 14368 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:17.385382 14368 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:17.297945 18679 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:17.314318 19012 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:17.386611 14368 leader_election.cc:304] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:17.386861 19012 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:17.387799 19012 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:17.387938 18679 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:17.388233 19012 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:17.313120 19257 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.331947 19173 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.311877 19270 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.394094 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:17.355566 13863 rpcz_store.cc:276] 0709 13:08:13.996738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.996909 (+   171us) service_pool.cc:224] Handling call
0709 13:08:14.007867 (+ 10958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:14.477080 (+469213us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54002f4f20. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f523245c06f 00007f52324d4f60 00007f52324d67de 00007f52324e0b49 00007f52324e1416 00007f52324ddd8f 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62
0709 13:08:17.101523 (+2624443us) spinlock_profiling.cc:243] Waited 59.2 ms on lock 0x7b54002f4f20. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f5232453a1d 00007f523243a1a4 00007f52324bc447 00007f52324d4fe7 00007f52324d67de 00007f52324e0b49 00007f52324e1416 00007f52324ddd8f 00007f52324dd83e 00007f52374a2419
0709 13:08:17.330802 (+229279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.330989 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":584279296}
W20260709 13:08:17.389951 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 59561.2us
I20260709 13:08:17.390515 14401 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:17.392319 13682 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:17.347247 19155 consensus_queue.cc:1059] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:17.397169 14368 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:17.414793 13862 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
W20260709 13:08:17.415656 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 192695us
I20260709 13:08:17.416893 14402 raft_consensus.cc:1240] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:17.418511 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:17.419395 14399 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
W20260709 13:08:17.397297 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 141223us
I20260709 13:08:17.421166 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:17.423017 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:17.395211 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:17.423774 13715 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:17.427904 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:17.428107 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:17.340569 18947 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.340442 19288 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.429045 13714 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:17.430409 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:17.357702 18698 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:17.430878 13856 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:17.425582 13682 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:17.428505 13707 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:08:17.379192 19273 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.462854 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:17.391297 19012 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.450379 13715 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:08:17.432677 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:17.466001 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:17.451429 13864 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:08:17.466674 13864 pending_rounds.cc:85] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 11
I20260709 13:08:17.333825 19196 consensus_queue.cc:1048] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:08:17.391927 19246 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:17.464210 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:17.393482 19101 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.467000 13864 pending_rounds.cc:107] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:08:17.466620 14398 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:08:17.416363 19190 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:17.467358 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 157289us
I20260709 13:08:17.437206 19212 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:17.498677 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 110148us
I20260709 13:08:17.497807 13864 raft_consensus.cc:2889] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:17.427469 18978 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:17.437744 18863 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.499231 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:17.506321 13862 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:17.507758 14368 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:17.395809 19257 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:17.529162 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:17.530050 13862 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:08:17.531793 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:17.532580 13862 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:08:17.417429 18810 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:08:17.593577 13785 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:17.596807 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:17.598814 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:17.600980 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:17.601759 13788 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.497221 14397 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:08:17.463637 13856 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:08:17.394616 19272 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:08:17.500818 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:17.510383 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:17.626315 13864 raft_consensus.cc:1240] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:17.627686 13864 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:17.461444 19288 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.633162 13791 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:17.485339 19104 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:17.633972 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 126317us
I20260709 13:08:17.634881 14398 raft_consensus.cc:1240] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:17.635473 13856 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:17.640020 13862 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:17.499850 19190 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.501516 19212 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:17.642418 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 219451us
I20260709 13:08:17.463657 18947 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.648970 13788 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:08:17.505826 18978 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:17.673066 14367 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:17.497311 19206 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.145s
I20260709 13:08:17.414454 19173 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.686513 14367 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:17.716420 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 3104) took 2593 ms. Trace:
I20260709 13:08:17.504029 19101 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:17.673919 19190 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:17.732496 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 93261.4us
I20260709 13:08:17.676009 19212 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:17.717712 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 281827us
I20260709 13:08:17.737980 13710 rpcz_store.cc:276] 0709 13:08:15.122972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.586249 (+1463277us) service_pool.cc:224] Handling call
0709 13:08:17.373884 (+787635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.374513 (+   629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.716126 (+341613us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b54001f7050. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:17.716322 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1810780416}
I20260709 13:08:17.597559 18863 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.684352 18978 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:17.747473 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 60977.5us
I20260709 13:08:17.749668 14367 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:17.670454 19104 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:17.754590 19089 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:17.772075 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 1357) took 2733 ms. Trace:
W20260709 13:08:17.756832 19147 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:08:17.774760 13708 rpcz_store.cc:276] 0709 13:08:15.038723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.807208 (+768485us) service_pool.cc:224] Handling call
0709 13:08:15.807501 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:16.372408 (+564907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.771795 (+1399387us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b54000c5154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:17.772012 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1264644864}
I20260709 13:08:17.776526 19284 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:17.776764 19219 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.094s
I20260709 13:08:17.758247 19200 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:17.777590 19293 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.106s
W20260709 13:08:17.791882 19238 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 1.518s	user 0.015s	sys 0.000s
I20260709 13:08:17.792810 19101 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:17.793548 19101 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:17.793932 19101 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.794313 19101 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.795511 19303 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:17.796041 19303 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:17.796449 19303 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.796892 18863 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:17.797472 18863 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.797911 18863 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:17.800803 18947 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:17.801945 19257 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:17.802531 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3519) took 2077 ms. Trace:
I20260709 13:08:17.819540 13865 rpcz_store.cc:276] 0709 13:08:15.725158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.740564 (+ 15406us) service_pool.cc:224] Handling call
0709 13:08:15.740871 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.741203 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.741230 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:15.749550 (+  8320us) log.cc:844] Serialized 26 byte log entry
0709 13:08:16.028339 (+278789us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:16.028470 (+   131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.029790 (+  1320us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:17.675224 (+1645434us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:17.802211 (+126987us) raft_consensus.cc:1685] finished
0709 13:08:17.802236 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.802453 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7100,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":7232384,"thread_start_us":276788,"threads_started":1,"wal-append.queue_time_us":450439}
I20260709 13:08:17.780149 19284 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:17.778245 19300 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:08:17.837124 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 99974.6us
I20260709 13:08:17.756229 19275 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:17.841763 19292 log.cc:927] Time spent T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 13:08:17.842456 19285 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.584s	user 0.000s	sys 0.010s
I20260709 13:08:17.838357 19291 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:17.845996 18834 raft_consensus.cc:3055] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:17.847038 19204 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:17.847776 19124 raft_consensus.cc:3055] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:17.851733 19273 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:17.853310 19156 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:17.854220 19104 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:17.831025 19219 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:17.857154 19228 consensus_meta.cc:287] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.001s
I20260709 13:08:17.857887 19097 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.859098 19284 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.867669 13756 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:08:17.874581 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.884702 19302 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.885269 19302 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.869621 19124 raft_consensus.cc:740] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:17.886300 19097 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:17.887102 19124 consensus_queue.cc:260] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.887676 19288 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:17.888144 19124 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.880124 19228 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:17.889788 19288 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:17.884769 19280 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:17.891031 19228 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:17.891348 19280 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.891801 19280 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:17.867879 18834 raft_consensus.cc:740] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:17.893042 18834 consensus_queue.cc:260] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:17.894194 18834 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:17.894693 19219 raft_consensus.cc:697] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:17.895722 19219 consensus_queue.cc:237] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.895895 19186 consensus_queue.cc:260] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.897010 19186 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:17.898844 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.887298 19302 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:17.891469 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.868194 19291 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.912745 13710 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:17.917124 13709 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:08:17.914851 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 171529us
I20260709 13:08:17.919147 14366 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:17.920583 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:17.919813 14368 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:17.861763 19300 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.875098 18863 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:17.917930 19291 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.934688 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:17.935446 13865 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:08:17.935657 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:17.937371 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:17.937506 19311 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:17.938067 19311 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.939359 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:17.940397 19311 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:17.941809 19275 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:17.919435 19138 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
W20260709 13:08:17.928073 18893 consensus_meta.cc:287] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.002s
I20260709 13:08:17.944460 18893 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.945202 13859 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:17.945907 18978 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.947779 19270 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:17.947921 19300 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:17.949853 19271 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:17.919896 19200 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:17.951824 19200 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.951941 18997 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.952280 19200 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:17.953531 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:17.917826 18942 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:17.954668 18942 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.955122 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:17.956589 18893 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:17.960395 19173 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:17.965088 13716 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:17.971339 19291 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:17.973503 19291 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:17.945346 19248 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
W20260709 13:08:17.983275 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 64262.9us
I20260709 13:08:17.986601 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:17.987352 13858 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:17.989567 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:17.990381 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:17.990403 13790 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:17.991238 13788 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:17.993882 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:17.994999 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:17.997961 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 493409us
I20260709 13:08:18.000871 13864 raft_consensus.cc:1275] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:17.920249 19303 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.005745 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:18.006569 13714 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:18.010895 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:18.012287 13788 raft_consensus.cc:2393] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 12: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:18.005816 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:18.017833 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:18.018741 13789 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:18.020861 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.021101 13858 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:18.003913 19271 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.996752 18889 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:08:18.043879 13682 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.008s	sys 0.009s
W20260709 13:08:18.044478 13682 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.008s	sys 0.009s
W20260709 13:08:18.044862 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 624630us
I20260709 13:08:18.045849 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:18.031450 13711 raft_consensus.cc:2393] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 13: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:18.038579 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:17.996762 19313 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:18.037448 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:18.048040 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 128474us
I20260709 13:08:18.054939 14368 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:18.046067 19271 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.052650 13787 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:08:18.026340 19284 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.052767 19303 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:18.038763 13680 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:18.053738 14398 raft_consensus.cc:2368] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 13.
I20260709 13:08:18.053627 13790 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:18.053366 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:18.059587 13714 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
W20260709 13:08:18.062526 14394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.004s	sys 0.013s
W20260709 13:08:18.062880 14394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.004s	sys 0.013s
I20260709 13:08:18.063887 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:18.064298 13680 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:18.064884 13790 raft_consensus.cc:2393] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 12: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:18.066174 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:18.063925 14366 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:18.069375 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:18.070896 14368 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:18.071645 14393 raft_consensus.cc:1240] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:18.072741 19284 leader_election.cc:290] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:18.026474 19311 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:08:18.064947 19302 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:18.074306 19306 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:08:18.080281 18942 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:18.081779 19012 consensus_meta.cc:287] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.000s
I20260709 13:08:18.082358 19012 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.055150 19180 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.083628 14395 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:18.083935 19180 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.091094 19203 raft_consensus.cc:3055] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:18.091835 19203 raft_consensus.cc:740] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:17.998113 19190 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.093742 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:18.094553 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:18.098125 13755 leader_election.cc:400] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 13.
I20260709 13:08:18.096629 13830 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:18.095845 13680 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:18.098493 13755 leader_election.cc:403] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:08:18.101778 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:18.102435 13860 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:18.104317 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:18.104799 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:18.104524 13710 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:18.105397 13860 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:08:18.106364 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:18.107036 13862 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:18.109157 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:18.109931 13860 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:18.100239 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:18.111874 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:18.056882 19096 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:18.112447 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:18.061556 18978 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:18.118150 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:18.119777 13859 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:08:18.129168 13711 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:08:18.130119 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:18.120996 13789 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:18.030229 19300 consensus_queue.cc:1059] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:08:18.140780 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:18.119679 13682 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:18.120481 13856 raft_consensus.cc:1240] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:08:18.023051 19322 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.094s
I20260709 13:08:18.140940 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:18.144351 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:18.144114 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:18.128158 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:18.138141 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 77559.3us
I20260709 13:08:18.138849 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:18.145337 13710 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:18.130693 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:18.141229 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:18.142477 13830 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:18.130717 13711 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:08:18.140595 13859 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:18.138540 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:18.144990 13789 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:08:18.132781 13862 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:18.147619 13790 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:18.135620 13713 raft_consensus.cc:2393] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 12: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:18.148483 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:18.149330 13716 raft_consensus.cc:2393] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 9: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:18.097201 18889 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:08:18.155514 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.112090 19302 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.111871 19303 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:18.111707 19306 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:18.153565 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:18.157403 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:18.142287 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 45320us
I20260709 13:08:18.119983 19248 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:08:18.185081 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.066879 19273 consensus_queue.cc:1059] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:08:18.065490 19299 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 13:08:18.159768 13682 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:18.160861 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:18.155115 13830 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:08:18.198997 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 43965.5us
I20260709 13:08:18.162483 13710 raft_consensus.cc:1240] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:18.164399 13860 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:08:18.119583 19096 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.118587 19173 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.165757 13859 raft_consensus.cc:1240] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:18.127923 19284 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:18.128648 19228 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:18.087287 19280 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.184701 13790 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:18.141342 19270 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.184935 13783 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:18.186324 14366 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:18.143392 18942 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 13.
W20260709 13:08:18.205809 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 46136us
I20260709 13:08:18.236195 13682 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:18.163874 18698 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.148541 19212 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.220119 13791 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:18.164863 19180 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:18.177282 19303 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.130383 19314 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.086s
I20260709 13:08:18.187924 19319 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.233894 13787 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
W20260709 13:08:18.256608 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 102387us
I20260709 13:08:18.257108 13783 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
W20260709 13:08:18.233987 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 47759us
W20260709 13:08:18.216094 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.235069 13757 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:18.182845 19323 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:18.241608 13682 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:18.263242 13757 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:18.209998 19096 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:18.209640 19169 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:18.223232 19138 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.227814 19228 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.224066 19147 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:18.251736 13790 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:08:18.224956 19306 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:18.185101 19302 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:18.260637 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:18.157595 19203 consensus_queue.cc:260] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:18.264020 13782 raft_consensus.cc:1240] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:08:18.280062 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:18.272904 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:18.274084 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:18.274601 14400 raft_consensus.cc:1275] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:18.274340 13682 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:18.224689 19173 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:18.279001 18997 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:18.279985 19306 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:18.345913 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 82746.5us
I20260709 13:08:18.247722 19309 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:18.252267 19303 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:18.349924 19219 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.435690 19219 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.235761 19260 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:08:18.439441 19273 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:18.440804 19273 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:18.238947 19270 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:18.444597 19329 log.cc:927] Time spent T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 13:08:18.445182 19270 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:18.263629 19323 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:18.351761 19316 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.447294 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:18.447686 19323 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:18.447983 13707 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:18.447820 19316 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.264920 19325 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:18.450665 19325 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.451022 19325 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:18.267355 19293 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.160s
I20260709 13:08:18.453855 18863 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:18.455744 19124 consensus_meta.cc:287] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.567s	user 0.005s	sys 0.005s
I20260709 13:08:18.361431 19203 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:18.459122 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1355) took 2728 ms. Trace:
I20260709 13:08:18.459542 13857 rpcz_store.cc:276] 0709 13:08:15.731082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.731199 (+   117us) service_pool.cc:224] Handling call
0709 13:08:15.731482 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.282644 (+1551162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.282688 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.282742 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:17.282786 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.458872 (+1176086us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54003dc7d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:18.458924 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.459055 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3566852352}
W20260709 13:08:18.460754 18834 consensus_meta.cc:287] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.566s	user 0.010s	sys 0.000s
I20260709 13:08:18.425262 13714 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:18.277225 19301 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:18.423276 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:18.468796 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.430411 13757 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:18.446193 19328 log.cc:927] Time spent T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 13:08:18.278703 19169 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.267189 19097 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.272436 19196 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:18.458804 19325 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.281216 19228 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:18.423362 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:18.245390 18698 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.494287 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:18.474192 13861 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:18.495225 13707 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:18.480500 13856 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:18.486510 13858 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:08:18.267280 19284 consensus_queue.cc:1059] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.156s
I20260709 13:08:18.362360 19311 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:18.430361 19308 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.509768 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:18.281641 19175 consensus_queue.cc:1059] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.203s
I20260709 13:08:18.465888 19291 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.454432 18863 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.465037 19306 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:18.524574 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.525750 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58552 (request call id 1380) took 1105 ms. Trace:
I20260709 13:08:18.470080 19012 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:18.468360 19309 raft_consensus.cc:697] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:18.268615 19319 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:18.516539 19315 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:18.539037 14394 raft_consensus.cc:2393] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 13: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:18.538492 13713 rpcz_store.cc:276] 0709 13:08:17.420617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.420889 (+   272us) service_pool.cc:224] Handling call
0709 13:08:18.525435 (+1104546us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b540008e154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:18.525663 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1640775552}
I20260709 13:08:18.346024 19138 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.554466 19138 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:18.486222 18834 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:18.555716 18834 raft_consensus.cc:697] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:18.556963 18834 consensus_queue.cc:237] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.496503 19169 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.502733 19273 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.565474 19273 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:18.516364 19327 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.425s	user 0.001s	sys 0.000s
I20260709 13:08:18.496335 19196 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:18.569344 19196 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:18.502480 19190 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:18.573182 19273 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:18.533185 18997 raft_consensus.cc:697] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:08:18.538013 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 263731us
I20260709 13:08:18.583609 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:18.584378 13861 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:18.508914 19097 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.579960 19012 raft_consensus.cc:3055] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:18.596083 13861 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:08:18.600417 19212 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:18.550335 19271 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:18.537060 19308 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.602842 19309 consensus_queue.cc:237] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.604336 19302 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:18.604624 19096 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:18.605592 19337 log.cc:927] Time spent T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
W20260709 13:08:18.362921 19265 consensus_queue.cc:1175] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b9d194f45e044e0988d5de1a99e5cd02" responder_term: 14 status { last_received { term: 13 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:18.607666 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:18.653626 13856 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:18.622519 19303 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:18.631960 19332 log.cc:927] Time spent T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:08:18.633354 18698 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:18.628528 19228 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.634845 18863 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:18.638926 19101 consensus_meta.cc:287] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.844s	user 0.010s	sys 0.000s
I20260709 13:08:18.678128 19101 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.680461 19101 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:18.681432 19308 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:18.642871 13682 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:08:18.682255 19200 consensus_meta.cc:287] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.729s	user 0.006s	sys 0.002s
I20260709 13:08:18.542721 19291 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.682703 19200 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.684690 19291 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:18.588713 19315 raft_consensus.cc:697] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:18.685887 19315 consensus_queue.cc:237] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:18.674098 19340 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:08:18.687819 18997 consensus_queue.cc:237] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:18.651865 19196 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:18.675701 19096 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:18.689139 19306 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:18.676826 19228 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:18.690188 19228 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:18.690675 19228 raft_consensus.cc:697] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 12 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:18.690778 19196 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:18.641480 19012 raft_consensus.cc:740] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:18.655305 19323 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.691844 19228 consensus_queue.cc:237] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.692795 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2479) took 1097 ms. Trace:
I20260709 13:08:18.676204 19303 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:18.693184 13785 rpcz_store.cc:276] 0709 13:08:17.595275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.595393 (+   118us) service_pool.cc:224] Handling call
0709 13:08:17.595786 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:18.050895 (+455109us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:18.050927 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:18.054478 (+  3551us) log.cc:844] Serialized 26 byte log entry
0709 13:08:18.530136 (+475658us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:18.530171 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.530239 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.692599 (+162360us) raft_consensus.cc:1685] finished
0709 13:08:18.692621 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.692741 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41277,"raft.queue_time_us":168620,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":4997,"thread_start_us":831142,"threads_started":2,"wal-append.queue_time_us":621865}
I20260709 13:08:18.694286 19319 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:18.681303 13709 raft_consensus.cc:1240] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:08:18.648037 19280 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:18.692354 19012 consensus_queue.cc:260] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.700753 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:18.702555 13708 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:18.704099 14368 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:18.707173 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:18.709589 14368 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:18.710358 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:18.711220 13712 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:18.718160 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:18.693610 19323 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:18.706902 19303 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.706634 19096 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:18.724200 19316 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:18.722712 19169 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.725157 19012 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.729385 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1900) took 1340 ms. Trace:
I20260709 13:08:18.742393 14393 rpcz_store.cc:276] 0709 13:08:17.389386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.389493 (+   107us) service_pool.cc:224] Handling call
0709 13:08:17.416872 (+ 27379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.072085 (+655213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.729110 (+657025us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b5400383954. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:18.729306 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1505367808}
W20260709 13:08:18.716140 19191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.410s	user 0.018s	sys 0.015s
I20260709 13:08:18.714136 19284 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:18.705905 19271 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:18.743651 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:18.744663 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:18.745832 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:18.748100 13861 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:18.747376 13715 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:18.749656 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:18.750229 13861 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:18.751154 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:18.744920 19191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.441s	user 0.019s	sys 0.015s
I20260709 13:08:18.754930 13708 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 20.
I20260709 13:08:18.755927 13862 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 15: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:18.759956 13715 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:18.719278 19175 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:18.761852 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:18.762112 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:18.762480 13857 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:18.762594 13859 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:18.767724 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:18.768368 13861 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:18.765239 19284 raft_consensus.cc:697] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 12 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:18.780550 19284 consensus_queue.cc:237] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.779644 13859 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 20.
I20260709 13:08:18.783672 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:18.784482 13857 raft_consensus.cc:2393] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 12: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:18.789449 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:18.744400 19303 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.792624 13861 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:18.745710 19096 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.790652 13715 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
W20260709 13:08:18.792418 19350 log.cc:927] Time spent T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:08:18.774410 19325 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:18.753149 19271 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:18.800122 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:18.803399 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.814193 14368 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:18.815519 19191 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:18.818841 19271 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:18.822352 14368 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:18.823318 14367 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:18.823130 14368 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:18.794204 19175 raft_consensus.cc:697] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:18.831164 14368 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:18.831792 14367 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:18.811991 19353 consensus_queue.cc:1059] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:08:18.842545 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:18.825608 19291 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:18.826074 19191 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:18.848203 14367 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:18.835786 19200 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:18.837373 19280 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:18.854488 14367 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:18.837976 19271 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:18.837843 19284 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:18.845885 19356 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:18.862916 19356 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:18.863337 19356 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.863703 19356 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:18.864818 19300 raft_consensus.cc:3055] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:18.865219 19300 raft_consensus.cc:740] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:18.865998 19300 consensus_queue.cc:260] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.846177 19291 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.861402 14367 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:18.849939 19191 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.853408 19306 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:18.878062 19175 consensus_queue.cc:237] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.879352 19303 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:18.880137 19169 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:18.873590 19291 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:18.888587 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:18.889761 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:18.889900 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:18.889953 19173 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:18.890357 13789 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:08:18.890560 13788 raft_consensus.cc:2368] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 15. Current term is 16.
I20260709 13:08:18.890834 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:18.860642 19271 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.891330 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:18.891605 19271 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.893496 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:18.873435 19096 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:18.905630 19169 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:18.906160 19169 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.906639 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:18.906652 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:18.908015 13682 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:18.908255 19169 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:18.909107 19306 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:18.909217 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:18.909513 19306 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.905160 19291 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.910035 13860 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:18.915390 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:18.909962 19306 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:18.940932 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:18.952121 19335 log.cc:927] Time spent T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.529s	user 0.003s	sys 0.000s
I20260709 13:08:18.903167 19271 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.946969 13863 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:18.932896 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:18.958395 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:18.959354 13711 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:08:18.959556 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:18.959647 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:18.960306 13715 raft_consensus.cc:2393] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 8: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:18.910830 13864 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:18.962854 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:18.964164 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.964603 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:18.968021 13829 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:18.965510 13787 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:08:18.965651 13830 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:18.964131 13682 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:18.975287 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:18.976172 13856 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:18.977283 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:18.977929 13856 raft_consensus.cc:1813] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Handling vote request from an unknown peer 35ecb005831740438d7537dd4b840e03
I20260709 13:08:18.978523 13856 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 12: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:18.910260 19169 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.981578 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:18.940131 19324 log.cc:927] Time spent T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.511s	user 0.002s	sys 0.000s
I20260709 13:08:18.993183 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:18.979797 13757 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:18.873695 19280 raft_consensus.cc:697] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 12 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:08:18.931839 19360 log.cc:927] Time spent T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.155s	user 0.000s	sys 0.002s
I20260709 13:08:18.972971 13830 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:08:18.926784 19354 log.cc:927] Time spent T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:08:18.993068 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:18.996690 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 154764us
I20260709 13:08:18.993829 13829 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:18.920337 19138 raft_consensus.cc:3055] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:18.876592 19191 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:18.970726 19303 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:18.955441 19271 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:18.934221 19317 raft_consensus.cc:3055] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:18.956679 19291 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:18.993829 13714 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.987339 19270 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:19.002492 13863 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:08:18.992873 19325 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:18.994707 19096 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:19.001377 19203 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:18.922384 19356 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:18.997932 18893 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:19.008136 13682 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:18.998495 18810 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:19.002327 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:19.011897 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:19.006702 19270 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.005119 19317 raft_consensus.cc:740] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:19.011003 19096 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.999658 19138 raft_consensus.cc:740] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:19.008006 19124 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:08:19.022333 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 161032us
I20260709 13:08:19.009092 19325 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.039776 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:19.021294 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:19.028051 13714 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:18.995195 19169 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:19.012849 19203 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.012595 19097 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:19.017004 18893 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.041177 13715 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:08:19.041579 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:19.044866 19169 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:19.021885 19315 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:19.047971 19315 raft_consensus.cc:697] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:19.049072 19315 consensus_queue.cc:237] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:19.052659 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:19.053500 13708 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:08:19.054406 19203 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:19.042686 19356 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:19.059034 13830 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:19.062135 13861 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:19.016635 19284 raft_consensus.cc:697] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 20 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:19.064721 19284 consensus_queue.cc:237] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:19.023049 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:19.063319 18893 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.067601 19280 consensus_queue.cc:237] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:19.071727 19138 consensus_queue.cc:260] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:19.073136 19138 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.078943 13784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 2994) took 1034 ms. Trace:
I20260709 13:08:19.079358 13784 rpcz_store.cc:276] 0709 13:08:18.044542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.044701 (+   159us) service_pool.cc:224] Handling call
0709 13:08:18.051957 (+  7256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:18.092792 (+ 40835us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:18.092821 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:18.093255 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:08:18.462144 (+368889us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b18002543e0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e0d1 00007f5232499a0f
0709 13:08:18.593066 (+130922us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:18.593108 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.078507 (+485399us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x7b54001e8554. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:19.078576 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:19.078685 (+   109us) raft_consensus.cc:1685] finished
0709 13:08:19.078706 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.078887 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14002,"raft.queue_time_us":4872,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":17903,"spinlock_wait_cycles":120363648,"thread_start_us":130737,"threads_started":1,"wal-append.queue_time_us":589011}
I20260709 13:08:19.029219 19096 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.084450 13830 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:19.024060 19270 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:19.039789 13712 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:19.019958 18810 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:19.098378 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 96113.4us
I20260709 13:08:19.097289 19260 consensus_queue.cc:1059] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:19.086004 19325 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:19.127393 13613 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49436 (request call id 349) took 21609 ms (client timeout 15000 ms). Trace:
I20260709 13:08:19.132895 19173 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:19.123255 13829 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:19.098315 19124 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:19.140069 19173 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.141142 19173 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:19.142127 18810 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:19.147902 19376 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:19.147980 19124 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:19.148694 19376 raft_consensus.cc:697] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 15 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:19.149835 14367 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:19.150000 19124 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:19.149717 19376 consensus_queue.cc:237] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:19.150517 19124 raft_consensus.cc:697] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:19.151782 19147 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:19.151383 19124 consensus_queue.cc:237] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:19.152230 19147 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:19.152992 19309 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:19.157716 19368 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:19.158365 19368 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:19.159585 19369 consensus_queue.cc:1059] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:19.159888 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:19.163957 19368 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:19.164021 13680 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:19.164961 13680 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:19.166241 18997 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.166569 19368 consensus_queue.cc:1059] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:19.166689 18997 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:19.169303 18997 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:19.169978 18997 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:19.170392 18997 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.170831 18997 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:19.171092 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.171737 19212 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:19.172221 19212 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.172655 19212 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:19.176259 19372 log.cc:927] Time spent T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:08:19.184152 19316 raft_consensus.cc:3055] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:19.184659 19316 raft_consensus.cc:740] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:19.185497 19316 consensus_queue.cc:260] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:19.186769 19316 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:19.189551 19300 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:19.191756 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.192641 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 69495.3us
I20260709 13:08:19.194160 13829 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:19.196491 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:19.199112 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:19.164067 13861 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:08:19.201795 13861 pending_rounds.cc:85] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 9
I20260709 13:08:19.201990 13861 pending_rounds.cc:107] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:08:19.202207 13861 raft_consensus.cc:2889] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:19.204419 13715 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:19.160020 19293 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:19.211311 19353 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:19.211596 19309 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:19.212518 19180 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:19.213064 19180 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:19.215075 19180 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:19.216353 19259 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.216832 19259 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:19.218545 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:19.219151 13787 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:08:19.219491 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:19.219856 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:19.219974 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:19.220527 13791 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:08:19.167106 18944 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.025s
I20260709 13:08:19.221207 19175 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:19.221329 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:19.221254 13784 raft_consensus.cc:1240] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:19.222064 13786 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:19.221902 19175 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:19.222666 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:19.223028 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:19.223742 13714 raft_consensus.cc:2393] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 17: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:19.223881 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:19.224062 19175 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:19.224433 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:19.224638 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:19.224931 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.225025 13716 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:08:19.208786 19260 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.226311 19260 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:19.227401 13788 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 25.
I20260709 13:08:19.228195 19260 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:19.228747 19260 consensus_queue.cc:1048] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:19.228822 19203 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:19.230193 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:19.230717 13712 raft_consensus.cc:1813] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Handling vote request from an unknown peer 35ecb005831740438d7537dd4b840e03
I20260709 13:08:19.230567 19299 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:19.231321 13712 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 12: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:19.233078 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 2825) took 1129 ms. Trace:
I20260709 13:08:19.233431 13864 rpcz_store.cc:276] 0709 13:08:18.103981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.104081 (+   100us) service_pool.cc:224] Handling call
0709 13:08:18.910644 (+806563us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54002f3620. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f5232455dc0 00007f52324e1e18 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6
0709 13:08:19.232929 (+322285us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b540004b854. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:19.233023 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1263718016}
W20260709 13:08:19.234686 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 69791.8us
I20260709 13:08:19.234934 13829 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:19.235595 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:19.222005 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:19.237852 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:19.238225 13710 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:19.238459 13790 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:19.240157 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:19.240981 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:19.241910 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:19.242627 14396 raft_consensus.cc:2368] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 15. Current term is 16.
I20260709 13:08:19.243429 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:19.220634 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:19.235607 13756 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:19.246419 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.255174 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.256076 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:19.259485 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.263813 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:19.264791 14400 raft_consensus.cc:2410] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:08:19.266510 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:19.270000 13715 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:19.271804 14396 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 15: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:19.273243 14396 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:08:19.278942 13790 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:19.275167 14367 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:19.290349 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:19.291182 14400 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:08:19.293215 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:19.296680 14399 raft_consensus.cc:2368] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12.
I20260709 13:08:19.297852 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:19.309015 13864 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:19.310623 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:19.106089 19317 consensus_queue.cc:260] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:19.316422 19283 raft_consensus.cc:3055] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:19.317020 19283 raft_consensus.cc:740] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:19.318051 19283 consensus_queue.cc:260] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:19.129312 13613 rpcz_store.cc:269] 0709 13:07:57.513157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.513302 (+   145us) service_pool.cc:224] Handling call
0709 13:08:19.122573 (+21609271us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:13.268164 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:13.585116 (+316952us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:13.592194 (+  7078us) write_op.cc:435] Acquired schema lock
0709 13:08:13.594981 (+  2787us) tablet.cc:662] Decoding operations
0709 13:08:13.609892 (+ 14911us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:13.609998 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:13.610031 (+    33us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:08:13.610451 (+   420us) tablet.cc:701] Row locks acquired
0709 13:08:13.610511 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:08:13.610691 (+   180us) write_op.cc:270] Start()
0709 13:08:13.610845 (+   154us) write_op.cc:276] Timestamp: P: 1783602493610613 usec, L: 0
0709 13:08:13.610879 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:08:13.611654 (+   775us) log.cc:844] Serialized 1317 byte log entry
0709 13:08:14.147796 (+536142us) op_driver.cc:464] REPLICATION: finished
0709 13:08:14.459260 (+311464us) write_op.cc:301] APPLY: starting
0709 13:08:14.471121 (+ 11861us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:14.764173 (+293052us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:14.764310 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:14.766311 (+  2001us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:14.766618 (+   307us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:08:14.766696 (+    78us) write_op.cc:312] APPLY: finished
0709 13:08:14.767016 (+   320us) log.cc:844] Serialized 41 byte log entry
0709 13:08:14.767245 (+   229us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:14.767350 (+   105us) write_op.cc:454] Released schema lock
0709 13:08:14.799543 (+ 32193us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:14.833653 (+ 34110us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:14.833690 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3825414,"reported_tablets":13,"spinlock_wait_cycles":13440,"child_traces":[["op",{"apply.queue_time_us":210721,"apply.run_cpu_time_us":22709,"apply.run_wall_time_us":374360,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16667,"num_ops":3,"prepare.queue_time_us":876103,"prepare.run_cpu_time_us":41069,"prepare.run_wall_time_us":737075,"raft.queue_time_us":119010,"raft.run_cpu_time_us":9955,"raft.run_wall_time_us":105147,"replication_time_us":536740,"spinlock_wait_cycles":15104,"thread_start_us":1057623,"threads_started":4,"wal-append.queue_time_us":375766,"wal-append.run_cpu_time_us":34404,"wal-append.run_wall_time_us":1781795}]]}
I20260709 13:08:19.313202 19175 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:08:19.325441 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:19.230803 19203 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:19.286160 19326 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:19.338253 18893 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:19.321415 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:19.300983 19369 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:19.338387 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:19.354920 14398 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:19.255376 19293 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:19.347126 14399 raft_consensus.cc:1240] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 13:08:19.348410 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.297170 19259 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:19.311407 14400 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 15: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:19.354763 19369 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:19.369792 19219 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:19.370206 19283 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:19.349550 19306 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:19.373519 19212 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:19.375433 19191 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:19.378618 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 2822) took 1307 ms. Trace:
I20260709 13:08:19.418670 13858 rpcz_store.cc:276] 0709 13:08:18.071031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.099211 (+ 28180us) service_pool.cc:224] Handling call
0709 13:08:19.378403 (+1279192us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b54003755d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:19.378542 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":781110656}
I20260709 13:08:19.419183 19315 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.389714 14398 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:19.394944 13710 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:19.425278 19388 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:19.425590 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 169768us
I20260709 13:08:19.425854 19388 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:19.427981 19388 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:19.428510 19388 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:19.428647 14398 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:08:19.429111 19388 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:19.379560 14394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 1708) took 1107 ms. Trace:
I20260709 13:08:19.429912 14394 rpcz_store.cc:276] 0709 13:08:18.272559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.272675 (+   116us) service_pool.cc:224] Handling call
0709 13:08:19.379312 (+1106637us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400147154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:19.379491 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":449448832}
I20260709 13:08:19.415431 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:19.431106 14400 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 25.
I20260709 13:08:19.440001 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:19.440892 14393 raft_consensus.cc:2393] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 12: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:19.431149 19388 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:19.449741 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:19.450817 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:19.451056 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:19.451614 14394 raft_consensus.cc:2393] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 17: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:19.451278 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:19.452349 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:19.452637 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:19.453675 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:19.454358 14400 raft_consensus.cc:2393] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 13: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:19.455298 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:19.456025 14393 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.460494 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:19.419780 19315 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:19.392083 19369 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:19.393055 19203 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:19.466727 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 382335us
W20260709 13:08:19.479974 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.480790 19212 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:19.482527 19212 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:19.484160 19096 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:19.486614 19383 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
I20260709 13:08:19.486774 19096 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:19.487782 14394 raft_consensus.cc:2393] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 13: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:19.489435 19212 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:19.492889 19306 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:19.493495 19315 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:19.494762 19191 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:19.467180 19355 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.003s	sys 0.005s
I20260709 13:08:19.495033 19212 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:19.495608 19355 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.004s	sys 0.005s
I20260709 13:08:19.497658 14401 raft_consensus.cc:1217] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Deduplicated request from leader. Original: 11.11->[12.12-12.12]   Dedup: 12.12->[]
I20260709 13:08:19.498293 14401 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:08:19.500030 18893 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:19.501111 19355 raft_consensus.cc:3055] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:19.501610 19355 raft_consensus.cc:740] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:19.503647 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:19.504630 13860 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:19.476173 14393 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:19.460708 19097 raft_consensus.cc:2764] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:08:19.389569 19325 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:19.461138 19204 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:19.512792 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:19.515204 13862 raft_consensus.cc:1275] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:19.512867 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:19.516394 13858 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:19.403759 19173 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:19.514448 13860 raft_consensus.cc:1275] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:19.518082 13861 raft_consensus.cc:2410] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:08:19.507936 19124 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:19.520035 19124 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:19.525277 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 290422us
I20260709 13:08:19.526351 13829 leader_election.cc:400] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 15. Current term is 16.
I20260709 13:08:19.526738 13829 leader_election.cc:403] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:19.540235 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 306246us
I20260709 13:08:19.512794 18698 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:08:19.542629 13756 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:19.502701 19270 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:19.544786 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 282785us
I20260709 13:08:19.540637 13858 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
W20260709 13:08:19.546368 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 285557us
I20260709 13:08:19.554490 13862 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:19.554939 13829 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:19.523167 19124 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.522886 19303 raft_consensus.cc:3055] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:19.559301 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:19.571208 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:19.571779 13857 raft_consensus.cc:1240] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:08:19.572230 13858 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:19.551522 18893 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:19.581521 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:19.560434 19219 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.522605 19147 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:19.554551 19384 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:19.586907 14368 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:19.580282 13755 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:19.595039 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:19.570031 19303 raft_consensus.cc:740] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:19.578248 13680 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:19.600288 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:19.601851 13858 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:19.605665 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:19.599735 13790 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:08:19.607940 13680 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:19.608753 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:19.609488 13791 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:19.573309 19402 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:08:19.579880 19259 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:08:19.596489 18978 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.006s	sys 0.013s
I20260709 13:08:19.614471 13859 raft_consensus.cc:1240] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:19.633968 13858 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:19.620368 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:19.621685 18893 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:19.623358 13756 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:19.577566 19355 consensus_queue.cc:260] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:19.590054 18944 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.034s
I20260709 13:08:19.596736 19382 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:19.608191 19280 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:19.638880 13756 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:19.646083 13791 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
W20260709 13:08:19.629421 18978 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.006s	sys 0.013s
W20260709 13:08:19.751895 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.753805 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 123255us
I20260709 13:08:19.593194 19257 consensus_queue.cc:1059] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
W20260709 13:08:19.755798 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 160141us
I20260709 13:08:19.596375 19219 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:19.641963 18893 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:19.759989 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:19.761994 13829 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:19.640290 19315 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.635037 19405 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:19.812976 13829 leader_election.cc:400] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12.
I20260709 13:08:19.813433 13829 leader_election.cc:403] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:19.640183 19375 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:19.800324 19355 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:19.828706 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 220813us
I20260709 13:08:19.803404 19382 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:19.832599 13680 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:19.830724 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 250536us
I20260709 13:08:19.640805 18997 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:19.635321 19259 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:19.831331 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 225823us
W20260709 13:08:19.840569 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 201754us
I20260709 13:08:19.805287 19212 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:19.837493 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:19.851131 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 92824.5us
I20260709 13:08:19.859499 13757 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:19.859813 13756 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:19.875790 13682 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:19.877321 13710 raft_consensus.cc:2393] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 11: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:08:19.849393 19399 log.cc:927] Time spent T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 13:08:19.834028 19325 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:19.929491 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.825765 19389 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12.
I20260709 13:08:19.817737 19315 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:19.972990 19147 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:19.967849 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 100623us
I20260709 13:08:19.979140 13755 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:19.839244 18944 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:19.868331 19393 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:20.041832 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 182401us
W20260709 13:08:20.042076 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 182352us
W20260709 13:08:20.045392 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 66369.3us
I20260709 13:08:20.054952 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:19.896559 19173 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:20.073282 14395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1910) took 2024 ms. Trace:
I20260709 13:08:19.838513 19405 consensus_queue.cc:1048] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.144s
I20260709 13:08:20.073716 14395 rpcz_store.cc:276] 0709 13:08:18.048847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.049280 (+   433us) service_pool.cc:224] Handling call
0709 13:08:18.049569 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.084027 (+ 34458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.073020 (+1988993us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b54000fa854. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:20.073221 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77854080}
I20260709 13:08:19.836792 19375 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:19.960668 19280 raft_consensus.cc:697] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:19.966899 19212 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:20.171809 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 296260us
I20260709 13:08:19.888862 19326 consensus_queue.cc:1059] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.186s
I20260709 13:08:19.999965 19415 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:20.242954 13754 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.006s	sys 0.031s
W20260709 13:08:20.245872 13754 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.006s	sys 0.031s
I20260709 13:08:20.243379 18944 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:20.246721 13829 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:20.115271 19147 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.055279 19257 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:20.244377 13682 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:08:20.210973 19283 consensus_meta.cc:287] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.798s	user 0.001s	sys 0.010s
I20260709 13:08:20.035271 19325 consensus_queue.cc:1048] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.210s
I20260709 13:08:20.202206 19012 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.353957 13856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3549) took 1400 ms. Trace:
I20260709 13:08:20.354444 13856 rpcz_store.cc:276] 0709 13:08:18.953455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.985087 (+ 31632us) service_pool.cc:224] Handling call
0709 13:08:18.985463 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:18.985896 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:18.985938 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:18.999068 (+ 13130us) log.cc:844] Serialized 26 byte log entry
0709 13:08:19.377306 (+378238us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b18002c7a00. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e0d1 00007f5232499a0f
0709 13:08:19.523089 (+145783us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:19.565234 (+ 42145us) log.cc:844] Serialized 14 byte log entry
0709 13:08:19.590289 (+ 25055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.590365 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:20.353593 (+763228us) raft_consensus.cc:1685] finished
0709 13:08:20.353712 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.353886 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24749,"prepare.queue_time_us":41754,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":27680,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":4907,"spinlock_wait_cycles":8879104,"thread_start_us":145568,"threads_started":1,"wal-append.queue_time_us":550178}
W20260709 13:08:20.358219 19408 log.cc:927] Time spent T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.384s	user 0.000s	sys 0.000s
I20260709 13:08:20.256356 19296 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:20.360451 19296 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.360906 19296 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:20.364037 19404 log.cc:927] Time spent T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.557s	user 0.001s	sys 0.000s
I20260709 13:08:20.363762 19012 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:20.365061 19407 log.cc:927] Time spent T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:08:20.366099 19012 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:20.366959 19315 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:20.348830 19147 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:20.254558 19212 raft_consensus.cc:697] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:20.369607 19212 consensus_queue.cc:237] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:20.370832 19147 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:20.380990 19405 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:20.381672 19405 raft_consensus.cc:697] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:20.382529 19405 consensus_queue.cc:237] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:20.384261 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.390363 14396 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
W20260709 13:08:20.398074 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.267880 18893 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:20.253826 19416 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:20.418880 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.348301 19389 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:20.456964 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:20.460590 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.462271 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:20.464324 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:20.464679 13681 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.005s	sys 0.004s
W20260709 13:08:20.465631 13681 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.005s	sys 0.004s
I20260709 13:08:20.465868 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:20.468230 14401 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 16: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:20.446974 19265 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.420851 19219 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:20.487664 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:20.488298 13790 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:20.490269 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:20.491076 13713 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:20.264977 19415 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:20.477136 13782 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.004s	sys 0.017s
I20260709 13:08:20.352579 19411 consensus_queue.cc:1059] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.110s
I20260709 13:08:20.499512 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:20.500157 13711 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:20.467964 19147 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:20.498224 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:20.495915 13782 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.004s	sys 0.017s
I20260709 13:08:20.504899 19411 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.505636 19411 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:20.506039 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:20.486291 18944 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:20.508508 13791 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:08:20.531653 13716 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:08:20.531780 13680 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:20.497009 19196 raft_consensus.cc:3055] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:08:20.521641 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 475074us
I20260709 13:08:20.556435 13712 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:20.532810 13790 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:08:20.559831 13830 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:20.507280 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:20.561091 13715 raft_consensus.cc:2393] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 15: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:20.453344 19416 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:20.501937 18997 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:20.569574 13713 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:08:20.570344 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:20.514271 19414 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:20.514600 18889 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.005s	sys 0.007s
I20260709 13:08:20.556264 19318 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.555866 19196 raft_consensus.cc:740] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:20.558092 19259 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:20.476348 19280 consensus_queue.cc:237] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:20.500890 19265 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:20.596406 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 352042us
I20260709 13:08:20.514509 19147 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:20.572212 19257 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.566887 19012 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:20.576109 18997 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.576920 19425 raft_consensus.cc:3055] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:20.590895 19424 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:20.595798 18889 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.988s	user 0.008s	sys 0.007s
I20260709 13:08:20.556159 18944 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:20.579136 19318 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:20.577800 19325 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:20.640242 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2494) took 1045 ms. Trace:
W20260709 13:08:20.639967 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 84563.9us
W20260709 13:08:20.664801 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 102973us
I20260709 13:08:20.644675 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:20.666865 13858 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:20.645191 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 89020us
I20260709 13:08:20.664575 13782 rpcz_store.cc:276] 0709 13:08:19.595304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.596038 (+   734us) service_pool.cc:224] Handling call
0709 13:08:19.597945 (+  1907us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.840135 (+242190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.840167 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:19.840696 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:08:20.504049 (+663353us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:20.568763 (+ 64714us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.569123 (+   360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.569196 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:20.639994 (+ 70798us) raft_consensus.cc:1685] finished
0709 13:08:20.640019 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.640178 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15892,"prepare.queue_time_us":46903,"prepare.run_cpu_time_us":1290,"prepare.run_wall_time_us":16042,"raft.queue_time_us":121027,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":754878,"threads_started":2,"wal-append.queue_time_us":701098}
I20260709 13:08:20.625020 19389 raft_consensus.cc:697] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:08:20.777283 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 106093us
I20260709 13:08:20.778244 13856 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:20.778196 13755 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:20.779614 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:20.669275 19396 log.cc:927] Time spent T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 13:08:20.579831 19414 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:20.808486 13755 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:20.636919 19425 raft_consensus.cc:740] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:20.819689 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:20.820533 13790 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:20.820664 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:20.825534 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:20.827440 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:20.828171 13782 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:20.630394 19012 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:20.640381 18997 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:20.803969 19259 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.900893 19434 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:20.901434 19434 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:20.901773 19415 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:20.627813 19257 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:20.903815 19257 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:20.904368 19257 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:08:20.904688 19257 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.905012 19257 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:20.909008 18944 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:20.912621 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3548) took 1959 ms. Trace:
I20260709 13:08:20.912998 13857 rpcz_store.cc:276] 0709 13:08:18.953166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.983278 (+ 30112us) service_pool.cc:224] Handling call
0709 13:08:19.000171 (+ 16893us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.572324 (+572153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.912359 (+1340035us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b54003dccd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:20.912561 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1314059136}
I20260709 13:08:20.889799 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:20.919799 13789 raft_consensus.cc:1275] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:20.889984 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:20.920840 13790 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:08:20.892649 19425 consensus_queue.cc:260] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:20.890589 19413 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:08:20.893989 19419 log.cc:927] Time spent T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.325s	user 0.000s	sys 0.000s
I20260709 13:08:20.893615 19430 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:08:20.894894 19420 log.cc:927] Time spent T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.328s	user 0.000s	sys 0.000s
I20260709 13:08:20.895641 19433 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:20.898275 19393 consensus_meta.cc:287] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.706s	user 0.007s	sys 0.003s
I20260709 13:08:20.900068 19318 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:20.900691 19259 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:20.892539 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:20.817338 19416 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:20.915146 18893 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:20.827484 19422 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:20.917725 19296 consensus_meta.cc:287] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.002s
I20260709 13:08:20.911073 13612 catalog_manager.cc:5697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 13 to 14, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 14 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:20.644894 19424 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.022166 19434 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:21.039583 19423 log.cc:927] Time spent T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 13:08:20.663790 19196 consensus_queue.cc:260] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.041425 19414 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.041676 19012 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:21.043603 19433 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.086536 19391 consensus_queue.cc:1059] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:08:21.087558 19391 raft_consensus.cc:3055] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:21.087716 19424 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.087934 19391 raft_consensus.cc:740] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:21.088073 19433 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.044373 19393 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:21.088788 19391 consensus_queue.cc:260] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:21.090198 19391 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:21.092238 19426 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.092792 19426 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.051885 19413 raft_consensus.cc:697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:21.046116 13709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 1390) took 3041 ms. Trace:
I20260709 13:08:20.839715 19438 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:21.049201 13711 consensus_meta.cc:287] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.002s
I20260709 13:08:21.118060 13711 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
W20260709 13:08:21.054807 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.120680 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:21.121457 13711 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
W20260709 13:08:21.059499 13680 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.001s	sys 0.029s
W20260709 13:08:21.047155 19406 log.cc:927] Time spent T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.523s	user 0.000s	sys 0.003s
I20260709 13:08:21.062068 13858 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
W20260709 13:08:21.063680 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 107310us
I20260709 13:08:21.065410 13787 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:21.082748 13782 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
W20260709 13:08:21.045776 19124 consensus_meta.cc:287] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 1.471s	user 0.010s	sys 0.002s
I20260709 13:08:21.094362 13612 catalog_manager.cc:5697] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 10 to 11, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 11 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.116093 13709 rpcz_store.cc:276] 0709 13:08:18.004247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.005065 (+   818us) service_pool.cc:224] Handling call
0709 13:08:18.005397 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:18.702226 (+696829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.045112 (+2342886us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b5400153bd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:21.046047 (+   935us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1553833216}
W20260709 13:08:21.122839 13680 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.001s	sys 0.029s
W20260709 13:08:21.137014 13756 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.000s	sys 0.018s
W20260709 13:08:21.142443 13756 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.000s	sys 0.019s
W20260709 13:08:21.143981 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.147372 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:21.060269 19422 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:21.180320 19427 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.180910 19427 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.181774 19422 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:21.182984 19427 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.128588 19438 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.131258 19196 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:21.187253 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:21.062318 19296 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:21.145968 19424 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.201817 19293 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:21.202613 19448 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:21.052110 19389 consensus_queue.cc:237] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:21.207345 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1409) took 1824 ms. Trace:
I20260709 13:08:21.208876 13864 rpcz_store.cc:276] 0709 13:08:19.382781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.387944 (+  5163us) service_pool.cc:224] Handling call
0709 13:08:19.388332 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.390288 (+  1956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.390316 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:19.391028 (+   712us) log.cc:844] Serialized 26 byte log entry
0709 13:08:19.594700 (+203672us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:19.594883 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.595849 (+   966us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.207144 (+1611295us) raft_consensus.cc:1685] finished
0709 13:08:21.207164 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.207287 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1546,"raft.queue_time_us":122146,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":118425,"threads_started":1,"wal-append.queue_time_us":1039452}
I20260709 13:08:21.158169 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:21.212370 13782 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:21.213202 13787 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:08:21.189277 19147 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.223124 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:21.191576 19438 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:21.228065 13784 raft_consensus.cc:2393] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 16: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:21.193662 19265 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.235694 19447 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.236541 19447 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.240716 19296 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:21.244092 19259 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:21.245489 18997 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.145900 19124 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.246297 19257 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.149014 19430 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:21.251426 19446 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:21.252102 19446 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.254323 19446 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.222108 19448 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.256950 13782 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:21.257097 19147 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:21.257553 19147 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:21.257910 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:21.258455 13782 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:21.217883 19424 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.260107 19265 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:21.260784 19265 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.262620 19424 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.206725 13612 catalog_manager.cc:5697] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 reported cstate change: config changed from index 9 to 8, term changed from 12 to 13, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from VOTER to NON_VOTER, now has a pending config: VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129), VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130), VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131), VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 13 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: NON_VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:21.259250 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:21.270457 13782 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 16: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:21.148362 19411 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.271610 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:21.271790 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:21.275393 13709 raft_consensus.cc:2393] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 14: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:21.276299 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:21.280709 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:21.283902 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:21.285907 13680 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:21.293586 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:21.294735 19380 log.cc:927] Time spent T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 1.856s	user 0.011s	sys 0.015s
I20260709 13:08:21.295991 19426 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.271855 19439 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:21.296978 19439 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:21.300062 19378 log.cc:927] Time spent T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 1.779s	user 0.007s	sys 0.014s
W20260709 13:08:21.250344 19369 consensus_meta.cc:287] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 1.742s	user 0.012s	sys 0.002s
I20260709 13:08:21.303572 13680 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:21.305028 13680 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:21.308800 19097 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:21.306551 19422 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:21.316532 19422 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:21.317034 19422 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:21.306643 18889 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:21.320828 18889 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.321265 18889 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:21.324664 19401 log.cc:927] Time spent T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.954s	user 0.010s	sys 0.002s
I20260709 13:08:21.310427 19430 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.328038 19439 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.328370 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1405) took 2080 ms. Trace:
I20260709 13:08:21.328913 13863 rpcz_store.cc:276] 0709 13:08:19.247166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.247846 (+   680us) service_pool.cc:224] Handling call
0709 13:08:19.248220 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.424674 (+176454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.424703 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:19.425166 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:08:19.637667 (+212501us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:19.637705 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.637775 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.321951 (+1684176us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:21.327122 (+  5171us) raft_consensus.cc:1685] finished
0709 13:08:21.327148 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.327404 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7457,"raft.queue_time_us":261987,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":9002,"spinlock_wait_cycles":53370112,"thread_start_us":360244,"threads_started":2,"wal-append.queue_time_us":829945}
I20260709 13:08:21.306720 18997 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:21.331597 18997 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:21.331938 13710 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 2673) took 1829 ms (client timeout 1912 ms). Trace:
W20260709 13:08:21.332347 13710 rpcz_store.cc:269] 0709 13:08:19.502953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.503103 (+   150us) service_pool.cc:224] Handling call
0709 13:08:21.331758 (+1828655us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54000c4254. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:21.331882 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":857465728}
I20260709 13:08:21.333554 19097 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:21.328132 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1914) took 2094 ms. Trace:
I20260709 13:08:21.334681 14397 rpcz_store.cc:276] 0709 13:08:19.233843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.233988 (+   145us) service_pool.cc:224] Handling call
0709 13:08:19.282173 (+ 48185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.367645 (+ 85472us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:19.367964 (+   319us) log.cc:844] Serialized 14 byte log entry
0709 13:08:19.581278 (+213314us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.581350 (+    72us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:19.581429 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.327920 (+1746491us) spinlock_profiling.cc:243] Waited 85.2 ms on lock 0x7b540070fb54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:21.327968 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.328079 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":597,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":103,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":12228,"spinlock_wait_cycles":196005760,"thread_start_us":210753,"threads_started":1,"wal-append.queue_time_us":1091402}
W20260709 13:08:21.336833 19355 consensus_meta.cc:287] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 1.504s	user 0.011s	sys 0.002s
I20260709 13:08:21.339329 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:21.331990 18997 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:21.257002 19448 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.309919 19424 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:21.411597 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:21.355464 14398 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
W20260709 13:08:21.404268 19440 log.cc:927] Time spent T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:08:21.335543 19191 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.404582 14402 raft_consensus.cc:1240] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:21.337406 14394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:40042
I20260709 13:08:21.417243 14394 raft_consensus.cc:606] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:21.417654 14394 raft_consensus.cc:614] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:21.405092 19384 consensus_meta.cc:287] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 1.793s	user 0.012s	sys 0.000s
I20260709 13:08:21.406435 19124 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.219830 19413 consensus_queue.cc:237] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.423244 19384 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 15. Current term is 16.
I20260709 13:08:21.350927 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:21.424310 14401 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:21.337188 19257 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 26 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.412650 14398 pending_rounds.cc:85] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 12
I20260709 13:08:21.336234 19430 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.425411 14398 pending_rounds.cc:107] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:08:21.425761 14398 raft_consensus.cc:2889] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:21.337796 19291 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:21.412199 19326 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:21.429247 19375 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.432572 19147 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:21.310076 19369 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.420078 19265 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:21.524068 13682 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.041s	sys 0.061s
W20260709 13:08:21.525007 13682 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.041s	sys 0.061s
W20260709 13:08:21.526392 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 221274us
I20260709 13:08:21.529757 13755 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:21.530263 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:21.531687 13710 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:21.531700 13754 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.031s	sys 0.071s
W20260709 13:08:21.537442 13754 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.032s	sys 0.072s
I20260709 13:08:21.545140 13782 raft_consensus.cc:2410] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:08:21.548867 14395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1726) took 1078 ms. Trace:
I20260709 13:08:21.549451 14395 rpcz_store.cc:276] 0709 13:08:20.469965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.470089 (+   124us) service_pool.cc:224] Handling call
0709 13:08:20.470375 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:20.626890 (+156515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.626925 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:20.629156 (+  2231us) log.cc:844] Serialized 26 byte log entry
0709 13:08:21.142266 (+513110us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:08:21.142312 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.142388 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.547981 (+405593us) raft_consensus.cc:1685] finished
0709 13:08:21.548034 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.548472 (+   438us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30510,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":5311,"thread_start_us":494595,"threads_started":2,"wal-append.queue_time_us":740983}
I20260709 13:08:21.556275 13862 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:21.558736 19228 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.559399 19300 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:21.560003 14366 leader_election.cc:304] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:21.559782 19228 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.560669 19300 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.562537 19147 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.563542 19147 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:21.564913 19300 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.565744 19300 consensus_queue.cc:1059] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:21.567018 19265 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.568185 19265 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.430884 19291 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.571241 19265 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.580029 19228 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.567078 19147 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:21.594547 19318 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:21.575361 19291 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:21.612488 19196 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:21.614445 19196 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:21.617439 19259 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.617800 19196 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:21.618299 19259 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:21.621234 19259 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:21.488940 19438 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.630637 19438 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:21.644974 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 47412.8us
I20260709 13:08:21.568507 19300 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:21.425964 19191 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.682505 19191 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:21.660388 19369 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:21.661378 13862 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 2849) took 2055 ms (client timeout 1925 ms). Trace:
I20260709 13:08:21.448619 19326 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.665439 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:21.670473 14366 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:21.673056 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:21.675705 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:21.675469 19303 consensus_queue.cc:260] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.676776 19382 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.677417 19391 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.612512 19444 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:08:21.656297 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:21.688158 13862 rpcz_store.cc:269] 0709 13:08:19.605946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.618385 (+ 12439us) service_pool.cc:224] Handling call
0709 13:08:21.661019 (+2042634us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b54002fb2d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:21.661237 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4409358208}
I20260709 13:08:21.692610 19391 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:21.697880 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 138809us
I20260709 13:08:21.694195 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:21.696532 13857 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.027s	sys 0.064s
I20260709 13:08:21.686014 19317 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:21.709174 13857 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.028s	sys 0.064s
I20260709 13:08:21.708508 19382 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:21.713593 13782 raft_consensus.cc:2393] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 11: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:21.714784 13863 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:21.719487 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:21.721576 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.722318 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.722476 13864 raft_consensus.cc:2393] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 16: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:08:21.723091 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.725917 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 89526.8us
W20260709 13:08:21.732244 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.737600 19303 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:21.738677 19424 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.739732 19424 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.738723 19422 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.742516 19424 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.743273 19422 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.739396 13783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2496) took 2143 ms. Trace:
I20260709 13:08:21.707508 13682 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:08:21.748664 13829 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.009s	sys 0.008s
W20260709 13:08:21.719043 19405 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.019s	sys 0.027s
I20260709 13:08:21.731446 14366 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:21.716647 19191 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:08:21.752817 13829 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.010s	sys 0.008s
I20260709 13:08:21.753456 13711 raft_consensus.cc:2393] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 12: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:21.755273 19147 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:08:21.756487 13788 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1304) took 2536 ms (client timeout 1675 ms). Trace:
W20260709 13:08:21.757102 13788 rpcz_store.cc:269] 0709 13:08:19.219497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.219631 (+   134us) service_pool.cc:224] Handling call
0709 13:08:21.755983 (+2536352us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b54003bdb54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:21.756209 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15807360}
I20260709 13:08:21.752346 19456 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:21.759191 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:21.760720 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:21.760962 19405 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.019s	sys 0.028s
I20260709 13:08:21.765245 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:21.768658 13785 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 26 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 25. Current term is 26. Ops: [25.18-25.18]
I20260709 13:08:21.769824 13863 raft_consensus.cc:2393] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 19: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:21.772296 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:21.773186 19377 log.cc:927] Time spent T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 2.353s	user 0.003s	sys 0.019s
I20260709 13:08:21.773803 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:21.774549 13787 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:21.774302 19456 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:21.778273 19385 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 2.314s	user 0.002s	sys 0.026s
I20260709 13:08:21.778630 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3545) took 2828 ms. Trace:
I20260709 13:08:21.769243 19326 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.780823 19382 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:21.781504 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:21.779125 13865 rpcz_store.cc:276] 0709 13:08:18.950104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.956152 (+  6048us) service_pool.cc:224] Handling call
0709 13:08:18.956603 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:18.956993 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:18.957031 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:18.957533 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:08:19.390336 (+432803us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:19.414733 (+ 24397us) log.cc:844] Serialized 14 byte log entry
0709 13:08:19.629374 (+214641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.629450 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.772175 (+2142725us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:21.775689 (+  3514us) raft_consensus.cc:1685] finished
0709 13:08:21.778169 (+  2480us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.778408 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":176,"prepare.queue_time_us":24133,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":11162,"raft.queue_time_us":94613,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":14067,"spinlock_wait_cycles":92214016,"thread_start_us":643988,"threads_started":2,"wal-append.queue_time_us":462264}
W20260709 13:08:21.773825 19379 log.cc:927] Time spent T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 2.337s	user 0.003s	sys 0.028s
W20260709 13:08:21.785889 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 97014us
I20260709 13:08:21.784958 19410 raft_consensus.cc:3055] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:21.746663 13783 rpcz_store.cc:276] 0709 13:08:19.595891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.596192 (+   301us) service_pool.cc:224] Handling call
0709 13:08:19.607790 (+ 11598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.899972 (+292182us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:19.972541 (+ 72569us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.350645 (+378104us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.350737 (+    92us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:20.350851 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.738929 (+1388078us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b54003bd154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:21.738988 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.739221 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":73670,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":135590,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":10377,"spinlock_wait_cycles":671116160,"thread_start_us":377468,"threads_started":1,"wal-append.queue_time_us":534293}
I20260709 13:08:21.787250 19191 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:21.787730 13864 raft_consensus.cc:2393] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 14: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:21.787876 19191 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:21.788455 19191 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:21.788950 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:21.787295 19410 raft_consensus.cc:740] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:21.788815 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:21.790625 13864 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:08:21.790922 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:21.790789 19410 consensus_queue.cc:260] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.791666 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:21.791711 13860 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:21.794121 13783 raft_consensus.cc:2393] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 16: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:21.794449 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:21.792508 13864 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 7.
I20260709 13:08:21.793291 13859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3558) took 2557 ms. Trace:
I20260709 13:08:21.782729 13680 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:21.805184 13859 rpcz_store.cc:276] 0709 13:08:19.235561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.236199 (+   638us) service_pool.cc:224] Handling call
0709 13:08:19.236485 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.629661 (+393176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.792802 (+2163141us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b5400235354. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:21.793112 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":868772608}
I20260709 13:08:21.808838 13713 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:08:21.809356 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:21.810070 13709 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:21.810473 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:21.792250 19410 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:21.813784 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:21.814314 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:21.815287 13710 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:08:21.807400 13788 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:21.794481 19456 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:21.807216 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:21.814680 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:21.817612 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 81156.2us
I20260709 13:08:21.812469 13712 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:21.818171 13862 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:08:21.821283 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:21.803730 19280 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.820382 19097 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.822291 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:21.825205 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:21.824134 19097 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.823166 19424 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:21.829734 13863 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 11: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:21.830868 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:21.838403 14397 raft_consensus.cc:2410] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:08:21.838466 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:21.840292 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:21.825322 19228 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:21.841563 13783 raft_consensus.cc:2410] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:08:21.841197 13712 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:21.856320 18889 consensus_meta.cc:287] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.534s	user 0.000s	sys 0.021s
I20260709 13:08:21.856498 18698 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.856837 18889 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.857143 18698 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.858327 19425 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:21.859840 13716 raft_consensus.cc:2393] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 13: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:08:21.861856 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 46089.3us
W20260709 13:08:21.861656 19381 log.cc:927] Time spent T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 2.436s	user 0.002s	sys 0.016s
I20260709 13:08:21.861938 19228 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.872809 19228 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:21.866752 19400 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.366s	user 0.012s	sys 0.015s
W20260709 13:08:21.877082 19400 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.437s	user 0.013s	sys 0.016s
I20260709 13:08:21.866894 19280 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.879401 14401 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:21.880225 19424 raft_consensus.cc:697] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:21.881595 19424 consensus_queue.cc:237] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:21.884907 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.889876 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 158673us
I20260709 13:08:21.859305 18889 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:21.891682 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 56503.4us
I20260709 13:08:21.895217 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:21.875334 19228 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.890028 13829 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:21.902720 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2856) took 1124 ms. Trace:
W20260709 13:08:21.907673 18997 consensus_meta.cc:287] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.564s	user 0.006s	sys 0.011s
I20260709 13:08:21.909384 13787 raft_consensus.cc:1240] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:21.909734 13599 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f09ef105d67b41dba510b44a6567d790 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 35ecb005831740438d7537dd4b840e03 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:21.911928 19280 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:21.913415 19376 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:21.914036 19376 raft_consensus.cc:697] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:21.915166 19376 consensus_queue.cc:237] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:21.901098 13830 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:08:21.918892 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 55563.1us
W20260709 13:08:21.923887 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.924217 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:21.926553 19306 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:21.926751 13790 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:21.926946 19228 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:21.929286 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:21.927314 19306 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.929558 19270 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:21.931821 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:21.932530 19306 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.932766 19391 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.929106 19228 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.937763 13712 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:21.939517 19228 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:21.941236 19386 log.cc:927] Time spent T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 2.503s	user 0.005s	sys 0.015s
I20260709 13:08:21.942629 19447 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.944401 13715 raft_consensus.cc:1240] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:08:21.945479 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:21.951184 19394 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.951655 19435 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:21.951867 19394 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:21.952301 19435 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.953234 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:21.953953 13715 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:21.954150 19394 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:21.954403 19435 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:21.954777 19394 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.955817 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:21.957686 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:21.961382 19418 raft_consensus.cc:3055] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:21.961831 19418 raft_consensus.cc:740] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:21.962800 19391 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.963668 13709 raft_consensus.cc:1240] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:08:21.904955 13857 rpcz_store.cc:276] 0709 13:08:20.776919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.913872 (+136953us) service_pool.cc:224] Handling call
0709 13:08:20.914305 (+   433us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:20.914634 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.914670 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:20.915269 (+   599us) log.cc:844] Serialized 52 byte log entry
0709 13:08:21.751930 (+836661us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:21.862930 (+111000us) log.cc:844] Serialized 14 byte log entry
0709 13:08:21.889123 (+ 26193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.894996 (+  5873us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.895060 (+    64us) raft_consensus.cc:1685] finished
0709 13:08:21.895079 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.901345 (+  6266us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":176038,"raft.run_cpu_time_us":522,"raft.run_wall_time_us":41494,"thread_start_us":775028,"threads_started":2,"wal-append.queue_time_us":765254}
W20260709 13:08:21.963428 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 43696.6us
I20260709 13:08:21.970113 13863 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:08:21.970372 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 59605.3us
I20260709 13:08:21.962500 19191 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:21.980695 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 90753.6us
I20260709 13:08:21.981666 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:21.982246 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:21.983040 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:21.983302 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:21.983994 13783 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:21.985488 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:21.995087 13858 raft_consensus.cc:1275] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:08:21.996212 14396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 1308) took 2696 ms (client timeout 2159 ms). Trace:
I20260709 13:08:21.962910 19418 consensus_queue.cc:260] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:21.996762 14396 rpcz_store.cc:269] 0709 13:08:19.302647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.325121 (+ 22474us) service_pool.cc:224] Handling call
0709 13:08:21.994552 (+2669431us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54004c18d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:21.995910 (+  1358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2441704704}
I20260709 13:08:21.997763 19418 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:21.994696 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:21.963503 19391 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:21.999799 13713 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:21.955343 19394 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:22.009248 14368 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 1.533s (SENT) [suppressed 16 similar messages]
I20260709 13:08:22.009339 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:22.009630 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:22.011297 13791 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:08:22.010207 13861 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:08:22.004057 19447 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:21.936081 18997 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:22.016853 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:22.018333 13864 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:22.020453 18658 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.021014 18658 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:22.025053 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:22.030282 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:22.024777 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:22.032866 13859 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:22.033653 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:22.036868 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:22.039366 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:22.043661 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:22.047994 19387 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.048681 19387 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:22.049015 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 56205us
I20260709 13:08:22.049897 14366 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:22.051775 19138 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:22.055697 13713 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:08:22.058569 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:22.060616 19394 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:22.068265 14366 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:22.068800 19391 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:22.070811 18997 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:22.070577 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:22.035466 19270 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:22.058446 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:22.072858 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:22.073630 19437 consensus_queue.cc:1059] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:22.074298 13757 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:22.076200 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:22.076478 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:22.077143 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:22.077334 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:22.078056 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:22.080899 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:22.084102 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:22.084748 13786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 3006) took 1265 ms. Trace:
I20260709 13:08:22.085438 13787 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:22.088946 13862 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:08:22.103333 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:22.051204 19387 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:22.042178 13829 connection.cc:256] RPC call timeout handler was delayed by -1.0408841020000636s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
I20260709 13:08:22.114425 13786 rpcz_store.cc:276] 0709 13:08:20.819647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.821520 (+  1873us) service_pool.cc:224] Handling call
0709 13:08:22.084406 (+1262886us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b5400371754. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:22.084563 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1540573952}
I20260709 13:08:22.105538 13861 raft_consensus.cc:2393] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 16: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:08:22.116616 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 107412us
I20260709 13:08:22.122531 13788 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:22.128172 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:22.132256 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:22.139616 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:22.140148 13787 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:22.140818 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:22.141225 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:22.141741 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.136905 13682 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:22.146165 13711 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 13: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:22.148389 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:22.161100 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:22.162556 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 88326.9us
I20260709 13:08:22.163344 14397 raft_consensus.cc:2410] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:08:22.166056 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:22.167531 13858 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
W20260709 13:08:22.168406 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 47846.9us
I20260709 13:08:22.162151 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:22.173702 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:22.166386 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:22.175343 19174 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:22.175781 18893 consensus_queue.cc:1059] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:08:22.176098 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:22.177410 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:22.178041 13784 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:08:22.178901 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:22.179490 13860 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 13: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:22.181762 18658 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:22.183988 13786 raft_consensus.cc:2410] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:08:22.173867 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:22.147033 19318 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:22.186482 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:22.187445 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:22.188943 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:22.184690 13829 leader_election.cc:336] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Timed out: RequestConsensusVote RPC to 127.12.76.132:43039 timed out after 1.502s (SENT)
I20260709 13:08:22.193236 14400 raft_consensus.cc:2393] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 13: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:22.193305 13756 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:22.187337 14401 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:22.189687 13682 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:22.196398 19447 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.205067 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:22.127825 19270 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:22.210454 13710 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:22.213760 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 145620us
I20260709 13:08:22.215740 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:22.219153 13715 raft_consensus.cc:2393] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 11: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:22.192284 19191 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:22.219535 19138 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.199071 19447 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:22.222141 13757 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:22.200265 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:22.236564 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:22.236917 19473 log.cc:927] Time spent T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:08:22.237188 13715 raft_consensus.cc:2376] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12. Re-sending same reply.
I20260709 13:08:22.237512 19313 consensus_queue.cc:1048] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:22.238168 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:22.238813 13715 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:08:22.239701 19138 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:22.241840 19138 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:22.242523 13712 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 20.
I20260709 13:08:22.243472 19465 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:22.243589 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:22.244135 19465 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:22.244519 13712 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:22.244725 19465 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:22.245625 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:22.246469 13712 raft_consensus.cc:2393] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 12: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:22.193259 19454 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:22.247344 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:22.249679 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 45873.7us
I20260709 13:08:22.265198 13680 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:08:22.266650 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 51790us
I20260709 13:08:22.267865 13710 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
W20260709 13:08:22.272321 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.272913 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:22.223892 19391 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:22.276446 13864 raft_consensus.cc:2410] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:08:22.271867 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:22.201560 19174 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 13:08:22.282830 13711 raft_consensus.cc:2376] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11. Re-sending same reply.
W20260709 13:08:22.290047 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 187426us
I20260709 13:08:22.289413 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:22.295208 14366 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:22.289251 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:22.264688 19454 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:22.297791 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:22.278774 18658 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:22.301587 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:22.302771 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:22.278635 19387 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:22.305855 19325 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:22.307365 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
W20260709 13:08:22.307549 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.308944 19138 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.310075 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 3139) took 3115 ms. Trace:
I20260709 13:08:22.311595 18698 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:22.311836 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:22.283806 19391 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:22.320348 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:22.206085 19318 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:22.334982 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:22.335996 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:22.302250 18658 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:22.343463 13715 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:22.339617 13863 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:22.304327 19454 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:22.316550 19444 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:22.343365 14394 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:08:22.324270 19391 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:22.314041 13708 rpcz_store.cc:276] 0709 13:08:19.194990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.197293 (+  2303us) service_pool.cc:224] Handling call
0709 13:08:19.197540 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.197738 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:19.546922 (+349184us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.292113 (+2745191us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b18004080a0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f52320864bc 00007f522f3d448b 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e23a
0709 13:08:22.309585 (+ 17472us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:22.309667 (+    82us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:22.309729 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.309804 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.309903 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":399290,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":6258,"spinlock_wait_cycles":4357888,"thread_start_us":336871,"threads_started":2,"wal-append.queue_time_us":531172,"wal-append.run_cpu_time_us":1677,"wal-append.run_wall_time_us":1322582}
W20260709 13:08:22.347770 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 174574us
W20260709 13:08:22.349128 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 125580us
I20260709 13:08:22.349373 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:22.322939 19191 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:22.358253 13682 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:22.350142 14400 raft_consensus.cc:1240] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:22.363803 19442 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:22.364202 13710 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:22.342057 19138 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:22.364488 19442 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:22.365613 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 193602us
I20260709 13:08:22.366613 19138 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:22.366982 19472 log.cc:927] Time spent T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
W20260709 13:08:22.367479 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 94459.1us
I20260709 13:08:22.368216 13830 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:08:22.369524 19474 log.cc:927] Time spent T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:08:22.369618 13830 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:22.371304 14367 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:22.359395 19303 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.375998 19303 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:22.377779 19191 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:22.378327 19191 raft_consensus.cc:697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:22.378654 19303 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:22.379242 19191 consensus_queue.cc:237] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:22.380048 19270 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:22.380592 19313 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:08:22.348039 19410 consensus_meta.cc:287] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.524s	user 0.002s	sys 0.011s
I20260709 13:08:22.387382 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:22.388000 13862 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:22.367008 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:22.385278 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:22.391012 19389 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:22.391335 18698 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:08:22.391567 19389 raft_consensus.cc:697] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:22.392683 19389 consensus_queue.cc:237] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:22.395607 19270 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:22.395546 19325 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:22.396135 19270 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:22.396461 19318 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:22.396557 19270 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:22.397348 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:22.397909 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.347594 18658 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:22.398723 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 58894.8us
I20260709 13:08:22.385809 13711 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:08:22.402488 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:22.401562 13830 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:22.398913 14396 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:22.406860 13863 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:22.408265 19422 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:08:22.408444 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 50240.1us
I20260709 13:08:22.408718 19422 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.409096 19422 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:22.409221 13682 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:22.410702 13682 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:22.411638 13858 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:22.412204 19169 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:22.412663 19169 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:22.413029 19169 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:22.414695 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3011) took 1524 ms. Trace:
I20260709 13:08:22.415040 13785 rpcz_store.cc:276] 0709 13:08:20.889850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.889990 (+   140us) service_pool.cc:224] Handling call
0709 13:08:21.759663 (+869673us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:21.769237 (+  9574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.414504 (+645267us) spinlock_profiling.cc:243] Waited 869 ms on lock 0x7b54003bdb50. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:22.414621 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1998924032}
I20260709 13:08:22.415800 13756 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:22.416565 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:22.417340 13707 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:08:22.404693 13857 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:08:22.419150 13829 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:22.434561 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:22.435704 19465 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:22.442245 13710 raft_consensus.cc:1240] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:22.406158 13790 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
W20260709 13:08:22.444625 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 47419us
W20260709 13:08:22.446099 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 57043.7us
I20260709 13:08:22.447016 13787 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:08:22.442814 13715 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:22.447551 13830 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:22.452754 19416 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:22.453205 19416 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:08:22.453555 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 47237.9us
W20260709 13:08:22.454247 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 43636.1us
I20260709 13:08:22.454438 19387 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:22.454458 19394 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:22.455094 19394 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.453580 19416 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:22.455583 18889 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:22.455996 18889 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.456351 18889 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:22.458895 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:22.459558 13782 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:22.460078 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 3028) took 1177 ms. Trace:
I20260709 13:08:22.460528 13791 rpcz_store.cc:276] 0709 13:08:21.282449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.752613 (+470164us) service_pool.cc:224] Handling call
0709 13:08:22.459914 (+707301us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b540033bb54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:22.460018 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":526696192}
I20260709 13:08:22.463456 19097 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:22.379257 19303 consensus_queue.cc:1059] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
W20260709 13:08:22.465549 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 193424us
I20260709 13:08:22.465776 19303 raft_consensus.cc:3055] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:22.466246 19303 raft_consensus.cc:740] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:22.467280 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:22.468210 13714 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 13: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:22.468300 14366 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:22.469471 13714 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:22.454276 13829 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:22.474206 13757 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:22.479749 13682 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:22.480741 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:22.487282 19387 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:22.488098 19387 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:22.488246 19485 log.cc:927] Time spent T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:08:22.488502 19387 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:22.475975 19394 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:22.487287 19376 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:22.492542 19437 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:22.495293 19412 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:22.495720 19412 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.495904 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:22.496546 19437 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:22.497220 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:22.498394 19437 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:22.487771 19481 log.cc:927] Time spent T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:08:22.498795 13715 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14. Ops: [12.9-13.10]
W20260709 13:08:22.491922 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 76218.2us
I20260709 13:08:22.496071 19412 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:22.499689 13756 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:22.501237 13756 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:22.503470 19228 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:22.503906 19228 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.504236 19228 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:22.504719 19317 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:22.505453 19317 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:22.509738 19196 raft_consensus.cc:3055] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:22.510222 19196 raft_consensus.cc:740] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:22.487391 13789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3010) took 1656 ms. Trace:
I20260709 13:08:22.516192 13789 rpcz_store.cc:276] 0709 13:08:20.830612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.830756 (+   144us) service_pool.cc:224] Handling call
0709 13:08:20.831073 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.920233 (+ 89160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.483364 (+1563131us) spinlock_profiling.cc:243] Waited 88.3 ms on lock 0x7b54001e7654. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:22.487221 (+  3857us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203134336}
I20260709 13:08:22.511765 19169 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:22.521844 19422 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:22.523115 13708 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:22.467221 19303 consensus_queue.cc:260] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:22.525669 19303 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:22.531942 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.505426 13830 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:22.558981 19465 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:22.538363 19169 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:22.635855 19169 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:22.636358 19169 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.636742 19169 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:22.553035 14368 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:22.552934 19138 consensus_queue.cc:1059] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:22.640399 19318 raft_consensus.cc:3055] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:22.640792 19318 raft_consensus.cc:740] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:22.641571 19138 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:22.642184 19138 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.641665 19318 consensus_queue.cc:260] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:22.642565 19138 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:22.643231 19318 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:22.544637 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:22.511246 19196 consensus_queue.cc:260] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:22.555294 18889 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:22.566684 19270 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:22.643965 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 90820us
I20260709 13:08:22.551035 19442 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:22.565416 19394 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:22.498896 19437 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:22.577023 19228 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:22.589404 19416 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:22.592783 19412 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:22.608815 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.550698 14367 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:22.639056 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 170859us
I20260709 13:08:22.646988 19196 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:22.583763 13782 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:22.663273 14396 raft_consensus.cc:2410] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 26 because replica has last-logged OpId of term: 25 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 17.
W20260709 13:08:22.672652 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 122416us
I20260709 13:08:22.647948 18889 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:22.688408 13680 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:22.691708 13756 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:22.648530 19270 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:22.716852 14366 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:22.710091 18889 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:22.712440 14367 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:22.684821 19280 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:22.724416 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:22.626632 19391 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:22.748454 13789 raft_consensus.cc:2393] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 16: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:22.751801 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:22.758332 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:22.724372 18889 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.743085 19280 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.769039 14401 raft_consensus.cc:2393] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 13: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:22.753444 19418 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:22.753243 18698 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:22.774374 19219 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:22.757913 19353 raft_consensus.cc:2764] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
I20260709 13:08:22.770926 18889 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:22.773329 19280 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:22.788689 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:22.755623 19435 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:22.744838 19422 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:22.787676 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 104289us
I20260709 13:08:22.782709 19219 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.796661 13789 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:22.796926 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:22.798920 19100 consensus_queue.cc:1059] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:08:22.800628 19219 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:22.782732 19394 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:22.807811 19368 raft_consensus.cc:3055] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:22.808212 19368 raft_consensus.cc:740] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:22.809053 19368 consensus_queue.cc:260] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:22.806772 18658 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:22.818028 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 155891us
I20260709 13:08:22.816279 14396 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 26 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 25. Current term is 26. Ops: []
I20260709 13:08:22.818964 13756 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:22.825098 19412 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:22.826161 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:22.826783 13859 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:22.832724 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:22.833405 14393 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:08:22.834540 19394 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:22.834983 19394 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.835388 19394 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:22.836905 13859 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:22.841018 13757 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:22.842711 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:22.843921 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.845890 19412 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:22.846856 13782 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:22.848878 19275 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.849471 19275 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:22.822472 19447 consensus_meta.cc:287] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.003s
W20260709 13:08:22.856791 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 376116us
I20260709 13:08:22.846653 19412 raft_consensus.cc:697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:22.865048 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:22.865406 19483 log.cc:927] Time spent T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:08:22.797782 19435 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:22.873900 13860 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.007s	sys 0.032s
I20260709 13:08:22.875541 13782 raft_consensus.cc:1275] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:22.880470 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:22.876736 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:22.877493 13791 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:22.858356 19410 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:22.884843 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:08:22.891309 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 72430.4us
W20260709 13:08:22.882315 13860 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.008s	sys 0.032s
I20260709 13:08:22.881111 13790 raft_consensus.cc:2376] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19. Re-sending same reply.
I20260709 13:08:22.904920 13756 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:22.900774 19228 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:22.909901 13756 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:22.872367 19387 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:22.911494 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:22.861663 19447 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:22.955523 19447 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:22.960108 19200 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:22.911265 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 56437.3us
I20260709 13:08:22.914028 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:22.913201 13756 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:22.915921 19412 consensus_queue.cc:237] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:22.921294 19138 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:22.924790 19169 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:22.908429 19391 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:22.925817 19394 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:22.928675 19196 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:22.931586 19454 consensus_meta.cc:287] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.543s	user 0.007s	sys 0.003s
I20260709 13:08:22.936306 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:22.907140 19437 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:22.995746 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:22.938508 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:22.915033 19410 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:22.950655 19416 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:22.951990 18658 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:22.952641 19212 consensus_queue.cc:1059] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.048s
W20260709 13:08:22.966869 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 53789us
W20260709 13:08:22.988096 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.988583 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:22.988979 19138 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:22.989285 19435 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:22.990680 19219 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:22.985481 19200 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:22.991770 19275 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:22.992940 19394 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:23.051098 13864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.006s	sys 0.027s
W20260709 13:08:23.051487 13864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.007s	sys 0.027s
I20260709 13:08:22.993314 19196 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:22.994079 14394 raft_consensus.cc:1240] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:08:22.990625 19169 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:22.937881 13791 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:22.939239 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:22.987178 13790 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:22.997094 13788 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:22.998054 13789 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:22.998407 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:23.001104 13856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2854) took 2322 ms. Trace:
I20260709 13:08:22.963373 19191 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:23.014834 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 509448us
I20260709 13:08:22.987228 19353 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:23.020696 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:23.021587 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:23.077651 14395 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:23.025767 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:23.025946 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:23.072250 13756 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:23.027381 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:23.052886 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:23.058998 13862 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:08:23.073169 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:23.072042 13785 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:23.079746 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:23.082993 14398 raft_consensus.cc:2393] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 10: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:23.083226 13712 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 13: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:23.046307 19200 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:23.056314 19389 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.003s	sys 0.033s
I20260709 13:08:23.091502 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:23.000389 19454 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:23.087744 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:23.089339 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 67970.1us
I20260709 13:08:23.096045 13859 raft_consensus.cc:2410] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:08:23.089790 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:23.052531 19376 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.004s	sys 0.028s
I20260709 13:08:23.105252 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:23.105373 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:23.106077 13715 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:23.092922 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.107792 13682 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:23.102319 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:23.103173 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.109144 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:23.109733 13712 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:08:23.112779 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:23.105373 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:23.111274 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:23.114986 13708 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 21: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:08:23.105500 19376 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.005s	sys 0.028s
I20260709 13:08:23.116181 19376 raft_consensus.cc:697] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:23.117105 19376 consensus_queue.cc:237] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.117853 19275 consensus_queue.cc:1059] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:08:23.118307 19416 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:23.118897 19275 raft_consensus.cc:3055] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:23.047494 19391 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:08:23.120442 13682 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:23.096062 19389 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.003s	sys 0.034s
I20260709 13:08:23.127067 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:23.127655 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:23.128237 13713 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.124766 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:23.129221 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:23.130085 13865 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 7.
I20260709 13:08:23.125700 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:23.131095 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.094450 19200 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:23.129174 14395 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:23.134430 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1426) took 1079 ms. Trace:
W20260709 13:08:23.135347 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 114962us
I20260709 13:08:23.076227 13856 rpcz_store.cc:276] 0709 13:08:20.664364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.808667 (+144303us) service_pool.cc:224] Handling call
0709 13:08:20.809113 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:21.317662 (+508549us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b4800061158. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5237407aa1 00007f52373feb37 00007f52373fe9ca 00007f52374f626f 00007f52374f5f37 00007f523750a55c 00007f523750a508 00007f523750a488 00007f523750a443 00007f52375096ec 00007f5236433a96
0709 13:08:22.196926 (+879264us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b18003bc3e0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f52320864bc 00007f522f3d448b 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3ee455 00007f52324d6060 00007f52324d6bfb 00007f52324e164b
0709 13:08:22.267528 (+ 70602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.267564 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:22.337314 (+ 69750us) log.cc:844] Serialized 26 byte log entry
0709 13:08:22.754043 (+416729us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:22.754084 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.755145 (+  1061us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:22.961229 (+206084us) raft_consensus.cc:1685] finished
0709 13:08:22.961254 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.987085 (+ 25831us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135491,"raft.queue_time_us":283494,"raft.run_cpu_time_us":2613,"raft.run_wall_time_us":199955,"spinlock_wait_cycles":113637120,"thread_start_us":571211,"threads_started":2,"wal-append.queue_time_us":568454}
I20260709 13:08:23.143898 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:23.144716 13859 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.119755 19315 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:23.147723 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:23.148285 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:23.170612 13857 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:08:23.154836 19454 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:23.155937 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:23.156229 19444 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:23.156613 19212 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:23.157430 14396 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:23.160552 14368 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:23.162101 19280 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.162626 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:23.163250 19387 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:23.121353 19191 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.164990 19422 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.168507 19219 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:23.119251 19196 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:23.119309 19275 raft_consensus.cc:740] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:23.132665 19416 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.172583 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:23.094710 19353 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.176498 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:23.137187 13861 rpcz_store.cc:276] 0709 13:08:22.054903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.126175 (+ 71272us) service_pool.cc:224] Handling call
0709 13:08:22.162992 (+ 36817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:22.247884 (+ 84892us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:22.683920 (+436036us) log.cc:844] Serialized 14 byte log entry
0709 13:08:23.134006 (+450086us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:23.134075 (+    69us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:23.134143 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.134228 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.134363 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":379,"prepare.queue_time_us":52056,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":8564,"raft.queue_time_us":10870,"thread_start_us":815588,"threads_started":2}
I20260709 13:08:23.167109 18889 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.193084 13865 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 21: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:23.172614 19444 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:23.196941 14393 raft_consensus.cc:2393] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 9: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:23.185032 19303 consensus_queue.cc:1059] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:08:23.199658 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:23.192498 19422 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:23.209918 19422 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:23.210700 19303 raft_consensus.cc:3055] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:23.212687 19191 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:23.213452 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:23.214296 13861 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 13: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:23.214884 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:23.216710 18889 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:23.222527 19465 raft_consensus.cc:3055] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:08:23.225803 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:23.257902 13859 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
W20260709 13:08:23.229594 19487 log.cc:927] Time spent T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.071s	user 0.002s	sys 0.000s
W20260709 13:08:23.231519 19489 log.cc:927] Time spent T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.002s
I20260709 13:08:23.231841 19280 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:23.232177 19275 consensus_queue.cc:260] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:23.233021 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:23.265332 13858 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:23.234094 19353 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:23.236948 13682 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:23.211158 19303 raft_consensus.cc:740] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:23.249024 13715 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:23.201045 19444 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:23.228348 13755 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:23.259943 14368 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:23.270825 13830 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:23.273630 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2868) took 1063 ms. Trace:
I20260709 13:08:23.273641 19280 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:23.274869 19280 raft_consensus.cc:697] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:23.275944 19280 consensus_queue.cc:237] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.281627 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2692) took 1087 ms. Trace:
I20260709 13:08:23.282152 13714 rpcz_store.cc:276] 0709 13:08:22.194518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.473461 (+278943us) service_pool.cc:224] Handling call
0709 13:08:22.512140 (+ 38679us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:22.512537 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.512565 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:22.513161 (+   596us) log.cc:844] Serialized 52 byte log entry
0709 13:08:23.011156 (+497995us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:23.011201 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.011270 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.281333 (+270063us) raft_consensus.cc:1685] finished
0709 13:08:23.281360 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.281536 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104291,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":497608,"threads_started":1,"wal-append.queue_time_us":748643}
I20260709 13:08:23.273906 19303 consensus_queue.cc:260] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.285797 13857 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 9.
I20260709 13:08:23.287801 19275 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:23.262308 19454 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:23.203295 19325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.005s	sys 0.068s
I20260709 13:08:23.262389 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:23.194876 19416 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.268227 13682 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:23.269393 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:23.304064 13716 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.004s	sys 0.043s
I20260709 13:08:23.270146 13861 raft_consensus.cc:1240] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:23.257686 19191 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.270043 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:23.270773 13865 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:23.258586 19465 raft_consensus.cc:740] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:08:23.299845 19325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.006s	sys 0.068s
I20260709 13:08:23.311971 13859 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 13: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:08:23.304415 13716 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.004s	sys 0.043s
I20260709 13:08:23.304298 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:23.305872 13682 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:23.313712 13858 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:23.313906 14368 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:23.274055 13860 rpcz_store.cc:276] 0709 13:08:22.212733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.219196 (+  6463us) service_pool.cc:224] Handling call
0709 13:08:22.270198 (+ 51002us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:22.285693 (+ 15495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.285724 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:22.312653 (+ 26929us) log.cc:844] Serialized 26 byte log entry
0709 13:08:22.894839 (+582186us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:22.894882 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.894952 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.230736 (+335784us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:23.265065 (+ 34329us) raft_consensus.cc:1685] finished
0709 13:08:23.265086 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.273546 (+  8460us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3809,"raft.queue_time_us":6621,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":160,"spinlock_wait_cycles":46775040,"thread_start_us":530283,"threads_started":1,"wal-append.queue_time_us":752436}
I20260709 13:08:23.308161 13863 raft_consensus.cc:2393] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 9: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:23.308048 13862 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:08:23.314181 13682 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:23.316705 13757 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:23.272845 18889 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:23.297725 13783 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:23.260231 13713 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:23.309569 19500 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:23.310956 19191 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.324203 19442 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:23.324812 19416 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:23.325801 19418 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:23.325927 19191 leader_election.cc:290] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:23.326531 19191 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.309556 19422 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:23.328178 13865 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:08:23.329084 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.319464 13859 raft_consensus.cc:1240] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:23.313915 18658 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:23.303509 19200 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.339264 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:23.316154 19212 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:23.339263 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 110992us
I20260709 13:08:23.340065 14397 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:23.307583 19454 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.356541 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:23.358777 14393 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:08:23.359125 19502 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.360899 19200 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:23.338265 18658 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.361665 18658 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:23.362363 19138 consensus_queue.cc:1059] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:23.334164 19500 raft_consensus.cc:697] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 15 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:23.364454 19500 consensus_queue.cc:237] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.367652 13862 raft_consensus.cc:2410] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:08:23.372531 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:23.373524 14397 raft_consensus.cc:2410] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:08:23.316231 18698 consensus_queue.cc:1059] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:08:23.375871 18698 raft_consensus.cc:3055] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:23.376248 18698 raft_consensus.cc:740] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:23.377009 18698 consensus_queue.cc:260] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.378209 18698 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:23.348042 19212 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.383786 19212 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:23.384490 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:23.385300 14393 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 15: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:23.386430 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:23.335362 19391 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:23.333978 19442 raft_consensus.cc:697] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:23.327040 19191 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:23.388860 13829 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.012s	sys 0.010s
W20260709 13:08:23.390295 13829 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.012s	sys 0.010s
W20260709 13:08:23.390645 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 510645us
W20260709 13:08:23.391338 13829 leader_election.cc:336] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Timed out: RequestConsensusVote RPC to 127.12.76.132:43039 timed out after 1.506s (SENT)
W20260709 13:08:23.392408 13829 leader_election.cc:336] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Timed out: RequestConsensusVote RPC to 127.12.76.132:43039 timed out after 1.538s (SENT)
I20260709 13:08:23.398360 19325 consensus_queue.cc:1059] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:23.389014 19465 consensus_queue.cc:260] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.399775 19465 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:23.400027 19418 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.400454 19418 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:23.389608 19391 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.405269 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:23.398403 19422 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:08:23.409189 14397 raft_consensus.cc:2368] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 15. Current term is 16.
I20260709 13:08:23.405278 19391 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:23.410179 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:23.411477 13860 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:08:23.412672 14393 raft_consensus.cc:2410] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:08:23.419162 13829 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:23.420606 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:23.409279 18889 raft_consensus.cc:3055] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:23.394347 19200 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:08:23.425837 14393 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 15: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:23.423583 19283 raft_consensus.cc:3055] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:23.429081 13829 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:23.441836 13755 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:23.443869 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:23.446179 13829 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:23.427219 18889 raft_consensus.cc:740] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:23.459038 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:23.442579 19283 raft_consensus.cc:740] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:23.448019 19447 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:23.466881 14397 raft_consensus.cc:2393] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 13: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:23.465801 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:23.467435 13713 raft_consensus.cc:1275] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:08:23.467836 14367 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.011s	sys 0.007s
W20260709 13:08:23.468230 14367 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.011s	sys 0.007s
I20260709 13:08:23.470773 14393 raft_consensus.cc:2393] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 14: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:23.473474 13756 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:23.449172 19275 consensus_queue.cc:1059] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:08:23.426959 19442 consensus_queue.cc:237] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.498615 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:23.468530 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 719230us
I20260709 13:08:23.471280 19412 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:08:23.468832 19447 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:23.502873 13713 raft_consensus.cc:1275] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:23.501248 13829 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:23.475222 19389 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:23.508409 13680 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:23.519915 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:23.522078 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.520815 14393 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:23.519174 14367 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:23.531872 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.504551 19447 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:23.481602 19435 consensus_queue.cc:1048] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 13:08:23.544106 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 43919.9us
I20260709 13:08:23.546509 13680 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:23.547169 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:23.548714 13829 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:23.519567 19497 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:23.561156 14393 raft_consensus.cc:2368] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13.
I20260709 13:08:23.534053 19454 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:23.541718 19275 raft_consensus.cc:3055] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:23.533841 19416 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:23.537633 19353 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:23.536921 19422 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:23.567139 13829 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:23.541918 19326 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:23.573690 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 178133us
I20260709 13:08:23.542168 19493 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:23.578912 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:23.583626 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 243269us
I20260709 13:08:23.568702 19191 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:23.588722 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 47409us
W20260709 13:08:23.588961 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.573333 19394 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:23.571641 19275 raft_consensus.cc:740] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:23.543566 18658 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.531531 18889 consensus_queue.cc:260] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.508313 19283 consensus_queue.cc:260] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.601874 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:23.587060 19219 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.586963 19497 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:23.599733 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:23.605581 13860 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:23.607476 19504 log.cc:927] Time spent T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:08:23.603653 19394 raft_consensus.cc:697] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:23.619889 19275 consensus_queue.cc:260] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.622769 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3585) took 1087 ms. Trace:
I20260709 13:08:23.624449 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:23.594754 19422 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:23.588515 19416 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:23.628765 13864 rpcz_store.cc:276] 0709 13:08:22.535426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.535591 (+   165us) service_pool.cc:224] Handling call
0709 13:08:22.535979 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:23.051804 (+515825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:23.051837 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:23.086270 (+ 34433us) log.cc:844] Serialized 26 byte log entry
0709 13:08:23.461035 (+374765us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:23.461658 (+   623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.461777 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.622501 (+160724us) raft_consensus.cc:1685] finished
0709 13:08:23.622523 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.622694 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":297923,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":107,"thread_start_us":830288,"threads_started":2,"wal-append.queue_time_us":442804}
I20260709 13:08:23.660987 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:23.661276 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:23.661648 13785 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:23.627895 19497 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:23.667721 13782 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:08:23.631356 19435 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:23.672186 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:23.666002 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 85748.3us
I20260709 13:08:23.651605 19422 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:23.676393 14395 raft_consensus.cc:2393] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 13: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:08:23.682974 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.687731 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:23.688081 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:23.688966 13710 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.696130 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:23.696727 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 223341us
I20260709 13:08:23.697608 13756 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:23.665640 19275 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:23.625986 19513 consensus_queue.cc:1059] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:08:23.696988 13711 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
W20260709 13:08:23.702749 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.654809 19391 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:23.708130 19454 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:23.711179 19454 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.711580 19454 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.710202 13756 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:23.714332 19196 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:23.628947 19219 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.725885 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:23.718024 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:23.718842 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:23.721484 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:23.631453 19492 consensus_queue.cc:1059] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:08:23.670205 19497 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.673892 19283 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:23.723541 13858 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
W20260709 13:08:23.724464 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 282751us
I20260709 13:08:23.739274 13755 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:23.741042 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:23.741699 13712 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:23.742480 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:23.731907 13715 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:23.727275 13707 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:23.743908 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:23.744445 13712 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:23.749750 13857 raft_consensus.cc:1275] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:23.678283 19422 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:23.757736 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:23.758539 13783 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:23.759764 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 59521.1us
I20260709 13:08:23.735750 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:23.771799 13755 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:23.726608 19303 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.776059 13829 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:23.668599 19212 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:23.763751 19494 log.cc:927] Time spent T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:23.800908 13710 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:23.783115 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:23.808327 14395 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:23.808558 13714 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:23.766042 19503 log.cc:927] Time spent T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.259s	user 0.001s	sys 0.001s
I20260709 13:08:23.804924 13782 raft_consensus.cc:1275] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:23.809269 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:23.818676 13715 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:08:23.817088 13783 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:23.706219 19353 consensus_queue.cc:1059] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
W20260709 13:08:23.820803 13829 leader_election.cc:336] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Timed out: RequestConsensusVote RPC to 127.12.76.132:43039 timed out after 1.708s (SENT)
I20260709 13:08:23.824113 13829 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:23.778800 19412 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.831802 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:23.832440 14396 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:23.782040 19391 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:23.805675 19500 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:23.819783 19410 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.803337 19100 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.862705 19526 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.863775 19100 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.864326 19526 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.866416 19100 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:23.867012 19526 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:23.862192 19315 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:23.867736 19526 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:23.863510 19444 consensus_meta.cc:287] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.564s	user 0.011s	sys 0.001s
I20260709 13:08:23.869593 19444 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.871701 13713 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:23.854442 13715 raft_consensus.cc:1240] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:23.876835 19444 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:23.831815 19492 raft_consensus.cc:3055] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:23.802275 19196 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:08:23.837513 19318 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:23.889809 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:23.890571 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 118841us
W20260709 13:08:23.885759 19517 log.cc:927] Time spent T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 13:08:23.899142 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 93077.2us
I20260709 13:08:23.898203 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:23.890897 19435 raft_consensus.cc:697] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:08:23.900231 13829 leader_election.cc:336] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Timed out: RequestConsensusVote RPC to 127.12.76.132:43039 timed out after 1.750s (SENT)
I20260709 13:08:23.904893 19535 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.905488 19535 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.906025 13829 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:23.907688 19495 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:23.908109 19495 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:23.908484 19495 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:23.908995 19512 log.cc:927] Time spent T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.304s	user 0.001s	sys 0.001s
I20260709 13:08:23.909978 14400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1744) took 1189 ms. Trace:
I20260709 13:08:23.911610 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:23.904450 13712 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:23.835599 19394 consensus_queue.cc:237] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.884277 19492 raft_consensus.cc:740] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:23.903120 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:23.923671 19416 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:23.880811 19500 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.926889 19500 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:23.910039 19518 raft_consensus.cc:3055] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:23.927747 19518 raft_consensus.cc:740] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:23.928581 19518 consensus_queue.cc:260] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:23.929755 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:23.931023 19219 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:23.933979 14401 raft_consensus.cc:2410] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:08:23.901556 19435 consensus_queue.cc:237] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:23.910719 19527 log.cc:927] Time spent T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:08:23.887337 19410 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:23.968252 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:23.969331 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:24.012916 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:24.013402 19410 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:23.970049 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:24.014963 13857 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:23.971376 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:23.922286 14367 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:24.016628 14394 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:08:24.016978 19544 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:24.017508 19544 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.017709 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:23.883987 19531 consensus_queue.cc:1059] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:08:23.929801 19518 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:23.912384 14400 rpcz_store.cc:276] 0709 13:08:22.720481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.742873 (+ 22392us) service_pool.cc:224] Handling call
0709 13:08:22.753214 (+ 10341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:23.194727 (+441513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:23.194763 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:23.262003 (+ 67240us) log.cc:844] Serialized 26 byte log entry
0709 13:08:23.546248 (+284245us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:23.662905 (+116657us) log.cc:844] Serialized 14 byte log entry
0709 13:08:23.836692 (+173787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.837750 (+  1058us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.909772 (+ 72022us) raft_consensus.cc:1685] finished
0709 13:08:23.909790 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.909922 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1512,"prepare.queue_time_us":222975,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":17686,"raft.queue_time_us":61085,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":5452,"thread_start_us":940861,"threads_started":4,"wal-append.queue_time_us":397644}
I20260709 13:08:24.018687 19533 raft_consensus.cc:3055] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:23.992132 19368 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:24.018959 19539 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:24.019168 19533 raft_consensus.cc:740] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:24.019666 19539 raft_consensus.cc:697] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:24.020300 19533 consensus_queue.cc:260] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:23.995059 18698 consensus_meta.cc:287] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.616s	user 0.001s	sys 0.009s
I20260709 13:08:24.020767 19539 consensus_queue.cc:237] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:24.022157 14396 raft_consensus.cc:2410] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
W20260709 13:08:24.018275 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 96051.4us
I20260709 13:08:23.983476 19389 consensus_queue.cc:1048] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:08:23.998952 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:23.931275 19447 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:23.991542 18658 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:24.028560 19418 consensus_meta.cc:287] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.628s	user 0.011s	sys 0.000s
I20260709 13:08:24.028753 19447 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:23.958508 19500 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:24.006448 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 404625us
W20260709 13:08:24.005722 19502 consensus_meta.cc:287] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.646s	user 0.008s	sys 0.008s
I20260709 13:08:24.009188 19212 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:23.998960 19492 consensus_queue.cc:260] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:24.017903 19544 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.999773 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 1434) took 1525 ms. Trace:
I20260709 13:08:24.048199 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:08:24.008744 19530 log.cc:927] Time spent T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:08:24.043702 13785 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:08:24.029052 19418 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:24.053714 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 146554us
I20260709 13:08:24.049680 14401 raft_consensus.cc:2393] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 14: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:24.034231 13714 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
W20260709 13:08:24.055315 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.061331 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 386193us
I20260709 13:08:24.068045 13858 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:24.069891 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:24.070600 13858 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:24.038522 18658 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.085601 13711 raft_consensus.cc:1275] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:24.089017 13714 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:24.089955 13858 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
W20260709 13:08:24.082116 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.083127 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:24.091476 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:24.092314 14395 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:24.048533 13716 rpcz_store.cc:276] 0709 13:08:22.473999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.515072 (+ 41073us) service_pool.cc:224] Handling call
0709 13:08:22.515378 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:22.617196 (+101818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.617229 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:22.617857 (+   628us) log.cc:844] Serialized 26 byte log entry
0709 13:08:23.319838 (+701981us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:23.571720 (+251882us) log.cc:844] Serialized 14 byte log entry
0709 13:08:23.749008 (+177288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.749080 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.999513 (+250433us) raft_consensus.cc:1685] finished
0709 13:08:23.999534 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.999677 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2155,"prepare.queue_time_us":292021,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":224550,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":45841,"thread_start_us":1091594,"threads_started":3,"wal-append.queue_time_us":831739}
I20260709 13:08:24.095945 13682 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:24.107702 14399 raft_consensus.cc:2410] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:08:24.107563 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:24.048199 19535 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:24.111825 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:24.059098 19502 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:24.125465 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:24.127475 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:24.130491 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:24.131208 13782 raft_consensus.cc:2393] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 13: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:24.136842 14368 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:24.139071 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:24.139788 14401 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:08:24.104504 19410 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:24.150173 13755 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:24.154136 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:24.149391 13682 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:24.114651 19492 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:24.079797 19447 consensus_queue.cc:1048] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:08:24.158914 14367 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:24.163540 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:24.115204 19529 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:24.170073 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:24.171722 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:24.174822 19533 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:24.178562 14394 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:24.180194 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:24.180759 14394 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:08:24.181180 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:24.181571 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:24.182904 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:24.190289 13856 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:24.185017 19525 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.191439 19525 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.192931 19465 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:24.193493 19465 raft_consensus.cc:697] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:24.194285 19525 leader_election.cc:290] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:24.185336 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:24.194514 19465 consensus_queue.cc:237] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.209404 19522 consensus_queue.cc:1059] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:24.210613 19522 raft_consensus.cc:3055] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:24.211043 19522 raft_consensus.cc:740] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:24.155575 18698 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:08:24.211992 19522 consensus_queue.cc:260] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:24.216924 13716 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:24.218340 13856 raft_consensus.cc:1275] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:24.221074 19549 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:24.222942 19546 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:24.225039 13829 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:24.226115 19540 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:24.227591 19387 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:24.228120 19547 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:24.229427 13790 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:24.230510 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:24.231776 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:24.232478 13789 raft_consensus.cc:2393] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 13: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:24.233237 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:24.233482 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:24.233909 13789 raft_consensus.cc:2368] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 16. Current term is 17.
I20260709 13:08:24.234695 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:24.235743 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:24.236981 13786 raft_consensus.cc:1240] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:24.238128 13787 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:24.230526 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:24.240267 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:24.240407 13829 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:24.241677 13829 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:24.241523 19540 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:24.242632 19540 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:24.243011 19540 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:24.158641 19535 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:24.243535 19546 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:24.245517 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:24.246061 13864 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:24.243813 19535 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.246688 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:24.246995 19535 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:24.247475 19442 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:24.247978 19442 raft_consensus.cc:697] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:24.248914 19442 consensus_queue.cc:237] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.251442 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:24.252238 14398 raft_consensus.cc:2368] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9.
I20260709 13:08:24.253012 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:24.253716 14398 raft_consensus.cc:2410] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:08:24.254410 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:24.256145 19422 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:24.160820 19389 consensus_queue.cc:1059] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:08:24.187815 19548 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:24.188844 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:24.182278 14367 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:24.195473 14399 raft_consensus.cc:2368] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13.
I20260709 13:08:24.185971 13707 raft_consensus.cc:1240] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:24.162161 19410 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.123446 19500 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:08:24.245908 19416 consensus_queue.cc:1048] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:24.187608 19550 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.137s
I20260709 13:08:24.259868 13712 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:24.260494 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:24.103658 18658 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:24.293485 14395 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:08:24.294342 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:24.264261 19522 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:24.260684 19502 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:24.265611 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.266350 14401 raft_consensus.cc:2410] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:08:24.264024 13682 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:24.269080 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:24.153389 18889 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.197140 14397 raft_consensus.cc:2410] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:24.157083 19318 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:24.282470 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 100296us
I20260709 13:08:24.320679 14367 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:24.283334 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:24.321667 13858 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:24.287221 14393 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:08:24.287626 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:24.164965 19507 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:24.261091 13784 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:08:24.295884 14394 raft_consensus.cc:2410] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:08:24.297878 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:24.298277 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:24.324082 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 55064.3us
I20260709 13:08:24.324838 13856 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:24.299045 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:24.325222 13829 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:24.299490 19325 consensus_queue.cc:1059] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:08:24.303177 19437 consensus_queue.cc:1048] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:08:24.239796 19544 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:24.313720 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 67117us
I20260709 13:08:24.159312 19435 consensus_queue.cc:1048] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.134s
I20260709 13:08:24.339596 14367 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:24.270890 19228 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:08:24.318069 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 54121.7us
I20260709 13:08:24.345342 13788 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:24.331461 14398 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:08:24.346124 14398 pending_rounds.cc:85] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 9
I20260709 13:08:24.332424 19387 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:24.235337 13789 raft_consensus.cc:2393] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 14: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:24.334565 13829 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:24.359130 13711 raft_consensus.cc:1240] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:08:24.337633 19416 raft_consensus.cc:3055] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:24.338135 13680 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:24.341854 14402 raft_consensus.cc:2393] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 10: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:24.165650 19454 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:24.293857 19303 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:24.357654 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:24.289124 19529 raft_consensus.cc:697] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:24.374074 13784 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 13: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:08:24.376914 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.371495 13829 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:24.222553 19497 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.346387 14398 pending_rounds.cc:107] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:08:24.394878 14398 raft_consensus.cc:2889] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:24.329434 19507 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.316675 19502 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:24.344139 19412 consensus_meta.cc:287] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.505s	user 0.005s	sys 0.005s
I20260709 13:08:24.335451 19549 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:24.334789 19500 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:24.287007 19535 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:24.395494 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 57437.2us
I20260709 13:08:24.345458 19518 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:24.406035 13860 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:24.408671 13788 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 20.
I20260709 13:08:24.356964 19280 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:24.413374 13785 raft_consensus.cc:1240] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:24.358343 19100 consensus_queue.cc:1059] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 13:08:24.422711 19544 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:24.422894 19100 raft_consensus.cc:3055] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:24.406471 19303 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.423399 19100 raft_consensus.cc:740] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:24.423709 19303 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.424414 19100 consensus_queue.cc:260] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.425760 19100 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:24.426136 19303 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:24.429384 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:24.430312 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:24.430935 13784 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:24.372870 19353 consensus_queue.cc:1059] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
W20260709 13:08:24.440092 19555 log.cc:927] Time spent T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:24.440461 19353 raft_consensus.cc:3055] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:24.440982 19353 raft_consensus.cc:740] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:24.441525 19518 raft_consensus.cc:697] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:24.441990 19353 consensus_queue.cc:260] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.442688 19518 consensus_queue.cc:237] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.444727 18658 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:24.408699 19502 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.408715 19507 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:24.407925 19531 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:24.451915 19531 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:24.452404 19531 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:24.453791 13680 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:24.459579 13861 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:08:24.385131 19389 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:24.338995 19318 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.362893 19416 raft_consensus.cc:740] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:08:24.415218 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 43851.5us
I20260709 13:08:24.474385 13856 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:24.413730 19549 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:24.295464 19548 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.488991 14400 raft_consensus.cc:2368] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14.
I20260709 13:08:24.480185 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:24.455381 19387 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:24.343478 19495 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:24.414283 19412 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:24.483093 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:24.492900 13858 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:24.493487 14394 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:24.485395 13784 raft_consensus.cc:1240] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:24.486284 19318 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:24.400857 19283 consensus_queue.cc:1059] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:08:24.476879 19389 raft_consensus.cc:697] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:24.489811 14397 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:08:24.499548 13680 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:24.505841 13829 leader_election.cc:400] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9.
I20260709 13:08:24.506304 13829 leader_election.cc:403] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:24.482250 19533 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:24.455865 19513 consensus_queue.cc:1048] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:08:24.492249 19549 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:24.512724 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:24.517838 13784 raft_consensus.cc:1240] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:24.491228 19387 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:24.496054 19418 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:24.528612 19497 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:24.529604 19389 consensus_queue.cc:237] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.531927 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:24.532509 14393 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:24.493623 19353 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:24.520179 19212 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:24.521159 19138 raft_consensus.cc:3055] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:08:24.542375 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 151866us
I20260709 13:08:24.525223 19387 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:24.542994 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:24.548059 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:24.548853 13712 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:24.552325 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:24.553805 14394 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:24.560534 19539 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 8. Current term is 9.
I20260709 13:08:24.547976 13755 leader_election.cc:304] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:24.566256 13865 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:24.566416 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:24.569989 14393 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:24.525606 19228 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:08:24.546101 19138 raft_consensus.cc:740] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:24.574586 19412 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:24.586534 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 113224us
I20260709 13:08:24.587845 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:24.599526 19561 log.cc:927] Time spent T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:08:24.575057 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 155324us
I20260709 13:08:24.578358 13755 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:24.602115 13757 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:24.605208 19196 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:24.605332 13757 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:24.607024 13712 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:08:24.608651 14367 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:24.586166 19560 log.cc:927] Time spent T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:08:24.605883 19196 raft_consensus.cc:697] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:08:24.622160 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.584333 19138 consensus_queue.cc:260] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.614979 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:24.629616 13858 raft_consensus.cc:2393] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 20: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:24.625310 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:24.631433 13711 raft_consensus.cc:1275] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:24.631598 13707 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:24.612239 19531 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.583874 19412 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.637805 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:24.633539 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 120868us
I20260709 13:08:24.624092 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:24.638976 13680 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:24.635124 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:24.580291 19573 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:24.640841 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:24.637586 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:24.637894 13756 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:24.637097 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:24.644475 13791 raft_consensus.cc:2410] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:08:24.641601 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:24.644078 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:24.540067 19416 consensus_queue.cc:260] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:24.646147 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:24.647871 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:24.647975 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:24.625202 19518 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:24.648490 13712 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:24.648403 13756 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:24.649025 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:24.542424 19529 consensus_queue.cc:237] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:24.655613 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.656759 13710 raft_consensus.cc:1240] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:24.655515 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 51303.2us
I20260709 13:08:24.585074 19507 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.659296 13829 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:24.646476 19138 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:24.656996 13756 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:24.639743 19525 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:24.643731 19412 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:24.657500 18658 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:24.659675 13680 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:24.646113 19454 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:24.647590 19533 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:24.640908 19573 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:08:24.699363 19562 log.cc:927] Time spent T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:08:24.699566 19573 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:24.699633 19196 consensus_queue.cc:237] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.707482 19412 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.676725 13712 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:24.653713 19437 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:24.712564 19548 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:24.712109 19573 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.713971 13785 raft_consensus.cc:2393] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 14: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:24.646342 19535 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:24.679561 19497 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:24.680114 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:24.641498 19318 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:08:24.689707 18658 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.692878 13789 raft_consensus.cc:2393] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 14: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:24.689392 19525 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.693795 19566 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.694231 19542 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:24.695057 19567 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:24.696049 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:24.845692 14395 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:24.696954 19531 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:24.697924 19444 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:24.698518 19558 log.cc:927] Time spent T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:08:24.718819 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:24.821070 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 102135us
I20260709 13:08:24.856920 13859 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:08:24.857005 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 230442us
I20260709 13:08:24.673157 19518 raft_consensus.cc:697] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:24.720445 19353 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.678310 19280 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:24.697954 19569 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:08:24.852874 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 172810us
I20260709 13:08:24.691723 19275 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:24.689749 19410 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:24.870824 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 213898us
I20260709 13:08:24.857874 14366 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:24.714571 19315 raft_consensus.cc:2764] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:08:24.822963 13858 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:24.845209 19418 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.720683 19495 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:24.846053 19540 consensus_meta.cc:287] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.603s	user 0.010s	sys 0.001s
I20260709 13:08:24.858777 19493 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:24.847640 18658 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:24.781801 19212 raft_consensus.cc:697] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:24.866137 19571 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:24.867861 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:24.899034 19100 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:24.907305 13707 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:24.866009 19535 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.893939 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:24.870293 19575 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.882854 13859 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
W20260709 13:08:24.913388 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 55603.5us
W20260709 13:08:24.914278 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.911780 13829 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:24.915437 14366 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:24.884143 19275 raft_consensus.cc:697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:24.865216 19353 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.869988 19280 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:24.943719 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.944274 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:24.945039 13782 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:24.946795 14366 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:24.949537 13791 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:24.897225 19493 raft_consensus.cc:697] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 17 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:24.966953 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:24.971119 13857 raft_consensus.cc:2393] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 14: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:24.912671 19435 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.932332 19394 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:24.965222 19138 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:24.973003 19394 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:24.975255 19394 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:24.976011 19502 consensus_meta.cc:287] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.000s
I20260709 13:08:24.889684 19418 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.976606 19502 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.979594 19573 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:24.980942 19353 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:24.980755 19212 consensus_queue.cc:237] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.981843 19275 consensus_queue.cc:237] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.985474 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:24.991151 14398 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:24.934958 19541 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.933648 19447 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:24.889564 19540 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.943020 19318 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:24.999662 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 52999.4us
I20260709 13:08:24.926167 19492 consensus_queue.cc:1059] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:08:25.022486 14366 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:24.928181 19535 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:25.025019 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:24.989022 19412 leader_election.cc:290] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:24.995239 19389 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:25.026625 14393 raft_consensus.cc:2393] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 14: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:08:25.025755 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 150435us
I20260709 13:08:25.026059 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:25.036104 14401 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:24.993206 19502 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:25.038484 13756 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:25.044201 14366 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:25.042862 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:25.047724 13782 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:24.926908 19575 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:25.053066 13756 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:25.055805 14394 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:08:25.021723 19447 raft_consensus.cc:697] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 20 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:24.856179 19566 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:25.014865 19541 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:24.905941 19571 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:24.943253 19518 consensus_queue.cc:237] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:25.035372 19196 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.049415 19389 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:25.064155 19566 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:25.049033 19542 raft_consensus.cc:697] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:25.064853 19389 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:25.020838 19549 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:25.065657 19542 consensus_queue.cc:237] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:25.045280 19318 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:25.067662 19196 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:25.069022 19575 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:25.069690 19493 consensus_queue.cc:237] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:25.070097 14366 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:25.070556 19196 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:25.071053 19566 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:25.071498 14366 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:25.071578 19447 consensus_queue.cc:237] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:25.072995 14366 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:25.059087 18889 consensus_meta.cc:287] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.724s	user 0.009s	sys 0.002s
I20260709 13:08:25.074465 13709 raft_consensus.cc:2410] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:08:25.074550 19502 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:25.075444 19502 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:25.076006 19502 raft_consensus.cc:697] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 11 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:25.077049 19502 consensus_queue.cc:237] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:25.080543 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:25.081327 13857 raft_consensus.cc:1813] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Handling vote request from an unknown peer 35ecb005831740438d7537dd4b840e03
I20260709 13:08:25.081905 13857 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 13: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:25.060178 19138 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:25.084507 19579 consensus_queue.cc:1048] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:25.088670 19585 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:25.024600 19353 consensus_queue.cc:1059] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:08:25.089723 19571 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:25.037007 19387 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:25.068519 18658 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:25.089520 19585 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:25.054085 19412 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.067138 19549 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:25.105887 13784 raft_consensus.cc:2393] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 10: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:25.104120 19525 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:25.104436 19412 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:25.121312 19412 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:25.122493 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:25.123735 19578 log.cc:927] Time spent T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:08:25.124904 19280 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:25.118206 13856 raft_consensus.cc:1240] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:25.116029 19567 raft_consensus.cc:697] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:25.140117 19492 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:25.142525 19581 log.cc:927] Time spent T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:08:25.143257 19574 log.cc:927] Time spent T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:08:25.144445 14396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1957) took 1186 ms. Trace:
I20260709 13:08:25.144840 14396 rpcz_store.cc:276] 0709 13:08:23.958119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.306169 (+348050us) service_pool.cc:224] Handling call
0709 13:08:24.306580 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:24.487496 (+180916us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:24.487530 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:24.488022 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:08:24.656900 (+168878us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:24.656939 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.016880 (+359941us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54009169d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:25.016946 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:25.144120 (+127174us) raft_consensus.cc:1685] finished
0709 13:08:25.144143 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:25.144383 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11942,"raft.queue_time_us":3720,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":7544,"spinlock_wait_cycles":415142784,"thread_start_us":152017,"threads_started":1,"wal-append.queue_time_us":423249}
I20260709 13:08:25.142956 19492 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:25.148023 19540 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:25.148663 19540 consensus_queue.cc:1059] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:25.150128 19492 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:25.151353 18658 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:25.136787 19387 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:25.152977 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 1954) took 1241 ms. Trace:
I20260709 13:08:25.153376 14402 rpcz_store.cc:276] 0709 13:08:23.912011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.912201 (+   190us) service_pool.cc:224] Handling call
0709 13:08:25.152784 (+1240583us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b5400147654. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:25.152900 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":715490048}
I20260709 13:08:25.155077 13709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58552 (request call id 1438) took 1465 ms. Trace:
I20260709 13:08:25.155522 13709 rpcz_store.cc:276] 0709 13:08:23.686531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.687683 (+  1152us) service_pool.cc:224] Handling call
0709 13:08:25.151853 (+1464170us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b540008e154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:25.151995 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3094153088}
I20260709 13:08:25.160975 19567 consensus_queue.cc:237] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:25.165531 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:25.167200 13857 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:25.168013 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:25.168483 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 95581.7us
I20260709 13:08:25.169386 14366 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:25.199141 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:25.199867 13857 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
W20260709 13:08:25.200734 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 147775us
I20260709 13:08:25.201529 13756 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:25.207020 13755 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:25.183455 19541 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:25.216583 14366 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:25.226405 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:25.227104 13857 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:08:25.236285 19353 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:25.228503 19535 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:25.228010 19200 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:25.244520 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:25.215181 18658 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:25.253298 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.215812 19518 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:25.256814 14401 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:25.264281 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:25.265076 14401 raft_consensus.cc:2393] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 14: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:25.265942 19603 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.266569 19603 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:25.267697 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:25.268486 14402 raft_consensus.cc:2368] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14.
I20260709 13:08:25.269630 19603 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:25.271835 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:25.272858 14401 raft_consensus.cc:2410] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:25.274833 18889 consensus_queue.cc:1059] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:25.276144 19575 raft_consensus.cc:3055] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:25.276504 19575 raft_consensus.cc:740] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:25.277422 19575 consensus_queue.cc:260] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:25.278641 19575 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:25.279461 13857 raft_consensus.cc:1240] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:25.287794 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:25.288687 14401 raft_consensus.cc:2376] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17. Re-sending same reply.
I20260709 13:08:25.292541 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:25.294838 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:25.295403 14396 raft_consensus.cc:1813] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Handling vote request from an unknown peer 35ecb005831740438d7537dd4b840e03
I20260709 13:08:25.296016 14396 raft_consensus.cc:2410] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:08:25.291399 13682 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:25.296294 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:25.296947 13711 raft_consensus.cc:1813] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Handling vote request from an unknown peer 35ecb005831740438d7537dd4b840e03
I20260709 13:08:25.297737 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:25.298588 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 77031.4us
I20260709 13:08:25.301829 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:25.303054 13711 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 13: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:25.303445 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:25.304076 13790 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 26.
I20260709 13:08:25.303252 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:25.305469 13755 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:25.308735 14366 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:25.315757 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:25.316120 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:25.316318 13791 raft_consensus.cc:2368] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 16. Current term is 17.
I20260709 13:08:25.317723 14366 leader_election.cc:304] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:25.319823 13755 leader_election.cc:304] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:25.320600 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:25.321897 14366 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:25.259651 19212 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:25.325229 19212 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:25.329006 19212 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:25.329692 13712 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:25.319952 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:25.336728 14366 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:25.334136 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:25.337813 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:25.339176 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:25.339193 13712 raft_consensus.cc:2393] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 12: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:25.340026 13710 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:25.341241 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:25.346131 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:25.346899 13783 raft_consensus.cc:2393] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 14: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:25.347205 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:25.348260 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:25.342047 14402 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:25.349871 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:25.333781 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:25.352177 13756 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:25.370456 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 50708.8us
I20260709 13:08:25.370803 13712 raft_consensus.cc:2393] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 10: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:25.370499 13789 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:25.368992 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:25.371197 14366 leader_election.cc:400] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 16. Current term is 17.
I20260709 13:08:25.373356 13711 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:25.375303 14366 leader_election.cc:403] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:25.358240 13830 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:25.377797 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:25.378379 13756 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:25.254005 19599 consensus_queue.cc:1059] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.106s
I20260709 13:08:25.338034 19353 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:25.333626 19535 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:25.346715 19513 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:25.385675 13708 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:25.338286 19410 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:25.348341 19100 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:25.379040 19556 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:25.398504 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:25.401294 13712 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:08:25.401405 14402 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:25.402010 13712 pending_rounds.cc:85] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 8
I20260709 13:08:25.402410 13712 pending_rounds.cc:107] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:08:25.402736 13712 raft_consensus.cc:2889] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:25.322929 19575 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:08:25.376789 19518 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:08:25.376953 19412 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:25.386967 19454 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:25.429679 14396 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:08:25.431231 14393 raft_consensus.cc:2368] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14.
I20260709 13:08:25.391305 19196 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:25.393055 19513 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.433998 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:25.436501 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:25.393304 19410 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.437811 13755 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:25.412388 19502 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 16. Current term is 17.
I20260709 13:08:25.435940 19196 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.425367 19518 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.439708 19513 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:25.439375 19497 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:25.441471 19410 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:25.441916 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:25.441937 19412 raft_consensus.cc:697] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:25.460822 13711 raft_consensus.cc:1240] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:25.434605 19579 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:08:25.468698 13755 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:25.451313 19567 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:25.469820 14402 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:08:25.471379 14396 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:25.472062 13829 leader_election.cc:400] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13.
I20260709 13:08:25.472434 13829 leader_election.cc:403] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:25.460412 19196 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:25.470288 14402 pending_rounds.cc:85] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 12
I20260709 13:08:25.476143 14402 pending_rounds.cc:107] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:08:25.476449 14402 raft_consensus.cc:2889] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:25.462733 19518 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:25.477240 14396 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:08:25.480969 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 109954us
I20260709 13:08:25.483098 14366 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:25.493738 14396 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:25.476289 19542 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:25.472877 19497 raft_consensus.cc:697] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:25.466578 19412 consensus_queue.cc:237] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:25.513412 13789 raft_consensus.cc:1240] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:08:25.519089 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 47165.5us
I20260709 13:08:25.485314 19567 consensus_queue.cc:1059] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
W20260709 13:08:25.530220 19609 log.cc:927] Time spent T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:25.510782 19614 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:25.502595 19592 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
W20260709 13:08:25.546384 19605 log.cc:927] Time spent T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 13:08:25.534972 19611 log.cc:927] Time spent T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:08:25.553018 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:25.553648 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:25.557837 13785 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:25.555364 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:25.556562 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:25.561177 13790 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:25.561329 13787 raft_consensus.cc:2393] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 16: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:25.534184 19614 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.573879 13786 raft_consensus.cc:1240] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:08:25.574847 19418 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:25.576378 19538 raft_consensus.cc:3055] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:25.576877 19538 raft_consensus.cc:740] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:25.577847 19538 consensus_queue.cc:260] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:25.556090 19607 log.cc:927] Time spent T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:08:25.582653 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:25.567286 19608 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:08:25.594610 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:25.599109 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.649935 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:25.609579 13786 raft_consensus.cc:1275] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:25.674350 13784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1332) took 1061 ms. Trace:
I20260709 13:08:25.662750 13790 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
W20260709 13:08:25.651839 19435 consensus_meta.cc:287] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.661s	user 0.009s	sys 0.002s
I20260709 13:08:25.639788 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:25.630388 19631 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:25.614558 19567 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:25.667605 19610 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:25.654371 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:25.653512 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:25.652706 19280 raft_consensus.cc:3055] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:25.664819 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:25.568104 19614 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:25.679304 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.606637 13791 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:25.709460 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:25.687518 19620 log.cc:927] Time spent T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:08:25.687793 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 166650us
I20260709 13:08:25.685199 13784 rpcz_store.cc:276] 0709 13:08:24.613141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.628778 (+ 15637us) service_pool.cc:224] Handling call
0709 13:08:25.674082 (+1045304us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b5400161f54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:25.674253 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1036761344}
I20260709 13:08:25.691169 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:25.828403 13829 leader_election.cc:400] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14.
I20260709 13:08:25.828280 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:25.828771 13829 leader_election.cc:403] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:25.631309 19538 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:25.700945 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:25.831727 13707 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:25.702101 13859 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:08:25.703826 13861 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 3607) took 1406 ms (client timeout 1848 ms). Trace:
I20260709 13:08:25.830081 14368 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:08:25.833549 13861 rpcz_store.cc:269] 0709 13:08:24.297528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.297650 (+   122us) service_pool.cc:224] Handling call
0709 13:08:25.703497 (+1405847us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b540035af54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:25.703733 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310225152}
I20260709 13:08:25.669248 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:25.708922 19280 raft_consensus.cc:740] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:25.752473 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:25.753376 19580 log.cc:927] Time spent T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.596s	user 0.005s	sys 0.005s
I20260709 13:08:25.863808 19280 consensus_queue.cc:260] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:25.767732 19575 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.864993 19280 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:25.864818 19575 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:25.824103 19567 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:25.866909 19575 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:25.867730 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3611) took 1266 ms. Trace:
I20260709 13:08:25.767935 19138 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:25.768947 14367 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:25.869130 13707 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:25.868959 19138 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:25.869343 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 100486us
I20260709 13:08:25.870411 13707 raft_consensus.cc:1240] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:25.870411 14367 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:25.870967 19138 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:25.678861 19422 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:25.769775 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 61216us
I20260709 13:08:25.868095 13860 rpcz_store.cc:276] 0709 13:08:24.601618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.602364 (+   746us) service_pool.cc:224] Handling call
0709 13:08:24.626760 (+ 24396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:24.640344 (+ 13584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:24.640381 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:24.653572 (+ 13191us) log.cc:844] Serialized 26 byte log entry
0709 13:08:24.937824 (+284252us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:24.937851 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.937899 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:25.648696 (+710797us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:25.867391 (+218695us) raft_consensus.cc:1685] finished
0709 13:08:25.867430 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:25.867667 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":9903,"spinlock_wait_cycles":7709568,"thread_start_us":244414,"threads_started":1,"wal-append.queue_time_us":349639}
W20260709 13:08:25.873487 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.863826 13708 raft_consensus.cc:2410] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:08:25.874475 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1962) took 1406 ms. Trace:
I20260709 13:08:25.875048 19138 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:25.875694 19138 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:25.876081 19138 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.876394 19138 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:25.877079 18889 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.877667 18889 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:25.707967 13716 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 26.
I20260709 13:08:25.874827 14398 rpcz_store.cc:276] 0709 13:08:24.468053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.484599 (+ 16546us) service_pool.cc:224] Handling call
0709 13:08:24.484877 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:24.999337 (+514460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.874274 (+874937us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b54004a8b54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:25.874426 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1155435264}
I20260709 13:08:25.880437 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:25.881567 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:25.883087 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:25.790663 19547 raft_consensus.cc:3055] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:25.883738 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 44999.1us
I20260709 13:08:25.883989 19547 raft_consensus.cc:740] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:25.884775 13829 leader_election.cc:400] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14.
I20260709 13:08:25.884912 19547 consensus_queue.cc:260] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:25.886018 19547 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:25.710742 19283 consensus_queue.cc:1059] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.090s
I20260709 13:08:25.889240 19283 raft_consensus.cc:3055] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:25.889581 19283 raft_consensus.cc:740] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:08:25.691023 19617 log.cc:927] Time spent T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:25.796804 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 1448) took 1644 ms. Trace:
I20260709 13:08:25.806526 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:25.890442 19631 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13.
I20260709 13:08:25.893146 13862 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:25.894107 14398 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.896967 14368 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:25.897728 13714 rpcz_store.cc:276] 0709 13:08:24.152725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.152834 (+   109us) service_pool.cc:224] Handling call
0709 13:08:25.152152 (+999318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:25.152444 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:25.152472 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:25.152511 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:25.152542 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.152597 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:25.796577 (+643980us) spinlock_profiling.cc:243] Waited 999 ms on lock 0x7b540008e150. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:25.796731 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1997,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":1667,"spinlock_wait_cycles":2297581312}
I20260709 13:08:25.804363 13791 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:08:25.809834 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:25.900671 14401 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:25.887079 13829 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:25.901808 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:25.902761 14401 raft_consensus.cc:2393] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 14: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:25.903620 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:25.590991 19497 consensus_queue.cc:237] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:25.823779 13788 raft_consensus.cc:2393] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 11: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:25.914911 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:25.827013 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:25.915606 14396 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:25.916051 13857 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:25.691253 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:25.828959 13858 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 21.
I20260709 13:08:25.830039 19353 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:25.692390 19435 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:25.822184 18658 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.840031 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:25.840721 19539 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14.
I20260709 13:08:25.841820 19502 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:25.853938 19542 raft_consensus.cc:3055] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:25.854425 19518 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:25.857743 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 2900) took 1449 ms. Trace:
I20260709 13:08:25.862490 19507 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:25.778083 19513 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:25.905498 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:25.906319 13707 raft_consensus.cc:1275] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:25.845948 19196 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:25.890398 19283 consensus_queue.cc:260] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:25.908594 19280 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:25.910797 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.911013 13680 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:25.868671 19567 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:25.919193 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:25.945897 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 58898.3us
I20260709 13:08:25.948763 14399 raft_consensus.cc:2410] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:08:25.951011 13858 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:08:25.927443 19325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.009s	sys 0.028s
I20260709 13:08:25.966902 13865 rpcz_store.cc:276] 0709 13:08:24.408406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.408602 (+   196us) service_pool.cc:224] Handling call
0709 13:08:25.857523 (+1448921us) spinlock_profiling.cc:243] Waited 56.2 ms on lock 0x7b540004ae54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:25.857663 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129227520}
I20260709 13:08:26.022214 13829 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:26.024356 13711 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 22: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:08:25.976176 13830 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.012s	sys 0.030s
I20260709 13:08:25.961038 19542 raft_consensus.cc:740] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:25.982349 14396 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
W20260709 13:08:25.976060 19599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.016s	sys 0.026s
I20260709 13:08:25.959991 18658 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:25.966573 19422 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.023872 14402 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 27 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 25. Current term is 27. Ops: []
W20260709 13:08:26.025700 13830 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.012s	sys 0.030s
W20260709 13:08:26.042207 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 684099us
W20260709 13:08:26.026189 19622 log.cc:927] Time spent T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:08:25.945851 19387 raft_consensus.cc:2764] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:08:26.026408 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:26.027207 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 116286us
I20260709 13:08:26.046317 14396 raft_consensus.cc:1275] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:26.047048 14401 raft_consensus.cc:2410] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
W20260709 13:08:26.010877 19574 log.cc:927] Time spent T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:26.019330 14368 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:26.038019 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 268528us
W20260709 13:08:26.024338 19325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.010s	sys 0.028s
I20260709 13:08:25.913630 19575 consensus_queue.cc:1059] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:08:26.055310 14398 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
W20260709 13:08:26.033299 19599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.016s	sys 0.026s
I20260709 13:08:26.031379 19539 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:26.031585 19315 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:26.058322 13680 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:26.070825 14399 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:26.072261 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:26.073122 13864 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
W20260709 13:08:26.075941 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 49470.6us
I20260709 13:08:26.043473 19567 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.025856 19280 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:08:26.039674 18889 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:26.061508 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:26.078936 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 208571us
I20260709 13:08:26.087379 13680 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:26.088459 19447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.012s	user 0.004s	sys 0.025s
I20260709 13:08:26.097378 13680 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:26.100893 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:26.086005 19602 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.006s	sys 0.020s
I20260709 13:08:26.106873 13680 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:26.088501 19465 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:26.047832 19275 consensus_queue.cc:1059] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:08:26.051002 19422 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:26.084757 19542 consensus_queue.cc:260] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:26.116225 19542 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:26.120595 18658 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:26.121858 19275 raft_consensus.cc:3055] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:26.122253 19275 raft_consensus.cc:740] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:26.122345 19138 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:26.108402 19590 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.123700 19590 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:26.124897 19422 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:26.123076 19275 consensus_queue.cc:260] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:26.108807 19602 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.007s	sys 0.020s
I20260709 13:08:26.137869 19422 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:26.138470 19422 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:26.140633 19422 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:26.144320 19636 log.cc:927] Time spent T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:08:26.161672 13830 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:08:26.102690 19454 consensus_meta.cc:287] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.667s	user 0.003s	sys 0.009s
I20260709 13:08:26.095382 19539 raft_consensus.cc:697] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:08:26.176772 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 68899.8us
W20260709 13:08:26.097254 19447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.021s	user 0.004s	sys 0.025s
I20260709 13:08:26.111840 19599 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:26.113503 19442 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:26.091482 19567 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:26.103657 19315 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:26.099584 19621 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 13:08:26.185245 19454 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:26.375771 14367 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:26.167589 19465 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:26.377846 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 270974us
W20260709 13:08:26.380846 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 219289us
W20260709 13:08:26.382381 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.404975 13680 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:26.410332 13756 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.014s	sys 0.020s
W20260709 13:08:26.410825 13756 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.014s	sys 0.020s
I20260709 13:08:26.418165 13782 raft_consensus.cc:1275] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:26.326876 19602 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:26.315799 19502 raft_consensus.cc:697] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:26.430120 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:26.374859 19599 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.330219 19641 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:08:26.450004 19625 log.cc:927] Time spent T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.290s	user 0.000s	sys 0.000s
I20260709 13:08:26.444927 19602 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:26.429519 19442 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:26.445920 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:26.456174 13716 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:26.446038 19630 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.357s
I20260709 13:08:26.438104 19454 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.459538 19454 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:26.461521 19454 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:26.462004 19454 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:26.462632 13711 raft_consensus.cc:1240] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:26.462471 19454 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:26.445658 19138 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:26.466296 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.467950 13711 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:26.451151 19641 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:26.452505 19637 log.cc:927] Time spent T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
I20260709 13:08:26.429674 19542 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:26.472126 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.445326 19591 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.473248 19591 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:26.421332 19465 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:26.478495 19465 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:26.444532 19599 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:26.447523 19502 consensus_queue.cc:237] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:26.484373 19629 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 13:08:26.446522 19577 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:26.493908 19590 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:26.486745 19325 raft_consensus.cc:3055] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:26.496994 19325 raft_consensus.cc:740] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:26.498208 19325 consensus_queue.cc:260] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:26.502502 14395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1971) took 1481 ms. Trace:
I20260709 13:08:26.507649 14395 rpcz_store.cc:276] 0709 13:08:25.021466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.022910 (+  1444us) service_pool.cc:224] Handling call
0709 13:08:25.044370 (+ 21460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:26.500578 (+1456208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:26.500623 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:26.500678 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:26.500730 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.502230 (+  1500us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540070e254. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:26.502282 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:26.502432 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3348421888}
I20260709 13:08:26.509517 13682 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:26.404819 19492 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:26.526876 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 481170us
I20260709 13:08:26.529625 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:26.530203 13864 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:26.531848 13862 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:26.533224 13716 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:26.533165 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:26.535070 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 131361us
I20260709 13:08:26.536801 14400 raft_consensus.cc:2410] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:08:26.521237 19533 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.005s	sys 0.030s
I20260709 13:08:26.541270 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:26.519810 19138 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.551301 13716 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:26.546295 19602 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:26.551929 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:26.552676 13710 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:08:26.512060 19540 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:26.555794 19540 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:26.558040 19540 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:26.546667 19447 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:08:26.540355 19318 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.561239 19318 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:26.565092 19632 log.cc:927] Time spent T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:08:26.566309 19646 consensus_queue.cc:1059] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:08:26.567219 19646 raft_consensus.cc:3055] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:26.567678 19646 raft_consensus.cc:740] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:26.567737 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:26.568549 19646 consensus_queue.cc:260] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:26.569718 19646 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:26.570956 19603 raft_consensus.cc:3055] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:26.571467 19603 raft_consensus.cc:740] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:08:26.535115 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.551645 19138 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:26.439437 19513 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:26.542940 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:26.540602 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 1357) took 1242 ms. Trace:
I20260709 13:08:26.578634 13708 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:26.525070 19325 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:26.577579 14393 rpcz_store.cc:276] 0709 13:08:25.297969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.298085 (+   116us) service_pool.cc:224] Handling call
0709 13:08:26.540418 (+1242333us) spinlock_profiling.cc:243] Waited 93.8 ms on lock 0x7b5400383954. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:26.540543 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215832448}
W20260709 13:08:26.540179 19228 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.001s	sys 0.035s
I20260709 13:08:26.504252 19196 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:26.529860 19442 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:26.453080 19518 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 27 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:26.472344 19542 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:26.534716 19629 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:26.535404 19492 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:26.601521 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 54500.4us
I20260709 13:08:26.548455 19416 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:26.577263 19533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.005s	sys 0.031s
I20260709 13:08:26.662181 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:26.547868 19566 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:26.631776 14366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.027s	sys 0.027s
I20260709 13:08:26.662708 13714 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:26.571309 19641 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:26.662842 13861 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:08:26.663300 14366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.027s	sys 0.027s
W20260709 13:08:26.663822 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 615146us
W20260709 13:08:26.634145 19410 consensus_meta.cc:287] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 1.154s	user 0.012s	sys 0.000s
I20260709 13:08:26.661517 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:26.575163 19318 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:26.645970 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:26.628080 19228 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.001s	sys 0.037s
I20260709 13:08:26.665877 13829 leader_election.cc:400] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14.
I20260709 13:08:26.683569 13829 leader_election.cc:403] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:08:26.671908 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:26.677546 13711 raft_consensus.cc:2393] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 14: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:26.678862 13710 raft_consensus.cc:2393] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 15: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:26.682786 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:26.685029 14398 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:26.685416 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:26.649858 19541 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.686226 13863 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:26.659183 19492 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:26.654767 19442 raft_consensus.cc:697] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:26.706663 13829 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:26.698192 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:26.719019 14394 raft_consensus.cc:2368] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14.
I20260709 13:08:26.662184 19575 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.667024 19518 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.722404 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:26.664086 19435 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:26.572515 19603 consensus_queue.cc:260] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:26.727903 14402 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:26.728657 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:26.731837 13829 leader_election.cc:400] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14.
I20260709 13:08:26.684465 19641 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.734962 13711 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:26.740262 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 1356) took 1445 ms. Trace:
I20260709 13:08:26.744349 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:26.744925 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:26.730504 19629 consensus_queue.cc:1048] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:08:26.744964 13856 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:26.746601 19599 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:26.721360 19630 consensus_queue.cc:1059] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:08:26.747292 19138 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:26.747900 19630 raft_consensus.cc:3055] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:26.748268 19630 raft_consensus.cc:740] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:26.749130 19630 consensus_queue.cc:260] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:26.750535 19630 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:26.752471 14367 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:26.755909 13856 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:26.626904 19539 consensus_queue.cc:237] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:26.768124 13711 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:26.686079 19645 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.375s
I20260709 13:08:26.684754 19566 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:26.732180 19590 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:26.684880 19410 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:26.769940 19567 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:26.783587 14401 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:26.772239 19138 consensus_queue.cc:1048] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:08:26.718710 19541 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:26.785597 19410 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:26.787015 13783 raft_consensus.cc:1240] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:26.762179 19454 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:26.733265 19575 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:26.751665 19621 consensus_queue.cc:1175] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b9d194f45e044e0988d5de1a99e5cd02" responder_term: 14 status { last_received { term: 10 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:26.752990 19435 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:26.796608 19435 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:26.801162 14400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 1979) took 1505 ms (client timeout 1839 ms). Trace:
W20260709 13:08:26.801608 14400 rpcz_store.cc:269] 0709 13:08:25.295777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.296430 (+   653us) service_pool.cc:224] Handling call
0709 13:08:26.800940 (+1504510us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54006a1dd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:26.801100 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2756637952}
I20260709 13:08:26.802690 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:26.761780 19641 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:26.768221 19603 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:26.741954 14397 rpcz_store.cc:276] 0709 13:08:25.295341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.295484 (+   143us) service_pool.cc:224] Handling call
0709 13:08:25.315943 (+ 20459us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:25.371573 (+ 55630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:25.371619 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:25.383588 (+ 11969us) log.cc:844] Serialized 52 byte log entry
0709 13:08:25.532761 (+149173us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:25.946752 (+413991us) log.cc:844] Serialized 14 byte log entry
0709 13:08:26.058326 (+111574us) log.cc:844] Serialized 14 byte log entry
0709 13:08:26.491209 (+432883us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b1800382900. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3ee455 00007f52324d6060 00007f52324e8716 00007f52324f9287 00007f52324f9208
0709 13:08:26.731340 (+240131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.731407 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:26.740073 (+  8666us) raft_consensus.cc:1685] finished
0709 13:08:26.740092 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:26.740213 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72631,"prepare.queue_time_us":108584,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":70,"raft.queue_time_us":254983,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":7365,"spinlock_wait_cycles":45920000,"thread_start_us":831950,"threads_started":4,"wal-append.queue_time_us":237018}
W20260709 13:08:26.813723 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 76566.4us
I20260709 13:08:26.816231 14367 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:26.813032 13861 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 22.
W20260709 13:08:26.803399 19635 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.390s	user 0.000s	sys 0.001s
W20260709 13:08:26.796645 19653 log.cc:927] Time spent T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:26.772727 19589 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.737310 19518 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:26.803287 14400 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:08:26.840045 13755 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:26.836635 19318 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.846132 14393 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:26.843333 19389 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:26.847669 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 255807us
I20260709 13:08:26.868311 13755 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:26.838549 19542 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:26.842620 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 428951us
I20260709 13:08:26.868836 13756 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:26.842499 19138 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:26.905251 13864 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:26.908983 13756 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:26.846683 19589 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:26.921613 19575 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:26.923158 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:26.925649 13862 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:26.931108 13708 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 27.
I20260709 13:08:26.848683 19650 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:26.932577 13786 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.015s	sys 0.021s
I20260709 13:08:26.968185 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3054) took 1413 ms. Trace:
I20260709 13:08:26.968791 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:26.969475 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 153297us
I20260709 13:08:26.969980 13862 raft_consensus.cc:2410] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:08:26.850484 19318 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:26.968997 13786 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.015s	sys 0.021s
I20260709 13:08:26.968604 13785 rpcz_store.cc:276] 0709 13:08:25.554719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.558639 (+  3920us) service_pool.cc:224] Handling call
0709 13:08:25.558904 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:25.559312 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:25.559352 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:25.564393 (+  5041us) log.cc:844] Serialized 26 byte log entry
0709 13:08:25.979541 (+415148us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:25.979592 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.979680 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:26.967947 (+988267us) raft_consensus.cc:1685] finished
0709 13:08:26.967967 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:26.968127 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1556,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7075,"thread_start_us":370045,"threads_started":1,"wal-append.queue_time_us":528207}
I20260709 13:08:26.981314 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:26.982281 13862 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 22: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:26.907167 19599 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:26.976751 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 47236.6us
I20260709 13:08:26.993391 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:26.995589 13864 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:26.996703 14368 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:26.997587 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:26.923372 19566 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:26.933276 19602 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14.
I20260709 13:08:27.004565 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:26.993358 19500 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:27.006016 19663 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:27.007484 19664 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:08:27.044566 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.008504 19502 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.013s	sys 0.009s
I20260709 13:08:27.017303 13789 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:27.018544 19683 consensus_queue.cc:1059] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:27.018676 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:27.019352 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:27.020584 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:27.022367 13790 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:08:27.023034 13712 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.001s	sys 0.006s
I20260709 13:08:27.023833 13786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3060) took 1425 ms. Trace:
W20260709 13:08:27.059397 13712 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.001s	sys 0.006s
I20260709 13:08:27.025203 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:27.025771 19665 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:08:27.026611 13682 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.002s	sys 0.001s
I20260709 13:08:27.029031 13791 raft_consensus.cc:1240] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:27.030398 13784 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:27.098758 13682 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.002s	sys 0.001s
W20260709 13:08:27.042776 19577 consensus_meta.cc:287] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.000s
I20260709 13:08:26.842218 19442 consensus_queue.cc:237] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:26.976027 19454 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:26.988847 19644 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:26.973742 19648 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:26.870469 19389 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:26.924321 19542 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
W20260709 13:08:27.042243 19654 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:08:27.099323 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 586160us
I20260709 13:08:27.137820 14367 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:27.138432 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 141786us
I20260709 13:08:27.139190 14367 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:27.046921 19664 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.059602 13786 rpcz_store.cc:276] 0709 13:08:25.598471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.690943 (+ 92472us) service_pool.cc:224] Handling call
0709 13:08:25.767758 (+ 76815us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:25.770866 (+  3108us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:26.178678 (+407812us) log.cc:844] Serialized 14 byte log entry
0709 13:08:26.973213 (+794535us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:26.990641 (+ 17428us) log.cc:844] Serialized 26 byte log entry
0709 13:08:26.990831 (+   190us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:26.991103 (+   272us) log.cc:844] Serialized 14 byte log entry
0709 13:08:26.991313 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.991407 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.023509 (+ 32102us) raft_consensus.cc:1685] finished
0709 13:08:27.023536 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.023744 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":767609,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":82,"raft.queue_time_us":73377,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":244,"thread_start_us":997959,"threads_started":2,"wal-append.queue_time_us":692447}
W20260709 13:08:27.048018 19502 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.013s	sys 0.009s
I20260709 13:08:27.040038 19541 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:27.045013 19641 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:27.106256 13782 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:27.144742 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:27.151964 13789 raft_consensus.cc:2393] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 12: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:27.137749 13682 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:27.145695 13788 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:27.146517 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:27.154835 13708 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 22: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:27.134783 19577 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:27.173013 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 264089us
I20260709 13:08:27.045593 19500 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:27.133929 19454 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:27.178484 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:27.178900 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 148404us
I20260709 13:08:27.180868 13716 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
W20260709 13:08:27.170557 19547 consensus_meta.cc:287] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 1.284s	user 0.012s	sys 0.000s
I20260709 13:08:27.186793 13713 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:27.177490 13756 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:27.153450 19664 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:27.177580 19502 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:27.164975 19599 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:27.203804 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:27.196856 13783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3063) took 1586 ms. Trace:
I20260709 13:08:27.164785 19661 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:27.207507 13783 rpcz_store.cc:276] 0709 13:08:25.610455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.787340 (+176885us) service_pool.cc:224] Handling call
0709 13:08:25.802386 (+ 15046us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:26.787467 (+985081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.196543 (+409076us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b54002ebb54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:27.196774 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2263981952}
I20260709 13:08:27.174170 19658 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:27.164861 19649 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:27.174511 19566 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.173956 19656 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:27.216445 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:27.236616 14394 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:27.180653 19454 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:27.174379 19662 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:08:27.182034 19518 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:27.234673 13708 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:27.145633 19648 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.238286 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2912) took 1177 ms. Trace:
I20260709 13:08:27.247248 13858 rpcz_store.cc:276] 0709 13:08:26.061046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.063132 (+  2086us) service_pool.cc:224] Handling call
0709 13:08:26.063556 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:26.087516 (+ 23960us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:26.087550 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:26.088060 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:08:26.635103 (+547043us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:26.635239 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.635515 (+   276us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.238081 (+602566us) raft_consensus.cc:1685] finished
0709 13:08:27.238101 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.238230 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88413,"raft.queue_time_us":27181,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":6349,"thread_start_us":474960,"threads_started":1,"wal-append.queue_time_us":741459}
I20260709 13:08:27.257252 19641 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:27.257277 19680 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:08:27.264235 19685 log.cc:927] Time spent T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:08:27.234213 19658 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.264387 19454 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.265121 19658 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:27.265659 13790 raft_consensus.cc:1240] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:27.270870 19454 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:27.272372 14398 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:08:27.277833 13710 pending_rounds.cc:85] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 10
I20260709 13:08:27.278204 13710 pending_rounds.cc:107] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:08:27.278438 13710 raft_consensus.cc:2889] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:27.278666 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.279537 19416 consensus_meta.cc:287] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.613s	user 0.009s	sys 0.000s
I20260709 13:08:27.280342 13715 raft_consensus.cc:2410] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
W20260709 13:08:27.280977 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 379641us
I20260709 13:08:27.284304 19389 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:27.284391 19500 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:27.284996 19389 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:27.285562 19389 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:27.295017 13708 raft_consensus.cc:1275] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:27.294456 14394 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
W20260709 13:08:27.277638 19614 consensus_meta.cc:287] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 1.450s	user 0.010s	sys 0.000s
W20260709 13:08:27.275266 19325 consensus_meta.cc:287] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.669s	user 0.006s	sys 0.000s
W20260709 13:08:27.289572 13680 connection.cc:256] RPC call timeout handler was delayed by -1.0495696140000064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
I20260709 13:08:27.259136 19641 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:27.245954 19589 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:27.286586 19681 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:27.220731 19599 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:27.295629 19492 consensus_meta.cc:287] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.555s	user 0.004s	sys 0.005s
I20260709 13:08:27.304286 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:27.252542 19662 raft_consensus.cc:697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 27 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:27.286906 19529 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.284621 19575 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:27.300647 13680 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:08:27.314553 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 137150us
I20260709 13:08:27.247189 19566 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.302675 19641 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.246632 19656 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.236655 19661 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.302021 19465 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:27.299252 19663 raft_consensus.cc:697] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:27.305672 19318 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:27.319643 19138 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.395390 19465 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.396265 19547 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:27.309763 19549 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:27.241714 19649 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.303784 19614 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:27.402423 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 101887us
W20260709 13:08:27.410497 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 202651us
I20260709 13:08:27.410684 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:27.337998 19325 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:27.307744 19212 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:08:27.307637 19577 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.092s
I20260709 13:08:27.412073 13755 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:27.358551 19641 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:27.414873 13680 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:27.334393 19492 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:27.405349 19416 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:08:27.425084 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 241822us
I20260709 13:08:27.356775 19603 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.430430 13709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2728) took 1041 ms. Trace:
I20260709 13:08:27.430506 13680 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:27.430778 14398 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:27.430910 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 293264us
I20260709 13:08:27.407657 19690 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.407032 19138 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.315568 19681 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:27.453176 13865 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:27.440357 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:27.440698 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:27.441314 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:27.441938 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:27.454387 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 114149us
W20260709 13:08:27.426045 19630 consensus_meta.cc:287] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.675s	user 0.007s	sys 0.007s
I20260709 13:08:27.444175 13682 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:27.413959 19325 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.358368 19575 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.411554 19547 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.442669 13709 rpcz_store.cc:276] 0709 13:08:26.389342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.389459 (+   117us) service_pool.cc:224] Handling call
0709 13:08:26.431207 (+ 41748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:26.431393 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:26.842653 (+411260us) log.cc:844] Serialized 14 byte log entry
0709 13:08:27.430129 (+587476us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:27.430173 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:27.430213 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.430266 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.430368 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":217044,"prepare.queue_time_us":15465,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":178266,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":18263,"thread_start_us":809705,"threads_started":3,"wal-append.queue_time_us":355597}
I20260709 13:08:27.452441 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:27.419080 19683 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.424851 19513 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:27.454347 13864 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:27.452050 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:27.455638 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:27.418529 19664 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:27.464473 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:27.459456 19686 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.354782 19529 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:27.411473 19549 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.477802 19688 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:27.459754 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 48593.7us
I20260709 13:08:27.492808 19196 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:08:27.502141 13612 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49444 (request call id 347) took 25221 ms (client timeout 15000 ms). Trace:
I20260709 13:08:27.502064 19196 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.484231 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:27.504304 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:27.452991 19690 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.482810 13863 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:27.505952 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:27.506476 19690 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:27.506578 13783 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:27.507366 19648 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:27.508036 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:27.508693 13789 raft_consensus.cc:2393] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 10: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:27.513320 19513 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:27.513453 19681 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:27.514099 19513 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:27.514477 19513 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.514803 19513 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:27.515082 19575 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:27.516734 19465 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:27.517827 19138 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:27.518280 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2730) took 1128 ms. Trace:
I20260709 13:08:27.518617 13713 rpcz_store.cc:276] 0709 13:08:26.389999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.390104 (+   105us) service_pool.cc:224] Handling call
0709 13:08:26.431857 (+ 41753us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:27.190418 (+758561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.518087 (+327669us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b540017a054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:27.518230 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1720900352}
I20260709 13:08:27.520955 13708 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:27.521310 19664 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:27.522059 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:27.522583 19614 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:27.523196 13787 raft_consensus.cc:2368] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15.
I20260709 13:08:27.523088 19549 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:27.459990 19662 consensus_queue.cc:237] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:27.526034 19646 consensus_meta.cc:287] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.956s	user 0.010s	sys 0.004s
I20260709 13:08:27.528184 13709 raft_consensus.cc:1275] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:27.528434 19566 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:27.460204 19663 consensus_queue.cc:237] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:27.530717 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:27.486675 18658 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.436359 18889 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:08:27.493429 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:27.471503 19325 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:27.493175 19702 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:27.540208 19539 consensus_queue.cc:1048] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:27.541599 19492 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:27.539088 19447 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:08:27.542826 19661 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:27.544152 19649 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:27.499061 19686 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.545166 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:27.500247 13788 raft_consensus.cc:1240] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:27.546341 19599 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:27.547231 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:27.504562 19196 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:27.520874 19658 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.528872 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:27.550185 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:27.550755 19658 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:27.452329 19389 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:27.448977 19416 raft_consensus.cc:697] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:27.552289 19416 consensus_queue.cc:237] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.553507 13863 raft_consensus.cc:1240] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:27.553889 13757 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:27.555023 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:27.551183 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:27.555743 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:27.556231 14399 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:27.557045 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:27.531481 13708 raft_consensus.cc:2393] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 15: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:27.487331 13858 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:08:27.534112 13790 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:27.531124 19591 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:27.534873 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:27.531482 18658 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:27.447595 19603 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.538067 19630 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:27.560451 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:27.502017 19689 log.cc:927] Time spent T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:08:27.563181 14368 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:27.564654 13783 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 27.
I20260709 13:08:27.566751 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:27.571132 13860 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:27.566578 19196 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:27.567677 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:27.573393 14399 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 22: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:27.568128 19603 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:27.568346 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:27.502660 13612 rpcz_store.cc:269] 0709 13:08:02.280947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.281345 (+   398us) service_pool.cc:224] Handling call
0709 13:08:27.501906 (+25220561us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:21.728553 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:21.729888 (+  1335us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:21.729974 (+    86us) write_op.cc:435] Acquired schema lock
0709 13:08:21.730039 (+    65us) tablet.cc:662] Decoding operations
0709 13:08:21.731241 (+  1202us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:21.731381 (+   140us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:21.736333 (+  4952us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:08:21.808391 (+ 72058us) tablet.cc:701] Row locks acquired
0709 13:08:21.819401 (+ 11010us) write_op.cc:260] PREPARE: finished
0709 13:08:21.841675 (+ 22274us) write_op.cc:270] Start()
0709 13:08:21.863494 (+ 21819us) write_op.cc:276] Timestamp: P: 1783602501835203 usec, L: 0
0709 13:08:21.885509 (+ 22015us) op_driver.cc:348] REPLICATION: starting
0709 13:08:21.944406 (+ 58897us) log.cc:844] Serialized 1621 byte log entry
0709 13:08:23.158494 (+1214088us) op_driver.cc:464] REPLICATION: finished
0709 13:08:23.616244 (+457750us) write_op.cc:301] APPLY: starting
0709 13:08:23.616347 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:23.619202 (+  2855us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:23.619326 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:23.957131 (+337805us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:24.122563 (+165432us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:08:24.147471 (+ 24908us) write_op.cc:312] APPLY: finished
0709 13:08:24.188353 (+ 40882us) log.cc:844] Serialized 41 byte log entry
0709 13:08:24.613616 (+425263us) spinlock_profiling.cc:243] Waited 71.1 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f522f3d40ac 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b
0709 13:08:24.679469 (+ 65853us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:24.679567 (+    98us) write_op.cc:454] Released schema lock
0709 13:08:24.679627 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:24.702817 (+ 23190us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:24.702851 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":304066,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":457417,"apply.run_cpu_time_us":35089,"apply.run_wall_time_us":1086458,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16667,"num_ops":3,"prepare.queue_time_us":438384,"prepare.run_cpu_time_us":13690,"prepare.run_wall_time_us":266246,"raft.queue_time_us":587867,"raft.run_cpu_time_us":15383,"raft.run_wall_time_us":349776,"replication_time_us":1251955,"spinlock_wait_cycles":163440000,"thread_start_us":1610410,"threads_started":5,"wal-append.queue_time_us":793668,"wal-append.run_cpu_time_us":22810,"wal-append.run_wall_time_us":3106959}]]}
I20260709 13:08:27.573557 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:27.500878 19691 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.575938 14367 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:27.516741 19547 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:27.576512 14394 raft_consensus.cc:1240] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:27.585064 14394 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:27.586414 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:27.588732 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.577416 13789 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:27.587132 13858 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:27.594825 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:27.596493 13864 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:08:27.600139 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.601250 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:27.601837 13860 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
I20260709 13:08:27.604663 13711 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:27.606206 13830 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:27.608563 19325 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:27.610132 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:27.610015 19513 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.612077 19697 consensus_queue.cc:1059] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:08:27.613421 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:27.615706 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:27.616310 13710 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:08:27.617101 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:27.617802 13710 raft_consensus.cc:2393] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 14: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:27.612655 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:27.573170 19196 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.621104 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:27.572754 19630 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.601799 14368 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:27.576254 19599 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:27.493673 19683 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.639211 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:27.641849 13782 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:08:27.637899 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:27.640075 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:27.579161 19688 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.647256 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:27.642575 13829 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.681s (SENT) [suppressed 21 similar messages]
I20260709 13:08:27.644551 18658 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:27.639557 14368 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:27.648670 13864 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:27.646029 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:27.636349 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:27.650893 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:27.647126 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:27.601305 19649 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:08:27.651590 13713 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:27.651680 13711 raft_consensus.cc:2410] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:27.595153 19627 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:27.653838 14368 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:27.659054 13789 raft_consensus.cc:1275] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:27.653913 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:27.656662 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:27.624812 19389 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.653327 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:27.658382 14368 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:27.640772 19196 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:27.712774 13791 raft_consensus.cc:2368] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15.
I20260709 13:08:27.595008 19661 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:08:27.713680 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:27.637773 19325 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:27.641427 19599 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.642038 19547 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:08:27.782245 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 123955us
I20260709 13:08:27.652772 19353 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:27.790267 19695 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.795087 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:27.796228 13864 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:08:27.803611 14367 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:27.657799 19694 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:27.813021 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 382563us
W20260709 13:08:27.828804 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 384681us
I20260709 13:08:27.775171 19658 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:27.588762 19691 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:27.794927 19318 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:08:27.837241 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.865922 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.866991 13757 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:27.791530 19656 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:27.829797 13682 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:27.858204 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:27.782397 19646 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:27.775703 19648 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.647354 19630 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.807330 19547 raft_consensus.cc:697] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:27.792299 19353 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:27.888890 13864 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:27.814749 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 1466) took 1089 ms. Trace:
I20260709 13:08:27.713231 19389 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:27.797415 19690 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:27.713023 19627 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.870631 13680 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:27.876050 13713 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:27.877628 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:27.792717 19599 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:27.858179 19658 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.890106 13784 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:27.890601 13714 rpcz_store.cc:276] 0709 13:08:26.725410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.745948 (+ 20538us) service_pool.cc:224] Handling call
0709 13:08:26.746263 (+   315us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:27.277349 (+531086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:27.277383 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:27.278001 (+   618us) log.cc:844] Serialized 52 byte log entry
0709 13:08:27.415601 (+137600us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:27.813802 (+398201us) log.cc:844] Serialized 14 byte log entry
0709 13:08:27.814460 (+   658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.814529 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.814567 (+    38us) raft_consensus.cc:1685] finished
0709 13:08:27.814577 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.814697 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":552782,"prepare.queue_time_us":76921,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":538099,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":32689,"thread_start_us":498761,"threads_started":2,"wal-append.queue_time_us":218257}
I20260709 13:08:27.653609 19688 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.900279 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:27.904706 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:27.885275 19664 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:27.889952 19566 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.887307 19212 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:27.878070 19646 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:27.894219 19353 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:27.914211 13861 raft_consensus.cc:2410] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:27.894510 19656 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:27.916994 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:27.918833 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:27.898680 19702 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:27.919379 13791 raft_consensus.cc:2393] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 12: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:27.876677 19533 consensus_queue.cc:1059] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:08:27.904024 19658 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:27.922744 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:27.890161 19648 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:27.923041 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 157413us
I20260709 13:08:27.831873 19694 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:27.808701 19695 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.928280 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:27.909734 19664 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.918916 19566 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.910753 19686 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:27.910744 19549 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:27.915108 19646 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:27.936390 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 304996us
I20260709 13:08:27.937024 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:27.948469 13714 raft_consensus.cc:2393] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 16: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:27.949510 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:27.950790 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:27.953101 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 149596us
I20260709 13:08:27.953470 13756 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:08:27.954685 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.955642 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:27.957261 14367 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:27.905871 19690 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:27.945919 19664 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:27.933362 19212 raft_consensus.cc:697] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 22 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:27.977177 14395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 1366) took 1307 ms. Trace:
I20260709 13:08:27.977957 14395 rpcz_store.cc:276] 0709 13:08:26.669670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.669794 (+   124us) service_pool.cc:224] Handling call
0709 13:08:26.677411 (+  7617us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:26.677817 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:27.270916 (+593099us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b1800389980. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3ee455 00007f5235ed63c7 00007f52324e89a7 00007f52324f80bf 00007f52324f8038
0709 13:08:27.443112 (+172196us) log.cc:844] Serialized 14 byte log entry
0709 13:08:27.963242 (+520130us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:27.963941 (+   699us) log.cc:844] Serialized 26 byte log entry
0709 13:08:27.964252 (+   311us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:27.964515 (+   263us) log.cc:844] Serialized 14 byte log entry
0709 13:08:27.972784 (+  8269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.972853 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.976979 (+  4126us) raft_consensus.cc:1685] finished
0709 13:08:27.976999 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.977123 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8012,"prepare.queue_time_us":338309,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":87,"raft.queue_time_us":48048,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":15627,"spinlock_wait_cycles":3244800,"thread_start_us":646197,"threads_started":3,"wal-append.queue_time_us":504328}
I20260709 13:08:27.981885 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:27.958884 19686 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:27.953166 19549 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:27.984522 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:27.981984 14401 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 1370) took 1310 ms (client timeout 1662 ms). Trace:
W20260709 13:08:27.991782 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.995901 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:27.997816 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:27.987849 14401 rpcz_store.cc:269] 0709 13:08:26.671585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.671699 (+   114us) service_pool.cc:224] Handling call
0709 13:08:27.981844 (+1310145us) spinlock_profiling.cc:243] Waited 99 ms on lock 0x7b540070eed4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:27.981937 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227710208}
I20260709 13:08:27.972139 14367 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:28.001303 14399 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:27.979064 19645 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:27.934506 19702 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.006299 14366 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:27.979256 19315 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:27.989383 19686 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.009709 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:28.090344 13863 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.011s	sys 0.011s
I20260709 13:08:27.987924 19549 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:27.987954 19442 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:28.097743 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:28.088414 19492 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:27.960471 19547 consensus_queue.cc:237] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:27.983283 19540 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:28.169678 13713 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:28.007776 19683 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:28.122021 13863 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.011s	sys 0.011s
I20260709 13:08:28.007002 19435 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:28.119773 19591 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:28.125108 19709 log.cc:927] Time spent T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:08:28.125814 19422 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:28.187503 19687 raft_consensus.cc:3055] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:28.126464 19725 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:28.188011 19687 raft_consensus.cc:740] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:28.182886 19435 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.188572 19725 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:28.188884 19687 consensus_queue.cc:260] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.190300 19435 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:28.127763 19389 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:28.130416 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:28.190831 19435 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:28.191494 19591 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:28.193038 13715 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 3190) took 3557 ms (client timeout 3091 ms). Trace:
I20260709 13:08:28.193472 19591 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:28.193533 13715 rpcz_store.cc:269] 0709 13:08:24.635315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.636341 (+  1026us) service_pool.cc:224] Handling call
0709 13:08:28.192767 (+3556426us) spinlock_profiling.cc:243] Waited 2.63 s on lock 0x7b5400041854. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:28.192934 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6051675392}
W20260709 13:08:28.131978 19711 log.cc:927] Time spent T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:08:28.131891 14396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1770) took 2240 ms. Trace:
I20260709 13:08:28.196156 19695 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:28.118319 13829 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:28.197296 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 79066.9us
I20260709 13:08:28.196519 14396 rpcz_store.cc:276] 0709 13:08:25.891798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.047075 (+155277us) service_pool.cc:224] Handling call
0709 13:08:26.807502 (+760427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:26.807718 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:27.134604 (+326886us) log.cc:844] Serialized 14 byte log entry
0709 13:08:27.239286 (+104682us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:27.239354 (+    68us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:27.239398 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.239497 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:28.131728 (+892231us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b54006a1dd0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:28.131836 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":206874,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":1214,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":6688,"spinlock_wait_cycles":1748201728,"thread_start_us":430685,"threads_started":2,"wal-append.queue_time_us":221613}
I20260709 13:08:28.197975 13829 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:28.199060 13829 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:28.123374 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 117172us
W20260709 13:08:28.200004 19714 log.cc:927] Time spent T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:08:28.134325 19549 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:28.009694 19447 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.203594 19447 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.206039 19447 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:28.206646 19447 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:28.207896 14399 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:28.209136 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:28.210901 14401 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:28.088878 19602 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:28.212013 19602 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:28.214414 19602 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:28.215009 19602 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:28.166080 19212 consensus_queue.cc:237] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:28.125869 19717 log.cc:927] Time spent T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:08:28.189101 19725 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.136996 19686 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.120200 19656 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:28.168762 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.123623 19493 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 13:08:28.230988 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:28.225152 13787 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.013s	sys 0.021s
I20260709 13:08:28.232391 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:28.237207 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:28.247011 14396 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:28.247403 14395 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:28.240914 13755 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:28.223603 14401 pending_rounds.cc:85] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 11
I20260709 13:08:28.160961 19442 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.248355 14401 pending_rounds.cc:107] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 14.12
W20260709 13:08:28.248344 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 295005us
I20260709 13:08:28.248957 14401 raft_consensus.cc:2889] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:28.249713 13756 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:28.250545 13787 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.014s	sys 0.022s
I20260709 13:08:28.250910 13756 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:28.252260 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 1985) took 1508 ms. Trace:
I20260709 13:08:28.167797 19492 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:28.136516 19315 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:28.231348 19389 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:28.238420 19688 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:28.239283 19627 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:28.180308 19540 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.278436 14402 rpcz_store.cc:276] 0709 13:08:26.743440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.771703 (+ 28263us) service_pool.cc:224] Handling call
0709 13:08:26.771953 (+   250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:26.809302 (+ 37349us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:26.809327 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:26.816864 (+  7537us) log.cc:844] Serialized 26 byte log entry
0709 13:08:28.243210 (+1426346us) spinlock_profiling.cc:243] Waited 57.4 ms on lock 0x7b5400a2f1a0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232448090 00007f52324556b8 00007f52324de92b 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c
0709 13:08:28.243284 (+    74us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:28.243344 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.246291 (+  2947us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:28.246344 (+    53us) raft_consensus.cc:1685] finished
0709 13:08:28.246361 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:28.252202 (+  5841us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48841,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":9900,"spinlock_wait_cycles":132601472,"thread_start_us":191571,"threads_started":1,"wal-append.queue_time_us":198809,"wal-append.run_cpu_time_us":2211,"wal-append.run_wall_time_us":1124015}
I20260709 13:08:28.316200 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:28.308390 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:28.307964 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:28.287384 13865 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 3634) took 1754 ms (client timeout 2123 ms). Trace:
I20260709 13:08:28.331027 14394 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:28.331396 13713 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
W20260709 13:08:28.331506 13865 rpcz_store.cc:269] 0709 13:08:26.532795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.532930 (+   135us) service_pool.cc:224] Handling call
0709 13:08:28.287181 (+1754251us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b54001accd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:28.287315 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2113913088}
W20260709 13:08:28.314193 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.297089 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:28.320021 14367 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:28.337023 18658 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:28.337538 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 51899.1us
I20260709 13:08:28.260511 19695 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:28.340281 19100 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:28.340857 19100 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.341468 19442 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:28.293506 19513 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:28.299309 19549 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:28.343561 19726 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:28.344128 19726 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.344851 19492 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:28.346415 19529 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:28.346621 19540 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:28.314138 19732 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.347875 13755 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:28.288439 19658 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.348670 19507 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:28.349905 19684 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:28.350343 19658 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:28.298687 19353 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.351876 13755 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:28.352268 19725 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:28.352596 19591 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:28.353363 19353 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:28.353978 19695 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:28.354159 19702 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:28.354413 19695 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.354857 19695 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.355756 19648 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:28.357435 19690 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:28.254745 19630 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:28.284888 19712 log.cc:927] Time spent T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:08:28.360518 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:28.353384 19694 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:28.343011 19100 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:28.301514 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:28.364436 19283 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:28.369797 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 49878.5us
I20260709 13:08:28.378907 14367 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:28.369477 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 118647us
I20260709 13:08:28.372716 13755 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:28.333703 19691 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:28.346709 19726 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:28.384483 18658 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:28.394523 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 384899us
I20260709 13:08:28.396690 18658 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:08:28.397176 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.397228 18658 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.383670 13756 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:28.397259 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:28.282625 19683 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:08:28.382251 19729 log.cc:927] Time spent T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.138s	user 0.002s	sys 0.000s
I20260709 13:08:28.376065 19629 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.405254 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:28.378835 19725 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:28.379631 19353 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:28.412160 13755 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:28.347819 19732 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:28.429335 19196 consensus_meta.cc:287] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.636s	user 0.010s	sys 0.001s
I20260709 13:08:28.401523 19100 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:28.411164 19733 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:28.429770 19691 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:28.422924 19725 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:28.432618 19688 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:28.431308 19683 raft_consensus.cc:697] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:28.433970 19513 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:28.436219 19100 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.448031 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:28.458796 13786 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:28.437832 19435 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.460798 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:28.456429 19688 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.430984 19629 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.469733 18658 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.471267 14395 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:28.431802 19353 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.436497 19708 consensus_queue.cc:1059] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:08:28.446260 19725 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:28.462003 19100 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.447861 19691 raft_consensus.cc:697] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:28.436101 19196 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:28.481262 19721 log.cc:927] Time spent T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.319s	user 0.000s	sys 0.005s
I20260709 13:08:28.437492 19681 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:08:28.469399 19549 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:28.497717 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 298721us
I20260709 13:08:28.469172 19688 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:28.458377 19513 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:28.458784 19507 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:28.490559 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:28.497059 18658 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:28.486024 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 1365) took 1816 ms. Trace:
W20260709 13:08:28.550082 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 49081.5us
I20260709 13:08:28.548411 14393 rpcz_store.cc:276] 0709 13:08:26.669240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.669369 (+   129us) service_pool.cc:224] Handling call
0709 13:08:26.696043 (+ 26674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:26.846651 (+150608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.485802 (+1639151us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54009371d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:28.485967 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344249088}
I20260709 13:08:28.554504 13788 raft_consensus.cc:2393] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 17: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:28.554870 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:28.472066 19435 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:28.503011 19646 consensus_meta.cc:287] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.000s
I20260709 13:08:28.570816 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:28.570793 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 85632.6us
I20260709 13:08:28.571602 13829 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:28.573446 19646 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.577797 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:28.577943 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:28.503299 19513 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:28.594815 13829 leader_election.cc:400] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15.
I20260709 13:08:28.596356 13829 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:28.599756 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 235910us
I20260709 13:08:28.600296 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:28.498768 19692 consensus_queue.cc:1059] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
I20260709 13:08:28.605641 14396 raft_consensus.cc:1240] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:28.503037 19549 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.592880 19540 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:28.596480 19492 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:28.569864 19507 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:28.572855 19493 consensus_queue.cc:1059] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:08:28.632699 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:28.630893 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:28.604346 19602 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:28.503192 19389 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.098s
I20260709 13:08:28.503400 19630 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 13:08:28.603107 19315 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:28.638211 13713 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:28.602588 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:28.633288 14395 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:28.640344 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:28.640987 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:28.641649 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:28.629298 19644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.457s	user 0.022s	sys 0.024s
I20260709 13:08:28.624285 19540 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.650874 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:28.641570 14395 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:08:28.640695 13682 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:28.603745 19627 consensus_queue.cc:1048] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:08:28.622012 19656 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:28.650072 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:28.652715 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:28.653901 13682 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:28.692497 13711 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:08:28.671180 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:28.692459 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:28.695225 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:28.649055 19644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.484s	user 0.023s	sys 0.024s
I20260709 13:08:28.696808 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:28.700016 13713 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:08:28.634464 19602 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:28.700822 13682 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:28.702390 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:28.691674 19704 log.cc:927] Time spent T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:08:28.704737 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 46055.8us
I20260709 13:08:28.701836 19602 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:28.705968 19507 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:28.714387 19602 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:28.715538 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:28.716931 19602 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:28.720072 14400 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:28.722708 19100 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.726233 19100 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:28.730160 13859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3644) took 1269 ms. Trace:
I20260709 13:08:28.735193 13857 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:28.736204 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59764 (request call id 93) took 1193 ms. Trace:
I20260709 13:08:28.730595 13859 rpcz_store.cc:276] 0709 13:08:27.461046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.462227 (+  1181us) service_pool.cc:224] Handling call
0709 13:08:27.481783 (+ 19556us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:27.485178 (+  3395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:27.485206 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:27.485842 (+   636us) log.cc:844] Serialized 52 byte log entry
0709 13:08:28.167186 (+681344us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b1800370480. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e0d1 00007f5232499a0f
0709 13:08:28.464381 (+297195us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:28.464438 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.464526 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:28.729818 (+265292us) raft_consensus.cc:1685] finished
0709 13:08:28.729840 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:28.730091 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2962,"raft.queue_time_us":10966,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5397,"spinlock_wait_cycles":75812096,"thread_start_us":296983,"threads_started":1,"wal-append.queue_time_us":1154206}
I20260709 13:08:28.736581 13862 rpcz_store.cc:276] 0709 13:08:27.542723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.544037 (+  1314us) service_pool.cc:224] Handling call
0709 13:08:28.735952 (+1191915us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b54002fb2d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e4735 00007f52324dc9fa 00007f52374a44c9 00007f5230a20c54 00007f5230a20be2 00007f5230a20b11 00007f5230a20a8c 00007f5230a1fd42 00007f523081948c 00007f52308188c6
0709 13:08:28.736128 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":798218624}
I20260709 13:08:28.736960 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:28.737416 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:28.737598 13860 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:28.642994 19643 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:28.651445 19738 raft_consensus.cc:3055] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:28.654908 19540 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:28.599699 19683 consensus_queue.cc:237] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.761482 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:28.793180 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:28.794557 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 46902.9us
I20260709 13:08:28.736232 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:28.774506 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 73751.8us
I20260709 13:08:28.736510 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:28.805413 13865 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.627576 19691 consensus_queue.cc:237] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:28.804275 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:28.790326 19715 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.668s	user 0.000s	sys 0.004s
I20260709 13:08:28.650995 19681 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.143s
I20260709 13:08:28.736426 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:28.704043 19734 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:28.819460 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:28.739078 19502 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:28.808297 19641 consensus_meta.cc:287] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 1.366s	user 0.011s	sys 0.001s
I20260709 13:08:28.826254 13865 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:28.795534 19416 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:28.862097 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:28.862612 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:28.863397 14395 raft_consensus.cc:2368] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14.
I20260709 13:08:28.703807 19708 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.817317 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:28.789700 19100 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:28.825495 13786 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:08:28.871718 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:28.703629 19644 raft_consensus.cc:697] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:28.832891 13863 raft_consensus.cc:2393] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 12: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:28.797408 19738 raft_consensus.cc:740] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:28.691606 19492 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.131s
I20260709 13:08:28.866842 13791 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
W20260709 13:08:28.873525 19744 log.cc:927] Time spent T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:08:28.698591 19656 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.834206 19629 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:28.874442 19100 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.812539 19533 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:28.877853 19695 consensus_meta.cc:287] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.523s	user 0.006s	sys 0.002s
I20260709 13:08:28.871376 19502 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:28.880825 19599 consensus_meta.cc:287] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.970s	user 0.006s	sys 0.003s
I20260709 13:08:28.881242 19627 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.881301 19648 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:28.869374 19641 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.886451 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:28.887452 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 229352us
I20260709 13:08:28.887705 13860 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:28.936233 13865 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:28.891932 13680 leader_election.cc:400] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14.
I20260709 13:08:28.889627 14368 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:28.873808 19549 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:28.897614 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:28.941787 13786 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:08:28.874032 19353 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:28.899300 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:28.813880 19283 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
W20260709 13:08:28.908124 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 202647us
I20260709 13:08:28.802861 19643 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.870344 19649 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:28.951819 13782 raft_consensus.cc:1240] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:08:28.872402 19315 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:28.889536 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:28.936709 13680 leader_election.cc:403] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:28.937238 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 47686.3us
I20260709 13:08:28.937879 14393 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:08:28.895247 19732 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:28.939178 19644 consensus_queue.cc:237] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.945870 13791 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:28.964562 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:28.964740 18889 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.965176 13791 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:08:28.966012 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:28.884599 19196 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:28.964578 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 72859us
I20260709 13:08:28.952391 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:28.942096 19629 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:28.970849 13786 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:28.973026 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:28.973263 13856 raft_consensus.cc:2410] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
W20260709 13:08:28.974787 19739 log.cc:927] Time spent T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
W20260709 13:08:28.976054 19750 log.cc:927] Time spent T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:08:28.961409 19649 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.976097 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:28.979920 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:28.980698 13790 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:28.929983 19533 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:28.940255 19627 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:28.987138 19627 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:28.989216 19533 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:28.933053 19695 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.937101 19599 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.940310 19648 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:28.970806 19646 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:29.011991 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 75615.7us
I20260709 13:08:29.016357 14397 raft_consensus.cc:2393] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 11: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:08:29.006445 19741 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.307s	user 0.000s	sys 0.001s
I20260709 13:08:28.992101 19629 raft_consensus.cc:697] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:28.963490 19315 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:29.024992 13830 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:29.033480 19627 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:29.040191 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:29.043820 14401 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:29.044935 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:29.045076 13680 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:29.045536 14401 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:29.045887 19734 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:29.046252 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1771) took 1727 ms. Trace:
I20260709 13:08:29.046445 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:29.047026 13680 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:29.041039 19513 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:29.048094 19758 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:29.048851 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:29.046784 14398 rpcz_store.cc:276] 0709 13:08:27.318729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.318866 (+   137us) service_pool.cc:224] Handling call
0709 13:08:27.327343 (+  8477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:27.443693 (+116350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.046032 (+1602339us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400684554. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:29.046199 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237309696}
I20260709 13:08:29.042385 13707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2729) took 2652 ms. Trace:
I20260709 13:08:29.058506 13860 raft_consensus.cc:1240] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:29.043692 19541 raft_consensus.cc:3055] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:29.059871 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:29.060757 13863 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
W20260709 13:08:29.032464 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 83835.8us
W20260709 13:08:29.062271 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.960961 19738 consensus_queue.cc:260] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:29.062546 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:29.068320 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:29.070760 14398 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:29.055608 13707 rpcz_store.cc:276] 0709 13:08:26.389706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.389809 (+   103us) service_pool.cc:224] Handling call
0709 13:08:28.201225 (+1811416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:28.201515 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:28.201556 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:28.201609 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:28.201661 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.221966 (+ 20305us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.041545 (+819579us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b18004594c0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3bf2a6 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4
0709 13:08:29.042248 (+   703us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b5400041850. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:29.042334 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5091,"raft.queue_time_us":20011,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":11331,"spinlock_wait_cycles":4144827136}
I20260709 13:08:29.041074 19566 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:29.046295 19734 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:29.061843 19627 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.077607 13829 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:29.080642 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:29.083115 13829 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:29.084754 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:29.083019 13757 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:29.028960 19649 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:29.085450 13863 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:29.083712 19734 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:29.081563 19761 log.cc:927] Time spent T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:08:29.048540 19758 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:08:29.113629 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 84775.5us
I20260709 13:08:29.062723 19541 raft_consensus.cc:740] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:08:29.085924 19760 log.cc:927] Time spent T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:08:29.113445 19507 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:29.124006 19513 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:29.086457 19567 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:29.126173 19753 log.cc:927] Time spent T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:08:29.125836 19567 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:29.123118 18889 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14.
I20260709 13:08:29.125931 19541 consensus_queue.cc:260] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:29.127851 19541 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:29.128656 19567 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:29.128945 19643 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:29.125306 19759 log.cc:927] Time spent T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:08:29.132562 19695 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:29.136812 19754 log.cc:927] Time spent T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:08:29.117038 13830 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:29.140240 19502 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:29.141173 19706 raft_consensus.cc:3055] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:29.141595 19706 raft_consensus.cc:740] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:29.142401 19706 consensus_queue.cc:260] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:29.143576 19629 consensus_queue.cc:237] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:29.146260 19751 log.cc:927] Time spent T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:08:29.086514 19627 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:29.030995 19756 consensus_queue.cc:1059] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
W20260709 13:08:29.160504 19318 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.266s	user 0.000s	sys 0.008s
I20260709 13:08:29.163856 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:29.113111 19755 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:29.115788 19738 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:29.172358 13857 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:08:29.180614 13857 pending_rounds.cc:85] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 9
I20260709 13:08:29.180958 13857 pending_rounds.cc:107] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:08:29.181270 13857 raft_consensus.cc:2889] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:29.183425 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:29.168702 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:29.082022 19681 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:29.082190 19416 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:29.166013 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:29.175279 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:29.175603 13790 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 27 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:08:29.169613 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:29.184243 13857 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
W20260709 13:08:29.175554 19318 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.287s	user 0.000s	sys 0.008s
I20260709 13:08:29.077606 19533 consensus_queue.cc:1059] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 13:08:29.193079 13857 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:08:29.148343 19758 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:29.176129 19686 consensus_meta.cc:287] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.925s	user 0.011s	sys 0.000s
W20260709 13:08:29.199623 19740 log.cc:927] Time spent T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.631s	user 0.002s	sys 0.000s
I20260709 13:08:29.156816 19656 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:29.158228 19630 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:29.201089 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 1376) took 1208 ms. Trace:
I20260709 13:08:29.228606 14397 rpcz_store.cc:276] 0709 13:08:27.993148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.993583 (+   435us) service_pool.cc:224] Handling call
0709 13:08:29.200857 (+1207274us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540057dfd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:29.201018 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2337152384}
I20260709 13:08:29.109542 19702 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:08:29.173286 19602 raft_consensus.cc:2764] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:08:29.174727 19643 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:29.179747 19688 consensus_meta.cc:287] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.632s	user 0.008s	sys 0.003s
W20260709 13:08:29.230858 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 147824us
I20260709 13:08:29.232045 13784 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:08:29.232851 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:29.232964 19540 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:29.179591 19641 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:29.178015 19755 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:29.252709 14397 raft_consensus.cc:1240] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:08:29.239377 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:29.211942 19756 raft_consensus.cc:3055] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:29.249804 13863 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:29.197044 19318 raft_consensus.cc:697] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:29.310802 13865 raft_consensus.cc:2393] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 16: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:29.255779 13859 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:29.256487 13757 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:29.312606 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 56202.3us
I20260709 13:08:29.315727 13757 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:29.200284 19681 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:29.321440 13757 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:29.252002 19533 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.200541 19416 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:29.227713 19686 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:29.309845 18889 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.319394 19275 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:29.308737 19756 raft_consensus.cc:740] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:29.308565 19755 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:29.316728 19454 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:29.323596 19641 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:29.247938 19688 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:29.329134 19728 log.cc:927] Time spent T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:08:29.404567 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:29.413239 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.466244 13859 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
W20260709 13:08:29.335610 19664 consensus_meta.cc:287] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 1.348s	user 0.012s	sys 0.000s
W20260709 13:08:29.606076 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.334414 19196 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:29.607829 13791 raft_consensus.cc:2368] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14.
I20260709 13:08:29.323362 19643 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:08:29.340538 19533 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:29.392408 19748 log.cc:927] Time spent T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
W20260709 13:08:29.393380 19749 log.cc:927] Time spent T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
W20260709 13:08:29.400081 19767 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:08:29.395704 13601 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 536b1fc131984687bf3b13417507e21d with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b5029654a4384e43a68eb67b794949b7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:29.622746 13783 raft_consensus.cc:2393] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 18: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:29.382550 19454 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.375113 18889 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:29.680860 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 439064us
W20260709 13:08:29.628454 19725 consensus_meta.cc:287] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 1.130s	user 0.007s	sys 0.004s
I20260709 13:08:29.754508 19772 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:29.759985 19725 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:29.760226 19772 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:29.761168 14395 raft_consensus.cc:2393] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 18: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:29.761358 19416 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:29.762507 19688 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:29.762852 19772 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:29.763000 19725 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:29.392537 19765 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:29.625418 19315 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:29.652879 19756 consensus_queue.cc:260] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:29.612193 19196 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:29.715754 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:29.719112 13789 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:29.417806 19641 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.507313 19644 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.760172 19540 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:29.763741 19765 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:29.773748 13859 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
W20260709 13:08:29.774076 13601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 435250us
W20260709 13:08:29.754988 19547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.556s	user 0.009s	sys 0.009s
W20260709 13:08:29.754935 19683 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.023s	sys 0.084s
I20260709 13:08:29.392163 19730 consensus_queue.cc:1059] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.339s
I20260709 13:08:29.611745 19664 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:29.763700 19533 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:29.404249 19318 consensus_queue.cc:237] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:29.757186 19454 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:29.808713 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 1483) took 1828 ms. Trace:
I20260709 13:08:29.816969 13714 rpcz_store.cc:276] 0709 13:08:27.980389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.317559 (+337170us) service_pool.cc:224] Handling call
0709 13:08:28.317913 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:28.318264 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:28.318290 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:28.319440 (+  1150us) log.cc:844] Serialized 26 byte log entry
0709 13:08:28.620154 (+300714us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:28.620196 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.620269 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:29.807395 (+1187126us) raft_consensus.cc:1685] finished
0709 13:08:29.807430 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.808655 (+  1225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1089,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"thread_start_us":300332,"threads_started":1,"wal-append.queue_time_us":546875}
I20260709 13:08:29.814903 14399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 2010) took 1389 ms. Trace:
I20260709 13:08:29.818500 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:29.794836 19196 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:29.794101 19641 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:29.819629 13859 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
W20260709 13:08:29.806866 19547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.608s	user 0.010s	sys 0.009s
I20260709 13:08:29.802112 19765 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:29.826249 13786 raft_consensus.cc:2393] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 11: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:29.818543 14399 rpcz_store.cc:276] 0709 13:08:28.425616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.426484 (+   868us) service_pool.cc:224] Handling call
0709 13:08:28.426846 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:28.427209 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:28.427248 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:28.427835 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 13:08:28.625116 (+197281us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:28.625178 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.625275 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:29.814648 (+1189373us) raft_consensus.cc:1685] finished
0709 13:08:29.814676 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.814831 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2588,"spinlock_wait_cycles":8269056,"thread_start_us":182127,"threads_started":1,"wal-append.queue_time_us":458756}
W20260709 13:08:29.835067 19775 log.cc:927] Time spent T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.424s	user 0.002s	sys 0.000s
I20260709 13:08:29.835793 19693 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:29.827391 19734 consensus_meta.cc:287] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.698s	user 0.005s	sys 0.004s
I20260709 13:08:29.833487 19566 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.848668 19566 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:29.850730 19566 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:29.853116 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:29.859481 19774 log.cc:927] Time spent T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:08:29.863555 13790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2559) took 1240 ms. Trace:
I20260709 13:08:29.864015 13790 rpcz_store.cc:276] 0709 13:08:28.623242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.198058 (+574816us) service_pool.cc:224] Handling call
0709 13:08:29.200464 (+  2406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:29.200755 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.200803 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:29.245446 (+ 44643us) log.cc:844] Serialized 26 byte log entry
0709 13:08:29.789606 (+544160us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:29.789646 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.789714 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:29.863295 (+ 73581us) raft_consensus.cc:1685] finished
0709 13:08:29.863318 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.863491 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10300,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":5871,"thread_start_us":451810,"threads_started":1,"wal-append.queue_time_us":478599}
W20260709 13:08:29.878722 19708 consensus_meta.cc:287] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.994s	user 0.004s	sys 0.005s
I20260709 13:08:29.889092 19664 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:29.890141 18889 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:29.872857 19681 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:29.873103 19686 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:29.865389 19693 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:29.855981 19734 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:29.915845 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.913432 19756 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:29.926349 19738 consensus_meta.cc:287] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.734s	user 0.007s	sys 0.003s
I20260709 13:08:29.916224 13785 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 16. Current term is 17. Ops: []
W20260709 13:08:29.916831 13788 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 2547) took 2281 ms (client timeout 2121 ms). Trace:
I20260709 13:08:29.941707 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:29.924193 19708 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:29.941884 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:29.942381 13711 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
W20260709 13:08:29.941414 13788 rpcz_store.cc:269] 0709 13:08:27.634992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.638840 (+  3848us) service_pool.cc:224] Handling call
0709 13:08:29.915775 (+2276935us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b54003bd154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:29.916728 (+   953us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2045973376}
I20260709 13:08:29.943794 13713 raft_consensus.cc:1240] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:29.811030 19644 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:29.925772 19645 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:29.963970 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:29.969098 13715 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:29.963352 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:29.970367 13707 raft_consensus.cc:2393] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 15: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:29.967445 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:29.930567 19681 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:08:30.011164 13858 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.019s	sys 0.052s
W20260709 13:08:30.011631 13858 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.019s	sys 0.052s
W20260709 13:08:30.018642 14366 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.024s	sys 0.049s
W20260709 13:08:30.019112 14366 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.024s	sys 0.049s
W20260709 13:08:30.019465 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 580121us
W20260709 13:08:30.021822 19591 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.027s	sys 0.068s
W20260709 13:08:30.041232 19591 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.028s	sys 0.069s
I20260709 13:08:29.987560 19645 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:29.973342 19641 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:30.038511 19566 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.034183 19318 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:30.012990 19681 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.069012 19662 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.057303 19566 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.058096 19318 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.084611 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:30.085310 19662 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.088101 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 2556) took 1488 ms. Trace:
I20260709 13:08:30.100173 13791 rpcz_store.cc:276] 0709 13:08:28.599478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.965790 (+366312us) service_pool.cc:224] Handling call
0709 13:08:30.087901 (+1122111us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b5400205654. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:30.088039 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1245928832}
W20260709 13:08:30.088820 14400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 1990) took 3265 ms (client timeout 2107 ms). Trace:
W20260709 13:08:30.101073 14400 rpcz_store.cc:269] 0709 13:08:26.823034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.969731 (+146697us) service_pool.cc:224] Handling call
0709 13:08:30.088653 (+3118922us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b54005145d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:30.088754 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3959760640}
I20260709 13:08:30.108382 19662 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:30.110610 19734 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:30.116381 19196 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:30.110167 19758 consensus_meta.cc:287] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.882s	user 0.012s	sys 0.000s
I20260709 13:08:30.123888 19644 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:30.121048 19758 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.130167 19641 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:30.130388 19318 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:30.137501 19718 log.cc:927] Time spent T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 1.917s	user 0.014s	sys 0.015s
I20260709 13:08:30.138695 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2746) took 2583 ms. Trace:
I20260709 13:08:30.134980 19645 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:30.134022 19681 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:30.143182 14393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 1783) took 1319 ms (client timeout 1565 ms). Trace:
W20260709 13:08:30.143539 19755 consensus_meta.cc:287] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.632s	user 0.007s	sys 0.004s
W20260709 13:08:30.143842 19627 consensus_meta.cc:287] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.964s	user 0.009s	sys 0.002s
I20260709 13:08:30.144115 19755 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.144341 19627 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:30.145234 13861 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.146942 19627 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:30.136341 19566 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:30.139052 13712 rpcz_store.cc:276] 0709 13:08:27.555110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.556972 (+  1862us) service_pool.cc:224] Handling call
0709 13:08:27.579293 (+ 22321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:27.596229 (+ 16936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:27.596259 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:27.604127 (+  7868us) log.cc:844] Serialized 26 byte log entry
0709 13:08:27.921130 (+317003us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:27.921168 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.921230 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:30.137231 (+2216001us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b240017ee38. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f2779c4 00007f522f275acb 00007f522f430dc9 00007f522f430a55 00007f522f43009d 00007f523206210e 00007f523207988c 00007f5232078bb6 00007f52320787d8 00007f5232082221
0709 13:08:30.138431 (+  1200us) raft_consensus.cc:1685] finished
0709 13:08:30.138452 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.138638 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18702,"raft.queue_time_us":22510,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":3619,"spinlock_wait_cycles":104981760,"thread_start_us":316740,"threads_started":1,"wal-append.queue_time_us":512764}
W20260709 13:08:30.143639 14393 rpcz_store.cc:269] 0709 13:08:28.823960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.826936 (+  2976us) service_pool.cc:224] Handling call
0709 13:08:30.143002 (+1316066us) spinlock_profiling.cc:243] Waited 74.9 ms on lock 0x7b5400a2e9d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:30.143128 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172204928}
I20260709 13:08:30.158094 13861 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:08:30.160904 19196 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:30.161684 19100 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:30.139369 19454 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.170038 14368 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:30.187637 19100 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:30.187896 13786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1353) took 1738 ms. Trace:
I20260709 13:08:30.187144 14368 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:30.188087 19454 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:30.188275 13786 rpcz_store.cc:276] 0709 13:08:28.449915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.972784 (+522869us) service_pool.cc:224] Handling call
0709 13:08:30.187713 (+1214929us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b5400371254. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:30.187841 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1960208768}
I20260709 13:08:30.189043 19656 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:30.189414 19656 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:30.189770 19656 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:30.171391 19755 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:30.188190 19100 raft_consensus.cc:697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 15 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:30.171571 19758 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:30.171664 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 1352) took 1722 ms. Trace:
I20260709 13:08:30.172987 19435 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:30.174525 19687 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.180568 14396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 2008) took 1879 ms. Trace:
I20260709 13:08:30.197140 14396 rpcz_store.cc:276] 0709 13:08:28.300757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.300873 (+   116us) service_pool.cc:224] Handling call
0709 13:08:28.301143 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:28.613445 (+312302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.180328 (+1566883us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b5400594f54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:30.180509 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":699762944}
I20260709 13:08:30.159169 19765 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:30.194607 13782 rpcz_store.cc:276] 0709 13:08:28.449171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.449278 (+   107us) service_pool.cc:224] Handling call
0709 13:08:28.449547 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:28.952272 (+502725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.171429 (+1219157us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b54001b71d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:30.171606 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1154572160}
W20260709 13:08:30.192480 19697 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.072s	user 0.009s	sys 0.017s
I20260709 13:08:30.208247 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:30.212445 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:30.213052 14397 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.214666 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:30.215975 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:30.216624 14400 raft_consensus.cc:2393] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 11: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:30.217298 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:30.217785 14400 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:30.208873 19697 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.088s	user 0.010s	sys 0.018s
I20260709 13:08:30.194314 19100 consensus_queue.cc:237] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.220762 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:30.221338 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:30.234290 14399 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:30.235924 14394 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:30.236403 14397 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
W20260709 13:08:30.212512 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.241194 19648 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:30.241194 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:30.242508 14394 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:30.247987 14396 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:30.249429 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:30.300547 14396 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:30.305487 14400 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:08:30.306030 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:30.306401 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:30.306638 14396 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:08:30.306949 14400 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.307395 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:30.312758 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:30.316103 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:30.317288 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 78179.9us
I20260709 13:08:30.220265 19656 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.248323 19228 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.326330 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:30.326653 14396 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 13:08:30.329327 14396 pending_rounds.cc:85] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 12
I20260709 13:08:30.329646 14396 pending_rounds.cc:107] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:08:30.329944 14396 raft_consensus.cc:2889] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:30.330664 14400 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
W20260709 13:08:30.327816 19794 log.cc:927] Time spent T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:08:30.338356 13711 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:08:30.339398 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:30.343108 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:30.340776 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:30.343722 13708 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:30.326546 19733 raft_consensus.cc:3055] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:08:30.342861 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.342017 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:30.345503 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:30.348218 13708 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:30.348466 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:30.349056 13711 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:30.350004 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:30.350508 13711 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:30.350746 13708 raft_consensus.cc:1275] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:08:30.352210 13856 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42104 (request call id 1485) took 1591 ms (client timeout 1947 ms). Trace:
W20260709 13:08:30.352589 13856 rpcz_store.cc:269] 0709 13:08:28.760979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.761134 (+   155us) service_pool.cc:224] Handling call
0709 13:08:30.351999 (+1590865us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b5400387054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:30.352148 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392756480}
I20260709 13:08:30.354280 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:30.354875 13709 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:30.355576 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:30.345665 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 99591.2us
I20260709 13:08:30.356995 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:30.357479 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:30.357026 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:30.357950 13716 raft_consensus.cc:2393] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 15: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:30.359676 19549 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.360169 19549 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:30.362231 19549 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:30.362323 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:30.362740 19549 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:30.364179 14367 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:30.373131 19645 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:08:30.374917 19518 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:30.375617 19518 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.376132 19518 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.377564 19644 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:30.378211 19644 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.382861 13680 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:30.385963 13680 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:30.326282 19228 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:30.387466 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.323088 13782 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:08:30.389263 13782 raft_consensus.cc:606] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:30.380442 14367 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:30.395021 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:30.347628 19733 raft_consensus.cc:740] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:30.393389 13755 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:30.352073 19542 consensus_queue.cc:1059] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:08:30.409811 14367 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:30.363233 19549 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:30.382108 19416 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:30.394315 19681 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:30.442492 19681 raft_consensus.cc:697] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:30.443382 19681 consensus_queue.cc:237] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:30.394172 19442 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:30.416494 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:30.416566 19549 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:30.418326 13755 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:30.418648 19535 consensus_queue.cc:1048] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:08:30.422297 19138 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:30.411775 19658 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:30.407620 19648 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.043s
I20260709 13:08:30.433228 19706 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:30.438375 19644 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:30.411194 13680 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:30.440950 19656 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:30.476872 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 65790us
I20260709 13:08:30.451562 19658 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:30.414038 13716 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:30.447129 14402 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:08:30.447808 19416 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.449332 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:30.404683 19641 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:30.406220 19662 consensus_queue.cc:1059] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:08:30.460711 13710 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:30.492003 13709 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 14. Ops: []
I20260709 13:08:30.492421 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:30.477797 19684 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:30.427793 14367 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:30.462783 13711 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:08:30.406472 19680 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:08:30.465647 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:30.440735 19518 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.478116 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:30.415273 13787 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:30.479844 19708 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:30.493811 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:30.489331 19641 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:30.494837 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:30.500299 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:30.500833 13713 raft_consensus.cc:2393] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 14: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:30.498241 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:30.501982 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:30.502223 13711 raft_consensus.cc:2410] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:08:30.496551 19416 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:30.448004 19196 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:30.498049 13715 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:30.503360 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:30.447516 19442 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:30.480489 19658 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:30.499686 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 71987.5us
I20260709 13:08:30.503232 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:30.504983 13680 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:30.508785 13710 raft_consensus.cc:1240] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:30.515908 14367 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:30.509007 13711 raft_consensus.cc:1240] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:30.455142 19733 consensus_queue.cc:260] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.518783 13680 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:30.518998 13711 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:30.508090 19442 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:30.500324 19708 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:30.499737 19683 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:30.508334 19758 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:30.499318 19454 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.506098 19684 raft_consensus.cc:697] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:30.511472 19662 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:30.517493 19535 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:30.535697 13711 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:30.518487 19196 raft_consensus.cc:697] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 13 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:30.521387 19416 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:30.535732 19549 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:30.530071 19733 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.557191 13715 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:30.558208 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:30.599587 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:30.602234 13710 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.541917 19518 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:30.539119 19683 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.559134 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:30.563982 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:30.609256 14393 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:30.564721 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:30.533324 19758 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.547485 19454 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.567972 19196 consensus_queue.cc:237] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.568003 19549 raft_consensus.cc:697] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:30.569466 19684 consensus_queue.cc:237] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:30.569869 19799 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:08:30.547734 19662 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:30.620626 19662 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:30.555749 19416 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:30.622941 19416 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.523272 19734 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:08:30.536296 19708 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:30.574910 13787 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1364) took 2122 ms (client timeout 2092 ms). Trace:
I20260709 13:08:30.628522 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:30.629227 13712 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
W20260709 13:08:30.632109 13789 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 3072) took 2713 ms (client timeout 1783 ms). Trace:
W20260709 13:08:30.632550 13789 rpcz_store.cc:269] 0709 13:08:27.918458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.918583 (+   125us) service_pool.cc:224] Handling call
0709 13:08:30.631935 (+2713352us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b5400161a54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:30.632041 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4138701696}
I20260709 13:08:30.633756 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.635018 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.579900 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:30.635677 13782 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:30.639863 14395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 1789) took 1781 ms (client timeout 1632 ms). Trace:
W20260709 13:08:30.640314 14395 rpcz_store.cc:269] 0709 13:08:28.858349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.863973 (+  5624us) service_pool.cc:224] Handling call
0709 13:08:30.639646 (+1775673us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b54009169d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:30.639786 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1844982656}
I20260709 13:08:30.580190 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:30.587970 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.641498 13786 raft_consensus.cc:2376] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 27 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 27. Re-sending same reply.
I20260709 13:08:30.642166 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.642427 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.580477 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:30.585773 14366 leader_election.cc:336] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.624s (SENT)
I20260709 13:08:30.588541 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.589708 19591 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.591835 19681 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:30.571380 19641 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:30.643877 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 58148.8us
I20260709 13:08:30.546419 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:30.602674 19732 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.595s	user 0.017s	sys 0.018s
I20260709 13:08:30.598066 19228 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:30.608564 19656 raft_consensus.cc:3055] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:30.655489 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.601797 19599 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:30.626266 19693 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:30.628531 19513 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:08:30.619851 13680 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:30.663901 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 245637us
W20260709 13:08:30.664249 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 44528.5us
I20260709 13:08:30.664587 13755 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:30.644019 13790 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:30.591295 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.666821 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:30.645820 14366 leader_election.cc:336] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.688s (SENT)
I20260709 13:08:30.667994 14366 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:08:30.641474 13787 rpcz_store.cc:269] 0709 13:08:28.452706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.819142 (+366436us) service_pool.cc:224] Handling call
0709 13:08:30.574714 (+1755572us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b540026ded4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:30.574825 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3582471936}
I20260709 13:08:30.656322 13791 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:30.616106 19758 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.660020 13710 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:30.616829 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:30.652256 13782 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:30.641119 19683 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:30.649359 19732 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.648s	user 0.018s	sys 0.018s
I20260709 13:08:30.663038 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:30.676088 13784 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.663267 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.669027 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.665737 13788 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:30.670646 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.678040 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.673535 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:30.673712 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.679819 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:30.658335 19318 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:30.671260 19533 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:30.654305 19656 raft_consensus.cc:740] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:30.685297 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.685925 13788 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:08:30.671465 19641 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:30.679111 13791 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 27.
I20260709 13:08:30.678608 13787 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:08:30.688476 19549 consensus_queue.cc:237] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.686039 19318 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.691370 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:30.692642 19318 leader_election.cc:290] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:30.658814 19591 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:30.693053 19442 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:30.694810 19591 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:30.682936 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:30.695729 13713 raft_consensus.cc:2368] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 20. Current term is 21.
I20260709 13:08:30.678231 13790 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:30.686734 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:30.673267 19599 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:30.699811 13788 raft_consensus.cc:2393] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 11: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:30.699982 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.700702 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.702767 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.700953 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:30.703636 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.704202 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.708432 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.708645 13788 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:30.709060 13786 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:08:30.710762 13782 raft_consensus.cc:1240] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:08:30.704252 13787 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:30.711462 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2935) took 1548 ms. Trace:
I20260709 13:08:30.713138 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.713948 13791 raft_consensus.cc:2376] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14. Re-sending same reply.
I20260709 13:08:30.711938 13860 rpcz_store.cc:276] 0709 13:08:29.163156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.190304 (+ 27148us) service_pool.cc:224] Handling call
0709 13:08:29.199558 (+  9254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:29.199886 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.199923 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:29.221742 (+ 21819us) log.cc:844] Serialized 26 byte log entry
0709 13:08:30.419001 (+1197259us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b18001cb280. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e0d1 00007f5232499a0f
0709 13:08:30.602811 (+183810us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:30.602852 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.602917 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:30.711189 (+108272us) raft_consensus.cc:1685] finished
0709 13:08:30.711208 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.711392 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45141,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":69241,"spinlock_wait_cycles":5039360,"thread_start_us":183626,"threads_started":1,"wal-append.queue_time_us":1433230}
I20260709 13:08:30.717531 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.718559 13791 raft_consensus.cc:2393] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 16: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:30.719192 13790 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:30.720448 13784 raft_consensus.cc:2410] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:08:30.721320 13788 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:30.724150 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.685999 19533 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:30.753868 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.754760 13789 raft_consensus.cc:2368] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14.
I20260709 13:08:30.756222 13791 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:30.757771 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:30.758314 13789 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:30.761327 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:30.762002 14400 raft_consensus.cc:2368] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15.
I20260709 13:08:30.762673 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:30.762984 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:30.763319 14400 raft_consensus.cc:2393] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 14: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:30.764061 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:30.714253 19641 raft_consensus.cc:697] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:30.765377 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.766114 13784 raft_consensus.cc:2393] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 11: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:30.769253 13755 leader_election.cc:400] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15.
I20260709 13:08:30.769531 13755 leader_election.cc:403] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:30.712774 19442 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:30.749782 19734 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:30.776566 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 1.01672e+06us
W20260709 13:08:30.777916 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.778112 13829 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:30.778631 13682 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:30.775447 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:30.756446 19533 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:30.751046 19228 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:30.780072 14400 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 15: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:30.788175 13790 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:30.755782 19591 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:30.790051 19547 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:30.790230 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.791090 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.791189 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.801232 13791 raft_consensus.cc:2393] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 14: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:30.791826 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:30.802090 13787 raft_consensus.cc:2376] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14. Re-sending same reply.
I20260709 13:08:30.792444 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.768633 19549 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:30.770587 19518 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:30.810387 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:30.812717 13710 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.697283 19656 consensus_queue.cc:260] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.775535 19813 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.818782 13789 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:08:30.819250 19325 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:30.823001 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:30.828395 13715 raft_consensus.cc:2368] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14.
I20260709 13:08:30.811553 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3667) took 1614 ms. Trace:
I20260709 13:08:30.829157 13858 rpcz_store.cc:276] 0709 13:08:29.197635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.197830 (+   195us) service_pool.cc:224] Handling call
0709 13:08:29.237430 (+ 39600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.237731 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:29.320220 (+ 82489us) log.cc:844] Serialized 14 byte log entry
0709 13:08:30.811159 (+1490939us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:30.811218 (+    59us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:30.811268 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.811358 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.811485 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":813042,"prepare.queue_time_us":100974,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":799943,"thread_start_us":691484,"threads_started":1,"wal-append.queue_time_us":723651}
I20260709 13:08:30.831456 19493 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.832046 19493 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.834327 19493 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:30.837494 19664 raft_consensus.cc:3055] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:30.837954 19664 raft_consensus.cc:740] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:30.839874 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3076) took 2881 ms. Trace:
I20260709 13:08:30.840270 13785 rpcz_store.cc:276] 0709 13:08:27.958626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.959146 (+   520us) service_pool.cc:224] Handling call
0709 13:08:29.915937 (+1956791us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.942453 (+ 26516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.839666 (+897213us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b54003bd150. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:30.839812 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4499560192}
I20260709 13:08:30.841022 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:30.842410 13757 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:30.844540 13856 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:30.845692 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:30.845837 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:30.846282 13859 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:30.846583 13856 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:30.799393 19442 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:30.848599 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 2926) took 1688 ms. Trace:
W20260709 13:08:30.848728 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 70748.1us
I20260709 13:08:30.848984 13865 rpcz_store.cc:276] 0709 13:08:29.160182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.163527 (+  3345us) service_pool.cc:224] Handling call
0709 13:08:30.848420 (+1684893us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b5400345154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:30.848538 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310697344}
I20260709 13:08:30.849680 13829 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:30.850168 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:30.850706 13865 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:30.843216 13757 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:30.857059 19815 log.cc:927] Time spent T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:08:30.857285 19814 log.cc:927] Time spent T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:08:30.857883 19795 log.cc:927] Time spent T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.497s	user 0.003s	sys 0.000s
I20260709 13:08:30.858047 19738 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.858302 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:30.858618 19738 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.859241 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:30.859598 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:30.860076 13857 raft_consensus.cc:2393] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 11: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:30.860759 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:30.860927 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:30.861353 19684 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:08:30.861522 19802 log.cc:927] Time spent T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:08:30.861831 19684 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.862211 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:30.857908 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:30.863662 13857 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.861853 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:30.870909 13710 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:08:30.871006 13865 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:30.871665 13859 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:30.864946 19447 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:30.875113 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:30.875231 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:30.875658 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 111654us
I20260709 13:08:30.873904 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:30.825940 19325 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.793601 19734 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:30.927634 13865 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 8.
I20260709 13:08:30.862515 19687 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:30.863297 19656 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.862926 19442 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:30.935631 13757 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:30.939800 13757 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:30.940703 13757 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:30.941830 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3661) took 1785 ms. Trace:
W20260709 13:08:30.943378 13861 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 3669) took 1689 ms (client timeout 2153 ms). Trace:
I20260709 13:08:30.928386 13680 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:30.929306 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:30.943905 13861 rpcz_store.cc:269] 0709 13:08:29.254105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.334554 (+ 80449us) service_pool.cc:224] Handling call
0709 13:08:30.943190 (+1608636us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b540004a454. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:30.943313 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1636057984}
I20260709 13:08:30.931239 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:30.931757 13856 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:30.808447 19591 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.876720 19756 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.928845 13858 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:30.933255 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:30.932169 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:30.801374 19228 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.865919 19684 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.946226 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:30.961831 13856 raft_consensus.cc:2393] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 11: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:30.962610 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:30.963213 13856 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 22.
I20260709 13:08:30.963258 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.838804 19664 consensus_queue.cc:260] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.826546 19518 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:30.947041 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 97441.5us
I20260709 13:08:30.969566 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:30.969925 13787 raft_consensus.cc:1240] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:08:30.970242 13856 raft_consensus.cc:2393] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 16: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:30.970163 13829 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:30.942310 13863 rpcz_store.cc:276] 0709 13:08:29.156438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.156572 (+   134us) service_pool.cc:224] Handling call
0709 13:08:29.177327 (+ 20755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.309034 (+131707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.941608 (+1632574us) spinlock_profiling.cc:243] Waited 72.2 ms on lock 0x7b54002fadd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:30.941777 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166105344}
I20260709 13:08:30.971159 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:30.876060 19749 log.cc:927] Time spent T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:08:30.954319 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:30.861032 19738 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:30.929317 19325 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:30.925631 19768 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.978871 19768 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:30.979803 19819 log.cc:927] Time spent T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:08:30.981000 19768 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:30.981359 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:30.982199 13863 raft_consensus.cc:2393] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 13: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:30.926327 19627 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:30.983860 19627 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:30.984242 19627 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:30.988968 19765 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:30.957283 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:30.989724 13786 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:30.958145 13857 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:30.992918 14399 raft_consensus.cc:1240] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:30.959520 13865 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:30.959668 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:30.960420 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:30.964025 13784 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:30.956193 19687 raft_consensus.cc:697] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:30.964787 13830 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:30.946990 19680 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:30.943674 19442 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:30.948609 13859 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:30.874624 19641 consensus_queue.cc:237] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:30.973724 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:31.024669 13856 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:30.953343 19196 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:30.965771 14396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:40042
I20260709 13:08:30.958254 19589 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:30.960175 19806 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:31.008101 13830 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:30.936345 19447 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:31.103636 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:31.102785 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 132680us
W20260709 13:08:31.107977 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 99983.9us
I20260709 13:08:31.094130 14401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 1786) took 2265 ms. Trace:
I20260709 13:08:31.110594 14401 rpcz_store.cc:276] 0709 13:08:28.828671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.048637 (+219966us) service_pool.cc:224] Handling call
0709 13:08:31.093914 (+2045277us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b540070eed4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:31.094062 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2209103104}
I20260709 13:08:31.112197 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:31.112546 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:31.112999 13786 raft_consensus.cc:2368] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 15. Current term is 16.
W20260709 13:08:31.102115 19816 log.cc:927] Time spent T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:08:31.119889 14368 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:31.108054 14396 raft_consensus.cc:606] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:31.143507 14396 raft_consensus.cc:614] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:31.024837 19658 consensus_meta.cc:287] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
I20260709 13:08:31.139544 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:31.147482 13715 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:08:31.148910 13715 raft_consensus.cc:1275] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:31.148816 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:31.000051 19542 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:31.030822 19768 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:31.145114 14368 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:31.145437 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 185092us
I20260709 13:08:31.113700 19755 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:31.146682 13791 raft_consensus.cc:1240] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:31.100683 19228 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:31.030222 19738 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:31.139225 13784 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 20. Current term is 21. Ops: [19.10-20.11]
I20260709 13:08:31.153026 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:31.120074 19196 raft_consensus.cc:697] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:08:31.149219 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 196974us
I20260709 13:08:31.166479 13782 raft_consensus.cc:2393] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 11: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:31.165620 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:31.032691 19547 consensus_queue.cc:1059] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 13:08:31.156592 13865 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:30.999218 19756 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:31.154749 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:31.177039 13789 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:31.161935 13680 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:08:31.156176 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.167668 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:31.168527 14368 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:31.176194 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:31.181314 14368 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:31.162596 19768 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.165642 19782 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.112758 19416 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:31.173475 13712 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:08:31.141955 19806 raft_consensus.cc:697] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:31.175076 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:31.166185 19738 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:31.197618 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:31.053031 19821 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:31.155018 19658 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:31.181325 13782 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
W20260709 13:08:31.205926 13829 connection.cc:256] RPC call timeout handler was delayed by -1.5746633619999102s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2121s for a response
I20260709 13:08:31.162441 19755 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.189281 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:31.208148 13791 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:31.189545 13789 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:08:31.167199 13757 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:31.172726 19228 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:08:31.172886 19629 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:31.192641 13712 pending_rounds.cc:85] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 11
I20260709 13:08:31.167609 19643 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:31.197816 13861 raft_consensus.cc:2410] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:31.198287 13865 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:31.198830 19644 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:31.221498 19644 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:31.221976 19644 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:31.222271 19756 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:31.208478 19733 consensus_meta.cc:287] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.637s	user 0.005s	sys 0.005s
I20260709 13:08:31.203976 19325 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:31.226307 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 57074.8us
I20260709 13:08:31.199105 13682 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:31.166010 19542 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:31.210743 13783 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1356) took 2760 ms (client timeout 1688 ms). Trace:
W20260709 13:08:31.231716 13783 rpcz_store.cc:269] 0709 13:08:28.450721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.556501 (+105780us) service_pool.cc:224] Handling call
0709 13:08:31.210540 (+2654039us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540026e3d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:31.210674 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2401111296}
I20260709 13:08:31.191484 19765 raft_consensus.cc:3055] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:31.191210 19768 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:31.194569 19808 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:31.215256 13712 pending_rounds.cc:107] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:08:31.235428 13712 raft_consensus.cc:2889] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:31.216873 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:31.148268 19353 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:08:31.217197 13829 connection.cc:256] RPC call timeout handler was delayed by -1.0009239409999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
I20260709 13:08:31.155359 19687 consensus_queue.cc:237] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:31.214669 19228 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:31.214936 19629 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:31.218304 19708 consensus_meta.cc:287] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.001s
I20260709 13:08:31.218719 19547 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:31.218816 13757 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:31.264287 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 45564.6us
I20260709 13:08:31.220865 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:31.202126 19738 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:31.209144 19755 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:31.193737 19734 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:31.217085 14368 leader_election.cc:304] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:31.226133 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:31.226950 14402 raft_consensus.cc:1240] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:31.235251 19808 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:31.214749 19680 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:31.217440 19831 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:31.263902 19629 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:31.243896 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:31.233824 19765 raft_consensus.cc:740] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:31.247877 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:31.243439 19627 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:31.275745 19645 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:31.251927 19591 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:31.255136 19416 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:31.209364 19832 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:08:31.257779 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:31.260401 19658 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:31.272109 19824 log.cc:927] Time spent T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:08:31.267258 13707 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:31.232805 19733 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:31.273211 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 56195.7us
I20260709 13:08:31.278302 19808 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:31.244146 19353 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:31.229831 13682 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:31.247262 19228 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:08:31.272080 19447 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:31.199276 19782 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:31.311503 19228 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:31.246093 13709 raft_consensus.cc:1240] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:31.280946 19533 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:31.314285 19533 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:31.314359 19684 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:31.283594 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:31.262822 19758 consensus_meta.cc:287] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.000s
W20260709 13:08:31.295460 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 51598.8us
I20260709 13:08:31.273272 19686 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:31.231001 19196 consensus_queue.cc:237] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:31.284863 19627 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:31.276952 19518 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:31.293509 19662 consensus_meta.cc:287] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.672s	user 0.005s	sys 0.006s
I20260709 13:08:31.324362 19662 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:31.263072 19442 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:31.302554 19353 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:08:31.304225 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 74435.5us
I20260709 13:08:31.273170 19547 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:31.291479 19680 raft_consensus.cc:697] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:31.265453 19708 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:31.336944 19684 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:31.338886 19708 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:31.308307 19325 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:31.311955 19782 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:31.314982 19533 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:31.273950 13711 raft_consensus.cc:2393] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 14: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:31.282019 19831 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:31.225255 19643 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:31.316411 13829 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:31.315621 19758 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:31.348011 19662 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:31.349303 19758 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:31.296783 19763 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:31.350602 13708 raft_consensus.cc:2393] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 15: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:31.354655 19763 raft_consensus.cc:2764] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:08:31.274147 19806 consensus_queue.cc:237] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:31.324739 19686 raft_consensus.cc:697] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:31.356122 19686 consensus_queue.cc:237] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:31.363821 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:31.364382 19228 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 28 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:31.366046 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1790) took 2493 ms. Trace:
I20260709 13:08:31.346648 19831 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:31.366488 14398 rpcz_store.cc:276] 0709 13:08:28.885361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.073579 (+188218us) service_pool.cc:224] Handling call
0709 13:08:29.075003 (+  1424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:29.075668 (+   665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.075710 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:29.076497 (+   787us) log.cc:844] Serialized 26 byte log entry
0709 13:08:29.261031 (+184534us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:29.261069 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.261132 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:31.343777 (+2082645us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b2400302a98. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f2779c4 00007f522f275acb 00007f522f430dc9 00007f522f430a55 00007f522f42ffb0 00007f52320a6488 00007f52320a6be8 00007f523207e398 00007f523207976a 00007f5232078bb6
0709 13:08:31.365717 (+ 21940us) raft_consensus.cc:1685] finished
0709 13:08:31.365742 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.365958 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":129,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":13631,"spinlock_wait_cycles":58308992,"thread_start_us":84655,"threads_started":1,"wal-append.queue_time_us":233331}
W20260709 13:08:31.325605 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.283304 19645 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:31.370633 19645 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:31.332777 14399 raft_consensus.cc:1240] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:31.225075 19821 consensus_queue.cc:1059] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:08:31.372416 19821 raft_consensus.cc:3055] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:31.372848 19821 raft_consensus.cc:740] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:31.373061 19643 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:31.373312 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.373772 13865 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:31.340405 19680 consensus_queue.cc:237] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:31.376027 19664 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:31.378875 19629 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:31.381425 19629 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:31.336558 19547 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:31.334313 19733 consensus_queue.cc:1059] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:08:31.392328 19733 raft_consensus.cc:3055] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:31.392719 19733 raft_consensus.cc:740] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:31.307363 19542 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:31.341179 13787 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 15: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:31.344427 19533 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:31.355106 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:31.416184 19533 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:31.416695 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 61659.2us
I20260709 13:08:31.416957 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 3229) took 1056 ms. Trace:
I20260709 13:08:31.417361 13716 rpcz_store.cc:276] 0709 13:08:30.360529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.362010 (+  1481us) service_pool.cc:224] Handling call
0709 13:08:31.416806 (+1054796us) spinlock_profiling.cc:243] Waited 50.8 ms on lock 0x7b540034d5d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:31.416902 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116793216}
I20260709 13:08:31.418033 19547 raft_consensus.cc:2764] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:08:31.418181 13829 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:31.419584 19630 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:31.420485 13829 leader_election.cc:400] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14.
I20260709 13:08:31.421411 13829 leader_election.cc:400] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 15. Current term is 16.
I20260709 13:08:31.421759 13829 leader_election.cc:403] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:08:31.334434 19765 consensus_queue.cc:260] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:31.422936 19643 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 15. Current term is 16.
I20260709 13:08:31.423151 19765 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:31.423281 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 3228) took 1063 ms. Trace:
I20260709 13:08:31.303170 19591 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.423898 13713 rpcz_store.cc:276] 0709 13:08:30.360275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.503030 (+142755us) service_pool.cc:224] Handling call
0709 13:08:31.423073 (+920043us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5400041854. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:31.423219 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430227328}
I20260709 13:08:31.424682 19591 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:31.427003 19591 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:31.428208 13830 leader_election.cc:400] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14.
I20260709 13:08:31.411010 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:31.428642 13830 leader_election.cc:403] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:08:31.424942 19643 consensus_queue.cc:1059] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:08:31.429795 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:31.430555 13829 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:31.430755 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:31.393581 19733 consensus_queue.cc:260] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:31.385118 19442 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:31.430924 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:31.446316 13715 raft_consensus.cc:1240] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:31.449522 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:31.452279 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58552 (request call id 1500) took 1102 ms. Trace:
I20260709 13:08:31.452759 13708 rpcz_store.cc:276] 0709 13:08:30.350269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.351745 (+  1476us) service_pool.cc:224] Handling call
0709 13:08:30.691216 (+339471us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b5800003398. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:08:31.452030 (+760814us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b54002e7cd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:31.452212 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1519222400}
I20260709 13:08:31.455330 19454 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:31.459534 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:31.461933 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:31.465899 19212 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.466476 19212 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:31.450994 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:31.432276 13864 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
W20260709 13:08:31.389721 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:31.394348 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:31.394637 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.398902 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:31.402855 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:31.405259 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:31.445096 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:31.406985 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:31.472180 13857 raft_consensus.cc:2393] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 16: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:08:31.408098 19820 log.cc:927] Time spent T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.619s	user 0.002s	sys 0.001s
I20260709 13:08:31.409946 19831 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:31.413245 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:31.441944 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:31.514611 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:31.432119 14398 raft_consensus.cc:1240] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:31.413375 19813 consensus_meta.cc:287] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.000s
I20260709 13:08:31.406297 14401 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:31.472502 14394 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:31.435242 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:31.435902 14368 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:31.540181 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 104367us
I20260709 13:08:31.439680 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:31.541929 13713 raft_consensus.cc:2376] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14. Re-sending same reply.
I20260709 13:08:31.543233 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:31.543524 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:31.544010 13713 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
W20260709 13:08:31.526839 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 62076us
I20260709 13:08:31.440363 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:31.546141 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:31.546777 13864 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:31.547272 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:31.442648 14366 leader_election.cc:336] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.711s (SENT)
I20260709 13:08:31.548624 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:31.548763 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 106157us
W20260709 13:08:31.549583 14366 leader_election.cc:336] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.779s (SENT)
I20260709 13:08:31.433718 14397 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:31.435252 13830 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:31.480739 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:31.551064 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 115887us
I20260709 13:08:31.551337 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:31.551563 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:31.552034 13712 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:31.553745 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:31.553956 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:31.554756 13708 raft_consensus.cc:2368] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15.
I20260709 13:08:31.471189 14367 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:31.545053 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:31.556432 13708 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:08:31.438064 19782 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:31.438726 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:31.565757 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:31.566152 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 127494us
I20260709 13:08:31.476208 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:31.566869 14402 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:08:31.567481 13829 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:31.565780 19782 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.571463 19782 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:31.476428 19212 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:31.442613 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:31.525962 19529 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:31.443275 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:31.484798 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 23 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:31.526265 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2928) took 2365 ms. Trace:
W20260709 13:08:31.586427 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 115310us
I20260709 13:08:31.480283 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:31.536212 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:31.557782 13715 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:31.554896 13682 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:31.558202 13865 raft_consensus.cc:2393] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 16: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:08:31.559640 14366 leader_election.cc:336] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.793s (SENT)
I20260709 13:08:31.589520 14366 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:31.473078 13858 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:31.593907 13858 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:31.559728 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:31.434631 19643 raft_consensus.cc:3055] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:31.561681 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:31.561614 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:31.433437 19733 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:31.562417 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:31.563028 13789 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:31.612349 13756 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:31.607648 13787 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:31.564793 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:31.574134 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:31.575136 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:31.477165 19549 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:08:31.574127 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 394159us
I20260709 13:08:31.373816 19821 consensus_queue.cc:260] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:31.563000 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:31.434356 19763 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14.
I20260709 13:08:31.585178 13862 rpcz_store.cc:276] 0709 13:08:29.160924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.166746 (+  5822us) service_pool.cc:224] Handling call
0709 13:08:30.353565 (+1186819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.353758 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:08:30.390230 (+ 36472us) log.cc:844] Serialized 14 byte log entry
0709 13:08:30.836647 (+446417us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:30.836701 (+    54us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:30.836747 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.836831 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.447405 (+610574us) spinlock_profiling.cc:243] Waited 6.22 ms on lock 0x7b4800061158. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5237407aa1 00007f52373feb37 00007f52373fe9ca 00007f52374f626f 00007f52374f5f37 00007f523750a55c 00007f523750a508 00007f523750a488 00007f523750a443 00007f52375096ec 00007f5236433a96
0709 13:08:31.526091 (+ 78686us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400387050. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:31.526210 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":303923,"prepare.queue_time_us":32400,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":4442,"raft.queue_time_us":304484,"raft.run_cpu_time_us":2075,"raft.run_wall_time_us":610128,"spinlock_wait_cycles":2742962304,"thread_start_us":142070,"threads_started":1,"wal-append.queue_time_us":225333}
I20260709 13:08:31.554153 19599 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:31.597922 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:31.626708 13783 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:08:31.597056 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:31.628116 13707 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:31.630151 13862 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:31.587529 13709 raft_consensus.cc:2376] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14. Re-sending same reply.
I20260709 13:08:31.554431 19813 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15.
I20260709 13:08:31.640614 13613 catalog_manager.cc:5697] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:31.642589 13613 catalog_manager.cc:5697] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 8 to 9, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 9 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:31.610555 14367 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:31.610653 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 51038us
W20260709 13:08:31.650373 14366 leader_election.cc:336] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.950s (SENT)
W20260709 13:08:31.651505 14366 leader_election.cc:336] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.966s (SENT)
I20260709 13:08:31.652506 14366 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:31.619027 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 64193.5us
I20260709 13:08:31.619388 13714 raft_consensus.cc:1240] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:31.620947 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:31.624404 13712 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:31.573696 19630 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:31.633527 19821 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:31.611920 19529 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:31.618784 13680 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:31.608032 19447 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:31.606755 19643 raft_consensus.cc:740] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:31.618376 19566 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:31.699201 13830 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:31.678987 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:31.693607 13708 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:31.647612 13613 catalog_manager.cc:5697] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 9 to 11, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 11 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:31.573397 19629 consensus_queue.cc:1059] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.088s
I20260709 13:08:31.437794 19533 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:31.688715 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 70011.5us
I20260709 13:08:31.627803 19138 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:31.734337 13680 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:31.690212 13861 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:31.649292 19212 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:31.691321 13712 raft_consensus.cc:1240] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:31.713482 13613 catalog_manager.cc:5697] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 14 to 15, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 15 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:31.627405 19662 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 13:08:31.626034 19664 consensus_queue.cc:1059] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:08:31.755584 13613 catalog_manager.cc:5697] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 11 to 12, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 12 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:31.686638 19447 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.629074 19454 consensus_queue.cc:1059] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.072s
I20260709 13:08:31.686255 19630 raft_consensus.cc:697] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:31.670742 19658 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:08:31.781608 13613 catalog_manager.cc:5697] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 13 to 15, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 15 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:31.650941 19549 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:31.705636 19228 raft_consensus.cc:2764] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 13:08:31.791762 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 57517us
I20260709 13:08:31.797597 13680 leader_election.cc:400] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14.
I20260709 13:08:31.798594 13680 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:31.711791 19591 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:31.771234 19627 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:31.776106 19602 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:31.774175 19212 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:31.690743 19782 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:31.791095 19447 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:31.722527 19763 consensus_queue.cc:1059] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.095s
I20260709 13:08:31.865602 13716 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:31.692790 19645 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:31.808089 13613 catalog_manager.cc:5697] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 9 to 13, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 13 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:31.867256 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:31.802690 19656 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:31.790874 19518 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:31.868264 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:31.770185 19684 consensus_queue.cc:1059] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.099s
I20260709 13:08:31.719192 19540 consensus_queue.cc:1059] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 13:08:31.798933 19513 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:31.876535 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 263219us
I20260709 13:08:31.885341 14402 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:31.876348 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:31.885870 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.783941 19435 consensus_queue.cc:1059] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:08:31.887075 14401 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:31.869158 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:31.898394 14396 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:31.869475 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:31.899848 14398 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:31.869751 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:31.882616 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:31.901364 14394 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:31.814096 19602 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.893092 13860 raft_consensus.cc:2393] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 13: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:31.894331 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:31.868381 19808 consensus_meta.cc:287] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.548s	user 0.009s	sys 0.000s
W20260709 13:08:31.907523 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 273343us
I20260709 13:08:31.919786 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:31.866557 19212 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:31.868342 19837 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:08:31.906833 19768 consensus_meta.cc:287] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.662s	user 0.009s	sys 0.000s
I20260709 13:08:31.810923 19599 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.091s
I20260709 13:08:31.970966 13756 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:31.960850 14398 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:32.007803 14396 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
W20260709 13:08:32.008379 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 356881us
I20260709 13:08:31.988541 14401 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:32.014904 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:32.015276 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 404791us
I20260709 13:08:31.971876 13755 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:32.016054 14367 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:08:32.016536 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 44762.6us
I20260709 13:08:31.917832 19602 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:32.017160 13755 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:32.020557 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 49664.1us
I20260709 13:08:32.027004 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:32.028263 14398 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:08:32.017608 14367 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:32.029798 14367 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:31.929630 19823 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:31.932598 19540 consensus_queue.cc:1243] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer b9d194f45e044e0988d5de1a99e5cd02 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:32.036247 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:32.036568 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:31.938194 19831 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:32.042905 14401 raft_consensus.cc:2393] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 11: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:08:32.008059 19644 consensus_meta.cc:287] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.786s	user 0.009s	sys 0.002s
I20260709 13:08:32.043890 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:32.045284 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 23 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:31.958770 19518 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:32.053882 19839 log.cc:927] Time spent T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:08:32.054235 19518 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.055968 19533 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:32.051820 19353 consensus_meta.cc:287] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.710s	user 0.010s	sys 0.000s
I20260709 13:08:32.057262 19518 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:32.056890 19353 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.057822 19518 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:32.058395 19518 raft_consensus.cc:697] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 15 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:31.975214 19768 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:32.059512 19353 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:32.059655 19848 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:32.061058 19846 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:32.061482 19768 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:32.006489 19196 consensus_queue.cc:1059] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:08:32.062023 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:32.062615 14396 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:08:32.063395 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:32.052526 19529 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:32.028640 19658 raft_consensus.cc:2764] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:08:32.064322 19644 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:32.053740 19738 consensus_meta.cc:287] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.777s	user 0.009s	sys 0.000s
I20260709 13:08:31.937841 19630 consensus_queue.cc:237] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:32.061477 19846 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:32.063587 19196 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:32.049104 14401 raft_consensus.cc:2368] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13.
I20260709 13:08:32.077451 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:32.065304 14394 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
W20260709 13:08:32.051993 19838 log.cc:927] Time spent T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 13:08:32.055826 19686 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:32.018116 19837 raft_consensus.cc:697] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:32.032253 19591 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:32.033588 19683 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:32.073369 14399 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
W20260709 13:08:32.074172 19835 log.cc:927] Time spent T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.401s	user 0.000s	sys 0.001s
I20260709 13:08:32.075291 19645 leader_election.cc:290] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:32.063277 19765 consensus_meta.cc:287] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.640s	user 0.006s	sys 0.000s
I20260709 13:08:32.013365 19697 consensus_queue.cc:1059] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 13:08:31.975066 19693 consensus_queue.cc:1059] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.097s
I20260709 13:08:31.968349 19808 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.075708 19730 raft_consensus.cc:3055] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:32.078572 19846 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:32.094369 19591 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.059252 19518 consensus_queue.cc:237] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.072230 19738 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.127573 19683 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:08:32.220433 19755 consensus_meta.cc:287] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.932s	user 0.010s	sys 0.000s
I20260709 13:08:32.202396 19730 raft_consensus.cc:740] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:08:32.250355 19850 log.cc:927] Time spent T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:08:32.243175 19837 consensus_queue.cc:237] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:32.289470 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 359736us
I20260709 13:08:32.291704 13680 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:31.884684 13613 catalog_manager.cc:5697] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 8 to 9, term changed from 13 to 16, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129), VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130), VOTER b5029654a4384e43a68eb67b794949b7 (127.12.76.131), VOTER ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 16 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:08:32.302314 13713 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.026s	sys 0.041s
W20260709 13:08:32.309160 13713 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.026s	sys 0.041s
I20260709 13:08:32.310803 13856 raft_consensus.cc:2393] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 10: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:32.302021 13613 catalog_manager.cc:5697] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:32.312280 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2949) took 1439 ms. Trace:
I20260709 13:08:32.314211 14395 raft_consensus.cc:1240] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:32.312788 13864 rpcz_store.cc:276] 0709 13:08:30.872908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.557724 (+684816us) service_pool.cc:224] Handling call
0709 13:08:31.558034 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:31.558369 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:31.558528 (+   159us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:31.558977 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:08:31.716470 (+157493us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:31.716524 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.716628 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.311634 (+595006us) raft_consensus.cc:1685] finished
0709 13:08:32.311674 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.312003 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":266,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":18146,"thread_start_us":157168,"threads_started":1,"wal-append.queue_time_us":454931}
I20260709 13:08:32.315155 14397 raft_consensus.cc:1240] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:08:32.316515 13863 raft_consensus.cc:2393] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 18: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:32.316157 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:32.086745 14366 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:32.317586 14397 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:32.088094 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:32.080588 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:32.319367 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 232593us
I20260709 13:08:32.325201 13613 catalog_manager.cc:5697] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 10 to 12, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 12 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:32.327297 14366 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:08:32.398149 13856 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42104 (request call id 1502) took 1372 ms (client timeout 1665 ms). Trace:
I20260709 13:08:32.392704 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:32.408069 19138 raft_consensus.cc:3055] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:32.408763 19138 raft_consensus.cc:740] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:32.409255 19540 consensus_queue.cc:1059] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:32.365912 19325 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:32.410964 19540 raft_consensus.cc:3055] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:32.411585 19540 raft_consensus.cc:740] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:32.411300 19325 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.394174 13829 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:32.414902 19325 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:32.344478 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:32.433625 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:32.434656 13787 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:32.415405 13829 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:32.441694 14395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 2043) took 1038 ms. Trace:
I20260709 13:08:32.321573 14396 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:32.442282 14395 rpcz_store.cc:276] 0709 13:08:31.403365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.407523 (+  4158us) service_pool.cc:224] Handling call
0709 13:08:31.407948 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.314778 (+906830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.441270 (+126492us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b5400a2e9d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:32.441592 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2082546432}
I20260709 13:08:32.442945 19513 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:32.409197 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:32.443810 13864 raft_consensus.cc:1240] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:32.444720 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:32.443969 19513 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.446008 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3685) took 1180 ms. Trace:
I20260709 13:08:32.353286 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:32.366957 19442 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:32.447682 19513 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:32.382372 19542 raft_consensus.cc:3055] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:32.306636 13865 raft_consensus.cc:1275] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:08:32.449709 13865 pending_rounds.cc:85] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 8
I20260709 13:08:32.398468 13858 raft_consensus.cc:1240] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:32.450207 13865 pending_rounds.cc:107] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:08:32.450670 13865 raft_consensus.cc:2889] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:32.449544 19542 raft_consensus.cc:740] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:32.452637 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3682) took 1574 ms. Trace:
I20260709 13:08:32.413539 19540 consensus_queue.cc:260] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:32.395681 13601 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 536b1fc131984687bf3b13417507e21d with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b5029654a4384e43a68eb67b794949b7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:08:32.407989 13856 rpcz_store.cc:269] 0709 13:08:31.025280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.107624 (+ 82344us) service_pool.cc:224] Handling call
0709 13:08:31.257560 (+149936us) spinlock_profiling.cc:243] Waited 48.3 ms on lock 0x7b5800021698. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:08:32.397762 (+1140202us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003dc7d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:32.398030 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2450169472}
I20260709 13:08:32.452857 19542 consensus_queue.cc:260] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:32.453619 13601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 58287.8us
I20260709 13:08:32.454567 19540 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:32.455713 19542 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:32.402287 13857 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:32.456522 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3686) took 1190 ms. Trace:
I20260709 13:08:32.350981 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:32.456838 13857 rpcz_store.cc:276] 0709 13:08:31.265732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.400987 (+1135255us) service_pool.cc:224] Handling call
0709 13:08:32.401545 (+   558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.456205 (+ 54660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.456415 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.421121 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:32.461669 13860 raft_consensus.cc:3055] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:32.462054 13860 raft_consensus.cc:740] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:32.322268 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:32.423638 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 2960) took 1092 ms. Trace:
I20260709 13:08:32.463404 13860 consensus_queue.cc:260] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.463830 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:32.463892 13863 rpcz_store.cc:276] 0709 13:08:31.331310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.516425 (+185115us) service_pool.cc:224] Handling call
0709 13:08:32.423280 (+906855us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b54003016d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:32.423554 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1602087296}
I20260709 13:08:32.465129 13860 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:32.425037 13680 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:32.344614 13783 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
W20260709 13:08:32.303220 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 281831us
I20260709 13:08:32.466450 19212 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:32.319968 14365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.008s	sys 0.010s
I20260709 13:08:32.429244 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3687) took 1163 ms. Trace:
I20260709 13:08:32.344043 13782 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:08:32.409142 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 82184.7us
I20260709 13:08:32.368336 19389 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.447821 13790 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:08:32.304435 13786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2564) took 1162 ms. Trace:
I20260709 13:08:32.551581 13786 rpcz_store.cc:276] 0709 13:08:31.141747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.141909 (+   162us) service_pool.cc:224] Handling call
0709 13:08:31.142278 (+   369us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:31.149965 (+  7687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:31.149996 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:31.150615 (+   619us) log.cc:844] Serialized 52 byte log entry
0709 13:08:31.277701 (+127086us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:31.297433 (+ 19732us) log.cc:844] Serialized 14 byte log entry
0709 13:08:31.299641 (+  2208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.299724 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.303586 (+1003862us) raft_consensus.cc:1685] finished
0709 13:08:32.303662 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.304071 (+   409us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21510,"prepare.queue_time_us":16054,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":13221,"raft.queue_time_us":14690,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":6259,"thread_start_us":86608,"threads_started":1,"wal-append.queue_time_us":385014}
I20260709 13:08:32.454708 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2953) took 1496 ms. Trace:
I20260709 13:08:32.554049 13858 rpcz_store.cc:276] 0709 13:08:30.958205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.601660 (+643455us) service_pool.cc:224] Handling call
0709 13:08:32.398010 (+796350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.450428 (+ 52418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.451215 (+   787us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b54003dc7d0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:32.454662 (+  3447us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1830266240}
I20260709 13:08:32.410331 19138 consensus_queue.cc:260] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.389461 19529 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:32.369295 19435 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:32.469089 13756 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:32.555346 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:32.469551 19196 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:32.448827 19442 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:32.472568 13865 rpcz_store.cc:276] 0709 13:08:30.877993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.588774 (+710781us) service_pool.cc:224] Handling call
0709 13:08:31.589114 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.451518 (+862404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.452300 (+   782us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b54001accd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:32.452568 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1647991552}
W20260709 13:08:32.605159 14365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.011s	sys 0.024s
I20260709 13:08:32.240710 19782 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:32.322093 14397 raft_consensus.cc:1240] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:32.358764 19228 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:32.484656 19547 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:32.235767 19549 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:32.209363 19591 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:32.208494 19566 raft_consensus.cc:697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:32.486331 19629 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:32.486897 19589 raft_consensus.cc:3055] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:32.485832 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:32.446666 13864 rpcz_store.cc:276] 0709 13:08:31.265438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.340325 (+1074887us) service_pool.cc:224] Handling call
0709 13:08:32.443505 (+103180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.444475 (+   970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.445686 (+  1211us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54003016d0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:32.445906 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235730176}
I20260709 13:08:32.501183 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:32.476902 19325 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:32.330209 13613 catalog_manager.cc:5697] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 11 to 13, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 13 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:32.549007 13861 rpcz_store.cc:276] 0709 13:08:31.266018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.428025 (+1162007us) service_pool.cc:224] Handling call
0709 13:08:32.428475 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.428842 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:32.428866 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:32.428903 (+    37us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:32.428939 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.428986 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.429086 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.480779 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:32.235296 19683 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:32.622623 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 180963us
I20260709 13:08:32.614557 19547 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.621397 19589 raft_consensus.cc:740] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:32.631503 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:32.635152 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:32.632498 14398 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.001s	sys 0.018s
I20260709 13:08:32.639153 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:32.633854 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:32.640921 19641 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.197s	user 0.030s	sys 0.104s
I20260709 13:08:32.641496 14395 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:32.642017 19756 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:32.640944 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.642783 19756 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.643556 19846 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:32.644722 19768 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:32.645501 19212 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:32.646152 19733 consensus_meta.cc:287] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 1.011s	user 0.010s	sys 0.000s
I20260709 13:08:32.647184 13788 raft_consensus.cc:2393] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 12: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:32.647994 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:32.648255 13711 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:32.648506 19808 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:32.648963 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:32.649379 19765 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:32.649850 14402 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:08:32.650027 19765 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:32.646448 19447 consensus_meta.cc:287] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.652s	user 0.016s	sys 0.003s
I20260709 13:08:32.651255 19447 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.652937 19738 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:32.652768 19589 consensus_queue.cc:260] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.654101 19447 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:32.654354 19589 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:32.655198 19855 consensus_queue.cc:1059] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:32.655895 13859 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:32.656271 19855 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:08:32.657773 14368 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 1.665s (SENT) [suppressed 36 similar messages]
I20260709 13:08:32.633790 19547 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:32.659498 19645 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:32.660234 19435 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:32.662433 19435 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:32.632932 19389 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.663559 13613 catalog_manager.cc:5697] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:32.666324 19389 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:32.670802 19846 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:32.641050 19732 consensus_queue.cc:1059] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
W20260709 13:08:32.671670 13757 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.017s	user 0.009s	sys 0.011s
I20260709 13:08:32.238430 19680 consensus_queue.cc:1059] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.434s
I20260709 13:08:32.672406 19732 raft_consensus.cc:3055] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:32.244128 19755 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:32.641546 19641 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.232s	user 0.030s	sys 0.105s
W20260709 13:08:32.672526 13757 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.009s	sys 0.011s
I20260709 13:08:32.674180 13784 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:08:32.674618 19755 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:32.675531 13862 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:32.675029 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 1.10993e+06us
I20260709 13:08:32.672827 19732 raft_consensus.cc:740] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:32.678946 19732 consensus_queue.cc:260] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.680433 19732 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:32.682014 19658 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.016s	sys 0.025s
W20260709 13:08:32.682497 19658 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.016s	sys 0.026s
I20260709 13:08:32.682713 19859 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:32.682327 19566 consensus_queue.cc:237] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.636111 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:32.636593 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 135643us
W20260709 13:08:32.682351 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 213546us
I20260709 13:08:32.666164 13613 catalog_manager.cc:5697] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 7 to 8, term changed from 8 to 12, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132), VOTER 35ecb005831740438d7537dd4b840e03 (127.12.76.130) evicted. New cstate: current_term: 12 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:32.705806 14398 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.001s	sys 0.019s
I20260709 13:08:32.709836 13787 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:08:32.636241 19854 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:32.710716 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 76668.5us
W20260709 13:08:32.636132 19353 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.003s	sys 0.018s
W20260709 13:08:32.720278 19822 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.016s	sys 0.040s
I20260709 13:08:32.720710 13757 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:32.721590 19758 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
W20260709 13:08:32.723176 14367 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.011s	sys 0.029s
W20260709 13:08:32.723531 14367 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.012s	sys 0.029s
W20260709 13:08:32.723816 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 680598us
I20260709 13:08:32.723884 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:32.725025 13716 raft_consensus.cc:2393] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 18: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:32.725214 19644 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:32.726986 13712 raft_consensus.cc:1240] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:32.727383 13756 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:32.724799 14367 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:32.728776 13790 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 28.
I20260709 13:08:32.628067 19529 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.736366 14366 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:32.720743 19822 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.016s	sys 0.040s
I20260709 13:08:32.744246 14393 raft_consensus.cc:2393] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 17: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:32.745240 13786 raft_consensus.cc:2393] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 12: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:32.748732 13680 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:32.632978 19442 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:32.740386 19353 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.004s	sys 0.018s
I20260709 13:08:32.750774 13613 catalog_manager.cc:5697] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 9 to 11, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 11 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:32.726910 19591 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.762207 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:32.768632 13715 raft_consensus.cc:1240] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:32.769235 19831 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:32.769872 19808 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:32.770537 19808 raft_consensus.cc:697] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:32.776343 19806 raft_consensus.cc:3055] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:32.776827 19806 raft_consensus.cc:740] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:32.776503 19808 consensus_queue.cc:237] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.777915 19806 consensus_queue.cc:260] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:32.778802 19821 consensus_meta.cc:287] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 1.102s	user 0.006s	sys 0.007s
I20260709 13:08:32.779503 19806 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:32.780496 19664 raft_consensus.cc:3055] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:32.780907 19664 raft_consensus.cc:740] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:32.781960 19664 consensus_queue.cc:260] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.783589 14396 raft_consensus.cc:1240] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:32.785562 19663 raft_consensus.cc:3055] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:08:32.785895 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 58773us
I20260709 13:08:32.786023 19663 raft_consensus.cc:740] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:32.786826 13756 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:32.788051 19765 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:32.741636 19854 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.756294 19435 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:32.795423 14402 raft_consensus.cc:1240] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:32.771324 14366 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:32.654444 19730 consensus_queue.cc:260] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:32.763686 19859 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:32.807734 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:32.808022 19859 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.808462 19859 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:32.808614 13716 raft_consensus.cc:2393] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 17: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:32.809828 19867 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:32.810056 19641 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:32.810632 19867 raft_consensus.cc:697] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:32.802570 19854 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:32.803050 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 78397.2us
I20260709 13:08:32.803557 19868 raft_consensus.cc:2764] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 13:08:32.805998 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 49641.3us
I20260709 13:08:32.815719 13712 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:08:32.815925 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:32.806684 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 89979.7us
I20260709 13:08:32.815631 19867 consensus_queue.cc:237] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.816983 13680 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:32.817569 13710 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:08:32.807221 13756 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:32.807535 13859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1508) took 1667 ms. Trace:
I20260709 13:08:32.790781 13785 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:32.813858 13613 catalog_manager.cc:5697] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:32.818473 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:32.821067 13715 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:32.819191 13859 rpcz_store.cc:276] 0709 13:08:31.139645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.646393 (+506748us) service_pool.cc:224] Handling call
0709 13:08:31.646680 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.656345 (+1009665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.807271 (+150926us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54002fadd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:32.807467 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2320136064}
I20260709 13:08:32.790829 19831 raft_consensus.cc:697] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:08:32.822553 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.820978 19629 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:32.853466 13711 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 3258) took 1374 ms (client timeout 1722 ms). Trace:
W20260709 13:08:32.853924 13711 rpcz_store.cc:269] 0709 13:08:31.478532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.479976 (+  1444us) service_pool.cc:224] Handling call
0709 13:08:32.853237 (+1373261us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400149454. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:32.853377 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2420154752}
I20260709 13:08:32.855345 19857 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:32.855532 19664 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:32.823796 19529 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:32.825917 19643 consensus_queue.cc:260] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 9, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:32.828015 13613 catalog_manager.cc:5697] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 11 to 13, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 13 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:32.832471 13757 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:32.833194 19435 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.834156 19858 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:08:32.834915 19845 log.cc:927] Time spent T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.808s	user 0.006s	sys 0.017s
I20260709 13:08:32.838915 19630 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.841989 13786 raft_consensus.cc:1240] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:32.852444 19831 consensus_queue.cc:237] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:32.862507 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.860378 13856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2959) took 1516 ms. Trace:
I20260709 13:08:32.864154 13860 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:32.867715 19730 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:32.869638 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 52782.8us
I20260709 13:08:32.871778 19857 raft_consensus.cc:697] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:32.872521 14393 raft_consensus.cc:1240] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:32.787015 19663 consensus_queue.cc:260] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.877089 19858 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:32.878870 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 60078.2us
I20260709 13:08:32.879637 19806 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:32.880705 19442 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:32.882134 14397 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:32.883816 19138 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:32.884845 19822 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:32.885700 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 123077us
W20260709 13:08:32.885886 19602 consensus_meta.cc:287] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.838s	user 0.008s	sys 0.006s
I20260709 13:08:32.885536 19869 consensus_queue.cc:1059] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:32.755759 19228 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.886530 19854 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:32.888228 19866 consensus_queue.cc:1059] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:32.874886 14367 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:08:32.875730 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.899910 19591 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:32.903687 19643 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:32.904636 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 97597.7us
I20260709 13:08:32.916778 19630 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:32.889863 13613 catalog_manager.cc:5697] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 11 to 13, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 13 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:32.891727 13856 rpcz_store.cc:276] 0709 13:08:31.331018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.454162 (+1123144us) service_pool.cc:224] Handling call
0709 13:08:32.454684 (+   522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:32.502518 (+ 47834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:32.502547 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:32.614675 (+112128us) log.cc:844] Serialized 26 byte log entry
0709 13:08:32.744785 (+130110us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:32.744839 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.744956 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.847003 (+102047us) raft_consensus.cc:1685] finished
0709 13:08:32.847031 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.847355 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":186670,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"thread_start_us":153953,"threads_started":2,"wal-append.queue_time_us":204861}
W20260709 13:08:32.940573 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.918490 19196 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:08:32.941152 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 129413us
I20260709 13:08:32.889710 19868 consensus_queue.cc:1059] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:08:32.952546 13680 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:32.957072 19848 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:32.957194 19837 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.957603 19821 raft_consensus.cc:3055] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:32.984052 19821 raft_consensus.cc:740] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:32.985173 19821 consensus_queue.cc:260] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.986531 19821 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:32.987073 19228 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:32.959153 19630 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:32.959681 13830 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:32.960137 19857 consensus_queue.cc:237] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:32.962649 19763 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:08:32.963065 19846 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.963783 19872 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.964498 19697 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.964618 19547 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:32.968308 14366 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:32.972076 13715 raft_consensus.cc:2410] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:32.953135 19822 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:32.935921 19641 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
W20260709 13:08:32.975046 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 100313us
I20260709 13:08:32.980690 19683 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:32.982192 13680 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:32.970953 19848 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:32.983201 19837 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:33.023594 13864 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:33.024847 19822 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:33.025290 19837 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:32.958122 19813 consensus_queue.cc:1059] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:08:33.026542 19813 raft_consensus.cc:3055] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:33.026930 19813 raft_consensus.cc:740] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:33.027846 19813 consensus_queue.cc:260] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:33.028390 13860 raft_consensus.cc:1275] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:32.957521 19391 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:08:33.029274 19813 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:32.987607 19758 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:32.946095 19765 consensus_queue.cc:1059] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:08:32.989889 19591 consensus_queue.cc:1059] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:32.990481 19196 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:32.989702 19533 consensus_queue.cc:1059] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:08:32.994069 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 52287.1us
I20260709 13:08:32.991189 13613 catalog_manager.cc:5697] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 15 to 20, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 20 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:32.968276 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:08:32.967576 19856 log.cc:927] Time spent T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.466s	user 0.000s	sys 0.002s
W20260709 13:08:33.004771 19627 consensus_meta.cc:287] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 1.191s	user 0.015s	sys 0.002s
W20260709 13:08:33.005246 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 52049.8us
I20260709 13:08:33.005863 19663 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:33.008666 13856 raft_consensus.cc:1275] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:33.008814 19435 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:32.996239 19542 consensus_meta.cc:287] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.004s
I20260709 13:08:33.000413 19732 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:33.010154 19868 raft_consensus.cc:3055] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:33.018828 13788 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 20. Current term is 21. Ops: [19.10-20.11]
I20260709 13:08:32.939827 19602 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.021102 19848 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:33.047883 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:33.021199 19697 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.050570 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:33.050833 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:33.052181 19697 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:33.052482 19846 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.052966 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:33.053618 19442 raft_consensus.cc:3055] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:33.053736 13711 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:33.054064 19442 raft_consensus.cc:740] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:33.054688 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:32.996712 19756 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:32.988628 19664 consensus_queue.cc:1059] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:33.057806 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:33.058660 14400 raft_consensus.cc:2393] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 16: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:33.041803 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:33.044066 19627 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:33.022825 19681 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:33.034229 19808 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:33.049834 14397 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.050638 14393 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:33.054735 19846 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:33.025424 19547 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:33.039893 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:33.057125 13790 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:33.059612 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:33.070732 14400 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 18: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:33.055788 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:33.062067 19664 raft_consensus.cc:3055] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:33.062548 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:33.064456 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 121265us
I20260709 13:08:33.046320 19868 raft_consensus.cc:740] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:33.044494 19758 raft_consensus.cc:697] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:33.062526 19872 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.065703 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:33.075225 13858 raft_consensus.cc:3055] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:33.072474 13756 leader_election.cc:400] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 20. Current term is 21.
I20260709 13:08:33.046154 19732 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:33.076682 13756 leader_election.cc:403] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:33.072899 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:33.076589 13858 raft_consensus.cc:740] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:33.021797 19859 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.079689 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:33.082434 13788 raft_consensus.cc:2393] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 13: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:33.069254 19681 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:33.084018 13859 raft_consensus.cc:2393] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 13: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:33.087378 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:33.055001 19442 consensus_queue.cc:260] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.072917 19664 raft_consensus.cc:740] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:33.086622 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:33.106537 13714 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:33.073068 19867 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.105436 19602 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:33.105038 19868 consensus_queue.cc:260] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.079829 19325 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.106460 19872 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:33.083861 19866 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.077672 19732 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.104467 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:33.107813 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:33.106990 13858 consensus_queue.cc:260] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.114392 13680 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:33.110801 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:33.115783 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:33.089159 19681 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:33.116133 14393 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:08:33.116384 13712 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:33.073681 19513 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:08:33.117738 14366 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:33.120400 13716 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:33.121357 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:33.120527 13755 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:33.122485 19325 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.079629 19758 consensus_queue.cc:237] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.131673 19658 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:33.136381 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:33.137138 14393 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:08:33.136410 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2775) took 1608 ms. Trace:
I20260709 13:08:33.138219 13713 rpcz_store.cc:276] 0709 13:08:31.527806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.558768 (+ 30962us) service_pool.cc:224] Handling call
0709 13:08:31.559021 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:31.710136 (+151115us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:31.710418 (+   282us) log.cc:844] Serialized 14 byte log entry
0709 13:08:32.630383 (+919965us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:32.640454 (+ 10071us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:32.672103 (+ 31649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.136177 (+464074us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54000c4754. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:33.136219 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:33.136335 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":557,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":4227,"raft.queue_time_us":138796,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":165,"spinlock_wait_cycles":346989824,"thread_start_us":894645,"threads_started":2,"wal-append.queue_time_us":527981}
I20260709 13:08:33.141459 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:33.141490 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:33.142838 13787 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:33.129791 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:33.115607 19196 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 20. Current term is 21.
I20260709 13:08:33.144798 13755 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:33.150053 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.153254 13715 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 28 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 27. Current term is 28. Ops: []
I20260709 13:08:33.153864 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:33.155803 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:33.159096 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 94923us
W20260709 13:08:33.160161 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 74042.4us
W20260709 13:08:33.160758 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.161057 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:33.153228 19866 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.163857 19866 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:33.171561 13858 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:33.172096 19889 log.cc:927] Time spent T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:08:33.173388 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 63586.5us
I20260709 13:08:33.174256 14366 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:33.176244 19859 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:33.177067 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:33.177657 13859 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:08:33.178438 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:33.179708 19664 consensus_queue.cc:260] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.181015 19664 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.183625 19870 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:33.188175 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:33.188412 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:33.188982 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.189157 13787 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:08:33.189796 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:33.190327 19325 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:33.191009 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:33.191217 19868 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:33.193610 19847 raft_consensus.cc:3055] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:33.194016 19847 raft_consensus.cc:740] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:33.195843 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:33.183573 19828 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:33.146776 19442 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:33.205461 13712 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:08:33.209795 13830 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:33.156271 19730 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:33.235599 19730 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.236088 19730 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:33.236421 13788 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:33.239596 19687 consensus_queue.cc:1048] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:08:33.244626 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3692) took 1722 ms. Trace:
I20260709 13:08:33.244745 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:33.245420 13863 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
I20260709 13:08:33.245118 13857 rpcz_store.cc:276] 0709 13:08:31.522692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.459378 (+936686us) service_pool.cc:224] Handling call
0709 13:08:32.467829 (+  8451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.662890 (+195061us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:32.662936 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:32.663000 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:32.663035 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.244366 (+581331us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b540024fc54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:33.244415 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:33.244557 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448021760}
I20260709 13:08:33.226924 13865 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.246527 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:33.250661 13863 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:08:33.207608 19828 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.251823 19828 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:33.252614 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1507) took 2113 ms. Trace:
I20260709 13:08:33.252996 13862 rpcz_store.cc:276] 0709 13:08:31.139389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.631053 (+491664us) service_pool.cc:224] Handling call
0709 13:08:31.673056 (+ 42003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.676706 (+1003650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.252366 (+575660us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400343d54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:33.252556 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2303873792}
I20260709 13:08:33.254328 13862 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:33.208743 13680 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:33.233213 13858 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:08:33.256306 13858 pending_rounds.cc:85] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 13
I20260709 13:08:33.256567 13858 pending_rounds.cc:107] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:08:33.171058 19732 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:33.260133 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 50418.2us
W20260709 13:08:33.208385 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 46676.6us
I20260709 13:08:33.209733 14402 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:08:33.245909 19658 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:33.256826 13858 raft_consensus.cc:2889] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:33.223963 13757 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:33.261785 14402 pending_rounds.cc:85] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 12
I20260709 13:08:33.262279 14402 pending_rounds.cc:107] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:08:33.262667 14402 raft_consensus.cc:2889] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:33.267381 13865 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:33.271639 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:33.205672 19447 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.291883 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:33.293982 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:33.295629 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 65153.1us
I20260709 13:08:33.264451 19658 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.304216 13859 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:33.229382 19858 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:33.323676 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 148233us
I20260709 13:08:33.158588 19867 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.194845 19847 consensus_queue.cc:260] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.280071 19663 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:33.327041 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 123409us
I20260709 13:08:33.226035 19641 consensus_queue.cc:1048] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:08:33.329139 14367 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:33.224177 19848 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:33.333115 19888 log.cc:927] Time spent T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:08:33.341353 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:33.333971 13682 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:33.330862 13784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2570) took 2169 ms. Trace:
I20260709 13:08:33.340458 13788 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:33.333837 13680 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:33.343319 13784 rpcz_store.cc:276] 0709 13:08:31.155685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.164278 (+  8593us) service_pool.cc:224] Handling call
0709 13:08:31.212283 (+ 48005us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:32.674618 (+1462335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.255250 (+580632us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540026e3d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:33.309431 (+ 54181us) spinlock_profiling.cc:243] Waited 47.7 ms on lock 0x7b540026e3d0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:33.324999 (+ 15568us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3470496512}
I20260709 13:08:33.317596 19683 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:33.330202 13865 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:33.350203 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:33.351627 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.352689 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:33.324343 19325 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:33.294133 19687 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.053s
W20260709 13:08:33.353889 13785 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1399) took 2415 ms (client timeout 1946 ms). Trace:
I20260709 13:08:33.354411 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:33.357450 13791 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:33.355922 13785 rpcz_store.cc:269] 0709 13:08:30.932914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.933045 (+   131us) service_pool.cc:224] Handling call
0709 13:08:33.324903 (+2391858us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b54003bc754. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:33.348579 (+ 23676us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4192857984}
I20260709 13:08:33.312877 19447 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:33.363581 14367 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:33.370500 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:08:33.373247 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 218417us
I20260709 13:08:33.373937 13682 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:33.361243 19870 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:33.377745 19662 consensus_queue.cc:1059] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:08:33.383538 14399 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.367607 19758 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.384693 19847 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:33.387769 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 53984.6us
I20260709 13:08:33.361519 19854 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:33.404780 13682 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:33.406303 19866 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:33.390232 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:33.396117 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.361754 19353 consensus_queue.cc:1059] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
W20260709 13:08:33.397866 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 58555.5us
W20260709 13:08:33.402704 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.402958 19442 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:33.406384 13682 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:33.415077 14399 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:33.440810 14397 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:08:33.455999 13715 raft_consensus.cc:1240] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:33.459725 13713 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:33.406577 19325 consensus_queue.cc:1059] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:08:33.471750 19854 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:08:33.473663 13712 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:33.479648 13791 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
W20260709 13:08:33.484953 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:33.487915 13601 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 536b1fc131984687bf3b13417507e21d with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b5029654a4384e43a68eb67b794949b7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:33.459300 13682 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:33.499958 13783 raft_consensus.cc:2410] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:08:33.500098 19325 raft_consensus.cc:3055] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:33.500515 19325 raft_consensus.cc:740] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:33.501358 19325 consensus_queue.cc:260] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:33.502563 19325 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:33.503679 19756 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.504247 19756 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:33.506368 19756 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:33.503065 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:33.508014 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:33.508704 13859 raft_consensus.cc:2393] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 10: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:33.509402 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:33.510671 13859 raft_consensus.cc:1240] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:08:33.511492 19589 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:33.512070 19589 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:33.512476 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 53278.8us
I20260709 13:08:33.513166 13682 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:33.444386 19602 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:33.513875 19513 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:33.514196 19589 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:33.514436 19513 raft_consensus.cc:697] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:33.514024 19602 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.515612 19228 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:33.516031 19228 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.516382 19228 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.516242 19859 consensus_queue.cc:1059] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:33.516767 19867 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:33.517324 19859 raft_consensus.cc:3055] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:33.517714 19859 raft_consensus.cc:740] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:33.518551 19859 consensus_queue.cc:260] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.520546 13756 leader_election.cc:400] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15.
I20260709 13:08:33.521140 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:33.521492 13756 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:33.445828 19821 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:33.522282 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:33.522753 19821 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.522791 13756 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:33.523494 19821 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:33.524425 19447 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:33.524683 19848 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:33.525310 19732 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:33.445636 19644 raft_consensus.cc:2764] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:08:33.564738 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.565280 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:33.525593 19533 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:33.567966 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:33.457261 19822 consensus_queue.cc:1059] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:08:33.571646 19602 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:33.573143 19730 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.575299 19730 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:33.575839 19837 raft_consensus.cc:3055] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:33.576236 19837 raft_consensus.cc:740] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:33.576802 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:33.578063 19630 raft_consensus.cc:3055] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:33.578444 19630 raft_consensus.cc:740] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:33.579121 13783 raft_consensus.cc:1275] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:33.579306 19630 consensus_queue.cc:260] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:33.581741 19658 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.582617 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:33.584466 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:33.584775 13829 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:33.585294 13712 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:08:33.525427 19513 consensus_queue.cc:237] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.526146 19808 raft_consensus.cc:3055] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:33.526633 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:33.526942 19870 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:33.527016 19641 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:33.530364 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:33.532644 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.536312 13865 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:33.539543 14368 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:33.540681 13859 raft_consensus.cc:1240] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:33.566066 13791 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:33.586932 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:08:33.601531 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 63311.4us
I20260709 13:08:33.608275 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:33.608827 13715 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.612223 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:33.612476 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.615406 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:33.615643 13757 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:33.616649 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:33.620738 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:33.621380 13712 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:33.621560 13859 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:33.618199 13713 raft_consensus.cc:1275] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:33.583199 19602 consensus_queue.cc:1059] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 13:08:33.628094 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 105376us
I20260709 13:08:33.596503 19732 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:33.597198 19447 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:33.635851 13865 raft_consensus.cc:1240] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:33.596804 19808 raft_consensus.cc:740] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:33.615065 19848 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:33.641191 13830 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:33.561532 19681 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.641139 13757 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:33.646279 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:33.614616 19822 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.614256 19683 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:33.645403 19658 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:33.625095 19765 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:33.626740 19859 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.591506 19442 consensus_queue.cc:1059] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:08:33.648844 13829 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:33.630818 19869 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.656975 19391 raft_consensus.cc:3055] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:33.657912 13712 raft_consensus.cc:2393] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 14: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:33.635433 19732 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:33.636252 19447 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:33.643667 19763 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:33.607875 19828 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:33.661777 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 301618us
I20260709 13:08:33.678766 13830 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:33.650501 19663 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:33.660491 19733 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.660802 19866 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:08:33.603524 19837 consensus_queue.cc:260] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.663264 19822 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.659595 19730 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:33.684363 19547 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:33.688778 19732 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.661751 19821 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:33.684768 19391 raft_consensus.cc:740] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:33.691171 19447 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:33.705926 13782 raft_consensus.cc:2368] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11.
I20260709 13:08:33.687510 19765 raft_consensus.cc:697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:33.680477 19454 consensus_queue.cc:1059] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:08:33.688060 19658 consensus_queue.cc:1059] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
W20260709 13:08:33.732100 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 368572us
I20260709 13:08:33.703265 19602 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:33.748744 14367 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:33.706063 19547 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.718061 19837 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:33.728824 13715 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
W20260709 13:08:33.777812 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.718284 19866 raft_consensus.cc:697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 28 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:08:33.788887 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 137955us
I20260709 13:08:33.703832 19869 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.731797 19730 raft_consensus.cc:697] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:33.763972 19547 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:33.734331 19566 consensus_queue.cc:1059] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:08:33.703711 19733 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:33.801786 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 123089us
W20260709 13:08:33.817687 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 168901us
I20260709 13:08:33.748335 19662 consensus_queue.cc:1059] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:08:33.816748 19681 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:33.823742 19658 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:33.834221 13859 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:33.818943 13829 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:33.836300 13757 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:33.840397 19602 raft_consensus.cc:697] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:33.841742 19602 consensus_queue.cc:237] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:33.855748 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 332341us
I20260709 13:08:33.837183 19454 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:33.749189 19808 consensus_queue.cc:260] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.859848 13680 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:33.860167 19828 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:33.860358 19730 consensus_queue.cc:237] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.821751 19391 consensus_queue.cc:260] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.862178 19391 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.804356 19870 raft_consensus.cc:697] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:33.864323 19870 consensus_queue.cc:237] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.869544 19822 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:33.875522 19765 consensus_queue.cc:237] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.920722 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:33.922456 13865 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:33.932896 13859 raft_consensus.cc:1240] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:33.934514 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:33.934963 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.915921 19658 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.936046 19658 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.936738 19913 consensus_queue.cc:1048] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:33.857440 19900 raft_consensus.cc:3055] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:33.858738 19454 raft_consensus.cc:697] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:33.949362 19828 consensus_queue.cc:1059] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
W20260709 13:08:33.960503 14366 connection.cc:256] RPC call timeout handler was delayed by -1.4372218070000145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
I20260709 13:08:33.966344 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:33.967836 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:08:33.970023 19896 log.cc:927] Time spent T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:08:33.973306 19566 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:33.976786 19763 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:33.951438 19900 raft_consensus.cc:740] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:33.980316 19900 consensus_queue.cc:260] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:33.936676 19899 consensus_queue.cc:1059] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 27.19, Next index: 20, Last known committed idx: 17, Time since last communication: 0.021s
W20260709 13:08:33.980801 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:33.987493 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 166166us
I20260709 13:08:33.949586 19822 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:33.857928 19629 consensus_queue.cc:1059] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.097s
I20260709 13:08:33.982932 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:33.997710 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 147185us
I20260709 13:08:33.998122 14399 raft_consensus.cc:2393] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 10: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:33.983837 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:33.984150 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:33.977326 19763 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:33.985185 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:33.985294 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:33.984912 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 125177us
W20260709 13:08:33.982568 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 340694us
I20260709 13:08:34.009064 13755 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:33.979178 19733 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:34.006532 13830 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:34.024720 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:34.026543 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 23 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:34.022424 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:34.031932 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:34.033896 13859 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:08:34.034802 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.036666 14393 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:34.027164 13680 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:34.036170 14394 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 23: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:34.036155 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:33.981652 19900 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:34.041076 14400 raft_consensus.cc:2393] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 11: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:34.043804 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:34.047022 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:34.047806 14399 raft_consensus.cc:2393] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 13: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:34.021776 19442 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.005565 19658 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:34.061156 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:34.064600 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 245732us
W20260709 13:08:34.068593 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.069042 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:34.069720 13785 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:34.070011 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:34.027009 19913 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:34.071302 13785 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:08:34.073257 13785 pending_rounds.cc:85] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 11
I20260709 13:08:34.072111 14396 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 8.
I20260709 13:08:34.072288 14393 raft_consensus.cc:2410] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:08:34.073513 13785 pending_rounds.cc:107] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:08:34.074420 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:34.075346 14399 raft_consensus.cc:2393] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 16: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:34.087368 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:34.088032 13790 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:34.064597 19821 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:34.089213 19325 consensus_meta.cc:287] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.586s	user 0.013s	sys 0.000s
I20260709 13:08:34.088889 19442 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.089757 19629 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:34.090337 19629 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.092746 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:34.058744 19758 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:34.086514 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:34.048100 19391 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:34.084715 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:34.096608 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 274353us
I20260709 13:08:34.095268 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:34.074859 13785 raft_consensus.cc:2889] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:34.145134 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:34.084964 19687 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.094538 19658 raft_consensus.cc:3055] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:08:34.082046 19697 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 13:08:34.206432 19658 raft_consensus.cc:740] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:34.200853 19869 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:34.210965 19658 consensus_queue.cc:260] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.211820 19687 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.212328 19658 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:08:34.213944 19687 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:34.214471 19391 raft_consensus.cc:697] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 13 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:34.215386 19391 consensus_queue.cc:237] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.084864 19353 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:34.160925 19903 raft_consensus.cc:3055] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:34.074687 19911 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.123s
I20260709 13:08:34.168222 19763 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:34.219766 19353 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:34.171555 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 133457us
I20260709 13:08:33.996696 19866 consensus_queue.cc:237] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.19, Last appended by leader: 19, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.191107 13791 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:08:34.180409 19602 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.092424 19629 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:34.167047 19547 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:34.273005 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:34.273779 13784 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:34.273638 19602 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.191934 19566 consensus_queue.cc:1059] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:08:34.274863 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:34.275923 19602 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:34.279498 19353 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:34.282416 14366 leader_election.cc:336] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.505s (SENT)
I20260709 13:08:34.282920 14366 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:34.285027 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:34.286360 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:34.287600 13858 raft_consensus.cc:1240] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:34.288421 19763 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:34.289332 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:34.289986 13786 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:34.291302 19925 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:34.292306 13863 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:34.292789 19925 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.262013 19923 consensus_queue.cc:1048] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:08:34.297925 14396 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:34.315737 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:34.262907 19848 consensus_meta.cc:287] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.613s	user 0.011s	sys 0.000s
I20260709 13:08:34.200887 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:34.208359 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:34.162632 19934 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:34.184491 19920 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:34.233521 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:34.319775 14399 raft_consensus.cc:2393] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 16: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:34.225736 19903 raft_consensus.cc:740] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:08:34.170631 19533 consensus_meta.cc:287] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.603s	user 0.006s	sys 0.002s
I20260709 13:08:34.262207 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:34.262691 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:34.204118 19627 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:34.064720 19454 consensus_queue.cc:237] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:34.297592 19917 log.cc:927] Time spent T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.332s	user 0.001s	sys 0.000s
I20260709 13:08:34.332474 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:34.332952 14399 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:34.333084 13714 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:34.233987 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:34.335175 13713 raft_consensus.cc:2410] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
W20260709 13:08:34.335299 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.321329 13790 raft_consensus.cc:2393] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 12: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:34.331012 13708 raft_consensus.cc:2393] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 16: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:34.258001 19662 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.320576 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:34.343777 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:34.345574 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:34.347018 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:34.347844 14396 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
W20260709 13:08:34.352582 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.356078 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:34.356803 13861 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 14. Current term is 15. Ops: [12.10-14.11]
W20260709 13:08:34.357352 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 270899us
I20260709 13:08:34.341207 19822 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:34.083207 13865 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:08:34.333688 19934 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.361935 13861 raft_consensus.cc:1240] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:34.378042 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.333582 19687 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.331732 19848 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:34.333185 19533 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:34.390827 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:34.388182 19932 consensus_queue.cc:1059] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:34.389182 19353 consensus_queue.cc:1059] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:34.389523 19925 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.393247 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:34.393254 13791 raft_consensus.cc:1240] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:34.380892 19763 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:34.441867 13680 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:34.454442 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 170149us
I20260709 13:08:34.393426 19627 raft_consensus.cc:697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:34.463044 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:34.466804 19533 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.468649 14367 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:34.443637 19932 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:34.475999 14398 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:08:34.477643 13708 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:34.443925 19911 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.473978 13680 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:34.478323 14367 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:34.482159 13714 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:34.363498 19662 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.454821 19763 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:34.396270 19687 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.455906 19926 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.492889 13680 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:34.497233 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 102750us
I20260709 13:08:34.487360 19353 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:34.493724 19763 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:34.493503 19919 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.446895 19925 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.493669 19533 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:34.511806 14394 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:34.513696 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:34.513401 19627 consensus_queue.cc:237] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:34.514344 19658 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.514922 19848 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:34.519587 14398 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
W20260709 13:08:34.501559 19228 consensus_meta.cc:287] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.985s	user 0.007s	sys 0.007s
W20260709 13:08:34.527998 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:34.530066 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.530889 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:34.531739 13791 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
W20260709 13:08:34.545008 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 56660.6us
I20260709 13:08:34.546789 13714 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:34.547467 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:34.503563 19938 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:34.492225 19939 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:08:34.556895 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:34.514930 19847 raft_consensus.cc:3055] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:34.552685 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:34.508258 19942 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.550403 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:34.491317 19932 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.532586 19533 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.557483 13791 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:08:34.558810 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:34.563967 14398 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:08:34.492280 19911 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:34.561631 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:34.556339 19732 consensus_meta.cc:287] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.824s	user 0.006s	sys 0.005s
I20260709 13:08:34.566226 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:34.582326 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.552820 19931 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:34.588824 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.551312 19547 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:34.597714 13680 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:34.604738 19901 log.cc:927] Time spent T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.669s	user 0.004s	sys 0.001s
W20260709 13:08:34.606344 19940 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:08:34.607184 19925 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:34.607977 19854 raft_consensus.cc:3055] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:34.607795 19931 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.608361 19854 raft_consensus.cc:740] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:34.609297 19854 consensus_queue.cc:260] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.610486 19854 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.610913 19931 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:34.571091 19909 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:08:34.612900 19662 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:34.613057 13782 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 2588) took 1425 ms (client timeout 1710 ms). Trace:
I20260709 13:08:34.534612 19353 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:34.613507 13782 rpcz_store.cc:269] 0709 13:08:33.188052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.188177 (+   125us) service_pool.cc:224] Handling call
0709 13:08:34.612846 (+1424669us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b54001e8054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:34.612980 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1181005696}
I20260709 13:08:34.615299 19353 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:34.613520 19924 log.cc:927] Time spent T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
W20260709 13:08:34.616796 19943 log.cc:927] Time spent T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:08:34.500226 19926 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.617865 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2980) took 1468 ms. Trace:
W20260709 13:08:34.618919 19837 consensus_meta.cc:287] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.827s	user 0.010s	sys 0.003s
I20260709 13:08:34.619022 19926 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:34.620209 19869 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:34.620738 19869 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:34.543704 19228 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:34.560946 19847 raft_consensus.cc:740] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:34.623443 13791 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:08:34.618216 13857 rpcz_store.cc:276] 0709 13:08:33.149768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.255763 (+105995us) service_pool.cc:224] Handling call
0709 13:08:33.273091 (+ 17328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:33.291238 (+ 18147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:33.291264 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:33.351757 (+ 60493us) log.cc:844] Serialized 26 byte log entry
0709 13:08:33.766456 (+414699us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:33.766499 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.766575 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:34.571407 (+804832us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:34.617595 (+ 46188us) raft_consensus.cc:1685] finished
0709 13:08:34.617613 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:34.617806 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7836,"raft.queue_time_us":18014,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":34763,"spinlock_wait_cycles":12923648,"thread_start_us":394344,"threads_started":1,"wal-append.queue_time_us":572848}
I20260709 13:08:34.565022 19533 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:34.562772 19938 raft_consensus.cc:697] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:34.625998 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:34.569396 19681 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:34.633617 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:34.634280 13860 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:34.634684 19228 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:34.635097 13829 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:34.635699 14368 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:34.636528 19939 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:34.636982 19939 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:34.637382 19939 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.638356 19916 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:34.638398 13829 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:34.639050 19916 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.639568 19923 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.640337 19547 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:34.591734 19732 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.643543 19934 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:34.643594 13859 raft_consensus.cc:1240] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:34.543139 19919 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.649603 13829 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:34.643117 19732 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:34.668888 19951 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:34.669462 19662 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:34.669531 19951 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.670274 19662 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.670845 19662 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:34.672060 19951 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:34.673889 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:34.674088 19939 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.676169 19939 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:34.676218 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:34.677045 19931 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.678002 13862 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:34.684068 13680 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:34.628014 19869 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:34.678369 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:34.677580 13829 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:34.646596 19916 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:34.732420 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 48459.8us
I20260709 13:08:34.664507 19454 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.735215 13680 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:34.646755 19681 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.739137 13716 raft_consensus.cc:1240] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18. Ops: []
W20260709 13:08:34.733402 19859 consensus_meta.cc:287] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 1.052s	user 0.009s	sys 0.003s
I20260709 13:08:34.744671 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:34.678689 19325 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:08:34.681285 19952 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.094s
I20260709 13:08:34.736348 19939 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:34.745107 19663 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.750906 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:34.750732 13715 raft_consensus.cc:1240] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:08:34.740155 19913 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:34.723459 19733 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:08:34.646576 19847 consensus_queue.cc:260] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:34.785631 13790 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.785012 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:34.741310 19681 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:34.744406 19228 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:08:34.764106 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.789429 13716 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18. Ops: []
W20260709 13:08:34.789729 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.730657 19938 consensus_queue.cc:237] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:34.788779 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 111401us
I20260709 13:08:34.751500 19513 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.793239 19899 raft_consensus.cc:3055] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:34.797778 19859 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:34.800210 19947 log.cc:927] Time spent T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:08:34.800278 13830 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:34.800491 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:34.822939 14396 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:34.790287 19913 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:34.803977 19847 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:34.828110 13790 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:34.805583 19228 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.748884 19909 consensus_queue.cc:1059] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:08:34.760736 19939 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:34.806216 19919 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:34.806856 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.807444 13860 raft_consensus.cc:1275] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:34.808239 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:34.809069 19872 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:34.842422 19909 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:34.842852 19872 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.843032 19909 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:34.845118 19928 log.cc:927] Time spent T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.779s	user 0.003s	sys 0.000s
I20260709 13:08:34.845203 19872 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:34.845485 19909 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:34.846144 19909 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:34.838253 14393 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:34.847036 19939 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:34.847584 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:34.848762 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:34.849292 14393 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:34.811769 19442 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:34.813040 13862 raft_consensus.cc:1240] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:34.815969 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:34.832928 19732 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:34.816792 19513 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.816979 19899 raft_consensus.cc:740] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:34.820500 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:34.824357 13757 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:34.828739 19859 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.826350 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:34.830472 13716 raft_consensus.cc:1240] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:34.831050 13856 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:34.834942 19228 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:34.842043 19782 consensus_queue.cc:1175] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "35ecb005831740438d7537dd4b840e03" responder_term: 12 status { last_received { term: 12 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 12 index: 9 } }
W20260709 13:08:34.846688 19918 log.cc:927] Time spent T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.701s	user 0.003s	sys 0.000s
I20260709 13:08:34.745330 19763 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.747254 19758 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:34.865618 13865 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.806154 19663 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.864355 13755 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:34.745085 19454 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:34.867946 13601 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 536b1fc131984687bf3b13417507e21d with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b5029654a4384e43a68eb67b794949b7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:34.828835 19913 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:34.871944 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 47686.7us
I20260709 13:08:34.865127 13857 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:34.858868 19644 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.882939 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:34.883605 13713 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:34.822214 19869 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:34.873458 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 58356.3us
I20260709 13:08:34.877835 19758 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:34.822335 19533 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.871168 19931 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:34.866464 19629 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.877925 19732 raft_consensus.cc:697] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:34.879881 19697 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:34.890231 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 74353us
I20260709 13:08:34.905798 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:34.903505 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:34.920789 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:34.921029 13712 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 18: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:08:34.889343 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 77958.7us
I20260709 13:08:34.921923 13791 raft_consensus.cc:2410] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:08:34.910557 13865 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:34.918491 19967 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:34.919746 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:34.920989 13829 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:34.891484 13783 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:34.925491 13711 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:08:34.936182 13711 pending_rounds.cc:85] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 9
I20260709 13:08:34.936424 13711 pending_rounds.cc:107] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:08:34.936697 13711 raft_consensus.cc:2889] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:34.890337 19758 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:34.896567 19911 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:34.941821 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 60613.8us
I20260709 13:08:34.911573 19964 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.925791 19627 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.912715 19733 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.939846 13682 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:34.950745 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:34.951390 14393 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:34.938764 19967 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.955436 13715 raft_consensus.cc:1275] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:34.938874 19919 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:34.888587 19644 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.941965 19325 raft_consensus.cc:3055] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:34.965376 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:34.947795 19447 consensus_meta.cc:287] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 1.177s	user 0.010s	sys 0.002s
I20260709 13:08:34.919171 19629 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.973338 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:34.964728 19967 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:34.963503 19848 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:34.983896 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:34.965523 19733 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:34.987244 19808 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:34.954337 19391 consensus_queue.cc:1059] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.021s
W20260709 13:08:34.988229 19900 consensus_meta.cc:287] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.942s	user 0.005s	sys 0.009s
W20260709 13:08:34.989229 19954 log.cc:927] Time spent T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:08:34.990571 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:34.990870 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:35.002835 13865 raft_consensus.cc:2393] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 17: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:35.004477 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:35.004896 13708 raft_consensus.cc:1240] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:35.005160 13711 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:35.007164 19589 raft_consensus.cc:3055] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:34.991137 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.007560 19589 raft_consensus.cc:740] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:35.008422 19589 consensus_queue.cc:260] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:35.009155 13715 raft_consensus.cc:2393] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 13: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:35.009598 19589 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:34.992194 19956 log.cc:927] Time spent T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 13:08:34.975061 19953 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 13:08:34.999842 19869 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:34.992882 19644 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:35.012216 14402 raft_consensus.cc:2393] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 13: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:35.012744 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 1403) took 1047 ms. Trace:
I20260709 13:08:35.013088 14402 rpcz_store.cc:276] 0709 13:08:33.965324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.967546 (+  2222us) service_pool.cc:224] Handling call
0709 13:08:34.990464 (+1022918us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b5800077d98. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9eee 0000000000375939 00007f523742d1e0 00007f52374f60c4 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:08:35.012657 (+ 22193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2900992}
I20260709 13:08:35.014345 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:34.937399 19899 consensus_queue.cc:260] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:34.976629 19442 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:34.974751 19447 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:35.015985 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2973) took 1874 ms. Trace:
I20260709 13:08:34.973799 19662 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.017675 19447 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:34.970366 19931 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:35.019009 13856 raft_consensus.cc:2410] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:08:34.969383 19325 raft_consensus.cc:740] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:34.992722 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:35.016382 13864 rpcz_store.cc:276] 0709 13:08:33.141791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.147977 (+  6186us) service_pool.cc:224] Handling call
0709 13:08:33.148304 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:33.231056 (+ 82752us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:33.698061 (+467005us) log.cc:844] Serialized 14 byte log entry
0709 13:08:34.202169 (+504108us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:34.202212 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:34.202255 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:34.846084 (+643829us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:35.015738 (+169654us) spinlock_profiling.cc:243] Waited 47.9 ms on lock 0x7b54003dc2d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:35.015787 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:35.015930 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34400,"prepare.queue_time_us":486640,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":5299,"raft.queue_time_us":181107,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":52369,"spinlock_wait_cycles":124427776,"thread_start_us":805667,"threads_started":3,"wal-append.queue_time_us":299740}
I20260709 13:08:34.993854 19732 consensus_queue.cc:237] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:35.024021 19513 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:35.025537 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:35.026196 13865 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:35.027808 19763 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:35.030100 13713 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:08:35.030747 13709 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:35.016124 19899 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:35.031973 14368 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:35.032245 19533 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:35.032584 19920 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:35.032809 19533 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.032912 19942 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:35.033452 19942 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.033411 19533 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:35.034024 19942 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:35.001999 19932 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:35.036175 19848 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.038300 19848 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:35.039086 19859 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:35.039485 19920 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:35.041361 14401 raft_consensus.cc:2410] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260709 13:08:35.047561 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.960949 19627 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:35.049173 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 98513.6us
I20260709 13:08:35.053654 19961 consensus_queue.cc:1059] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:08:35.054831 19533 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:35.061144 14396 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:08:35.061450 14395 raft_consensus.cc:2410] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:08:35.062068 19763 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:35.061162 19913 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.065030 19913 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:35.062160 14396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:40042
I20260709 13:08:35.066205 13830 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:35.069232 13857 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:35.069875 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:35.072018 13856 raft_consensus.cc:1240] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:34.962365 19964 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.087107 14396 raft_consensus.cc:606] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:35.091050 14396 raft_consensus.cc:614] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:35.088362 13864 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
W20260709 13:08:35.111945 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 61800.5us
I20260709 13:08:35.113055 13829 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:35.116473 19970 consensus_queue.cc:1048] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:08:35.117404 19939 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:35.063059 19758 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.119727 19641 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.121179 19758 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:35.120600 19641 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.122758 19681 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.072240 19808 consensus_queue.cc:1059] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:08:35.124081 19808 raft_consensus.cc:3055] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:35.124426 19808 raft_consensus.cc:740] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:35.124842 19681 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:35.125250 19808 consensus_queue.cc:260] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.129948 19968 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:35.125648 19641 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:35.130563 19968 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:35.161468 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 48514.5us
I20260709 13:08:35.144414 13711 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:35.145740 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:35.149765 13712 raft_consensus.cc:1240] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:35.143759 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:35.144061 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:35.220528 13707 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:35.144920 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:35.143708 14398 raft_consensus.cc:1240] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:35.226814 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:35.227876 14399 raft_consensus.cc:2393] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 16: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:35.126650 19808 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.244338 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:35.256912 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:35.256896 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:35.264361 14399 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:35.265295 13707 raft_consensus.cc:2393] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 15: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:35.133185 19964 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:35.131253 19900 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.113842 19913 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:35.191792 19589 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:35.267135 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:35.207499 19821 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.138554 19939 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:35.229947 19641 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.245164 19950 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:35.245334 19533 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.270035 19859 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.138178 19228 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.276953 19589 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:35.282276 19913 raft_consensus.cc:697] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:35.279017 19900 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.269042 19697 raft_consensus.cc:697] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:35.318358 14399 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:35.294728 19662 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:35.282775 19821 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:35.288407 19664 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.200s	user 0.009s	sys 0.037s
I20260709 13:08:35.285934 19847 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:35.308576 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 89336.5us
I20260709 13:08:35.288884 19533 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:35.332960 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.313987 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:35.308673 13708 raft_consensus.cc:1240] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:08:35.300554 19589 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:35.320246 19138 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.337061 19138 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.337603 19920 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:35.340698 19228 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:35.342144 19138 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:35.145464 19967 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.323261 19899 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.133603 19903 consensus_queue.cc:260] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.320235 19919 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:35.325796 13790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:08:35.327790 13829 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:35.328042 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:35.330680 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:35.288060 19641 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.293180 19732 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:35.345347 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:35.326972 19664 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.237s	user 0.009s	sys 0.037s
I20260709 13:08:35.297219 19859 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.292111 19950 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:35.346974 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:35.360713 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.348869 13788 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:35.350436 14399 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:08:35.353490 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:35.354821 13791 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:08:35.355737 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:35.364121 13789 raft_consensus.cc:2410] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:08:35.347643 19913 consensus_queue.cc:237] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:35.357357 19663 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:35.359069 13713 raft_consensus.cc:1240] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:35.343233 19899 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.373102 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:35.373683 13787 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:35.378024 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:35.378585 14394 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:35.378690 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:35.379383 13791 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:35.386309 13788 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:08:35.335440 19847 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.387873 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:35.359359 19931 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:35.390516 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:08:35.398334 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 70643.1us
W20260709 13:08:35.408761 19974 log.cc:927] Time spent T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:08:35.410578 19870 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:35.411715 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.413899 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:35.394820 19968 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:35.425616 13829 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:35.396731 19697 consensus_queue.cc:237] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.431581 19967 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:35.432894 19687 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:35.433394 19899 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:35.434849 14367 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:35.411266 19870 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.437455 19900 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:35.400046 19920 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:35.438795 19870 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:35.439949 19533 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:35.439653 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:35.403545 19975 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.440828 13716 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:35.441169 19975 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:35.395784 19664 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.442397 19664 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.443964 19942 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.444420 19664 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:35.444607 14394 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:08:35.446130 19942 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:35.448102 13864 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:35.449070 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:35.449512 19641 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:35.450642 19821 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:35.451138 13680 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:35.453756 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:35.445482 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:35.454584 13829 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:35.455516 14396 raft_consensus.cc:2393] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 17: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:35.456943 14394 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:08:35.456027 13782 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:35.458367 14367 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:35.403903 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:35.459723 13788 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 15: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:35.371239 19732 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.452759 13680 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:35.470299 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:35.470731 13680 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:35.471210 13863 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:08:35.472929 13787 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:08:35.486702 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:35.488703 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:35.425726 19847 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:35.422981 19589 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.490111 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:35.489518 13716 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 23.
I20260709 13:08:35.493361 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:35.520989 13862 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 10.
I20260709 13:08:35.485460 13791 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:35.522231 13714 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:35.479508 19899 consensus_queue.cc:1059] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:08:35.544435 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:35.545836 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:35.505360 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:35.547222 13788 raft_consensus.cc:2368] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18.
I20260709 13:08:35.474107 19911 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:35.486200 19821 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:35.493894 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 66510us
I20260709 13:08:35.522272 19931 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:35.477701 19662 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:35.492779 13863 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:35.495668 19687 raft_consensus.cc:3055] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:35.463275 19900 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:35.443323 19975 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:35.439318 19950 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:35.523715 13790 raft_consensus.cc:606] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:35.524197 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:35.587742 13790 raft_consensus.cc:614] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:35.575596 19974 log.cc:927] Time spent T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:08:35.555694 14367 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:35.525358 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:35.555262 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 98116.8us
I20260709 13:08:35.558166 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:35.493626 19831 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:35.576152 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:35.575984 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.582899 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:35.591639 13863 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 23.
W20260709 13:08:35.588436 13829 connection.cc:256] RPC call timeout handler was delayed by -1.0020364020000443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
I20260709 13:08:35.592432 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:35.557730 19533 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:35.581207 19911 raft_consensus.cc:697] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:35.579735 13714 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:35.557891 19821 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.590858 13788 raft_consensus.cc:2376] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15. Re-sending same reply.
I20260709 13:08:35.598299 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:35.593348 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:08:35.598285 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 251129us
I20260709 13:08:35.599761 14367 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:35.605057 19831 raft_consensus.cc:697] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:35.582103 19687 raft_consensus.cc:740] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:35.582377 19662 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:35.609525 13757 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.008s	sys 0.033s
W20260709 13:08:35.609915 13757 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.008s	sys 0.033s
W20260709 13:08:35.610189 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 661197us
I20260709 13:08:35.612004 13787 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:35.598542 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:35.617872 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:35.608805 19821 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:35.620544 19980 log.cc:927] Time spent T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:08:35.621764 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:35.618578 19533 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:35.625608 19533 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:35.626405 19325 consensus_queue.cc:260] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.628167 19732 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:35.628741 19566 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:35.628849 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:35.629192 19566 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.629456 13788 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:35.629585 19566 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:35.630383 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:35.598119 19837 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:35.617654 19662 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:35.632534 19808 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:35.633031 19808 raft_consensus.cc:697] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:35.633404 19733 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:35.634107 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:35.633841 19808 consensus_queue.cc:237] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.634843 19821 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:35.635742 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:35.636407 19630 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:35.636963 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:35.636838 19911 consensus_queue.cc:237] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.638094 19822 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:35.638641 19822 raft_consensus.cc:697] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:35.639487 19822 consensus_queue.cc:237] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.636409 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:35.641208 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:35.641754 13784 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:35.642544 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:35.643107 13784 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:08:35.645347 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:35.645910 13680 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:35.631345 13786 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:35.646579 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:35.631402 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:35.647784 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:35.648893 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:35.589602 19913 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.651362 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:35.644114 13757 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:35.651636 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:35.651986 13787 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:35.647902 13788 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:35.646938 13789 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:08:35.655720 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:35.656050 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:35.648590 19821 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:35.657626 19589 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:35.658003 19986 log.cc:927] Time spent T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:08:35.676781 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:35.677557 14400 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 14: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:35.678464 19931 consensus_queue.cc:1059] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:35.679314 19936 raft_consensus.cc:3055] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:35.679798 19936 raft_consensus.cc:740] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:35.680749 19936 consensus_queue.cc:260] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:35.660629 19662 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.661633 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:35.663195 19857 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:35.651682 19837 raft_consensus.cc:697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:08:35.664947 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.666628 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:35.668910 13789 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.621785 19627 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:35.736805 14395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 1405) took 1761 ms (client timeout 2012 ms). Trace:
I20260709 13:08:35.737222 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:35.738276 13791 raft_consensus.cc:2393] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 16: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:08:35.737216 14395 rpcz_store.cc:269] 0709 13:08:33.965984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.966104 (+   120us) service_pool.cc:224] Handling call
0709 13:08:35.673142 (+1707038us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54006b5154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:35.727615 (+ 54473us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2516492672}
I20260709 13:08:35.739249 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:35.740034 13707 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:35.741175 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.653218 19325 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.670017 13784 raft_consensus.cc:2368] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 16. Current term is 17.
I20260709 13:08:35.683378 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:35.743125 13712 raft_consensus.cc:2393] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 17: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:35.685081 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:35.696518 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 52488.2us
I20260709 13:08:35.706545 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:35.747052 13789 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:35.747733 13786 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:35.749532 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:35.715699 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.678395 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:35.752286 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 2068) took 1179 ms. Trace:
I20260709 13:08:35.667100 19900 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:35.728368 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 43759.2us
I20260709 13:08:35.729575 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:35.756575 13682 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:35.669207 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:35.729072 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.740756 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:35.759184 13711 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:35.752198 14400 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 28.
I20260709 13:08:35.755894 13857 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:35.761372 13714 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:08:35.764467 13786 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:35.758054 13682 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:35.770625 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:35.772405 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.773798 13788 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 16: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:35.774255 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:35.774735 13710 raft_consensus.cc:1240] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 12. Current term is 14. Ops: []
I20260709 13:08:35.774972 13784 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:35.775148 13860 raft_consensus.cc:1240] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:35.730769 19872 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:35.776352 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:35.782047 14395 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:35.727494 19857 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.779775 13786 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 28 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260709 13:08:35.730036 19821 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.780903 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:35.752786 14393 rpcz_store.cc:276] 0709 13:08:34.572610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.439860 (+867250us) service_pool.cc:224] Handling call
0709 13:08:35.440115 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:35.440300 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:08:35.440587 (+   287us) log.cc:844] Serialized 14 byte log entry
0709 13:08:35.751014 (+310427us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:35.751083 (+    69us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:35.751146 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:35.751234 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:35.752215 (+   981us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8840,"prepare.queue_time_us":6530,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":31,"raft.queue_time_us":58242,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":34421,"thread_start_us":301096,"threads_started":2,"wal-append.queue_time_us":154919}
I20260709 13:08:35.793946 13857 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18. Ops: []
W20260709 13:08:35.806681 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 48721.5us
I20260709 13:08:35.807085 13786 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 28 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 27. Current term is 28. Ops: []
I20260709 13:08:35.811108 13786 raft_consensus.cc:1240] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:35.814750 13786 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:35.783519 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:35.822862 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:35.823742 14393 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:35.784154 13860 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:08:35.755964 19730 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.785s	user 0.012s	sys 0.008s
I20260709 13:08:35.816951 13862 raft_consensus.cc:1813] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Handling vote request from an unknown peer 35ecb005831740438d7537dd4b840e03
I20260709 13:08:35.817621 13791 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19. Ops: []
W20260709 13:08:35.832443 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.833072 13862 raft_consensus.cc:2368] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15.
I20260709 13:08:35.770707 19936 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:35.777309 19911 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:35.835215 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:35.837522 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:35.841830 14400 raft_consensus.cc:2410] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:08:35.770309 19138 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:35.838737 13756 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:35.849305 14366 leader_election.cc:336] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.795s (SENT)
I20260709 13:08:35.839506 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:08:35.834528 19730 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.863s	user 0.012s	sys 0.008s
I20260709 13:08:35.840929 13786 raft_consensus.cc:1240] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:35.837903 13682 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:35.843554 13787 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:08:35.856962 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:35.844718 14394 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:35.781523 13789 raft_consensus.cc:1240] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 14. Current term is 15. Ops: [12.11-14.12]
I20260709 13:08:35.848167 13791 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
W20260709 13:08:35.818300 19948 log.cc:927] Time spent T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:08:35.806263 19857 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:35.776769 19900 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.786017 19967 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.673285 19913 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.781859 19872 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.882977 19872 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:35.883296 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.775812 19687 consensus_queue.cc:260] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:35.885412 19687 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:35.839213 13860 raft_consensus.cc:1240] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:35.888741 13860 raft_consensus.cc:1240] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:35.851194 14393 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:35.853463 14366 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:35.890424 20000 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:35.890648 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 69809.2us
I20260709 13:08:35.861168 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:35.893587 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:35.894325 14394 raft_consensus.cc:2393] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 15: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:35.891618 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:35.837374 19228 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:35.897193 19758 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:35.869426 13857 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:35.865533 13682 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:35.899241 13864 raft_consensus.cc:2410] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:08:35.878396 19992 log.cc:927] Time spent T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:08:35.892402 14366 leader_election.cc:400] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18.
I20260709 13:08:35.901773 14366 leader_election.cc:403] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:08:35.858999 19911 raft_consensus.cc:697] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:35.904325 13757 leader_election.cc:400] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15.
I20260709 13:08:35.904647 13757 leader_election.cc:403] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:35.901021 13682 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:08:35.879571 19989 log.cc:927] Time spent T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:08:35.911270 13682 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:35.862411 13786 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:35.902812 14393 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:08:35.819443 19821 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:35.906397 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:35.914023 13862 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:35.975737 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:35.975212 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:35.977689 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:35.978417 14393 raft_consensus.cc:2393] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 16: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:35.976560 14400 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 18: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:35.853535 19990 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:35.849308 19831 consensus_queue.cc:237] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.989109 19821 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:35.908736 19847 consensus_queue.cc:1059] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 13:08:35.997619 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:35.998373 14393 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:35.999526 19982 consensus_queue.cc:1059] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:36.000463 19997 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18.
W20260709 13:08:36.001325 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 218127us
W20260709 13:08:36.003793 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.005250 19662 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:36.005970 19903 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:35.983037 19938 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:36.008412 19938 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.008729 19938 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:36.008652 19900 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:36.016078 14401 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 1411) took 2032 ms (client timeout 2127 ms). Trace:
W20260709 13:08:36.016520 14401 rpcz_store.cc:269] 0709 13:08:33.983470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.983607 (+   137us) service_pool.cc:224] Handling call
0709 13:08:36.015863 (+2032256us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540070eed4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:36.016020 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2395870080}
I20260709 13:08:36.017302 19911 consensus_queue.cc:237] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:36.018893 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:36.019604 14399 raft_consensus.cc:2393] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 16: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:36.020323 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:36.020771 14399 raft_consensus.cc:1813] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Handling vote request from an unknown peer 35ecb005831740438d7537dd4b840e03
I20260709 13:08:36.021201 14399 raft_consensus.cc:2368] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15.
I20260709 13:08:36.021961 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:36.027762 13829 leader_election.cc:400] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11.
I20260709 13:08:36.028129 13829 leader_election.cc:403] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:36.017714 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:35.999356 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:36.033900 14393 raft_consensus.cc:2410] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:08:35.926357 13682 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:35.904724 19442 raft_consensus.cc:2764] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:08:36.046463 13829 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:36.049154 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 156871us
I20260709 13:08:36.048655 13784 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
W20260709 13:08:36.043979 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 117719us
I20260709 13:08:36.051882 13788 raft_consensus.cc:1240] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:36.051750 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:36.054740 13829 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:36.056205 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:36.056792 13682 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:08:35.986461 19974 log.cc:927] Time spent T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:08:36.061597 14366 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:36.056960 14400 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:35.914335 19664 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.853839 19138 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:35.919256 19822 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:08:36.064168 13783 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 3124) took 1996 ms (client timeout 2633 ms). Trace:
I20260709 13:08:36.068346 14401 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:08:35.905061 19967 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:36.070895 14401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 2069) took 1488 ms. Trace:
I20260709 13:08:36.071255 14401 rpcz_store.cc:276] 0709 13:08:34.582644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.048271 (+1465627us) service_pool.cc:224] Handling call
0709 13:08:36.068190 (+ 19919us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:36.070616 (+  2426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.070827 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:36.071453 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 68487.3us
I20260709 13:08:36.073097 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 2071) took 1443 ms. Trace:
I20260709 13:08:36.073567 13756 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:36.068377 13783 rpcz_store.cc:269] 0709 13:08:34.068107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.068253 (+   146us) service_pool.cc:224] Handling call
0709 13:08:36.064002 (+1995749us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b54001b67d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:36.064111 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1835469696}
I20260709 13:08:36.048066 19765 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:35.866303 19837 consensus_queue.cc:237] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:36.058009 19997 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.048364 19821 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:36.042663 19730 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:35.915597 19975 consensus_queue.cc:1059] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.152s
I20260709 13:08:35.913980 19813 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.152s
I20260709 13:08:35.908553 19641 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.152s
I20260709 13:08:36.060026 19589 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:35.916759 19758 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.150s
I20260709 13:08:36.060400 19643 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:36.060685 19627 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 10. Current term is 11.
I20260709 13:08:36.063189 19732 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:36.099514 14399 raft_consensus.cc:2410] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:36.067979 19454 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:36.072520 19867 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:36.049412 19931 consensus_queue.cc:1059] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:08:36.114944 13756 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:36.087947 19990 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.109583 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:36.089865 20000 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:36.118796 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:36.097632 19821 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.174070 19821 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:36.174641 19990 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:36.119930 19975 consensus_queue.cc:1243] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer b5029654a4384e43a68eb67b794949b7 log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:36.176816 19990 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:36.144016 19643 raft_consensus.cc:697] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 15 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:36.150727 19228 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:36.182350 19872 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:36.186087 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 95289.1us
I20260709 13:08:36.151023 19138 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:36.075177 19866 consensus_queue.cc:1059] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
W20260709 13:08:36.157135 20007 log.cc:927] Time spent T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:08:36.145154 19867 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.113832 19919 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
I20260709 13:08:36.198503 19867 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:36.164976 19967 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:36.103137 19997 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:36.096064 19978 consensus_queue.cc:1059] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:08:36.169507 19984 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:36.110147 19730 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:36.182350 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 2991) took 1357 ms. Trace:
I20260709 13:08:36.192147 13755 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:36.108242 19663 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:36.155272 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:36.195967 13707 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:08:36.187955 14401 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:36.180872 19643 consensus_queue.cc:237] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:36.200663 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 121697us
I20260709 13:08:36.115536 19982 consensus_queue.cc:1048] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:08:36.109601 19566 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:36.211393 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:36.195433 19899 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.006s	sys 0.028s
I20260709 13:08:36.193868 19732 raft_consensus.cc:697] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 17 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:36.216631 13858 rpcz_store.cc:276] 0709 13:08:34.824966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.825075 (+   109us) service_pool.cc:224] Handling call
0709 13:08:34.830384 (+  5309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:34.832943 (+  2559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:34.832984 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:34.842205 (+  9221us) log.cc:844] Serialized 26 byte log entry
0709 13:08:35.682706 (+840501us) spinlock_profiling.cc:243] Waited 9.88 ms on lock 0x7b1800475f60. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e0d1 00007f5232499a0f
0709 13:08:36.028048 (+345342us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:36.028106 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.028199 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:36.180991 (+152792us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:36.182140 (+  1149us) raft_consensus.cc:1685] finished
0709 13:08:36.182158 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:36.182286 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7789,"raft.queue_time_us":4691,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":1270,"spinlock_wait_cycles":67582080,"thread_start_us":345123,"threads_started":1,"wal-append.queue_time_us":1302265}
I20260709 13:08:36.221350 14402 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:36.223376 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3139) took 1408 ms. Trace:
I20260709 13:08:36.226361 13785 rpcz_store.cc:276] 0709 13:08:34.814839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.815063 (+   224us) service_pool.cc:224] Handling call
0709 13:08:34.815330 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:34.971467 (+156137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:34.971508 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:34.972575 (+  1067us) log.cc:844] Serialized 26 byte log entry
0709 13:08:35.284060 (+311485us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:35.284117 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.216656 (+932539us) spinlock_profiling.cc:243] Waited 80.8 ms on lock 0x7b540033b654. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:36.216708 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:36.216766 (+    58us) raft_consensus.cc:1685] finished
0709 13:08:36.216781 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:36.223291 (+  6510us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":164788,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"spinlock_wait_cycles":187566080,"thread_start_us":286902,"threads_started":2,"wal-append.queue_time_us":375704}
I20260709 13:08:36.194332 19847 consensus_queue.cc:1059] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:08:36.228262 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:36.230386 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:36.218534 19978 consensus_queue.cc:1243] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer b9d194f45e044e0988d5de1a99e5cd02 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:08:36.231885 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:36.229954 13755 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:36.223058 19899 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.006s	sys 0.028s
I20260709 13:08:36.235584 13784 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:36.203459 14400 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:36.237560 14398 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 24: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:36.250512 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:36.235430 19763 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:36.253786 19763 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:36.255859 19763 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:36.256716 19938 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:36.258827 19938 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:36.233300 19391 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:08:36.264809 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:08:36.246659 19630 consensus_meta.cc:287] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.002s
I20260709 13:08:36.268224 13859 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:36.248471 19663 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:36.282652 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:36.284984 13707 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:08:36.285526 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 136713us
I20260709 13:08:36.265424 19391 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.290661 13830 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:36.267017 19138 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.289310 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:36.269335 19916 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.295002 13708 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:36.296615 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:36.297065 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 62411.8us
I20260709 13:08:36.280813 19663 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.285816 13755 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:36.281149 19866 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.302978 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:36.303638 13860 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:36.305361 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:36.305904 13864 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.298305 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:36.305800 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:36.299980 13858 pending_rounds.cc:85] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 10
I20260709 13:08:36.306634 13860 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 23.
I20260709 13:08:36.307081 13858 pending_rounds.cc:107] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 13:08:36.307559 13858 raft_consensus.cc:2889] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:36.299365 13830 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:36.309633 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:36.312445 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:36.312997 13860 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:36.313256 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:36.292044 19391 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:08:36.295816 19629 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:36.298146 19627 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:36.307837 19663 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:36.318491 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 50971.9us
I20260709 13:08:36.319456 14366 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:36.322139 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:36.322722 13865 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:36.320681 13755 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:36.324936 13755 leader_election.cc:400] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15.
W20260709 13:08:36.328096 20010 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:08:36.328118 20020 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:36.328884 20017 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:36.329520 20017 raft_consensus.cc:697] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 17 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:36.330464 20017 consensus_queue.cc:237] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:36.331789 20021 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:36.335592 20018 consensus_queue.cc:1059] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:36.336627 19630 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:36.336859 20018 raft_consensus.cc:3055] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:36.337452 20018 raft_consensus.cc:740] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:36.338321 20018 consensus_queue.cc:260] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:36.339529 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.339993 19859 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:36.340065 20018 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.342449 14399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1858) took 1589 ms. Trace:
I20260709 13:08:36.342782 14399 rpcz_store.cc:276] 0709 13:08:34.752684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.341726 (+1589042us) service_pool.cc:224] Handling call
0709 13:08:36.342013 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.342164 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:36.342186 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:36.342225 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:36.342256 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.342303 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:36.342400 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:36.347146 14366 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:36.326224 13755 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:36.356637 14366 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:36.339154 19913 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:36.361747 13790 raft_consensus.cc:1275] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:36.369589 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:36.371318 14368 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:36.369799 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:36.372742 13863 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:36.375036 14366 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:36.318447 19627 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.382584 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:36.384747 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:36.302012 19138 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:36.387265 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:36.393275 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:36.393424 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:36.381793 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 55658.4us
I20260709 13:08:36.388900 13864 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:36.394196 13789 raft_consensus.cc:2376] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15. Re-sending same reply.
I20260709 13:08:36.390090 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:36.395243 13782 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 15: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:36.312930 19866 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:36.390306 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:36.398173 13860 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:36.395763 14366 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:36.353579 19629 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.306672 19916 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:36.390456 13862 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:36.399816 14368 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:36.401166 13786 raft_consensus.cc:2368] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19.
I20260709 13:08:36.291338 19732 consensus_queue.cc:237] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:36.363680 20013 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:36.404320 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:36.407835 13789 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 15: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:36.404413 13863 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:36.378010 19899 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:36.378266 19808 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:36.384785 19900 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:36.385353 19627 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.406873 13829 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:36.435597 13865 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:08:36.380437 20021 raft_consensus.cc:697] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:36.405653 19629 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:36.397863 19982 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:36.407079 19730 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:36.410702 20013 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:36.437129 19857 consensus_meta.cc:287] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.003s
I20260709 13:08:36.406944 19566 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:36.404363 19970 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:36.465454 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 58683.4us
I20260709 13:08:36.466666 13829 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:36.443975 20000 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:36.438544 19900 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:36.447707 19872 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:36.449223 19982 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:36.483469 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 83776.6us
W20260709 13:08:36.488457 20027 log.cc:927] Time spent T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:08:36.489490 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:36.489898 19821 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:36.490726 13829 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:36.491596 19913 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:36.492355 19913 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:36.492698 19913 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:36.493121 19913 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:36.495952 20016 log.cc:927] Time spent T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:08:36.453540 20013 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:36.495858 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1857) took 1746 ms. Trace:
I20260709 13:08:36.500159 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:36.467595 19808 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:36.500128 14402 rpcz_store.cc:276] 0709 13:08:34.749416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.278605 (+1529189us) service_pool.cc:224] Handling call
0709 13:08:36.289962 (+ 11357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:36.301371 (+ 11409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:36.301417 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:36.307886 (+  6469us) log.cc:844] Serialized 26 byte log entry
0709 13:08:36.443714 (+135828us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:36.443753 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.443823 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:36.495597 (+ 51774us) raft_consensus.cc:1685] finished
0709 13:08:36.495628 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:36.495775 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6149,"raft.queue_time_us":8725,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":5759,"thread_start_us":121708,"threads_started":1,"wal-append.queue_time_us":177687}
I20260709 13:08:36.467149 19970 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:36.492699 19765 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:36.504477 13829 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:36.483253 19566 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:36.481101 19900 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:36.514295 19643 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:36.484201 19982 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.464596 19857 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:36.535630 19857 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:36.475582 20025 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:36.537343 20025 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:36.537742 20025 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:36.538460 19903 consensus_meta.cc:287] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.000s
I20260709 13:08:36.539155 14397 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:36.540174 13716 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
W20260709 13:08:36.540962 14397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 1420) took 2003 ms (client timeout 2194 ms). Trace:
W20260709 13:08:36.541349 14397 rpcz_store.cc:269] 0709 13:08:34.537734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.544388 (+  6654us) service_pool.cc:224] Handling call
0709 13:08:36.540771 (+1996383us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b54008c41d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:36.540895 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4578959232}
I20260709 13:08:36.542878 14397 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:36.520095 20015 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:36.545902 20015 raft_consensus.cc:697] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:36.547037 14400 raft_consensus.cc:1240] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:36.546741 20015 consensus_queue.cc:237] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:36.547672 14400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1864) took 1573 ms. Trace:
I20260709 13:08:36.548127 19138 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:36.549861 19664 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15.
I20260709 13:08:36.549906 14398 raft_consensus.cc:3055] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:36.518250 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:36.501989 20024 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.560006 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 1420) took 1130 ms. Trace:
I20260709 13:08:36.560386 13788 rpcz_store.cc:276] 0709 13:08:35.429304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.809118 (+379814us) service_pool.cc:224] Handling call
0709 13:08:36.051664 (+242546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.052390 (+   726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.559820 (+507430us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54003bc750. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:36.559949 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491926912}
I20260709 13:08:36.562206 20025 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:36.563179 19997 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:36.568140 19971 raft_consensus.cc:3055] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:36.568559 19971 raft_consensus.cc:740] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:36.569640 14399 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:36.569355 19971 consensus_queue.cc:260] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:36.570236 14399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1872) took 1288 ms. Trace:
I20260709 13:08:36.570350 19971 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:36.571000 20025 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:36.571743 19857 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:36.572299 19857 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:36.573351 13859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 3000) took 1126 ms. Trace:
I20260709 13:08:36.573702 13859 rpcz_store.cc:276] 0709 13:08:35.447216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.448846 (+  1630us) service_pool.cc:224] Handling call
0709 13:08:36.573214 (+1124368us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b5400235354. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:36.573301 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1882429696}
I20260709 13:08:36.550514 19566 raft_consensus.cc:697] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:36.575194 19566 consensus_queue.cc:237] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:36.575598 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:36.576119 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.576349 13713 raft_consensus.cc:2393] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 14: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:36.577936 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:36.580071 13710 raft_consensus.cc:1275] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:36.583134 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:36.523663 20021 consensus_queue.cc:237] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:36.528606 19916 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:36.583735 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:36.529765 20011 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.269s	user 0.002s	sys 0.000s
I20260709 13:08:36.531118 19228 raft_consensus.cc:3055] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:36.532207 19866 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:36.533016 14395 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:36.551229 14398 raft_consensus.cc:740] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:36.551709 14402 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:36.594115 14395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1859) took 1840 ms. Trace:
I20260709 13:08:36.570391 19627 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:36.594532 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:36.594446 14395 rpcz_store.cc:276] 0709 13:08:34.753463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.532321 (+1778858us) service_pool.cc:224] Handling call
0709 13:08:36.532620 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.593137 (+ 60517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.594061 (+   924us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:36.595233 13708 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:36.552407 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1860) took 1756 ms. Trace:
I20260709 13:08:36.548017 14400 rpcz_store.cc:276] 0709 13:08:34.973813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.546597 (+1572784us) service_pool.cc:224] Handling call
0709 13:08:36.546885 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.547400 (+   515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.547627 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:36.554031 19629 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:36.517736 19765 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.556399 19589 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:36.520351 19808 raft_consensus.cc:697] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:08:36.557197 20012 log.cc:927] Time spent T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
I20260709 13:08:36.607918 14398 consensus_queue.cc:260] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:36.574262 19857 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:36.521907 20022 log.cc:927] Time spent T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:08:36.584295 13712 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:36.526156 19970 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:36.584643 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:36.657935 13714 raft_consensus.cc:2410] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:36.570583 14399 rpcz_store.cc:276] 0709 13:08:35.281628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.568999 (+1287371us) service_pool.cc:224] Handling call
0709 13:08:36.569314 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.570018 (+   704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.570189 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:36.590526 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:36.658792 13863 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:36.658919 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:36.592307 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:36.659716 13713 raft_consensus.cc:1813] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Handling vote request from an unknown peer 35ecb005831740438d7537dd4b840e03
I20260709 13:08:36.660372 13713 raft_consensus.cc:2368] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15.
I20260709 13:08:36.661172 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:36.661710 13713 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:36.596287 14397 rpcz_store.cc:276] 0709 13:08:34.787013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.542209 (+1755196us) service_pool.cc:224] Handling call
0709 13:08:36.542526 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.543203 (+   677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.543370 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:36.598448 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:36.663723 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:36.518958 19942 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.601330 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:36.665643 13865 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:36.603191 13716 raft_consensus.cc:1275] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:36.551108 19933 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.607064 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:36.610461 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:36.667186 13709 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:36.610461 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:36.611589 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:36.596659 19228 raft_consensus.cc:740] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:36.631659 14398 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:36.634908 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:36.670574 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.633819 13755 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:36.639529 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:36.672574 13712 raft_consensus.cc:2393] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 14: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:36.643959 14394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1856) took 1897 ms. Trace:
I20260709 13:08:36.676479 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:36.677227 13785 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:36.679848 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:36.556685 19982 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:36.654699 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.691037 13789 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:08:36.655870 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 279232us
I20260709 13:08:36.692157 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:36.692382 14366 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:36.571660 20025 consensus_queue.cc:1059] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:36.584039 14396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 1867) took 1430 ms. Trace:
I20260709 13:08:36.664402 13714 raft_consensus.cc:2393] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 19: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:36.666446 14399 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:36.703680 14399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 2077) took 1257 ms. Trace:
I20260709 13:08:36.704147 14399 rpcz_store.cc:276] 0709 13:08:35.446486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.665860 (+1219374us) service_pool.cc:224] Handling call
0709 13:08:36.666145 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.703323 (+ 37178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.703608 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:36.697103 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:36.705503 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:36.706209 14399 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:36.668220 13858 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:36.669113 13682 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:36.668315 13715 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:36.708145 13715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 3281) took 1064 ms. Trace:
I20260709 13:08:36.683936 13791 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:36.685562 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:36.709868 13784 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:36.673012 14394 rpcz_store.cc:276] 0709 13:08:34.746804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.268960 (+1522156us) service_pool.cc:224] Handling call
0709 13:08:36.276170 (+  7210us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:36.286709 (+ 10539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:36.286754 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:36.295388 (+  8634us) log.cc:844] Serialized 52 byte log entry
0709 13:08:36.372539 (+ 77151us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:36.449307 (+ 76768us) log.cc:844] Serialized 14 byte log entry
0709 13:08:36.643570 (+194263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.643648 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:36.643708 (+    60us) raft_consensus.cc:1685] finished
0709 13:08:36.643728 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:36.643910 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7934,"prepare.queue_time_us":148501,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":78831,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":46122,"thread_start_us":304306,"threads_started":3,"wal-append.queue_time_us":206898}
I20260709 13:08:36.659693 19821 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:36.694182 13709 raft_consensus.cc:1240] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:08:36.708578 13715 rpcz_store.cc:276] 0709 13:08:35.643611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.591814 (+948203us) service_pool.cc:224] Handling call
0709 13:08:36.708067 (+116253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:36.695297 14366 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:36.695603 13783 raft_consensus.cc:1275] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:36.662847 19589 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.602770 19867 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:36.632687 19919 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:08:36.705528 13788 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:36.731676 13708 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:08:36.720464 13756 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:36.702968 14396 rpcz_store.cc:276] 0709 13:08:35.153890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.252339 (+ 98449us) service_pool.cc:224] Handling call
0709 13:08:36.583872 (+1331533us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b540068a1d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:36.583986 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396980992}
I20260709 13:08:36.723999 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:36.743579 14394 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:36.716812 13857 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:36.724901 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:36.728760 13784 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:08:36.686417 19970 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:36.749775 13756 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:36.752717 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 57496.3us
I20260709 13:08:36.754158 14366 leader_election.cc:400] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 16. Current term is 17.
I20260709 13:08:36.754441 14366 leader_election.cc:403] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:36.756213 13713 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
W20260709 13:08:36.724682 19931 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.024s	sys 0.051s
I20260709 13:08:36.698788 19629 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:36.795028 14366 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:36.795156 14396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1873) took 1168 ms. Trace:
I20260709 13:08:36.798827 14396 rpcz_store.cc:276] 0709 13:08:35.627155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.743257 (+1116102us) service_pool.cc:224] Handling call
0709 13:08:36.794646 (+ 51389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.794823 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:36.794850 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:36.794903 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:36.794932 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.794984 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:36.795096 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:36.770171 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:36.800135 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 50490us
I20260709 13:08:36.801328 13756 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:36.682173 19942 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:36.732090 19697 raft_consensus.cc:3055] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:36.807363 14399 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:08:36.686554 19933 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:36.811400 14394 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:08:36.814949 13756 leader_election.cc:400] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15.
I20260709 13:08:36.823935 13756 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:36.815959 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 146941us
I20260709 13:08:36.819869 14396 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 28 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260709 13:08:36.820703 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1866) took 1667 ms. Trace:
I20260709 13:08:36.753084 19970 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:36.795214 19931 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.024s	sys 0.052s
I20260709 13:08:36.798074 19325 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:36.833784 14398 rpcz_store.cc:276] 0709 13:08:35.153472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.549429 (+1395957us) service_pool.cc:224] Handling call
0709 13:08:36.549741 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.820305 (+270564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:36.820337 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:36.820376 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:36.820408 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.820492 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:36.820633 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77746,"raft.queue_time_us":82491}
I20260709 13:08:36.758916 19990 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.833263 14396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1875) took 1205 ms. Trace:
I20260709 13:08:36.854264 14396 rpcz_store.cc:276] 0709 13:08:35.627723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.800041 (+1172318us) service_pool.cc:224] Handling call
0709 13:08:36.819573 (+ 19532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.833027 (+ 13454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.833215 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:36.830782 13756 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:36.763662 20025 raft_consensus.cc:3055] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:36.764568 19821 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.835667 20020 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:36.838971 19950 raft_consensus.cc:3055] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:36.872982 13858 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 11.
I20260709 13:08:36.840184 20034 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:36.847761 14368 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:36.824980 19872 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:36.848562 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:36.881547 13862 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:36.073632 14393 rpcz_store.cc:276] 0709 13:08:34.629638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.050767 (+1421129us) service_pool.cc:224] Handling call
0709 13:08:36.051162 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.064219 (+ 13057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:36.064264 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:36.064317 (+    53us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:36.072753 (+  8436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.072859 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:36.073022 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7535,"raft.queue_time_us":12990,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":8843}
I20260709 13:08:36.849265 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:36.849943 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:36.851962 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.852626 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:36.852875 14397 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:36.732661 19968 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 13:08:36.812093 19662 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 16. Current term is 17.
I20260709 13:08:36.863857 13857 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:36.887115 14396 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:36.757680 20035 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.861474 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 1433) took 1041 ms. Trace:
I20260709 13:08:36.864594 13680 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:36.836982 19325 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.751928 19589 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:36.833844 19391 consensus_meta.cc:287] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.003s
I20260709 13:08:36.816665 19697 raft_consensus.cc:740] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:36.874784 13682 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:36.877475 19950 raft_consensus.cc:740] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:36.877399 19821 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:36.883193 19872 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.834403 19913 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:36.880511 20033 consensus_queue.cc:1059] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 13:08:36.794121 19952 consensus_queue.cc:1059] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 13:08:36.818241 20014 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:36.910012 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:36.940547 13791 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
W20260709 13:08:36.889914 20018 consensus_meta.cc:287] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.549s	user 0.000s	sys 0.010s
I20260709 13:08:36.889955 20020 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:36.879595 14368 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:36.848429 20015 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.838251 19970 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.888055 14398 rpcz_store.cc:276] 0709 13:08:35.819830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.860611 (+1040781us) service_pool.cc:224] Handling call
0709 13:08:36.860898 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.861079 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:36.861110 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:36.861153 (+    43us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:36.861181 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.861243 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:36.861397 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:36.870393 13788 raft_consensus.cc:2410] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:08:36.755064 19808 consensus_queue.cc:237] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:36.866312 20025 raft_consensus.cc:740] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:36.889240 13829 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:36.975344 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 86164.9us
I20260709 13:08:36.975757 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:36.892463 19627 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:36.895617 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:36.919061 19663 consensus_meta.cc:287] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.566s	user 0.007s	sys 0.000s
I20260709 13:08:36.896585 13783 raft_consensus.cc:1275] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:36.897260 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:36.982223 13789 raft_consensus.cc:2393] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 14: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:36.898216 13785 raft_consensus.cc:3055] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:36.982692 13785 raft_consensus.cc:740] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:36.877096 19629 consensus_queue.cc:1059] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:08:36.815850 19228 consensus_queue.cc:260] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:36.938706 13865 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:08:36.941737 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 67076.8us
I20260709 13:08:36.889644 19566 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:36.941725 14393 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:36.920336 19867 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:36.968470 19442 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:36.769870 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.933534 14396 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:36.949415 13864 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:08:37.015466 19866 consensus_queue.cc:1059] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 13:08:37.068341 19866 consensus_queue.cc:1243] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Peer b5029654a4384e43a68eb67b794949b7 log is divergent from this leader: its last log entry 16.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:08:37.057560 20020 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:08:37.069685 19933 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:36.951443 13863 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:08:36.963243 13862 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 24.
I20260709 13:08:36.892311 19325 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:36.939783 20019 log.cc:927] Time spent T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.476s	user 0.000s	sys 0.002s
I20260709 13:08:36.976632 13829 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:36.892908 13680 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:36.893154 19931 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:36.937736 20044 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:36.983577 13785 consensus_queue.cc:260] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:36.950525 19872 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:37.007635 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:36.910208 19589 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:36.913246 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:37.014916 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 135425us
I20260709 13:08:36.913051 19900 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.113339 13785 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:37.113831 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:36.915508 19391 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:37.055171 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 199086us
I20260709 13:08:37.075132 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:37.116014 14366 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:37.116243 13863 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:37.083931 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 107390us
I20260709 13:08:37.117059 19391 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 29 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:37.119972 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:37.120347 14368 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:37.085371 13862 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 16. Ops: [14.8-14.8]
I20260709 13:08:37.016992 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:37.122150 13858 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:37.089727 13857 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
W20260709 13:08:37.090019 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 197183us
I20260709 13:08:37.123709 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:37.090849 13713 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:08:37.051848 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:37.125063 13860 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 24: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:08:37.036098 20038 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:08:37.079173 13864 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:08:37.049817 19990 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:37.052955 19936 raft_consensus.cc:3055] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:36.967646 19730 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.110s
I20260709 13:08:37.053211 20034 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:37.037670 19913 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:37.009152 19919 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:37.130548 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:37.054383 20024 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:37.051007 20035 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:37.132660 13680 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:37.133446 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:37.036514 19967 raft_consensus.cc:3055] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:37.036599 19566 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:37.135691 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.130120 20043 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:08:37.223285 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 392574us
I20260709 13:08:37.042274 19821 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:37.040697 19982 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:37.140064 13757 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:08:37.227948 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 87978.9us
I20260709 13:08:37.141952 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:37.137627 19936 raft_consensus.cc:740] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:37.146929 14399 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:36.977234 20015 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:37.089238 19442 raft_consensus.cc:697] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:37.007110 20013 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.128042 20014 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.012152 19732 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.130s
I20260709 13:08:37.138434 19952 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:08:37.137923 19933 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:37.040359 19942 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:37.132310 19589 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:37.222868 13863 raft_consensus.cc:1240] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:37.138311 14366 leader_election.cc:304] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:37.089324 19916 consensus_queue.cc:1048] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
W20260709 13:08:37.224726 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 92142.3us
I20260709 13:08:37.009855 19663 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.226557 13785 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:08:37.331135 13785 pending_rounds.cc:85] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 10
I20260709 13:08:37.331385 13785 pending_rounds.cc:107] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:08:37.331677 13785 raft_consensus.cc:2889] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:37.228230 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:37.332729 14393 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:08:37.228717 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:37.232436 13858 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:08:37.138912 13755 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:37.334659 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 195814us
I20260709 13:08:37.130237 20033 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.095s
I20260709 13:08:37.242319 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3157) took 1599 ms. Trace:
I20260709 13:08:37.138921 20018 consensus_queue.cc:1059] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:08:37.159042 20034 raft_consensus.cc:697] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:37.225441 19566 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:37.162531 19967 raft_consensus.cc:740] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:08:37.222548 19533 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.004s	sys 0.025s
I20260709 13:08:37.036834 19697 consensus_queue.cc:260] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.154672 19391 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 13:08:37.230495 19837 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:37.374598 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:37.223834 20043 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:37.225733 20045 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:37.238406 19990 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:37.299268 14394 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:37.338376 19933 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:37.301707 19662 raft_consensus.cc:3055] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:37.305550 19950 consensus_queue.cc:260] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.308487 14399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1878) took 1680 ms. Trace:
I20260709 13:08:37.385594 14399 rpcz_store.cc:276] 0709 13:08:35.628529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.817814 (+1189285us) service_pool.cc:224] Handling call
0709 13:08:36.818203 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.231006 (+412803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.308195 (+ 77189us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b5400943ed4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:37.308403 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":755444096}
I20260709 13:08:37.250718 19589 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.310940 20013 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:37.311597 19442 consensus_queue.cc:237] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.312156 13856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59764 (request call id 100) took 1023 ms. Trace:
I20260709 13:08:37.402197 13856 rpcz_store.cc:276] 0709 13:08:36.288960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.289099 (+   139us) service_pool.cc:224] Handling call
0709 13:08:37.311862 (+1022763us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b54002fb2d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e4735 00007f52324dc9fa 00007f52374a44c9 00007f5230a20c54 00007f5230a20be2 00007f5230a20b11 00007f5230a20a8c 00007f5230a1fd42 00007f523081948c 00007f52308188c6
0709 13:08:37.312050 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":752036096}
W20260709 13:08:37.313083 20042 log.cc:927] Time spent T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:37.249423 20014 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:37.316123 20036 log.cc:927] Time spent T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:08:37.347496 19821 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 17, Time since last communication: 0.043s
I20260709 13:08:37.324195 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:37.409291 13857 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:37.322477 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 2076) took 1876 ms. Trace:
I20260709 13:08:37.410204 14402 rpcz_store.cc:276] 0709 13:08:35.446224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.607792 (+1161568us) service_pool.cc:224] Handling call
0709 13:08:36.633586 (+ 25794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.633827 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:36.673500 (+ 39673us) log.cc:844] Serialized 14 byte log entry
0709 13:08:36.941290 (+267790us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b180029c440. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e23a 00007f52324e8a2a
0709 13:08:37.322069 (+380779us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:37.322135 (+    66us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:37.322197 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.322278 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:37.322414 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":443,"prepare.queue_time_us":35754,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":3447,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":1774,"spinlock_wait_cycles":24398720,"thread_start_us":379995,"threads_started":1}
I20260709 13:08:37.414613 13789 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 18. Current term is 19. Ops: [16.9-18.10]
I20260709 13:08:37.152685 19664 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 13:08:37.320902 19952 raft_consensus.cc:697] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 24 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:37.402362 19589 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:37.336932 13757 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:37.419118 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 82265.3us
I20260709 13:08:37.419698 14368 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:37.338156 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 199899us
I20260709 13:08:37.343199 19936 consensus_queue.cc:260] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.326850 19982 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.345281 13680 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:37.353493 14393 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 29.
I20260709 13:08:37.378324 13865 raft_consensus.cc:1240] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 17 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 16. Current term is 17. Ops: []
W20260709 13:08:37.379081 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:37.347769 19454 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
W20260709 13:08:37.300432 19765 consensus_meta.cc:287] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.000s
I20260709 13:08:37.380717 13710 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:37.344044 19687 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:08:37.373260 19533 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.004s	sys 0.032s
I20260709 13:08:37.353837 20021 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.398427 20045 raft_consensus.cc:697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:37.380959 20043 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.319643 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:37.380625 19990 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:37.408390 13785 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:37.398648 19837 raft_consensus.cc:697] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:37.330684 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:37.385197 19662 raft_consensus.cc:740] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:37.339375 13787 rpcz_store.cc:276] 0709 13:08:35.642896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.857198 (+214302us) service_pool.cc:224] Handling call
0709 13:08:35.857514 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:36.061062 (+203548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:36.061106 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:36.069647 (+  8541us) log.cc:844] Serialized 26 byte log entry
0709 13:08:36.314790 (+245143us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:36.314829 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.498074 (+183245us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400161f54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:36.498125 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:36.939240 (+441115us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:37.242038 (+302798us) raft_consensus.cc:1685] finished
0709 13:08:37.242066 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:37.242237 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":469883904,"thread_start_us":170653,"threads_started":1,"wal-append.queue_time_us":284379}
I20260709 13:08:37.406379 19916 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:37.403527 19933 raft_consensus.cc:697] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 15 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:37.406054 20047 raft_consensus.cc:3055] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:37.422433 14366 leader_election.cc:400] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19.
I20260709 13:08:37.496858 14366 leader_election.cc:403] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 13:08:37.430101 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 84918.8us
I20260709 13:08:37.405799 19763 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:08:37.407662 20024 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:37.434386 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:37.435439 19857 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:37.436137 19982 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.432168 20034 consensus_queue.cc:237] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:37.447964 20048 log.cc:927] Time spent T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:08:37.456190 20045 consensus_queue.cc:237] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.430065 19942 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.422845 20013 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.423151 20000 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:37.476645 13864 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:37.432551 20015 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:37.437326 19808 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:37.464805 13682 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:37.499042 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:37.445186 19687 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.503386 13789 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:08:37.466495 20021 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:37.557045 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 92339.6us
W20260709 13:08:37.506664 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 84348.8us
I20260709 13:08:37.499862 19916 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.482925 19990 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:37.520804 13679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.005s	sys 0.012s
I20260709 13:08:37.534144 14368 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:37.496706 20047 raft_consensus.cc:740] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:37.571322 20057 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:37.571938 20057 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.572306 20057 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:37.572240 20047 consensus_queue.cc:260] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:37.573942 20047 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:08:37.540719 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 462785us
W20260709 13:08:37.576859 19970 consensus_meta.cc:287] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.569s	user 0.009s	sys 0.000s
I20260709 13:08:37.577284 19970 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.578645 13713 raft_consensus.cc:1275] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:37.579564 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:37.579689 13601 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 536b1fc131984687bf3b13417507e21d with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b5029654a4384e43a68eb67b794949b7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:37.581247 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:37.581837 13709 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 12.
I20260709 13:08:37.583070 13708 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:37.584769 20021 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:37.585736 19916 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:37.545028 19942 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.587927 19942 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:37.551733 19808 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.588608 19808 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.594219 19982 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:37.431941 19967 consensus_queue.cc:260] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:37.595440 19967 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:37.599471 19970 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:37.600294 19228 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:37.601930 19589 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.608181 20057 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.610467 20057 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:37.611678 19663 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:37.611871 19808 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.612336 19662 consensus_queue.cc:260] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.613580 19662 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:37.613924 19808 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:37.615489 19837 consensus_queue.cc:237] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:37.619560 19936 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.562731 19687 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:37.513422 20033 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19.
I20260709 13:08:37.449292 19765 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:37.568797 13679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.005s	sys 0.013s
W20260709 13:08:37.565758 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 67116.8us
I20260709 13:08:37.533669 20024 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:37.571002 19629 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:37.551334 20013 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.615949 19589 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:37.488025 19758 consensus_queue.cc:1059] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:08:37.525487 19857 raft_consensus.cc:697] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:08:37.653188 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 71482.7us
I20260709 13:08:37.529292 19664 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:37.560977 14366 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:37.655937 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:37.677919 13713 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:37.679179 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:37.681202 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:37.681315 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:37.682129 13864 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:37.683969 13680 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:37.658432 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:37.687322 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 126448us
I20260709 13:08:37.688251 13712 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 24: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:37.688285 14366 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:08:37.690448 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.657446 13708 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:37.692215 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:37.693099 13709 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:37.694924 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:37.696707 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:37.692262 13830 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:37.641718 19533 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:37.706837 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:37.530187 19325 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.703258 13716 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:37.657584 19629 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.607474 19933 consensus_queue.cc:237] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.689459 13757 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:37.746400 13709 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:08:37.687152 20044 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.735867 19533 raft_consensus.cc:697] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:37.711779 19763 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:08:37.556201 20000 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.712201 20066 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:37.711608 19872 consensus_meta.cc:287] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.000s
I20260709 13:08:37.711050 19629 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:37.717425 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:37.785339 13708 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:37.700736 19916 consensus_queue.cc:1048] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:08:37.544922 19952 consensus_queue.cc:237] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.739349 13707 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:37.698755 19808 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.736625 13712 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 16: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:37.693708 19589 consensus_queue.cc:1059] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:08:37.693912 20033 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:37.820526 20075 consensus_queue.cc:1059] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:37.820827 13829 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:37.746158 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:37.746791 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:37.709669 13713 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:37.824689 20000 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:37.746840 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 57475.7us
I20260709 13:08:37.696373 19971 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.826853 19971 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.828986 19971 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:37.748996 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:37.750370 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:37.830819 14401 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 17: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:37.703789 19942 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:37.782668 20014 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:37.706418 19664 raft_consensus.cc:697] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 19 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:37.757923 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:37.759424 14400 raft_consensus.cc:1240] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:37.832827 19325 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:37.832552 19664 consensus_queue.cc:237] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.832923 19990 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:37.762365 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:37.835954 14396 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
W20260709 13:08:37.838016 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.766993 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:37.772300 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:37.839741 14398 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:37.753916 19663 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:37.728281 19857 consensus_queue.cc:237] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.777827 20044 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:37.792719 20065 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:37.792747 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:37.835871 19765 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:37.856873 13829 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:37.784380 20066 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.765837 20013 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:37.804315 20064 log.cc:927] Time spent T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:37.805197 19872 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:37.806003 13711 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
W20260709 13:08:37.810354 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.816653 13755 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:37.817138 13864 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:37.817735 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:37.863978 13859 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:37.865607 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:37.866814 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:37.867933 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:37.870676 13707 raft_consensus.cc:2393] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 18: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:37.871778 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:37.872339 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:37.873095 14402 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:37.826363 20000 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.751350 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:37.892309 13829 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:37.841138 13709 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:37.843137 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:37.844558 13857 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:37.844775 19663 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.846601 20024 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:37.848803 19533 consensus_queue.cc:237] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:37.854497 14398 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:37.834935 19990 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:37.890931 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 74384.6us
I20260709 13:08:37.897941 14395 raft_consensus.cc:2368] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15.
I20260709 13:08:37.900790 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:37.844529 20043 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:37.860288 20015 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:37.856174 20065 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:37.860003 20066 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:37.912958 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:37.919430 14398 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:37.839618 19808 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.923919 13829 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:37.916990 13864 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:37.844661 19566 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.900707 19936 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:37.933929 13859 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:37.935434 13709 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:37.936457 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:37.912768 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 228896us
I20260709 13:08:37.901360 19663 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:37.901361 19971 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:08:37.917217 20065 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:37.941573 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.942085 13716 raft_consensus.cc:1240] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:37.942699 13755 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:37.912250 19730 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:37.939873 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.948755 14393 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:37.952016 14397 raft_consensus.cc:1240] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 13:08:37.938896 20072 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:08:37.954828 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:37.950486 13682 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:37.900574 19913 consensus_queue.cc:1048] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:08:37.955683 13709 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.960680 13829 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:37.936180 19765 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:37.967124 13709 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:37.901130 20000 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.956636 14367 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:37.938855 19919 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:37.936784 19662 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.972520 19919 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:37.972584 19662 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:37.975353 19662 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:37.981992 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:37.984097 14367 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:37.954581 19454 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:37.948215 20024 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:08:37.962442 19971 raft_consensus.cc:697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 29 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:37.990033 14367 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:37.947479 19732 consensus_queue.cc:1059] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:08:37.954507 19866 consensus_queue.cc:1059] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:08:37.981608 19627 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:37.963054 19730 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:37.986912 19454 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.014753 19964 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:37.991773 19662 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:38.016295 20081 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:38.039820 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.018206 19866 raft_consensus.cc:3055] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:38.019719 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:38.014096 20073 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:08:38.022243 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 61637.3us
W20260709 13:08:38.047931 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 80314us
I20260709 13:08:38.048223 13829 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:38.024916 14367 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:37.989923 20083 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:38.000784 20013 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:08:38.000890 19933 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:37.985495 19687 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.049100 13680 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:38.029724 19454 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:38.042235 19866 raft_consensus.cc:740] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:38.032790 19662 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:38.003371 19942 consensus_queue.cc:1059] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:08:38.024319 20079 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:38.002755 19442 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:08:38.082996 19662 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:38.032308 20033 consensus_queue.cc:1059] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:08:38.085482 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:38.096030 13856 raft_consensus.cc:2410] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:08:38.056350 19913 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:38.091701 13857 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:38.053941 19627 consensus_queue.cc:1059] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:08:38.101894 19808 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:38.102552 19627 raft_consensus.cc:3055] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:38.102905 19627 raft_consensus.cc:740] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:38.103377 19687 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:38.103847 19730 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:38.104153 20093 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:38.104516 20043 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:38.105106 20043 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:38.105597 20043 raft_consensus.cc:697] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:38.106420 20043 consensus_queue.cc:237] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:38.107388 19866 consensus_queue.cc:260] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:38.107978 20000 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:38.108628 19866 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:38.045567 20081 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.064517 20044 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:38.113906 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:38.093111 20083 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:38.135465 20083 raft_consensus.cc:697] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 15 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:38.116932 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:38.117034 14402 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:38.083907 19629 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.094652 19971 consensus_queue.cc:237] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.19, Last appended by leader: 19, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.098937 19942 consensus_queue.cc:1243] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Peer b9d194f45e044e0988d5de1a99e5cd02 log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:08:38.094911 19872 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:38.131495 19566 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:38.115581 20033 consensus_queue.cc:1243] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer b9d194f45e044e0988d5de1a99e5cd02 log is divergent from this leader: its last log entry 15.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:08:38.133728 19138 raft_consensus.cc:3055] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:38.138420 14398 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:38.139946 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 75020.4us
I20260709 13:08:38.143127 13755 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:38.099661 19913 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:38.171135 13680 connection.cc:256] RPC call timeout handler was delayed by -1.331960740999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
I20260709 13:08:38.135643 19627 consensus_queue.cc:260] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.176754 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:38.177261 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:38.174397 13784 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:38.177410 13789 raft_consensus.cc:1240] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:38.177762 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:38.190213 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.183116 14402 raft_consensus.cc:1275] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:38.191162 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:38.166554 19138 raft_consensus.cc:740] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:38.193063 13783 raft_consensus.cc:2410] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:38.193720 13788 raft_consensus.cc:1240] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:38.196164 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:38.196880 14402 raft_consensus.cc:2393] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 16: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:38.196807 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:38.190114 14398 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:38.197667 13782 raft_consensus.cc:2410] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:08:38.148173 19663 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.202973 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:38.203714 14402 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 16: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:38.204233 14395 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:38.171518 20079 raft_consensus.cc:697] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:38.175761 19913 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:38.177948 19936 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:38.177953 19664 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:38.211119 20079 consensus_queue.cc:237] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.212860 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:38.213709 13856 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 17: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:38.214534 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:38.216786 20081 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:38.221609 13755 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:38.221532 14368 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:38.224443 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:38.225595 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:38.226126 13858 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:38.226945 19942 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:08:38.231073 20074 log.cc:927] Time spent T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.404s	user 0.000s	sys 0.001s
I20260709 13:08:38.206647 20083 consensus_queue.cc:237] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.233774 13829 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:38.242799 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:38.235729 13858 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:38.256240 13829 leader_election.cc:400] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15.
I20260709 13:08:38.256616 13829 leader_election.cc:403] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:38.259728 19765 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:38.262121 19758 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:38.217600 19900 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:38.262375 19765 raft_consensus.cc:697] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:38.264801 13680 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:38.266036 14394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 1423) took 2498 ms. Trace:
I20260709 13:08:38.268754 19662 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.271782 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3750) took 1233 ms. Trace:
I20260709 13:08:38.273159 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 2091) took 1052 ms. Trace:
I20260709 13:08:38.277088 13863 rpcz_store.cc:276] 0709 13:08:37.038551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.117161 (+ 78610us) service_pool.cc:224] Handling call
0709 13:08:37.117506 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.331407 (+213901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.271546 (+940139us) spinlock_profiling.cc:243] Waited 46 ms on lock 0x7b54000d02d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:38.271725 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105747712}
I20260709 13:08:38.277431 14397 rpcz_store.cc:276] 0709 13:08:37.220688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.227211 (+  6523us) service_pool.cc:224] Handling call
0709 13:08:37.246552 (+ 19341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:37.952416 (+705864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.272931 (+320515us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b540070e254. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:38.273105 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1621887744}
I20260709 13:08:38.276412 14394 rpcz_store.cc:276] 0709 13:08:35.767511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.822987 (+1055476us) service_pool.cc:224] Handling call
0709 13:08:36.825014 (+  2027us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.380811 (+555797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.265798 (+884987us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b54006b5154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:38.265958 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1090213632}
I20260709 13:08:38.272607 19629 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:38.235039 19664 raft_consensus.cc:697] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:38.257912 19627 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:38.286289 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:38.260536 19936 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15.
W20260709 13:08:38.299638 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.300182 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:38.303437 13863 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 16: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:38.264140 20044 consensus_queue.cc:1059] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
W20260709 13:08:38.285311 20055 log.cc:927] Time spent T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.836s	user 0.001s	sys 0.007s
I20260709 13:08:38.273223 19970 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:38.273072 20104 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:38.304585 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 279715us
I20260709 13:08:38.311640 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:38.264266 20075 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:08:38.305380 20108 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:38.319307 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3749) took 1281 ms. Trace:
I20260709 13:08:38.328013 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:38.323173 13865 rpcz_store.cc:276] 0709 13:08:37.038144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.116148 (+ 78004us) service_pool.cc:224] Handling call
0709 13:08:37.116413 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.430348 (+313935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.319090 (+888742us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b5400235854. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:38.319243 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601802624}
I20260709 13:08:38.337620 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:38.338840 13863 raft_consensus.cc:2393] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 14: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:38.288226 20082 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:08:38.259995 19138 consensus_queue.cc:260] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.287945 20065 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:38.315752 20104 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:38.343510 19970 raft_consensus.cc:697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:38.288512 19732 consensus_queue.cc:1059] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:08:38.345964 13865 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:38.305379 20060 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:08:38.354128 13863 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:38.368570 20118 raft_consensus.cc:3055] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:38.369050 20118 raft_consensus.cc:740] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:38.369782 20066 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:38.369942 19664 consensus_queue.cc:237] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.356652 19732 consensus_queue.cc:1243] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer ceb06175847b428ea8bd77055fcddf58 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 13:08:38.394287 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:38.401098 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.408595 19913 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:38.409953 20056 log.cc:927] Time spent T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.875s	user 0.002s	sys 0.000s
I20260709 13:08:38.410954 19913 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:38.411926 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3741) took 1468 ms. Trace:
I20260709 13:08:38.412398 13861 rpcz_store.cc:276] 0709 13:08:36.943394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.947526 (+  4132us) service_pool.cc:224] Handling call
0709 13:08:36.947853 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:36.948202 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:36.948233 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:36.968304 (+ 20071us) log.cc:844] Serialized 26 byte log entry
0709 13:08:37.327798 (+359494us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:37.327980 (+   182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.328058 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:38.372844 (+1044786us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:38.411630 (+ 38786us) raft_consensus.cc:1685] finished
0709 13:08:38.411652 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:38.411865 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":514,"raft.queue_time_us":2289,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":9825,"spinlock_wait_cycles":23440256,"thread_start_us":348824,"threads_started":1,"wal-append.queue_time_us":486228}
I20260709 13:08:38.413549 19970 consensus_queue.cc:237] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.414675 13861 raft_consensus.cc:1240] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:38.405591 20069 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:38.417225 20069 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.417873 20065 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:38.419533 20104 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:38.423823 19629 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:38.424466 19629 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.424777 20069 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:38.357398 20020 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.941s	user 0.009s	sys 0.006s
W20260709 13:08:38.430892 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:38.447815 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.448945 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:38.445894 20020 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.038s	user 0.010s	sys 0.006s
I20260709 13:08:38.455969 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:38.379146 19932 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:38.456876 13861 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:38.350296 19765 consensus_queue.cc:237] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.464917 13861 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:38.445734 19900 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.468194 19900 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:38.465891 20113 log.cc:927] Time spent T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:08:38.470044 19629 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:38.470654 19900 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:38.470548 19932 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.476176 19662 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:38.478327 20066 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:38.478542 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 1.25423e+06us
I20260709 13:08:38.369833 20118 consensus_queue.cc:260] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.479727 20118 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:38.479872 13756 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:38.483515 13789 raft_consensus.cc:1275] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:38.483973 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:38.484553 14400 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:38.486809 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:38.487538 13784 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:08:38.488230 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:38.489967 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:38.490361 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:38.490929 13789 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:38.492297 13829 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:38.499308 13756 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:38.505450 14400 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
W20260709 13:08:38.506050 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:38.506544 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 193279us
I20260709 13:08:38.512236 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:38.513018 14393 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:38.519655 20083 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:38.519508 19533 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 13:08:38.520402 20083 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.523521 14397 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:08:38.529716 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:38.530123 13861 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:38.530329 14398 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:38.532740 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:38.533505 13680 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:38.534312 13782 raft_consensus.cc:1240] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:38.493021 20069 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:38.574311 13789 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:38.518137 19730 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:38.515256 20017 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:08:38.610751 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 49934.6us
I20260709 13:08:38.616722 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:38.617545 14393 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:38.619771 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:38.627326 14398 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:38.496647 20066 consensus_queue.cc:1048] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:08:38.631112 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:38.633220 13861 raft_consensus.cc:2368] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 15. Current term is 16.
I20260709 13:08:38.620505 13863 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
I20260709 13:08:38.641058 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:38.641799 13782 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:38.529175 20080 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.109s
I20260709 13:08:38.560422 20082 consensus_queue.cc:1059] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
I20260709 13:08:38.548758 19454 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:38.635679 19866 consensus_meta.cc:287] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.527s	user 0.005s	sys 0.006s
I20260709 13:08:38.621191 20017 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:38.576586 20065 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
I20260709 13:08:38.668463 20115 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:38.669032 20125 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:08:38.675253 14398 raft_consensus.cc:1240] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14. Ops: [12.11-13.12]
I20260709 13:08:38.681753 13861 raft_consensus.cc:1275] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:08:38.687058 20127 log.cc:927] Time spent T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:08:38.695539 19932 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:38.697847 13829 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:38.698947 13829 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:38.680953 20115 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:38.700510 13829 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:38.703106 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.703867 13829 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:38.701462 20115 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:38.707904 20115 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.708654 20115 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:38.711627 19765 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:38.712523 19765 raft_consensus.cc:697] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:38.713766 19765 consensus_queue.cc:237] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.711704 19629 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:38.715610 19936 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:38.716176 19629 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.717020 19936 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:38.718771 19936 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:38.720331 13786 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:38.636044 19533 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:08:38.719094 19629 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:38.711131 20115 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:38.737457 13782 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:08:38.673460 20017 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:38.744138 13680 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:38.775405 19662 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.776607 13863 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:38.748270 14398 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:38.776145 19662 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.754323 13680 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:38.771893 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:38.730613 19936 raft_consensus.cc:697] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:08:38.799824 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 45516.1us
I20260709 13:08:38.743499 19589 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:38.802501 13680 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:38.803386 13865 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:38.753576 20098 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:08:38.810545 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.815076 13863 raft_consensus.cc:1275] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:38.798871 19629 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:38.818441 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:38.766323 20065 consensus_queue.cc:1059] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:08:38.801712 20080 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:38.832363 13861 raft_consensus.cc:2393] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 9: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:08:38.819270 20077 log.cc:927] Time spent T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 1.000s	user 0.003s	sys 0.001s
I20260709 13:08:38.837391 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 3754) took 1157 ms. Trace:
I20260709 13:08:38.839687 13857 rpcz_store.cc:276] 0709 13:08:37.680434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.680972 (+   538us) service_pool.cc:224] Handling call
0709 13:08:38.837182 (+1156210us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b5400387554. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:38.837308 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373892864}
I20260709 13:08:38.816287 19454 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:38.844395 14400 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 29 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 28. Current term is 29. Ops: [28.20-28.20]
I20260709 13:08:38.841427 19936 consensus_queue.cc:237] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.841821 19629 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:38.857323 20063 log.cc:927] Time spent T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 1.064s	user 0.000s	sys 0.003s
I20260709 13:08:38.857869 19629 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:38.830245 19533 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:38.865309 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3752) took 1794 ms. Trace:
I20260709 13:08:38.866191 13860 rpcz_store.cc:276] 0709 13:08:37.071267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.125696 (+ 54429us) service_pool.cc:224] Handling call
0709 13:08:37.126064 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:37.126456 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:37.126494 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:37.141606 (+ 15112us) log.cc:844] Serialized 26 byte log entry
0709 13:08:37.513477 (+371871us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:37.513520 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.513589 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:38.856500 (+1342911us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:38.859828 (+  3328us) raft_consensus.cc:1685] finished
0709 13:08:38.859859 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:38.865242 (+  5383us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10005,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":80392960,"thread_start_us":272711,"threads_started":1,"wal-append.queue_time_us":539785}
I20260709 13:08:38.860280 19589 raft_consensus.cc:697] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:38.881138 13829 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:38.882326 20066 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:38.882859 20066 raft_consensus.cc:697] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:38.833400 20116 consensus_queue.cc:1059] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:08:38.884965 13860 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:38.883733 20066 consensus_queue.cc:237] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:38.899531 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.895814 19533 raft_consensus.cc:3055] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:38.911449 13787 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 29 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 28. Current term is 29. Ops: [28.20-28.20]
I20260709 13:08:38.912757 13783 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 18. Current term is 19. Ops: [16.9-18.10]
I20260709 13:08:38.898499 20123 consensus_queue.cc:1059] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:08:38.900104 19454 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:38.910868 19533 raft_consensus.cc:740] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:38.917392 19847 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.917707 20020 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:38.937124 20045 raft_consensus.cc:3055] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:38.937407 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:38.937608 20045 raft_consensus.cc:740] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:38.938534 20045 consensus_queue.cc:260] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.939389 13783 raft_consensus.cc:1240] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:38.942472 20131 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.944744 20138 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:38.920743 19454 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:38.949132 14402 raft_consensus.cc:1240] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:38.919135 19913 consensus_queue.cc:1059] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 13:08:38.931366 19627 consensus_meta.cc:287] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.627s	user 0.006s	sys 0.005s
I20260709 13:08:38.930743 20132 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.955574 14366 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:38.927214 20069 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:38.961077 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:38.961546 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:38.962093 13790 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:38.915999 19589 consensus_queue.cc:237] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.956672 20131 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.981994 19697 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:38.982594 19454 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:38.983593 20131 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:38.964325 19533 consensus_queue.cc:260] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.984962 19533 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:38.952553 20020 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:38.987910 20118 consensus_meta.cc:287] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.508s	user 0.012s	sys 0.000s
I20260709 13:08:38.988703 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:38.989456 13783 raft_consensus.cc:2368] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 15. Current term is 16.
I20260709 13:08:38.989481 20020 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:38.990439 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:38.990998 13783 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:38.953383 19687 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:38.997816 13790 raft_consensus.cc:2410] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:08:38.950330 19847 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:39.008735 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:38.995754 19629 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:39.014602 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:39.017611 14366 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:38.967271 20069 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:39.004179 19687 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:38.993906 20138 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:38.968904 20132 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:39.046653 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:39.116932 13786 raft_consensus.cc:2368] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 15. Current term is 16.
I20260709 13:08:39.059923 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:39.064179 19663 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:39.066454 19916 raft_consensus.cc:3055] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:39.086454 20025 consensus_queue.cc:260] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:39.088927 20083 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:39.091933 20087 log.cc:927] Time spent T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 1.081s	user 0.000s	sys 0.003s
W20260709 13:08:39.092039 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:39.092955 20054 log.cc:927] Time spent T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 1.636s	user 0.001s	sys 0.002s
I20260709 13:08:39.093079 20081 consensus_queue.cc:1059] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:39.097842 13757 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:39.098837 20014 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.099610 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 3282) took 2517 ms. Trace:
I20260709 13:08:39.100615 13682 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:39.101820 13707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 2846) took 1309 ms. Trace:
I20260709 13:08:39.103322 19913 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:39.109840 20059 log.cc:927] Time spent T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 1.305s	user 0.001s	sys 0.001s
I20260709 13:08:39.164469 13790 raft_consensus.cc:2410] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:39.162468 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:39.168205 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:39.220711 13713 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:39.197748 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:39.221453 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 120893us
W20260709 13:08:39.166218 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.164289 20013 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:39.207327 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.209640 13715 raft_consensus.cc:1240] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:39.209784 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 112040us
I20260709 13:08:39.210400 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 3171) took 1034 ms. Trace:
W20260709 13:08:39.210741 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 193206us
I20260709 13:08:39.214387 13710 rpcz_store.cc:276] 0709 13:08:36.581704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.593020 (+ 11316us) service_pool.cc:224] Handling call
0709 13:08:36.606036 (+ 13016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.437183 (+831147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.099334 (+1662151us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b54001c48d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:39.099533 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1781169920}
I20260709 13:08:39.215364 13707 rpcz_store.cc:276] 0709 13:08:37.792102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.792499 (+   397us) service_pool.cc:224] Handling call
0709 13:08:39.101629 (+1309130us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b54002639d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:39.101767 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32395136}
I20260709 13:08:39.226008 13785 rpcz_store.cc:276] 0709 13:08:38.176215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.176467 (+   252us) service_pool.cc:224] Handling call
0709 13:08:39.210201 (+1033734us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b54001b67d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:39.210343 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1797911936}
I20260709 13:08:39.227190 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:39.227303 14366 leader_election.cc:400] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 15. Current term is 16.
I20260709 13:08:39.227736 14366 leader_election.cc:403] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:08:39.228520 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:39.222911 13682 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:39.233081 14366 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:08:39.238554 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.239524 14366 leader_election.cc:400] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 15. Current term is 16.
I20260709 13:08:39.200575 19916 raft_consensus.cc:740] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:39.240088 14366 leader_election.cc:403] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:39.243471 20083 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:39.245836 20068 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.251637 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:39.263932 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:39.267874 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 45040us
I20260709 13:08:39.270071 20083 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:39.216565 20020 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:39.258543 13757 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:39.274024 19821 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:39.279240 19821 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.279614 19821 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:39.233017 20125 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:39.252565 20143 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
W20260709 13:08:39.314462 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.309890 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:39.318631 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:39.247628 20147 log.cc:927] Time spent T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
W20260709 13:08:39.253655 20142 log.cc:927] Time spent T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:08:39.248551 20144 log.cc:927] Time spent T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
W20260709 13:08:39.249109 20140 log.cc:927] Time spent T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 13:08:39.256166 19566 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 15. Current term is 16.
I20260709 13:08:39.275547 20013 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.223567 20014 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:39.332568 14367 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.129:37533 timed out after 2.197s (SENT) [suppressed 23 similar messages]
W20260709 13:08:39.326947 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 123823us
W20260709 13:08:39.336002 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.229558 19913 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:39.340749 13782 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:08:39.341289 13782 pending_rounds.cc:85] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 12
I20260709 13:08:39.341621 13782 pending_rounds.cc:107] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:08:39.341988 13782 raft_consensus.cc:2889] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:39.305840 19663 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:39.263826 19990 consensus_queue.cc:1059] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:08:39.321331 19866 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.389076 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:39.392962 13782 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:08:39.314543 20020 raft_consensus.cc:697] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:08:39.330401 20017 consensus_meta.cc:287] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.564s	user 0.002s	sys 0.010s
W20260709 13:08:39.396229 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.320832 20116 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:08:39.397985 13680 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:39.253756 20148 consensus_queue.cc:1059] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.183s
I20260709 13:08:39.246523 20068 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:39.379652 19952 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.560s	user 0.015s	sys 0.035s
I20260709 13:08:39.407709 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:39.412798 14394 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:39.338018 19938 consensus_queue.cc:1048] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:08:39.419924 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:39.328513 20098 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:08:39.400210 19758 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:39.396358 19663 raft_consensus.cc:697] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:39.447755 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:39.448734 14395 raft_consensus.cc:2393] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 17: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:39.449623 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:39.429143 13713 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
W20260709 13:08:39.402330 19952 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.583s	user 0.015s	sys 0.036s
I20260709 13:08:39.380627 20013 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:39.408313 20148 raft_consensus.cc:3055] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:39.409637 20014 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:39.460925 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:39.463323 13783 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:39.413565 20114 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:39.469113 14394 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:39.381289 19916 consensus_queue.cc:260] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:39.476282 20114 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:39.477701 14394 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 16. Current term is 17. Ops: [14.12-16.13]
I20260709 13:08:39.478892 20114 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:39.481320 20145 log.cc:927] Time spent T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 13:08:39.481861 19687 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:39.483176 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:39.484171 14397 raft_consensus.cc:1240] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
W20260709 13:08:39.485560 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.398449 19866 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:39.443094 20079 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:39.487116 14395 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 17: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:39.410046 20167 consensus_queue.cc:1059] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:08:39.410077 20124 consensus_queue.cc:1059] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.132s
I20260709 13:08:39.535926 13783 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:08:39.543244 13783 pending_rounds.cc:85] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 10
I20260709 13:08:39.543543 13783 pending_rounds.cc:107] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:08:39.543830 13783 raft_consensus.cc:2889] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:39.466992 20148 raft_consensus.cc:740] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:08:39.503747 19697 consensus_meta.cc:287] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.000s
I20260709 13:08:39.485440 20138 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:39.526763 19936 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.022s	sys 0.092s
I20260709 13:08:39.564414 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2849) took 1711 ms. Trace:
I20260709 13:08:39.554034 13786 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 9.
W20260709 13:08:39.547338 20142 log.cc:927] Time spent T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:08:39.401362 20017 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:39.564894 13716 rpcz_store.cc:276] 0709 13:08:37.852605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.852781 (+   176us) service_pool.cc:224] Handling call
0709 13:08:37.863535 (+ 10754us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.953939 (+ 90404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.564097 (+1610158us) spinlock_profiling.cc:243] Waited 77.3 ms on lock 0x7b54000c4754. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:39.564343 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177880320}
I20260709 13:08:39.534565 20132 leader_election.cc:290] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:39.549276 20124 consensus_queue.cc:1243] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer b5029654a4384e43a68eb67b794949b7 log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:08:39.563568 19936 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.022s	sys 0.092s
I20260709 13:08:39.583266 13783 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:08:39.584088 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 244186us
W20260709 13:08:39.551214 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 218674us
I20260709 13:08:39.568559 20134 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.552863 19758 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:08:39.590276 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.595909 20163 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.596570 20163 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:39.599045 20163 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:39.600840 20013 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:39.604532 14397 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 29 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 29 index: 20. (index mismatch)
I20260709 13:08:39.606909 13783 raft_consensus.cc:1240] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:39.609004 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:39.609627 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:39.609930 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:39.619956 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 222057us
I20260709 13:08:39.621332 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:39.621364 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:39.589216 14367 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:39.626835 13858 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:39.627229 13860 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
I20260709 13:08:39.631201 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 30 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:39.631340 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:39.552009 20020 consensus_queue.cc:237] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:39.592468 20068 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:39.605557 19913 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:39.663339 13601 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 536b1fc131984687bf3b13417507e21d with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b5029654a4384e43a68eb67b794949b7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:39.592238 20148 consensus_queue.cc:260] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:39.664937 20148 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:39.602478 19758 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:39.623999 19589 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:39.646968 20114 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:39.647421 20079 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.660178 20163 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.633708 20132 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.588245 19663 consensus_queue.cc:237] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:39.658391 19938 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:39.686126 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.687731 13713 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:08:39.679493 14397 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:39.601358 20134 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:39.670410 20172 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:40.227443 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:40.227782 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:39.667637 19765 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.720428 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:40.170104 13789 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:39.787346 13714 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:39.782367 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:39.831121 20158 log.cc:927] Time spent T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
W20260709 13:08:39.712903 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.789932 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:40.237183 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 2118) took 1141 ms. Trace:
W20260709 13:08:40.152905 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.234748 14368 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:39.702908 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:40.238201 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:40.241447 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:40.239189 13864 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 17: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:39.696112 13858 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:40.031314 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3170) took 1857 ms. Trace:
I20260709 13:08:40.241220 14397 rpcz_store.cc:276] 0709 13:08:39.096074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.635097 (+539023us) service_pool.cc:224] Handling call
0709 13:08:39.663920 (+ 28823us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.236963 (+573043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.237135 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:40.169226 13757 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:40.242656 13787 rpcz_store.cc:276] 0709 13:08:38.173524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.174695 (+  1171us) service_pool.cc:224] Handling call
0709 13:08:38.175053 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.911931 (+736878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.030977 (+1119046us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b54003bdb54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:40.031226 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1692886784}
I20260709 13:08:40.228223 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:40.243696 13859 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
W20260709 13:08:40.244334 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 75196.7us
I20260709 13:08:40.244936 13789 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:39.720669 20163 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:40.246356 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:40.246790 20068 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:40.246949 13864 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:40.247236 20068 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:40.247699 20068 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:40.248457 13710 raft_consensus.cc:2393] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 16: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:40.249285 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:40.250458 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:40.242130 13856 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:40.250892 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:39.887141 20083 consensus_meta.cc:287] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.000s
I20260709 13:08:40.252158 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:39.843021 20162 log.cc:927] Time spent T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260709 13:08:39.841989 19533 consensus_meta.cc:287] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.857s	user 0.010s	sys 0.002s
I20260709 13:08:40.252426 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:40.252707 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:39.838985 20169 log.cc:927] Time spent T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:08:40.253352 13710 raft_consensus.cc:2393] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 15: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:08:39.841506 20086 log.cc:927] Time spent T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 1.838s	user 0.000s	sys 0.003s
I20260709 13:08:40.296869 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:40.012821 20177 log.cc:927] Time spent T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:08:40.146540 19916 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:40.255256 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:39.786018 20127 log.cc:927] Time spent T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:08:40.026420 19847 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:39.976985 19866 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:40.172011 19950 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:40.239236 19765 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:40.220947 20148 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.169724 20185 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:39.720367 20132 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:40.297617 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 62958us
I20260709 13:08:40.297680 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:40.167400 19758 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:40.301064 13859 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:40.180646 20184 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:39.702595 20079 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:40.254843 19938 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:39.798139 20069 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:40.352473 13856 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:08:40.318234 19821 consensus_meta.cc:287] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 1.037s	user 0.010s	sys 0.004s
I20260709 13:08:39.690469 19589 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:40.304023 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:40.305066 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:40.293947 20083 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 15. Current term is 16.
I20260709 13:08:40.306951 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:40.302387 20168 log.cc:927] Time spent T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.690s	user 0.000s	sys 0.003s
W20260709 13:08:39.880690 20174 log.cc:927] Time spent T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:08:40.318723 13713 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 14: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:40.319337 14368 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:40.317936 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:40.193523 20085 log.cc:927] Time spent T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 2.190s	user 0.004s	sys 0.000s
I20260709 13:08:40.233711 20172 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:40.366626 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.231680 19629 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.301513 20159 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:40.321345 20184 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:40.364231 13715 raft_consensus.cc:2368] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 15. Current term is 16.
I20260709 13:08:40.365553 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 30 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:40.372511 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:40.374943 13789 raft_consensus.cc:1240] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:08:40.369874 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2838) took 2793 ms. Trace:
I20260709 13:08:40.378716 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:40.378661 13711 rpcz_store.cc:276] 0709 13:08:37.576298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.577632 (+  1334us) service_pool.cc:224] Handling call
0709 13:08:37.577940 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.863431 (+285491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.369567 (+2506136us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54002850d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:40.369806 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":523723648}
I20260709 13:08:40.379657 13783 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
W20260709 13:08:40.381028 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 136892us
I20260709 13:08:40.360855 20163 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:40.318511 20148 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:40.383100 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:40.386368 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:40.386559 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:40.385064 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:40.384799 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.392493 20199 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:40.371297 20069 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.407291 13708 raft_consensus.cc:2410] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:08:40.403566 13710 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:40.408277 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:40.403350 13783 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:40.412111 13858 raft_consensus.cc:2410] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:08:40.320515 20185 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:40.414330 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:40.419723 19732 raft_consensus.cc:3055] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:40.420186 19732 raft_consensus.cc:740] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:40.420387 20184 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:40.421015 19732 consensus_queue.cc:260] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:40.422060 19732 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:40.422245 20115 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:40.409933 20197 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:40.423918 20197 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:40.424957 19942 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:40.425665 19942 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:40.426126 19942 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:40.439589 20185 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:40.440446 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:40.440853 19765 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:40.441645 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:40.442263 13710 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:08:40.442389 19589 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:40.381991 20193 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.361208 19821 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:40.443116 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:40.381893 20083 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.384598 20159 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:40.381002 19629 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:40.495903 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3183) took 1259 ms. Trace:
I20260709 13:08:40.653539 13788 rpcz_store.cc:276] 0709 13:08:39.236007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.485275 (+249268us) service_pool.cc:224] Handling call
0709 13:08:39.485546 (+   271us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:39.485945 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.485969 (+    24us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:39.486580 (+   611us) log.cc:844] Serialized 52 byte log entry
0709 13:08:39.694146 (+207566us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:39.694200 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.694290 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.495677 (+801387us) raft_consensus.cc:1685] finished
0709 13:08:40.495700 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.495847 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4280,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":6599,"thread_start_us":142884,"threads_started":1,"wal-append.queue_time_us":729816}
I20260709 13:08:40.489754 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:40.657121 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 337807us
I20260709 13:08:40.657999 13713 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:40.444267 20069 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:40.500959 13857 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:40.443778 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:40.510381 13786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1456) took 1567 ms. Trace:
I20260709 13:08:40.468885 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1896) took 1721 ms. Trace:
I20260709 13:08:40.454964 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:40.637989 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:40.668720 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.615938 14401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1886) took 2365 ms. Trace:
I20260709 13:08:40.688936 14368 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:40.689566 13860 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
W20260709 13:08:40.691156 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 138905us
I20260709 13:08:40.694952 13708 raft_consensus.cc:3055] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:40.695432 13708 raft_consensus.cc:740] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:40.695050 13786 rpcz_store.cc:276] 0709 13:08:38.942803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.207563 (+264760us) service_pool.cc:224] Handling call
0709 13:08:40.510189 (+1302626us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54002f9c54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:40.510322 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":746800384}
I20260709 13:08:40.694540 14398 rpcz_store.cc:276] 0709 13:08:38.747222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.835890 (+ 88668us) service_pool.cc:224] Handling call
0709 13:08:38.868074 (+ 32184us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.008571 (+140497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.008601 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.029386 (+ 20785us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.548614 (+519228us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:39.580360 (+ 31746us) log.cc:844] Serialized 14 byte log entry
0709 13:08:39.580577 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.580642 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.468568 (+887926us) raft_consensus.cc:1685] finished
0709 13:08:40.468596 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.468807 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31159,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":11803,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":8555,"thread_start_us":569559,"threads_started":2,"wal-append.queue_time_us":616573}
I20260709 13:08:40.477370 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:40.697378 14368 leader_election.cc:400] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 15. Current term is 16.
W20260709 13:08:40.624976 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 240040us
I20260709 13:08:40.698833 13756 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:40.701215 13756 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:40.504513 20154 log.cc:927] Time spent T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 1.167s	user 0.001s	sys 0.000s
I20260709 13:08:40.696394 13708 consensus_queue.cc:260] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:40.708052 13708 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:40.704929 13713 raft_consensus.cc:3055] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 13:08:40.690173 14401 rpcz_store.cc:276] 0709 13:08:38.168780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.169749 (+   969us) service_pool.cc:224] Handling call
0709 13:08:38.169987 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:38.170178 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:38.181955 (+ 11777us) log.cc:844] Serialized 14 byte log entry
0709 13:08:40.221924 (+2039969us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b18004cb820. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e23a 00007f52324e8a2a
0709 13:08:40.533803 (+311879us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:40.533882 (+    79us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:40.533946 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.534037 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.534206 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11617,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":65564,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":87,"spinlock_wait_cycles":5928832,"thread_start_us":311500,"threads_started":2,"wal-append.queue_time_us":2195680}
W20260709 13:08:40.497437 20196 log.cc:927] Time spent T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:08:40.705971 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:40.709897 13713 raft_consensus.cc:740] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:40.705772 19967 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:40.713195 19967 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:40.713694 19629 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:40.713658 19967 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:40.714318 19629 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:08:40.716005 20194 log.cc:927] Time spent T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:08:40.644753 19916 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.698029 20083 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:40.711001 13713 consensus_queue.cc:260] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.20, Last appended by leader: 20, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:40.759701 13710 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:40.718237 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:40.760326 13713 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:08:40.719002 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:40.719907 19967 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:40.444017 20066 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.720011 20069 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:40.762307 20204 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.732098 20172 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:40.733219 19942 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:40.733821 20134 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:40.734596 20132 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:40.540628 20034 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:40.736027 20079 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:40.689388 20045 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:40.505999 19391 raft_consensus.cc:3055] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:40.498327 19662 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:40.736567 20080 raft_consensus.cc:3055] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:40.715523 20018 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:40.741197 20148 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:40.742797 14399 raft_consensus.cc:2410] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:08:40.746429 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:40.747116 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:40.749763 13790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1457) took 1806 ms (client timeout 2110 ms). Trace:
W20260709 13:08:40.755087 14366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.000s	sys 0.018s
I20260709 13:08:40.756603 13714 raft_consensus.cc:2368] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15.
I20260709 13:08:40.715838 20024 raft_consensus.cc:3055] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:40.760998 13708 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:08:40.761032 13786 raft_consensus.cc:2376] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17. Re-sending same reply.
I20260709 13:08:40.426126 20197 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:40.739033 19950 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
W20260709 13:08:40.770579 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.771059 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:40.721877 19629 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:40.691632 20199 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
W20260709 13:08:40.772264 20068 consensus_meta.cc:287] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.524s	user 0.006s	sys 0.004s
W20260709 13:08:40.770128 20118 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.713s	user 0.021s	sys 0.005s
I20260709 13:08:40.443380 20193 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:40.881524 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1901) took 2051 ms. Trace:
I20260709 13:08:40.885990 13715 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:40.889348 19138 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:40.889793 13861 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:40.763060 19916 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:40.892053 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:40.888269 14402 rpcz_store.cc:276] 0709 13:08:38.829735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.954542 (+124807us) service_pool.cc:224] Handling call
0709 13:08:38.954873 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.955194 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.955225 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:38.956837 (+  1612us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.161307 (+204470us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:39.161347 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.161417 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.503990 (+1342573us) spinlock_profiling.cc:243] Waited 7.93 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:40.872283 (+368293us) raft_consensus.cc:1685] finished
0709 13:08:40.872326 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.881441 (+  9115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":865,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"spinlock_wait_cycles":18229120,"thread_start_us":124815,"threads_started":1,"wal-append.queue_time_us":260940}
I20260709 13:08:40.896661 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 3058) took 1273 ms. Trace:
I20260709 13:08:40.902529 13863 rpcz_store.cc:276] 0709 13:08:39.623141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.623837 (+   696us) service_pool.cc:224] Handling call
0709 13:08:39.624103 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.925867 (+301764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.925910 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.983978 (+ 58068us) log.cc:844] Serialized 26 byte log entry
0709 13:08:40.757515 (+773537us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:40.757571 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.757661 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.896448 (+138787us) raft_consensus.cc:1685] finished
0709 13:08:40.896469 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.896600 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122,"raft.queue_time_us":166211,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":12583,"thread_start_us":741702,"threads_started":2,"wal-append.queue_time_us":587647}
I20260709 13:08:40.895984 20159 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:40.896479 19916 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:40.890842 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:40.921144 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 222829us
I20260709 13:08:40.927084 13863 raft_consensus.cc:1240] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:40.920670 13708 pending_rounds.cc:85] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 12
I20260709 13:08:40.927827 13708 pending_rounds.cc:107] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:08:40.928077 13708 raft_consensus.cc:2889] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:40.900375 14366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.005s	sys 0.026s
W20260709 13:08:40.901006 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.796329 13862 raft_consensus.cc:2376] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17. Re-sending same reply.
W20260709 13:08:40.929962 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.797690 20080 raft_consensus.cc:740] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:08:40.887580 20118 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.830s	user 0.021s	sys 0.005s
W20260709 13:08:40.900785 13790 rpcz_store.cc:269] 0709 13:08:38.943056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.011694 (+ 68638us) service_pool.cc:224] Handling call
0709 13:08:40.749529 (+1737835us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400161f54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:40.749703 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341559680}
I20260709 13:08:40.793234 19391 raft_consensus.cc:740] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:40.796694 19900 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.942966 13757 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:40.955873 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:40.956497 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:40.795655 20034 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:40.911320 19847 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:40.937364 20069 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.974996 13786 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:40.889528 19629 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.958664 20212 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.786521 20204 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:40.898241 20024 raft_consensus.cc:740] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:40.927305 14368 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:40.893316 19938 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:40.907727 20153 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.959879 14398 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:40.960515 14366 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:40.964128 13787 raft_consensus.cc:3055] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:40.907816 20123 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:40.970598 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:40.937036 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.971019 13757 leader_election.cc:304] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:40.925870 20184 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.936755 20203 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.955878 20173 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:40.961651 20065 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.891s	user 0.019s	sys 0.017s
I20260709 13:08:40.893203 20068 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:40.979766 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:41.025869 13862 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:40.980763 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:40.776117 20066 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:40.961490 20209 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:40.997324 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:40.998699 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:41.031692 13789 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:08:40.996585 19629 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:41.000164 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:40.973593 20020 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:41.017881 20199 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.019958 20167 consensus_queue.cc:1059] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:08:41.015558 20080 consensus_queue.cc:260] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:41.015947 19391 consensus_queue.cc:260] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:41.028864 20173 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:41.014765 20069 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:41.061252 20204 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:40.943238 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:41.094483 20080 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:41.094655 13863 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:40.926630 13861 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 9.
W20260709 13:08:41.067024 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:41.012384 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 85146.2us
I20260709 13:08:41.014312 13787 raft_consensus.cc:740] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:41.016105 13790 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
W20260709 13:08:41.018185 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 57742.7us
W20260709 13:08:41.019809 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 48998.6us
I20260709 13:08:41.001945 19952 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.012446 19821 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:40.978953 19847 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:41.024315 20210 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:08:40.973270 19900 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:41.029893 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:41.022886 20202 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
W20260709 13:08:41.026018 20065 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.956s	user 0.019s	sys 0.017s
W20260709 13:08:41.714655 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.093766 20066 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:41.065101 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:41.715802 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.716279 19938 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:08:41.716487 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.716832 19938 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:41.715094 13682 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:41.718868 19938 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:41.096210 14368 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:41.002167 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:41.021638 19942 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.726301 19942 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:41.728904 19942 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:41.729542 19942 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.730078 19942 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:41.062192 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:41.062938 20218 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:41.597122 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:41.511679 20178 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:41.021497 19916 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:41.749080 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:41.749776 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.025072 19971 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:41.102656 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:41.021011 20123 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:41.019763 20216 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:41.703604 20204 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:41.021199 20215 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:08:41.119719 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:41.705315 13858 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42104 (request call id 1573) took 1521 ms (client timeout 1707 ms). Trace:
I20260709 13:08:41.052861 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3770) took 1270 ms. Trace:
I20260709 13:08:41.096809 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:41.003469 20212 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:41.048667 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 3764) took 1438 ms. Trace:
I20260709 13:08:41.065618 20020 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:41.706745 13714 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 3304) took 1972 ms (client timeout 1713 ms). Trace:
I20260709 13:08:41.033465 20083 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:41.076292 20207 log.cc:927] Time spent T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:08:41.066039 20206 log.cc:927] Time spent T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 13:08:41.783059 20123 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:41.784512 20204 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:41.759272 20216 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:41.785701 20216 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:41.758507 20218 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:41.790676 20218 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:41.022416 20184 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:41.792251 13861 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:41.794217 20020 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:41.062417 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2855) took 1865 ms. Trace:
I20260709 13:08:41.702271 19952 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:41.701293 13787 consensus_queue.cc:260] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:41.039047 20209 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:41.066097 20179 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.795979 13787 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:41.796285 20179 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:41.797322 20209 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:41.797730 20184 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:41.798319 14396 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:41.798571 20179 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:41.093766 20025 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:41.795228 13712 rpcz_store.cc:276] 0709 13:08:39.197064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.197228 (+   164us) service_pool.cc:224] Handling call
0709 13:08:39.197601 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.197848 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:39.568910 (+371062us) log.cc:844] Serialized 14 byte log entry
0709 13:08:39.704141 (+135231us) log.cc:844] Serialized 14 byte log entry
0709 13:08:40.504841 (+800700us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b4800080358. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5237407aa1 00007f52373feb37 00007f52373fe9ca 00007f52374f626f 00007f52374f5f37 00007f523750a55c 00007f523750a508 00007f523750a488 00007f523750a443 00007f52375096ec 00007f5236433a96
0709 13:08:40.738172 (+233331us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b18004c7380. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3bf2a6 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f1522 00007f522f3f37c1
0709 13:08:40.739521 (+  1349us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b18004c7380. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f1522 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
0709 13:08:41.061962 (+322441us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b18004c7380. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f36bc0a 00007f5238aab219 00007f522f3f3a40 00007f522f3ee4e4 00007f522f3ee455 00007f52324d6060 00007f52324e8716 00007f52324f9287 00007f52324f9208
0709 13:08:41.062106 (+   144us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:41.062157 (+    51us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:41.062201 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.062263 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.062366 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":665998,"prepare.queue_time_us":1531018,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":69,"raft.queue_time_us":1367710,"raft.run_cpu_time_us":2714,"raft.run_wall_time_us":801465,"spinlock_wait_cycles":58504448,"thread_start_us":460368,"threads_started":2,"wal-append.queue_time_us":603428,"wal-append.run_cpu_time_us":1581,"wal-append.run_wall_time_us":1020056}
I20260709 13:08:41.801296 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:41.802654 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:41.791326 20218 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:08:41.805879 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:41.055119 19325 raft_consensus.cc:3055] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:41.804903 19942 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:41.807605 19325 raft_consensus.cc:740] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:08:41.715086 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.812274 20069 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:41.717276 20213 log.cc:927] Time spent T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.721s	user 0.006s	sys 0.014s
W20260709 13:08:41.069553 20164 log.cc:927] Time spent T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 1.521s	user 0.004s	sys 0.000s
I20260709 13:08:41.722959 19533 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:41.815795 19533 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:41.815973 19964 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.754799 20178 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:41.816291 19533 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:41.816450 19964 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:41.818544 19964 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:41.818728 20178 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:41.762938 19391 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:41.722389 19228 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.723958 19866 raft_consensus.cc:3055] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:41.820933 19866 raft_consensus.cc:740] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:41.820982 19228 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:41.821853 19866 consensus_queue.cc:260] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:41.822821 19866 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:41.722880 19867 consensus_queue.cc:1059] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:41.092012 19629 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:41.825598 20080 consensus_meta.cc:287] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.731s	user 0.009s	sys 0.001s
I20260709 13:08:41.825644 19629 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:41.045279 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:08:41.826854 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 781596us
I20260709 13:08:41.053287 20068 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:41.734001 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 3312) took 1549 ms. Trace:
I20260709 13:08:41.733986 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 1574) took 1484 ms. Trace:
I20260709 13:08:41.827530 13829 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:41.089440 20193 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:41.751094 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:41.755494 19971 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.748558 20066 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:41.756217 19916 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:41.830060 20066 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:41.752753 20202 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:41.737301 19870 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:41.757634 19938 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:41.709699 20033 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.011s	sys 0.010s
I20260709 13:08:41.058652 20024 consensus_queue.cc:260] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:41.771100 13858 rpcz_store.cc:269] 0709 13:08:40.183731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.251911 (+ 68180us) service_pool.cc:224] Handling call
0709 13:08:41.563118 (+1311207us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54000d11d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:41.705259 (+142141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":361547264}
I20260709 13:08:41.025509 20203 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:41.771226 13864 rpcz_store.cc:276] 0709 13:08:39.782029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.247695 (+465666us) service_pool.cc:224] Handling call
0709 13:08:40.248011 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.443678 (+195667us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.443722 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:40.443781 (+    59us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:40.443826 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.052648 (+608822us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b540004a454. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:41.052696 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.052805 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":449443584}
W20260709 13:08:41.750295 20210 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:08:41.772008 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.707500 20192 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:41.733228 20034 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:41.758373 20045 consensus_meta.cc:287] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.964s	user 0.010s	sys 0.001s
I20260709 13:08:41.777011 13857 rpcz_store.cc:276] 0709 13:08:39.609814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.621070 (+ 11256us) service_pool.cc:224] Handling call
0709 13:08:41.048464 (+1427394us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b54002fadd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:41.048606 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2009963904}
I20260709 13:08:41.788085 19932 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:41.806977 13712 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:41.827781 13710 rpcz_store.cc:276] 0709 13:08:40.249824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.765333 (+515509us) service_pool.cc:224] Handling call
0709 13:08:40.772318 (+  6985us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.733642 (+961324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:41.733675 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:41.733721 (+    46us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:41.733756 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.733816 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.733938 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":960996,"raft.queue_time_us":962240,"raft.run_cpu_time_us":47,"raft.run_wall_time_us":47}
I20260709 13:08:41.827700 13713 rpcz_store.cc:276] 0709 13:08:40.184386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.658827 (+474441us) service_pool.cc:224] Handling call
0709 13:08:40.704827 (+ 46000us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.733699 (+1028872us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:08:41.733727 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:41.733765 (+    38us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:08:41.733794 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.733857 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.733952 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":851502,"raft.queue_time_us":852792,"raft.run_cpu_time_us":47,"raft.run_wall_time_us":47}
I20260709 13:08:41.747759 13782 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:08:41.878806 13707 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:41.737408 20118 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:41.756870 20084 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.819060 19964 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:41.778343 13714 rpcz_store.cc:269] 0709 13:08:39.734342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.241207 (+506865us) service_pool.cc:224] Handling call
0709 13:08:41.598048 (+1356841us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b54000c4254. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:41.706681 (+108633us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1182741888}
I20260709 13:08:41.911456 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:41.911705 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.823132 19228 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:41.840126 13829 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:08:41.912866 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 72823.2us
I20260709 13:08:41.828537 20123 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:41.832056 19971 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:41.164016 20199 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:41.859897 13708 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:41.860244 13787 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
W20260709 13:08:41.848743 20033 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.011s	sys 0.011s
I20260709 13:08:41.861060 19916 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:41.852679 19938 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:41.863711 19913 consensus_queue.cc:1175] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "35ecb005831740438d7537dd4b840e03" responder_term: 13 status { last_received { term: 13 index: 9 } last_committed_idx: 8 last_received_current_leader { term: 13 index: 9 } }
I20260709 13:08:41.863410 20024 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:41.868072 14399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 2101) took 3968 ms (client timeout 1606 ms). Trace:
W20260709 13:08:41.925307 14399 rpcz_store.cc:269] 0709 13:08:37.899702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.900564 (+   862us) service_pool.cc:224] Handling call
0709 13:08:41.867785 (+3967221us) spinlock_profiling.cc:243] Waited 2.83 s on lock 0x7b54009169d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:41.867958 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6515394304}
I20260709 13:08:41.869010 14393 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:41.845978 20184 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:41.018018 20153 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:41.880008 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:41.880607 20066 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:41.881016 20075 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.890789 20216 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:41.881198 19533 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:41.892213 13712 raft_consensus.cc:2410] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:08:41.892355 20173 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:41.904997 20203 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:41.875541 20192 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:41.942453 20224 log.cc:927] Time spent T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:08:41.928779 20184 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.911777 20118 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:41.933877 19867 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.850421 19870 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:41.915930 19964 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:41.917109 20123 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.920785 20167 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:41.934528 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:41.953359 13712 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:41.918553 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:41.955086 13714 raft_consensus.cc:2368] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15.
I20260709 13:08:41.911845 20020 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:41.850164 20202 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:41.912734 20084 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:41.914397 13829 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:41.947942 20184 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:41.956205 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:41.952641 19867 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:41.957726 20020 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:41.960491 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 46196.7us
I20260709 13:08:41.965390 20084 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:41.935971 13710 raft_consensus.cc:2393] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 18: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:41.967100 20017 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:41.968010 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:41.961251 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:41.974807 13714 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:41.975937 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:41.978096 20118 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:41.981046 19870 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:41.983088 20153 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:41.984203 20199 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:41.954247 20167 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:41.969993 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:41.959229 19964 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:41.969197 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:41.989511 13782 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:41.989776 13712 raft_consensus.cc:2368] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 15. Current term is 16.
I20260709 13:08:41.990257 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:41.991364 13790 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:08:41.952356 20123 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:41.938647 20075 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:42.009501 14399 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:41.957543 20216 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:41.967506 20126 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:41.988082 20066 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:08:41.993263 20153 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:41.995708 20089 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.996498 20017 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:41.997085 14396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1884) took 3829 ms. Trace:
I20260709 13:08:41.997382 20173 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:41.997838 13784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3178) took 2763 ms. Trace:
I20260709 13:08:42.007723 20199 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.998095 20203 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:08:41.998534 13791 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 3181) took 2763 ms (client timeout 1644 ms). Trace:
I20260709 13:08:42.060174 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:41.997839 20025 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:41.999931 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:42.009452 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:42.068764 14398 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:08:42.009810 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:41.978298 20212 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:42.010691 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:42.001485 20167 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:42.025149 13789 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:08:42.028163 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:42.089960 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:42.090586 14399 raft_consensus.cc:2410] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:08:42.028826 14396 rpcz_store.cc:276] 0709 13:08:38.168142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.169339 (+  1197us) service_pool.cc:224] Handling call
0709 13:08:38.169580 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.798750 (+3629170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.996857 (+198107us) spinlock_profiling.cc:243] Waited 3.63 s on lock 0x7b54004a8b54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:41.997031 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8344597376}
W20260709 13:08:42.039529 13755 connection.cc:256] RPC call timeout handler was delayed by -1.5935767299999952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260709 13:08:42.091863 13755 connection.cc:256] RPC call timeout handler was delayed by -1.542276730000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
W20260709 13:08:42.092594 13755 connection.cc:256] RPC call timeout handler was delayed by -1.0922767299999805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2066s for a response
I20260709 13:08:42.060871 13782 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
W20260709 13:08:42.093071 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 381608us
W20260709 13:08:42.093854 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.061787 14395 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:42.064793 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:42.070937 14401 raft_consensus.cc:1813] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Handling vote request from an unknown peer 35ecb005831740438d7537dd4b840e03
W20260709 13:08:42.060657 13791 rpcz_store.cc:269] 0709 13:08:39.235435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.289854 (+ 54419us) service_pool.cc:224] Handling call
0709 13:08:41.998344 (+2708490us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54000ed3d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:41.998469 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3430711168}
W20260709 13:08:42.086741 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 367899us
W20260709 13:08:42.087765 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 991561us
W20260709 13:08:42.093025 13755 connection.cc:256] RPC call timeout handler was delayed by -1.0895767299999761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2069s for a response
I20260709 13:08:42.108285 13782 raft_consensus.cc:1240] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 16. Current term is 17. Ops: []
W20260709 13:08:42.109673 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.097527 14394 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:42.016408 20126 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.136554 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:42.137444 14401 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 16: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:42.139670 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:42.142794 13756 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:42.139922 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:42.141023 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:42.144522 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:42.145228 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:42.145836 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:42.147042 14399 raft_consensus.cc:2410] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 17 because replica has last-logged OpId of term: 16 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 14.
I20260709 13:08:42.148866 14394 raft_consensus.cc:1240] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:42.150086 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:42.150784 14394 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:08:42.138583 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:42.145972 13710 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:08:42.143682 14397 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 8.
W20260709 13:08:42.154958 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 446286us
I20260709 13:08:42.156106 14398 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 16: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:42.156002 14366 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:42.167493 14401 raft_consensus.cc:1275] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:42.168794 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:42.169656 14399 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:42.059628 20202 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:42.171051 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:42.173216 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:42.139370 20068 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.175060 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:42.139968 20118 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.174786 14397 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:42.139864 20131 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.174278 13791 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:42.136612 20199 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:42.154124 19964 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.191735 19964 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:42.193915 14395 raft_consensus.cc:1240] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14. Ops: [12.11-13.12]
I20260709 13:08:42.194041 19964 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:42.154239 20069 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:42.153957 20126 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:42.193032 20199 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:42.160439 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:42.158178 19870 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.180846 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:42.200119 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:42.068569 20153 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:42.194757 20069 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:42.238379 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.209724 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:42.159937 13755 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:42.061369 20089 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:42.067978 20017 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:42.190537 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:42.219604 13782 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
W20260709 13:08:42.247179 14368 connection.cc:256] RPC call timeout handler was delayed by -1.8560835700000098s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
I20260709 13:08:42.221000 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:42.223745 14398 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:08:42.224233 14367 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.002s	sys 0.039s
I20260709 13:08:42.226394 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:42.207069 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:42.176134 20216 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:42.136492 20173 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:42.229012 13757 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.025s	sys 0.041s
W20260709 13:08:42.269650 13757 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.026s	sys 0.041s
W20260709 13:08:42.270030 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 569245us
I20260709 13:08:42.231802 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:42.274333 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:42.233677 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:42.135274 20025 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:42.154822 20212 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:08:42.134810 20203 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:42.258725 14397 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:08:42.187630 19533 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:42.262149 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:42.262367 14367 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.002s	sys 0.039s
W20260709 13:08:42.266674 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 106835us
I20260709 13:08:42.263100 14402 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:42.262810 13710 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:42.283166 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:42.287488 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:42.288108 13710 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:08:42.288966 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:42.285125 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:42.289929 13791 raft_consensus.cc:2393] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 17: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
W20260709 13:08:42.285408 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:42.252208 20065 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.027s	sys 0.068s
I20260709 13:08:42.291224 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:42.261515 14394 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
W20260709 13:08:42.260476 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 113233us
I20260709 13:08:42.279779 13757 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:42.292482 13756 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:42.275089 13857 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:42.218698 19938 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:42.286320 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 577246us
I20260709 13:08:42.296216 13865 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:08:42.296708 13865 pending_rounds.cc:85] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 9
I20260709 13:08:42.296943 13865 pending_rounds.cc:107] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:08:42.297185 13865 raft_consensus.cc:2889] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:42.294870 14368 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:42.289943 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:42.298066 13710 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:42.267597 20216 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:42.293151 14394 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:42.280813 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:42.302951 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:42.303567 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.303781 14397 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:08:42.304556 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:42.305588 14398 raft_consensus.cc:2393] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 14: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:42.295140 13862 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:42.293968 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:42.309077 13857 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:42.310236 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:42.312074 20216 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:42.303404 14401 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:08:42.198798 20118 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:42.286207 20225 log.cc:927] Time spent T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:08:42.258057 20238 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.278201 20192 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:42.328222 13755 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:42.316787 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2656) took 1299 ms. Trace:
I20260709 13:08:42.329077 13785 rpcz_store.cc:276] 0709 13:08:41.017469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.064596 (+ 47127us) service_pool.cc:224] Handling call
0709 13:08:41.065037 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.792872 (+727835us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:41.792909 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:41.792960 (+    51us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:41.792998 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.316570 (+523572us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b54003df254. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:42.316623 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.316727 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1673406976}
I20260709 13:08:42.316984 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:42.279978 19982 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:42.327105 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:42.219311 20131 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:42.296315 20065 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.027s	sys 0.068s
W20260709 13:08:42.300164 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 170187us
I20260709 13:08:42.332304 13857 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:42.345136 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:42.198123 20068 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:42.334110 13709 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 3302) took 2608 ms (client timeout 1606 ms). Trace:
I20260709 13:08:42.345634 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 3313) took 2131 ms. Trace:
I20260709 13:08:42.228008 19870 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:42.346526 13709 rpcz_store.cc:269] 0709 13:08:39.723073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.723377 (+   304us) service_pool.cc:224] Handling call
0709 13:08:42.316800 (+2593423us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b5800003398. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:08:42.331359 (+ 14559us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44215680}
W20260709 13:08:42.346297 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.348699 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:42.354811 13857 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:08:42.350697 13712 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:08:42.352975 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:42.356312 14401 raft_consensus.cc:2393] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 13: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:42.347525 14368 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:42.357517 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:42.323568 19932 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.322192 20199 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.365968 13859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3774) took 1739 ms. Trace:
W20260709 13:08:42.366707 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.366011 13785 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:08:42.367638 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.366386 13859 rpcz_store.cc:276] 0709 13:08:40.626124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.679806 (+ 53682us) service_pool.cc:224] Handling call
0709 13:08:40.680227 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.704717 (+ 24490us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:40.769812 (+ 65095us) log.cc:844] Serialized 14 byte log entry
0709 13:08:40.980932 (+211120us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:40.980976 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:40.981015 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.365767 (+1384752us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b540024f254. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:42.365810 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.365917 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68979,"prepare.queue_time_us":88457,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":64,"raft.queue_time_us":16138,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":4627,"spinlock_wait_cycles":55855360,"thread_start_us":210757,"threads_started":1,"wal-append.queue_time_us":267219,"wal-append.run_cpu_time_us":1065,"wal-append.run_wall_time_us":1001094}
I20260709 13:08:42.327958 20227 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:42.346608 13711 rpcz_store.cc:276] 0709 13:08:40.214520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.689337 (+474817us) service_pool.cc:224] Handling call
0709 13:08:40.707004 (+ 17667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.706153 (+999149us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:42.191856 (+485703us) log.cc:844] Serialized 14 byte log entry
0709 13:08:42.345343 (+153487us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:42.345390 (+    47us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:42.345429 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.345489 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.345583 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":372513,"prepare.queue_time_us":366214,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":994159,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":12650,"thread_start_us":583365,"threads_started":2}
I20260709 13:08:42.373132 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:42.374567 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:42.375464 13857 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:42.371730 13782 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:42.378398 13711 raft_consensus.cc:2410] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:08:42.370056 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:42.282955 20236 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 13:08:42.379598 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:42.342538 20209 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:42.334141 20034 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:42.380651 13859 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:42.380358 14401 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:08:42.391721 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:42.393445 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:42.394124 19971 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:42.371176 19932 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:42.395671 20069 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:42.395900 20149 log.cc:927] Time spent T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 3.355s	user 0.014s	sys 0.004s
I20260709 13:08:42.342878 20238 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:42.396742 20236 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:42.397915 20153 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:42.399003 20025 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:42.399487 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 3051) took 3580 ms. Trace:
I20260709 13:08:42.400522 20231 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:42.402738 20123 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:42.334208 20249 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:42.348515 19982 raft_consensus.cc:697] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:42.412853 13711 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:08:42.413585 13857 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:08:42.361549 20193 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.108s
I20260709 13:08:42.370179 20202 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.145s
W20260709 13:08:42.775349 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:42.765493 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.418637 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:42.411293 20209 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.779937 20209 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:42.371436 20199 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:42.470075 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:42.783300 20123 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:42.736920 20068 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:42.783866 13863 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:08:42.784699 20173 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:42.471964 13859 raft_consensus.cc:2410] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:08:42.738054 20254 log.cc:927] Time spent T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 13:08:42.737833 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 458124us
I20260709 13:08:42.801290 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:42.718479 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 371103us
W20260709 13:08:42.466598 20024 consensus_meta.cc:287] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.000s
I20260709 13:08:42.803349 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:42.804749 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:42.807092 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:42.686637 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 338300us
I20260709 13:08:42.808099 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:42.805822 14368 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:42.807694 13859 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:42.381183 20033 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.427s
W20260709 13:08:42.624886 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 332428us
I20260709 13:08:42.771315 20231 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:42.734385 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:42.737545 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1892) took 4121 ms. Trace:
W20260709 13:08:42.665891 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 493434us
I20260709 13:08:42.753468 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:42.406379 20227 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:42.652581 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 323534us
W20260709 13:08:42.731192 20246 log.cc:927] Time spent T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:08:42.418514 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:42.801257 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:42.818928 14401 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:42.819083 13716 raft_consensus.cc:2410] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:08:42.802150 20236 raft_consensus.cc:697] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:08:42.820369 13716 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 3305) took 3085 ms (client timeout 1671 ms). Trace:
I20260709 13:08:42.817335 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:42.820799 13716 rpcz_store.cc:269] 0709 13:08:39.734643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.181121 (+446478us) service_pool.cc:224] Handling call
0709 13:08:42.418360 (+2237239us) spinlock_profiling.cc:243] Waited 34.2 ms on lock 0x7b5800003398. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374a40a0 00007f52374a3984 00007f5230a1e6d4 00007f5230a1e662
0709 13:08:42.820300 (+401940us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78583680}
I20260709 13:08:42.468171 20034 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:42.793090 13865 rpcz_store.cc:276] 0709 13:08:38.819264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.825357 (+  6093us) service_pool.cc:224] Handling call
0709 13:08:38.825739 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:42.297612 (+3471873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.399210 (+101598us) spinlock_profiling.cc:243] Waited 3.46 s on lock 0x7b540004b854. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:42.399393 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7968472832}
I20260709 13:08:42.771406 19932 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:42.511229 19970 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:42.813462 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58552 (request call id 1588) took 1047 ms. Trace:
I20260709 13:08:42.771252 20017 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:42.816751 14367 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:42.796566 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:42.959049 13757 leader_election.cc:336] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 1.566s (SENT)
I20260709 13:08:42.959832 13757 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:42.856698 13710 consensus_meta.cc:287] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.558s	user 0.008s	sys 0.000s
I20260709 13:08:42.824514 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:42.897840 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 79413.9us
W20260709 13:08:42.830247 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.824885 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:42.814023 20242 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.918488 19870 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:42.823063 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:43.004036 20261 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 13:08:43.004488 20242 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:43.005617 14402 raft_consensus.cc:2393] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 12: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:42.897538 20131 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:43.005316 20069 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:43.005791 20261 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:08:42.961359 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 144676us
I20260709 13:08:42.841574 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:43.006830 14367 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:42.815276 14393 rpcz_store.cc:276] 0709 13:08:38.616231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.618740 (+  2509us) service_pool.cc:224] Handling call
0709 13:08:41.868620 (+3249880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.926856 (+ 58236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.737335 (+810479us) spinlock_profiling.cc:243] Waited 3.25 s on lock 0x7b54009169d0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:42.737482 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7473147776}
I20260709 13:08:42.814973 20231 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:42.855948 20216 consensus_meta.cc:287] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.523s	user 0.005s	sys 0.000s
I20260709 13:08:43.008327 13712 rpcz_store.cc:276] 0709 13:08:41.766478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.734077 (+967599us) service_pool.cc:224] Handling call
0709 13:08:42.813406 (+ 79329us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:43.009123 20216 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.009634 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.010215 14399 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 9.
I20260709 13:08:43.010432 13712 raft_consensus.cc:2410] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 19 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:08:43.010883 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 2869) took 1148 ms. Trace:
I20260709 13:08:42.962404 19847 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:42.932905 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:43.012174 20216 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:42.932924 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:43.005028 13755 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:42.837271 20238 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:42.921816 20258 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.101s
W20260709 13:08:42.838616 19391 consensus_meta.cc:287] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 1.019s	user 0.006s	sys 0.006s
I20260709 13:08:42.939090 20227 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:42.940085 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3789) took 1997 ms. Trace:
I20260709 13:08:42.969316 20193 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:42.912511 14400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1898) took 4088 ms. Trace:
I20260709 13:08:42.821810 13857 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:08:42.960755 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:43.056499 14396 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:08:43.057356 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:43.057988 13857 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:43.058851 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:43.059955 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:43.061038 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:43.062125 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:43.063146 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:43.064320 13857 raft_consensus.cc:2410] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 20 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:43.065114 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:43.065824 13857 raft_consensus.cc:2410] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 13:08:43.066741 20184 consensus_meta.cc:287] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 1.093s	user 0.007s	sys 0.000s
I20260709 13:08:43.066838 13857 raft_consensus.cc:1217] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Deduplicated request from leader. Original: 14.11->[15.12-15.12]   Dedup: 15.12->[]
I20260709 13:08:43.067479 13857 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:08:43.067328 20184 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.069823 20184 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:43.079118 20167 consensus_meta.cc:287] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.921s	user 0.011s	sys 0.000s
I20260709 13:08:43.013134 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:42.831811 13859 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:43.020155 14367 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:43.083779 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 63729.6us
I20260709 13:08:43.084584 14367 leader_election.cc:400] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 15. Current term is 16.
I20260709 13:08:43.085517 14367 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:43.086838 14367 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:42.962065 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:43.055786 14400 rpcz_store.cc:276] 0709 13:08:38.823927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.845597 (+ 21670us) service_pool.cc:224] Handling call
0709 13:08:38.845973 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.862027 (+ 16054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.862076 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:38.877682 (+ 15606us) log.cc:844] Serialized 26 byte log entry
0709 13:08:38.995267 (+117585us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:38.995402 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.995878 (+   476us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:42.293792 (+3297914us) spinlock_profiling.cc:243] Waited 71.7 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:42.892373 (+598581us) raft_consensus.cc:1685] finished
0709 13:08:42.892399 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.912428 (+ 20029us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2376,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":5234,"spinlock_wait_cycles":164877568,"thread_start_us":95335,"threads_started":1,"wal-append.queue_time_us":111321}
I20260709 13:08:43.087649 13865 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:42.903801 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 74647.2us
I20260709 13:08:42.832305 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:42.837450 20126 consensus_meta.cc:287] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.643s	user 0.006s	sys 0.002s
I20260709 13:08:43.091667 20126 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.094010 20126 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:42.886477 20118 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:42.885890 20065 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.095494 20065 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:42.835633 20263 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:43.097755 20263 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.097926 20065 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:43.098281 20263 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:42.835981 20203 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:42.828222 19952 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:43.015588 20209 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.041043 20017 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.105257 20017 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:43.105777 20263 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.106451 20209 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:43.046838 19847 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:43.107578 19847 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:43.107735 20227 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:43.108009 19847 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:43.108456 20227 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:43.108836 20227 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:43.109193 20227 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:43.110446 20167 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:42.933630 19982 consensus_queue.cc:237] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.111310 13865 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:43.112465 20167 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:43.112589 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:43.113263 13865 raft_consensus.cc:2368] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 9. Current term is 10.
I20260709 13:08:42.992755 20236 consensus_queue.cc:237] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.114019 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:43.114416 13858 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:43.114809 13865 raft_consensus.cc:2410] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:08:43.107589 20216 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:43.116554 20227 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.117079 20216 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.984269 20259 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:43.051443 20199 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:43.052830 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:43.053834 13861 rpcz_store.cc:276] 0709 13:08:40.942733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.095795 (+153062us) service_pool.cc:224] Handling call
0709 13:08:41.703140 (+607345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.792637 (+ 89497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.939833 (+1147196us) spinlock_profiling.cc:243] Waited 88.7 ms on lock 0x7b5400387554. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:42.940027 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204051200}
I20260709 13:08:43.117893 13865 raft_consensus.cc:1240] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:43.049420 20034 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:43.117465 20216 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:43.115293 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:43.117992 14394 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 17: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:43.118793 13860 raft_consensus.cc:1240] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 13:08:43.020836 19932 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:43.120173 13858 raft_consensus.cc:1240] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:43.121220 20263 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:43.123558 20017 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:43.124539 20227 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:43.130262 20216 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.132501 20216 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:43.134131 19847 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.078662 20231 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.136999 20231 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:43.138760 19847 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:43.140348 20227 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:43.141062 20227 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.143704 20227 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:43.011186 13712 rpcz_store.cc:276] 0709 13:08:41.862583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.009370 (+1146787us) service_pool.cc:224] Handling call
0709 13:08:43.010830 (+  1460us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:42.827862 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.192780 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.194401 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.194610 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:42.961094 13710 raft_consensus.cc:2410] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:08:43.195672 13712 raft_consensus.cc:2393] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 15: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:43.196290 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 3336) took 1054 ms. Trace:
W20260709 13:08:43.196502 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.196779 13710 rpcz_store.cc:276] 0709 13:08:42.141444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.289738 (+148294us) service_pool.cc:224] Handling call
0709 13:08:43.196060 (+906322us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:42.824401 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.198325 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.198974 13716 raft_consensus.cc:2410] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:42.961967 13711 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:43.199932 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.200243 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.200899 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.201151 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 2867) took 1339 ms. Trace:
I20260709 13:08:43.201344 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.201577 13716 rpcz_store.cc:276] 0709 13:08:41.862095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.199834 (+1337739us) service_pool.cc:224] Handling call
0709 13:08:43.201103 (+  1269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:43.202256 13709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 3326) took 1450 ms. Trace:
I20260709 13:08:43.202771 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:43.189791 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 237081us
I20260709 13:08:43.204185 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:43.205617 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.206604 13716 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:43.201697 13711 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:08:43.041980 13755 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:43.207647 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58552 (request call id 1591) took 1430 ms. Trace:
I20260709 13:08:43.208048 13711 rpcz_store.cc:276] 0709 13:08:41.777785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.200429 (+1422644us) service_pool.cc:224] Handling call
0709 13:08:43.207597 (+  7168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:43.209281 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:43.209877 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 167895us
I20260709 13:08:43.210088 13711 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:43.210636 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58552 (request call id 1592) took 1362 ms. Trace:
I20260709 13:08:43.196897 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.212015 13712 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:08:43.212637 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 3327) took 1460 ms. Trace:
I20260709 13:08:43.212985 13712 rpcz_store.cc:276] 0709 13:08:41.752156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.196516 (+1444360us) service_pool.cc:224] Handling call
0709 13:08:43.212554 (+ 16038us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:43.213367 13755 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:43.214828 13755 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:43.215245 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 3328) took 1462 ms. Trace:
I20260709 13:08:43.216130 13710 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:43.218318 13710 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:43.219069 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2857) took 1409 ms. Trace:
I20260709 13:08:43.219594 13710 rpcz_store.cc:276] 0709 13:08:41.810140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.217158 (+1407018us) service_pool.cc:224] Handling call
0709 13:08:43.217685 (+   527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.218789 (+  1104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.219003 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:43.221566 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.202705 13709 rpcz_store.cc:276] 0709 13:08:41.751720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.194146 (+1442426us) service_pool.cc:224] Handling call
0709 13:08:43.202182 (+  8036us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:42.884980 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 72412.4us
W20260709 13:08:42.962960 13757 leader_election.cc:336] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 1.599s (SENT)
I20260709 13:08:43.222088 13712 rpcz_store.cc:276] 0709 13:08:41.754061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.213780 (+1459719us) service_pool.cc:224] Handling call
0709 13:08:43.214338 (+   558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.214848 (+   510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.214876 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:43.214938 (+    62us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:43.214978 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.215062 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.215175 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:43.224277 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.224354 13757 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:43.225234 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.225787 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:43.226214 13756 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:43.226526 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 263586us
I20260709 13:08:43.226752 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:43.228405 13757 leader_election.cc:336] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 2.066s (SENT)
I20260709 13:08:43.229194 13757 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:43.229676 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2859) took 1419 ms. Trace:
I20260709 13:08:43.230762 13756 leader_election.cc:400] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15.
I20260709 13:08:43.210975 13711 rpcz_store.cc:276] 0709 13:08:41.847850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.208836 (+1360986us) service_pool.cc:224] Handling call
0709 13:08:43.210588 (+  1752us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:43.233835 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.234967 13786 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:43.230214 13712 rpcz_store.cc:276] 0709 13:08:41.810729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.228104 (+1417375us) service_pool.cc:224] Handling call
0709 13:08:43.228738 (+   634us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.229199 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.229243 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:43.229330 (+    87us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:43.229393 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.229475 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.229614 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:43.224434 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.237074 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2659) took 1268 ms. Trace:
I20260709 13:08:43.238412 13791 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:08:43.240598 13716 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:08:43.235772 13756 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:43.259989 13709 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:43.264456 19847 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:43.266683 13830 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:43.268225 13712 raft_consensus.cc:1240] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:43.269098 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2862) took 1457 ms. Trace:
I20260709 13:08:43.269484 13712 rpcz_store.cc:276] 0709 13:08:41.835982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.241936 (+1405954us) service_pool.cc:224] Handling call
0709 13:08:43.267849 (+ 25913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.268743 (+   894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.269014 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:43.270362 14368 leader_election.cc:400] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 9. Current term is 10.
I20260709 13:08:43.270226 19857 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:43.270861 14368 leader_election.cc:403] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:08:43.271709 19391 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:43.271894 20069 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:43.272791 19391 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:43.273172 14400 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:43.273734 19391 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:43.275607 20020 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:43.275911 14396 raft_consensus.cc:1240] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:43.276634 19870 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:43.277084 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 167275us
I20260709 13:08:43.277397 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2868) took 1415 ms. Trace:
I20260709 13:08:43.279203 20216 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:43.279832 19970 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:43.280341 19970 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.280746 19970 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:43.277334 19870 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.277915 13712 rpcz_store.cc:276] 0709 13:08:41.862338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.270467 (+1408129us) service_pool.cc:224] Handling call
0709 13:08:43.270982 (+   515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.276966 (+  5984us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.276998 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:43.277067 (+    69us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:43.277140 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.277203 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.277327 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:43.263397 13709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2858) took 1452 ms. Trace:
I20260709 13:08:43.283619 13709 rpcz_store.cc:276] 0709 13:08:41.810455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.226848 (+1416393us) service_pool.cc:224] Handling call
0709 13:08:43.227322 (+   474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.260576 (+ 33254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.262338 (+  1762us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:43.285247 19533 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:43.288293 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2860) took 1477 ms. Trace:
I20260709 13:08:43.280647 19982 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:43.290987 19982 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.291446 19982 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:43.293947 19870 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:43.294667 20126 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:43.242666 13787 rpcz_store.cc:276] 0709 13:08:41.968171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.969820 (+  1649us) service_pool.cc:224] Handling call
0709 13:08:41.970175 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.970443 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:41.970759 (+   316us) log.cc:844] Serialized 14 byte log entry
0709 13:08:42.929017 (+958258us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b18002b5760. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e23a 00007f52324e8a2a
0709 13:08:43.236131 (+307114us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:43.236265 (+   134us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:43.236418 (+   153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.236585 (+   167us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.236797 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":137,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":3546,"spinlock_wait_cycles":7443840,"thread_start_us":306566,"threads_started":1,"wal-append.queue_time_us":1118474}
I20260709 13:08:43.290303 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:43.296408 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:43.300642 13858 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:43.303921 13859 raft_consensus.cc:2393] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 10: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:08:43.304917 13708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 3323) took 1554 ms (client timeout 1524 ms). Trace:
I20260709 13:08:43.305261 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:43.306038 13859 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:43.305523 13708 rpcz_store.cc:269] 0709 13:08:41.750711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.750841 (+   130us) service_pool.cc:224] Handling call
0709 13:08:43.304472 (+1553631us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b54002e7cd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:43.304688 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7555840}
I20260709 13:08:43.313944 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:43.314772 13861 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:43.315904 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3197) took 1193 ms. Trace:
I20260709 13:08:43.316833 19847 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:43.317718 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 51456.7us
I20260709 13:08:43.320182 13830 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:43.321745 20025 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:43.322270 20025 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:43.322793 20025 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:43.323205 20184 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:43.324208 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42104 (request call id 1581) took 1089 ms. Trace:
I20260709 13:08:43.324723 13862 rpcz_store.cc:276] 0709 13:08:42.234571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.235954 (+  1383us) service_pool.cc:224] Handling call
0709 13:08:43.323780 (+1087826us) spinlock_profiling.cc:243] Waited 7.23 ms on lock 0x7b540035aa54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:43.323994 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16628480}
I20260709 13:08:43.327848 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:43.331926 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 3194) took 1225 ms. Trace:
I20260709 13:08:43.332402 13782 rpcz_store.cc:276] 0709 13:08:42.106781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.268946 (+162165us) service_pool.cc:224] Handling call
0709 13:08:43.312020 (+1043074us) spinlock_profiling.cc:243] Waited 79.8 ms on lock 0x7b54000b1b54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:43.331683 (+ 19663us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183457152}
I20260709 13:08:43.316392 13785 rpcz_store.cc:276] 0709 13:08:42.122343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.330676 (+208333us) service_pool.cc:224] Handling call
0709 13:08:42.342617 (+ 11941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:42.367960 (+ 25343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.315316 (+947356us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b54000b2f54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:43.315680 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53028736}
W20260709 13:08:43.342340 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 111205us
I20260709 13:08:43.312927 20126 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.289141 13711 rpcz_store.cc:276] 0709 13:08:41.810995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.232975 (+1421980us) service_pool.cc:224] Handling call
0709 13:08:43.233350 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.284506 (+ 51156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.284526 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:43.287860 (+  3334us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:43.288037 (+   177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.288113 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.288241 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":47988,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":184,"thread_start_us":49114,"threads_started":1}
I20260709 13:08:43.349414 13712 raft_consensus.cc:1240] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:43.354554 20204 consensus_queue.cc:1059] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:43.356020 20263 raft_consensus.cc:3055] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:43.353372 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:43.357189 20263 raft_consensus.cc:740] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:43.357626 19325 consensus_queue.cc:260] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.359265 19325 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:43.358572 20263 consensus_queue.cc:260] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:42.059394 13784 rpcz_store.cc:276] 0709 13:08:39.234542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.446615 (+212073us) service_pool.cc:224] Handling call
0709 13:08:40.750296 (+1303681us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.750519 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:40.750835 (+   316us) log.cc:844] Serialized 14 byte log entry
0709 13:08:40.980431 (+229596us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:40.986918 (+  6487us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:40.997095 (+ 10177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.997158 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.997660 (+1000502us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400161f50. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:41.997774 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":161,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":70,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"spinlock_wait_cycles":2997360384,"thread_start_us":229080,"threads_started":1,"wal-append.queue_time_us":290112,"wal-append.run_cpu_time_us":1035,"wal-append.run_wall_time_us":1018074}
I20260709 13:08:43.377710 13859 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:43.379437 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:08:43.388441 14367 leader_election.cc:336] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Timed out: RequestConsensusVote RPC to 127.12.76.129:37533 timed out after 2.212s (SENT)
I20260709 13:08:43.375466 19867 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:43.394096 20078 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:43.394698 20078 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.379233 19900 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:43.397426 14367 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:43.399686 13680 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:43.399714 19900 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:43.400908 14367 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:43.402016 19900 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:43.403055 20208 log.cc:927] Time spent T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 2.395s	user 0.002s	sys 0.019s
I20260709 13:08:43.395859 20078 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:43.404997 14367 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:43.406101 19900 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:43.406558 19900 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.406970 19900 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:43.409058 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3193) took 1302 ms. Trace:
I20260709 13:08:43.409468 13791 rpcz_store.cc:276] 0709 13:08:42.106483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.298641 (+192158us) service_pool.cc:224] Handling call
0709 13:08:42.311714 (+ 13073us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:43.259185 (+947471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.408707 (+149522us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b540033ac54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:43.408993 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2129182592}
W20260709 13:08:43.413733 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.415066 13682 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:43.403668 19867 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:43.429725 14368 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:43.419953 19867 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.431226 19867 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:43.433530 13858 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
W20260709 13:08:43.432879 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 197384us
I20260709 13:08:43.427886 19900 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.434971 20204 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:43.434990 19837 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:43.434993 20123 raft_consensus.cc:2764] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:08:43.460443 14399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 1456) took 1254 ms. Trace:
W20260709 13:08:43.463955 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 49029.7us
I20260709 13:08:43.459398 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 1464) took 1129 ms. Trace:
W20260709 13:08:43.457593 13707 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 3315) took 3225 ms (client timeout 2172 ms). Trace:
I20260709 13:08:43.463675 14399 rpcz_store.cc:276] 0709 13:08:42.206307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.209421 (+  3114us) service_pool.cc:224] Handling call
0709 13:08:43.460106 (+1250685us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b540070fb54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:43.460251 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1739755904}
I20260709 13:08:43.446262 20126 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:43.467357 13707 rpcz_store.cc:269] 0709 13:08:40.231913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.413965 (+182052us) service_pool.cc:224] Handling call
0709 13:08:43.457234 (+3043269us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b5400260554. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:43.457405 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3366039296}
I20260709 13:08:43.447222 20204 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:43.456422 20263 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:43.472427 14367 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:43.471632 13756 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:43.476943 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 3067) took 1053 ms. Trace:
I20260709 13:08:43.477152 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:43.477344 13857 rpcz_store.cc:276] 0709 13:08:42.391203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.069266 (+678063us) service_pool.cc:224] Handling call
0709 13:08:43.331438 (+262172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.331852 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.331874 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:43.331934 (+    60us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:43.331975 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.332045 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.438934 (+106889us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b540035aa50. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:43.444133 (+  5199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":602055936}
I20260709 13:08:43.477911 14396 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:43.479745 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:43.480727 14400 raft_consensus.cc:2410] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:08:43.485334 20075 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:43.472975 20204 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:43.486383 13861 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:08:43.489202 13830 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:43.490463 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 30 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.490844 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:43.491654 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 62201.7us
I20260709 13:08:43.491748 13709 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:43.491868 19932 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:43.496685 20115 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:43.496654 20284 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:43.499784 20203 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:43.502730 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.494540 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:43.494761 19932 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.505939 20231 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.504660 20118 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:43.510447 20231 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.510603 20118 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.511981 13712 raft_consensus.cc:2410] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 30 because replica has last-logged OpId of term: 28 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 19.
I20260709 13:08:43.512836 20231 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:43.512892 20118 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:43.514632 20235 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 1.452s	user 0.003s	sys 0.000s
I20260709 13:08:43.516413 13715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 1578) took 3214 ms. Trace:
I20260709 13:08:43.516623 20284 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.516822 13715 rpcz_store.cc:276] 0709 13:08:40.301937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.889464 (+587527us) service_pool.cc:224] Handling call
0709 13:08:40.892602 (+  3138us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:41.715357 (+822755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:41.715386 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:41.715825 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:08:42.061977 (+346152us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:42.354241 (+292264us) log.cc:844] Serialized 14 byte log entry
0709 13:08:42.354966 (+   725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.355032 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:43.513808 (+1158776us) spinlock_profiling.cc:243] Waited 9.2 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:43.515914 (+  2106us) raft_consensus.cc:1685] finished
0709 13:08:43.516002 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.516195 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":822373,"prepare.queue_time_us":11343,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":836017,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":8231,"spinlock_wait_cycles":21158656,"thread_start_us":637581,"threads_started":2,"wal-append.queue_time_us":346119}
I20260709 13:08:43.518923 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1582) took 1282 ms. Trace:
I20260709 13:08:43.518998 20284 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:43.519395 13863 rpcz_store.cc:276] 0709 13:08:42.236291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.237330 (+  1039us) service_pool.cc:224] Handling call
0709 13:08:42.237665 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:42.799905 (+562240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.518427 (+718522us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b54002d8cd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:43.518737 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1255585024}
W20260709 13:08:43.521026 20285 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:08:43.522425 13716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2870) took 1307 ms. Trace:
I20260709 13:08:43.525177 14393 raft_consensus.cc:2410] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 17 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:43.525524 14395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1904) took 1383 ms. Trace:
I20260709 13:08:43.525326 20159 consensus_queue.cc:1059] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:43.497396 20115 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:43.523617 19932 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:43.526425 20115 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:43.525933 14395 rpcz_store.cc:276] 0709 13:08:42.141829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.147661 (+  5832us) service_pool.cc:224] Handling call
0709 13:08:42.148069 (+   408us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:42.194521 (+ 46452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.524947 (+1330426us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b5400595bd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:43.525349 (+   402us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104776448}
I20260709 13:08:43.528528 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.464797 14398 rpcz_store.cc:276] 0709 13:08:42.329992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.330647 (+   655us) service_pool.cc:224] Handling call
0709 13:08:42.331005 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:42.821413 (+490408us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:08:43.100489 (+279076us) log.cc:844] Serialized 14 byte log entry
0709 13:08:43.154021 (+ 53532us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:43.154074 (+    53us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:43.154127 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.458913 (+304786us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54005c1054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:43.458990 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.459222 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":266627,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":379,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"spinlock_wait_cycles":1127336832,"thread_start_us":331997,"threads_started":2,"wal-append.queue_time_us":53486}
I20260709 13:08:43.529894 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:43.533643 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 58138.3us
I20260709 13:08:43.522846 13716 rpcz_store.cc:276] 0709 13:08:42.214859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.281155 (+1066296us) service_pool.cc:224] Handling call
0709 13:08:43.285393 (+  4238us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:43.286039 (+   646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.286074 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:43.286732 (+   658us) log.cc:844] Serialized 26 byte log entry
0709 13:08:43.341113 (+ 54381us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:08:43.466320 (+125207us) log.cc:844] Serialized 14 byte log entry
0709 13:08:43.466546 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.466620 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:43.522162 (+ 55542us) raft_consensus.cc:1685] finished
0709 13:08:43.522188 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.522349 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26845,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":3229,"raft.queue_time_us":3188,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":27717,"thread_start_us":170370,"threads_started":2,"wal-append.queue_time_us":89177}
I20260709 13:08:43.537706 14368 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:43.539824 14368 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:43.539898 20033 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:43.536331 20126 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:43.556905 14398 raft_consensus.cc:1240] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:08:43.556929 20227 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:43.557740 20227 raft_consensus.cc:697] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:43.558935 20227 consensus_queue.cc:237] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:43.559945 13786 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 2655) took 2544 ms (client timeout 1905 ms). Trace:
W20260709 13:08:43.560528 13786 rpcz_store.cc:269] 0709 13:08:41.015513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.016349 (+   836us) service_pool.cc:224] Handling call
0709 13:08:43.559643 (+2543294us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b540026ded4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:43.559798 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3511380224}
I20260709 13:08:43.563588 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.566346 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.567392 13715 raft_consensus.cc:2410] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:08:43.581248 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.583007 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.584333 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.586745 14367 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:43.588598 14367 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:43.588850 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.589797 13713 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:08:43.590775 14367 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:43.590934 19629 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:43.591387 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:43.591575 19629 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.590804 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:43.592185 19629 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:43.592357 13709 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:43.596089 19982 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.596639 20199 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:43.597996 19971 leader_election.cc:290] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:43.598709 19982 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:43.598879 14367 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:43.552564 19900 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:43.605118 19900 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:43.606083 13714 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:43.608790 19763 raft_consensus.cc:3055] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:43.609301 19763 raft_consensus.cc:740] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:43.610919 13709 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:08:43.613569 20089 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:43.614681 20204 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.616080 20115 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:43.618333 20115 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:43.551137 20078 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.620306 14367 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:43.531782 19867 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:43.624275 13710 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:08:43.625787 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 77488.1us
I20260709 13:08:43.551874 20126 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.628373 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:43.631999 13716 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:43.623464 13714 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58552 (request call id 1585) took 1857 ms (client timeout 1746 ms). Trace:
W20260709 13:08:43.632644 13714 rpcz_store.cc:269] 0709 13:08:41.765769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.975675 (+209906us) service_pool.cc:224] Handling call
0709 13:08:43.623177 (+1647502us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b540017a054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:43.623353 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3746803456}
I20260709 13:08:43.633253 19325 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:43.633718 14367 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:43.635582 20034 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:43.636000 20034 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.636339 20034 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:43.637722 19867 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:43.636341 20078 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:43.639694 19900 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:43.643661 14368 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:43.646685 19952 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:43.647313 19952 raft_consensus.cc:697] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:43.648677 19952 consensus_queue.cc:237] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.651294 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:43.652614 13856 raft_consensus.cc:2410] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:43.652918 20204 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:43.653616 20204 consensus_queue.cc:1059] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:43.654623 20204 raft_consensus.cc:3055] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:43.656549 19971 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.657387 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2866) took 1795 ms. Trace:
I20260709 13:08:43.657800 13710 rpcz_store.cc:276] 0709 13:08:41.861824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.277547 (+1415723us) service_pool.cc:224] Handling call
0709 13:08:43.623910 (+346363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.626940 (+  3030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.657170 (+ 30230us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b540017a050. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:43.657314 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":795499392}
I20260709 13:08:43.658365 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:43.657989 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:43.660223 13785 raft_consensus.cc:2410] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:08:43.661134 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:43.661247 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:43.661788 14398 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:43.662173 13791 raft_consensus.cc:2410] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:08:43.663553 14367 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:43.553433 20216 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 9. Current term is 10.
I20260709 13:08:43.666469 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:43.666682 14393 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:43.666978 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:43.667172 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:43.668246 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:43.554780 20033 raft_consensus.cc:697] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:43.686005 14398 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:43.667212 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:43.671008 20231 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:43.671123 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:43.675097 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 144007us
I20260709 13:08:43.675791 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:43.662431 20204 raft_consensus.cc:740] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:43.674090 13682 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:43.685192 13712 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 15: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:43.657279 19971 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:43.688586 20285 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:08:43.697757 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:43.698006 14396 raft_consensus.cc:1240] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:43.688807 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:43.692145 13782 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:43.699157 13786 raft_consensus.cc:2393] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 19: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:43.664529 20126 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:43.692322 20231 raft_consensus.cc:697] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 19 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:43.705529 13756 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:43.707046 13756 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:43.706790 20231 consensus_queue.cc:237] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.708706 13756 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:43.695040 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.709504 13713 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:43.710616 20218 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:43.711077 20218 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:43.711537 20218 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:43.712270 13609 catalog_manager.cc:5697] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.694623 13783 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:43.689358 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:43.610703 19763 consensus_queue.cc:260] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:43.703241 19971 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:43.703519 20242 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:43.704284 20033 consensus_queue.cc:237] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:43.722302 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.708729 20249 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:43.724362 20249 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.724427 20116 raft_consensus.cc:2764] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:08:43.724830 20249 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:43.715157 14395 raft_consensus.cc:2410] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:08:43.703013 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.717335 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:43.705256 13680 connection.cc:256] RPC call timeout handler was delayed by -1.264302872999906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21080000000000002s for a response
I20260709 13:08:43.716661 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:43.719056 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 45109.4us
I20260709 13:08:43.719973 13609 catalog_manager.cc:5697] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:08:43.693534 20020 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:43.774595 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:43.768232 20069 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:43.786029 14393 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:43.776801 20282 log.cc:927] Time spent T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:08:43.782102 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:43.770009 20199 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:08:43.791291 13830 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:43.776444 19982 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:43.782158 13609 catalog_manager.cc:5697] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 11 to 13, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 13 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.797614 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:43.800467 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:43.800942 13856 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:43.807914 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:43.812238 14368 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:43.821292 13783 raft_consensus.cc:2393] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 22: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:43.822786 14398 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:43.824115 13609 catalog_manager.cc:5697] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:43.793669 20242 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:08:43.830533 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:43.827643 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 119029us
I20260709 13:08:43.814044 19982 raft_consensus.cc:697] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:43.833811 13791 raft_consensus.cc:2393] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 16: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:43.833154 13784 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:43.825066 19900 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:43.799067 20020 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:43.843247 20037 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:43.843395 20192 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:08:43.848320 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:43.851652 13613 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57116 (request call id 256) took 20245 ms (client timeout 15000 ms). Trace:
W20260709 13:08:43.839565 19970 consensus_meta.cc:287] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.558s	user 0.014s	sys 0.000s
I20260709 13:08:43.846824 13609 catalog_manager.cc:5697] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 8 to 9, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 9 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.862457 13755 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:43.855293 19763 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:43.867525 20204 consensus_queue.cc:260] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.868275 13777 tablet_service.cc:1558] Processing DeleteTablet for tablet c9e22f0634b34971aed9c5b948f3275e with delete_type TABLET_DATA_TOMBSTONED (TS 35ecb005831740438d7537dd4b840e03 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:48902
I20260709 13:08:43.868806 20204 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:43.871094 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:43.871914 14401 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:08:43.873029 20037 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.873513 20037 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:43.858572 19970 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:43.876363 13601 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 536b1fc131984687bf3b13417507e21d with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b5029654a4384e43a68eb67b794949b7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:43.877712 19970 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:43.837286 19932 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.907735 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:43.955752 13791 raft_consensus.cc:2393] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 10: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:43.909888 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.910936 13710 raft_consensus.cc:1240] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:08:43.911568 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.911823 13609 catalog_manager.cc:5697] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 12 to 14, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 14 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.918571 20037 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:43.919333 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.919486 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:43.922760 19982 consensus_queue.cc:237] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:43.925467 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.925369 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:43.926353 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:43.927345 20020 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:43.927260 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:43.928525 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:43.929201 19971 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:43.930594 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:43.934948 20116 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.965288 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.965888 20116 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.966732 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:43.967634 14402 raft_consensus.cc:1240] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:08:43.969440 20116 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:43.855017 20115 consensus_queue.cc:1059] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.100s
I20260709 13:08:43.971666 19971 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.974622 19971 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:43.976135 20288 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:08:43.976611 13857 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:08:43.977955 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:43.979759 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:43.980309 13790 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:08:43.980551 13856 raft_consensus.cc:2393] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 10: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:43.982421 19932 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:43.983615 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:43.984385 13715 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:43.984822 13784 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:08:43.939970 13682 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:43.941807 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:43.947136 20025 consensus_meta.cc:287] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.624s	user 0.006s	sys 0.007s
I20260709 13:08:43.885707 20034 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:43.991359 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:43.991761 13788 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:43.992321 14396 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 10.
I20260709 13:08:43.950340 13757 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:43.954054 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:43.959306 13714 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 14: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:43.960358 13787 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:08:43.964133 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:43.964993 20037 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:43.996603 13709 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 15: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:43.936046 13755 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:43.985386 13716 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:43.989692 13783 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:08:43.965170 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:43.999660 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 225924us
I20260709 13:08:44.015666 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:44.016726 13784 raft_consensus.cc:2368] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 9. Current term is 10.
I20260709 13:08:44.018591 13858 raft_consensus.cc:1240] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:44.020152 20078 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:44.020715 20078 raft_consensus.cc:697] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:44.021617 20078 consensus_queue.cc:237] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:44.023758 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.023695 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:44.024855 13863 raft_consensus.cc:2393] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 19: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:08:44.025198 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.027668 20118 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:44.028744 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:44.028962 13680 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:44.029215 19837 consensus_queue.cc:1059] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:08:44.030014 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 90191.4us
I20260709 13:08:44.030432 19837 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:44.030901 19837 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.032039 20284 raft_consensus.cc:3055] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:44.032419 13682 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:44.032493 20284 raft_consensus.cc:740] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:44.031248 19837 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:44.033830 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:44.035063 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:44.034775 13609 catalog_manager.cc:5697] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 12 to 14, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 14 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:08:44.032462 13680 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:44.036485 13609 catalog_manager.cc:5697] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:08:44.037855 13609 catalog_manager.cc:5697] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 14 to 15, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 15 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:08:44.039929 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.041054 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.042439 19629 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:44.047940 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 112017us
I20260709 13:08:44.048825 13755 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:44.049127 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:44.049657 20020 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:44.049957 13864 raft_consensus.cc:2393] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 16: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:44.049824 13755 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:44.050374 20020 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:43.993646 20192 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:44.050895 20192 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:44.051067 20020 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:44.051327 20192 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:44.053651 20034 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:44.029947 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.057965 13784 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 15: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:44.036211 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.070031 14397 raft_consensus.cc:2393] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 18: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:44.059141 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:44.072377 14399 raft_consensus.cc:1240] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:08:44.072819 13712 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:44.075834 13788 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:08:44.068697 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.078714 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.084833 13755 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:44.086061 13715 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:44.087641 13715 pending_rounds.cc:85] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 19
W20260709 13:08:44.089445 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 95954.9us
I20260709 13:08:44.089928 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:43.994529 20025 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:44.093389 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:44.091518 13783 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:08:44.085512 13609 catalog_manager.cc:5697] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:44.092783 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.099869 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:44.087956 13715 pending_rounds.cc:107] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 28.20
I20260709 13:08:44.101486 13715 raft_consensus.cc:2889] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:44.104363 20239 raft_consensus.cc:2764] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 13:08:44.104570 20115 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:44.105178 20115 raft_consensus.cc:697] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:44.106097 20115 consensus_queue.cc:237] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:44.106518 13791 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:44.088285 19325 consensus_queue.cc:1048] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:08:44.107445 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.108311 13791 raft_consensus.cc:2410] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:08:44.108631 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:44.109071 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.109716 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.110234 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.110553 13790 raft_consensus.cc:2410] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:08:44.104375 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.111063 13791 raft_consensus.cc:2410] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:44.109115 13609 catalog_manager.cc:5697] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 13 to 14, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 14 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:08:44.111384 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.113987 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.114555 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.116151 13790 raft_consensus.cc:1240] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 13:08:44.117010 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:44.117903 13784 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 15: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:44.113485 13609 catalog_manager.cc:5697] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 11 to 12, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 12 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:44.119525 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 151543us
I20260709 13:08:44.124128 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:44.124887 14396 raft_consensus.cc:2393] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 15: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:44.125847 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:44.126716 14402 raft_consensus.cc:2410] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:08:44.130961 14401 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:44.131561 20284 consensus_queue.cc:260] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:44.119127 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.132874 20284 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:43.852090 13613 rpcz_store.cc:269] 0709 13:08:23.605943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.606194 (+   251us) service_pool.cc:224] Handling call
0709 13:08:43.851391 (+20245197us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:33.937409 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:33.972565 (+ 35156us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:33.972633 (+    68us) write_op.cc:435] Acquired schema lock
0709 13:08:33.972672 (+    39us) tablet.cc:662] Decoding operations
0709 13:08:34.401706 (+429034us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:34.456347 (+ 54641us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:34.462188 (+  5841us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:08:34.835244 (+373056us) tablet.cc:701] Row locks acquired
0709 13:08:34.866549 (+ 31305us) write_op.cc:260] PREPARE: finished
0709 13:08:34.885654 (+ 19105us) write_op.cc:270] Start()
0709 13:08:34.926080 (+ 40426us) write_op.cc:276] Timestamp: P: 1783602514879448 usec, L: 0
0709 13:08:34.937117 (+ 11037us) op_driver.cc:348] REPLICATION: starting
0709 13:08:35.055677 (+118560us) log.cc:844] Serialized 7103 byte log entry
0709 13:08:35.642998 (+587321us) op_driver.cc:464] REPLICATION: finished
0709 13:08:35.996755 (+353757us) write_op.cc:301] APPLY: starting
0709 13:08:35.996881 (+   126us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:36.179750 (+182869us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:36.182392 (+  2642us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:36.921250 (+738858us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:36.921765 (+   515us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 13:08:36.921855 (+    90us) write_op.cc:312] APPLY: finished
0709 13:08:36.922470 (+   615us) log.cc:844] Serialized 164 byte log entry
0709 13:08:37.319995 (+397525us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:37.328712 (+  8717us) write_op.cc:454] Released schema lock
0709 13:08:37.348682 (+ 19970us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:37.406794 (+ 58112us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:37.407842 (+  1048us) write_op.cc:454] Released schema lock
0709 13:08:38.269499 (+861657us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b180033cca0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f13f3 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
Metrics: {"mutex_wait_us":23244,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":353422,"apply.run_cpu_time_us":61864,"apply.run_wall_time_us":1387978,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79367,"num_ops":18,"prepare.queue_time_us":549243,"prepare.run_cpu_time_us":33885,"prepare.run_wall_time_us":1355755,"raft.queue_time_us":211832,"raft.run_cpu_time_us":25750,"raft.run_wall_time_us":208610,"replication_time_us":703789,"spinlock_wait_cycles":4196736,"thread_start_us":1158112,"threads_started":5,"wal-append.queue_time_us":850595,"wal-append.run_cpu_time_us":13038,"wal-append.run_wall_time_us":2126099}]]}
I20260709 13:08:44.137223 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:44.137971 14396 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:44.139068 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:44.139967 14402 raft_consensus.cc:2410] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:08:44.107496 13713 raft_consensus.cc:1240] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:08:44.141588 13785 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:08:44.143050 19971 raft_consensus.cc:3055] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:44.143474 19971 raft_consensus.cc:740] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:44.144385 19971 consensus_queue.cc:260] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:44.145104 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:44.145901 20306 log.cc:927] Time spent T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:08:44.150868 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:44.098654 13756 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:44.067834 19970 consensus_queue.cc:1059] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.083s
I20260709 13:08:44.089129 19857 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:44.166085 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:44.101924 20069 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:08:44.172849 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 74312.8us
I20260709 13:08:44.170346 14396 raft_consensus.cc:2393] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 10: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:44.166493 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:44.171300 13862 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:44.174817 14402 raft_consensus.cc:2410] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:08:44.168341 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:44.176373 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:44.181442 14367 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:44.078289 19837 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:44.189339 13859 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:44.168408 19847 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:44.193497 14400 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:08:44.205088 13709 raft_consensus.cc:1240] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:08:44.185856 20033 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:44.158962 20249 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:44.203619 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:44.217903 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 286522us
W20260709 13:08:44.218657 13829 connection.cc:256] RPC call timeout handler was delayed by -1.0346441159999813s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
I20260709 13:08:44.202899 20034 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:44.216948 20218 consensus_meta.cc:287] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.002s
I20260709 13:08:44.194126 20126 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:44.207090 19982 consensus_queue.cc:1059] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:08:44.208653 20216 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:08:44.218781 20033 raft_consensus.cc:697] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:44.255405 14367 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:44.264758 13861 raft_consensus.cc:2393] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 19: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:08:44.257967 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 51788.2us
I20260709 13:08:44.221149 19847 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:08:44.282168 13708 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:44.256655 19952 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:44.283870 13756 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:44.238288 20034 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:44.289706 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.313428 20034 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:44.318001 19837 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:44.266171 20089 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.318893 20089 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:44.320920 20089 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:44.322173 20249 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:44.323076 20249 raft_consensus.cc:3055] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:44.323464 20249 raft_consensus.cc:740] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:44.324302 20249 consensus_queue.cc:260] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:44.325519 20249 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:44.330677 20192 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:44.290745 20025 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:44.299896 20297 log.cc:927] Time spent T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:08:44.302361 20242 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:44.303022 19952 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:44.307919 20033 consensus_queue.cc:237] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:44.310571 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:44.310683 13756 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:44.345986 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:44.343890 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 310495us
I20260709 13:08:44.358831 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:44.349298 14366 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.856s (SENT) [suppressed 36 similar messages]
I20260709 13:08:44.364068 13782 raft_consensus.cc:2393] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 18: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:44.266422 20231 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:44.244535 20218 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:44.367609 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:44.372839 13682 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:44.373714 19857 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:44.374109 19857 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.374476 19857 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:44.382382 19857 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:44.384691 19629 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:44.348368 19900 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:08:44.387761 20301 tablet_replica.cc:333] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
W20260709 13:08:44.388362 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 77811.7us
I20260709 13:08:44.390837 19952 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:44.442451 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:44.396210 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:44.385326 20218 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:44.417886 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 467610us
I20260709 13:08:44.419749 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1603) took 1126 ms. Trace:
I20260709 13:08:44.446563 13862 rpcz_store.cc:276] 0709 13:08:43.293777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.326152 (+ 32375us) service_pool.cc:224] Handling call
0709 13:08:43.326623 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.178690 (+852067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.419458 (+240768us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b540006ed54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:44.419681 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1937615744}
W20260709 13:08:44.423763 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:44.425802 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 258636us
I20260709 13:08:44.438704 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:44.456238 13863 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:44.458644 13861 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:08:44.459044 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:44.461256 13857 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:44.461918 13716 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:08:44.464031 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 431601us
I20260709 13:08:44.469808 13680 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:44.470562 13755 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:44.473304 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:44.450608 20069 raft_consensus.cc:697] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:44.479846 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:44.480588 13708 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:44.476073 20126 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:44.521135 20192 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:44.521937 20192 consensus_queue.cc:1059] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:44.482882 20218 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:44.493932 20311 consensus_queue.cc:1059] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:08:44.528234 20318 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:44.529016 20318 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:44.529421 20318 raft_consensus.cc:697] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:44.530299 20318 consensus_queue.cc:237] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:44.531818 20312 consensus_queue.cc:1059] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:44.533586 13863 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:08:44.534613 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 94365.9us
W20260709 13:08:44.537074 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 252264us
W20260709 13:08:44.538362 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 68612.8us
I20260709 13:08:44.541952 13857 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:44.474604 19952 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:08:44.523010 20192 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:44.580547 13710 raft_consensus.cc:1240] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:44.579425 13829 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:44.591565 13857 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:44.537931 19900 consensus_queue.cc:1059] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:08:44.604532 19900 raft_consensus.cc:3055] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:44.604971 19900 raft_consensus.cc:740] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:44.606087 19900 consensus_queue.cc:260] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:44.611583 20126 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:44.611737 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:44.612085 20126 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:44.612569 20126 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:44.585806 20020 consensus_queue.cc:1059] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
W20260709 13:08:44.616257 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.612581 13863 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:44.582008 19629 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:44.625936 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 46478.1us
W20260709 13:08:44.626157 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 152382us
W20260709 13:08:44.626785 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 157017us
I20260709 13:08:44.620570 20321 raft_consensus.cc:3055] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:44.621282 19900 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:44.620882 20249 raft_consensus.cc:3055] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:44.643744 13757 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:44.611869 19857 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:44.623802 20118 raft_consensus.cc:3055] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:44.654057 14402 raft_consensus.cc:1240] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:08:44.655478 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:44.653846 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:44.659354 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:44.659999 13856 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 15: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:44.660125 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:44.661842 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 118094us
W20260709 13:08:44.657975 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 122403us
I20260709 13:08:44.663671 14399 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 15: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:44.657047 13682 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:44.640923 20321 raft_consensus.cc:740] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:44.669200 14396 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:44.649417 20249 raft_consensus.cc:740] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:44.670922 13713 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:08:44.654922 20118 raft_consensus.cc:740] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:44.632315 20034 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:08:44.672818 13713 pending_rounds.cc:85] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 12
I20260709 13:08:44.632875 20227 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:08:44.680712 13713 pending_rounds.cc:107] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:08:44.681061 13713 raft_consensus.cc:2889] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:44.681094 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:44.671427 14394 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:44.681831 14402 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:44.681094 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:44.678992 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 49205.7us
I20260709 13:08:44.634058 20319 consensus_queue.cc:1059] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:08:44.628046 19629 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:44.662989 20311 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:08:44.697552 19629 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:44.700490 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:44.701212 13707 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:44.701715 14397 raft_consensus.cc:1240] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:44.702937 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:44.672220 19857 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:44.704015 19857 raft_consensus.cc:697] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:44.681329 19970 consensus_queue.cc:1059] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:08:44.705116 19970 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:08:44.634431 20069 consensus_queue.cc:237] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:44.709472 13708 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:08:44.721107 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:44.723038 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:44.726374 13788 raft_consensus.cc:3055] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:44.726768 13788 raft_consensus.cc:740] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:44.728796 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:44.731180 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 88469.6us
I20260709 13:08:44.736330 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.738983 14402 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:08:44.744386 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.747473 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.733188 13788 consensus_queue.cc:260] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:44.748610 13788 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:44.714687 20284 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:44.705128 19857 consensus_queue.cc:237] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:44.753314 13783 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:44.754851 13829 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:44.756384 13829 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:44.758095 13829 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:44.771944 13788 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:44.772925 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:44.776695 20118 consensus_queue.cc:260] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:44.777211 20089 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:44.777860 20089 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:44.778061 20118 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:44.778412 20089 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:44.783578 20218 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:44.784260 20037 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:44.783849 20249 consensus_queue.cc:260] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:44.786760 20227 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:44.787273 19971 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:44.787398 20227 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:44.790675 20227 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:44.794250 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.794047 20321 consensus_queue.cc:260] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:44.795383 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.796025 13783 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:08:44.796844 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.797575 13783 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:44.798635 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.820065 13783 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 15: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
W20260709 13:08:44.808241 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 50235.8us
I20260709 13:08:44.777232 20159 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:08:44.819561 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 54158.1us
I20260709 13:08:44.813898 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.816712 19982 raft_consensus.cc:3055] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:08:44.817463 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.820911 13755 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:44.824549 20311 consensus_queue.cc:1059] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:44.827185 13829 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:44.828855 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.830730 13830 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:44.833058 14366 leader_election.cc:400] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 9 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 9. Current term is 10.
W20260709 13:08:44.833370 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.844448 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:44.862289 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 127756us
I20260709 13:08:44.865417 14368 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:44.879578 13707 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
W20260709 13:08:44.879632 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 48977.7us
W20260709 13:08:44.880162 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 47285.6us
I20260709 13:08:44.834507 19982 raft_consensus.cc:740] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:08:44.884059 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 63237.3us
I20260709 13:08:44.884727 13755 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:44.887490 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:44.893726 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:44.897836 13755 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:44.898702 13756 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:44.879850 20037 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:44.902163 13829 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:44.903898 13757 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:44.881814 20034 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:44.907833 13757 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:44.909384 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.908296 13863 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 11.
W20260709 13:08:44.910385 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 87070.7us
I20260709 13:08:44.910560 13861 raft_consensus.cc:1275] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:44.911157 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.890797 20338 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:44.890956 19763 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:44.883279 20159 raft_consensus.cc:697] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:44.864023 20126 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:44.922516 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:44.905673 20192 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:44.909034 20037 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:44.929497 20037 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:44.931522 20303 log.cc:927] Time spent T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.631s	user 0.003s	sys 0.006s
I20260709 13:08:44.916682 20328 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:44.932780 13786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2668) took 1156 ms. Trace:
I20260709 13:08:44.933825 19970 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:44.933209 13786 rpcz_store.cc:276] 0709 13:08:43.776737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.777065 (+   328us) service_pool.cc:224] Handling call
0709 13:08:43.790828 (+ 13763us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:43.817188 (+ 26360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.817221 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:43.837766 (+ 20545us) log.cc:844] Serialized 26 byte log entry
0709 13:08:44.158059 (+320293us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:44.158132 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.158234 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:44.820601 (+662367us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:44.932444 (+111843us) raft_consensus.cc:1685] finished
0709 13:08:44.932470 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.932707 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20204,"raft.queue_time_us":20613,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":5587,"spinlock_wait_cycles":76795648,"thread_start_us":266341,"threads_started":1,"wal-append.queue_time_us":447951}
I20260709 13:08:44.935473 20131 consensus_queue.cc:1059] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:08:44.936594 14366 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:44.909168 20034 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:44.937614 20034 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:44.924702 20192 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:44.938432 20192 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:44.938732 20333 consensus_queue.cc:1059] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:08:44.939644 20347 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:44.940186 20347 raft_consensus.cc:697] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 19 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:08:44.940305 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 46249.7us
I20260709 13:08:44.941107 20347 consensus_queue.cc:237] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:44.941840 13829 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:44.942674 13680 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:44.927752 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:44.944625 13782 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:44.897221 20334 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:08:44.973907 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:44.972506 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:44.979753 14366 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:44.924307 19763 raft_consensus.cc:697] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 19 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:44.982173 13784 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:44.984372 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:44.979722 14367 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:44.972944 20338 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:44.976405 19982 consensus_queue.cc:260] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:44.979686 20025 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:44.994180 20033 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:44.995852 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:44.996155 14366 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:45.000161 20309 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:45.009027 20249 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:45.015746 20231 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.015475 20037 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:45.016444 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:45.020833 20118 raft_consensus.cc:3055] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:45.027771 20131 raft_consensus.cc:3055] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:45.029079 20333 raft_consensus.cc:3055] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:45.038348 20159 consensus_queue.cc:237] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:44.971010 20227 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:44.970683 20115 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:08:45.053467 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 109432us
I20260709 13:08:45.055732 20025 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:45.091852 20025 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:45.051550 20316 log.cc:927] Time spent T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:08:45.096803 20037 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:45.097530 20037 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:45.098022 20037 raft_consensus.cc:697] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 17 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:45.100026 19982 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:45.102917 20192 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:45.052139 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 154373us
I20260709 13:08:45.049763 20199 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:45.068819 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 155465us
I20260709 13:08:45.066562 20078 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:45.087253 20227 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.046042 20319 consensus_queue.cc:1059] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:08:45.113309 13755 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:45.111479 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 203716us
I20260709 13:08:45.116966 13757 leader_election.cc:304] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:45.111164 20199 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:45.119712 20089 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:45.121069 20199 leader_election.cc:290] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:45.108786 20078 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.122328 20078 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:45.115236 20216 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:45.123682 19763 consensus_queue.cc:237] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:45.126890 20263 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:45.115392 20227 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:45.130035 20078 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:45.131557 20319 consensus_queue.cc:1243] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer b9d194f45e044e0988d5de1a99e5cd02 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:45.098843 20037 consensus_queue.cc:237] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:45.085963 20333 raft_consensus.cc:740] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:08:45.135129 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 155494us
I20260709 13:08:45.084131 20131 raft_consensus.cc:740] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:45.074203 20118 raft_consensus.cc:740] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:45.136344 14399 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:08:45.151237 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:45.137686 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:45.139106 13680 connection.cc:256] RPC call timeout handler was delayed by -1.6331686249999393s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
I20260709 13:08:45.104662 20115 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:45.137383 13787 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:45.152176 14398 raft_consensus.cc:1240] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:08:45.157096 14396 raft_consensus.cc:1240] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
W20260709 13:08:45.152036 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 166198us
W20260709 13:08:45.157802 13680 connection.cc:256] RPC call timeout handler was delayed by -1.5404686250000168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260709 13:08:45.160605 13680 connection.cc:256] RPC call timeout handler was delayed by -1.0454686250000123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
I20260709 13:08:45.073820 20231 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:45.121698 20089 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:45.140578 20347 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:45.169684 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:45.170444 13783 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:08:45.160804 20334 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:45.181449 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:45.159991 20115 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:45.185396 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:45.186113 13783 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:45.187459 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:45.188396 13786 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 15: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:45.197376 13829 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:45.199666 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:45.200793 13757 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:45.219858 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 223791us
I20260709 13:08:45.220577 13786 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:45.223940 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:45.225489 13782 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:45.218343 19971 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:45.228096 20360 log.cc:927] Time spent T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:08:45.229512 20353 log.cc:927] Time spent T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:08:45.231997 20192 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:45.210386 20118 consensus_queue.cc:260] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:45.233511 20118 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.235963 13680 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:45.202454 20357 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:45.203693 20347 raft_consensus.cc:697] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:45.204116 20126 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:45.240547 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:45.230839 20227 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:45.215740 19763 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:45.244422 14366 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:08:45.249197 20343 log.cc:927] Time spent T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:08:45.219470 20131 consensus_queue.cc:260] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:45.253648 20131 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.254249 13829 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:45.255551 20310 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:45.245780 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:45.292994 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 47491.5us
I20260709 13:08:45.313352 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:45.222014 20309 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:08:45.246811 20078 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:45.329442 20364 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:45.329327 19758 consensus_queue.cc:1048] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:08:45.332159 19847 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:45.334892 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:45.336247 20358 log.cc:927] Time spent T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 13:08:45.352414 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 116534us
I20260709 13:08:45.339504 20025 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:45.295001 20310 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:08:45.343617 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 236911us
W20260709 13:08:45.349433 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 111412us
I20260709 13:08:45.351203 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:45.355777 13790 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.262518 19763 raft_consensus.cc:697] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 19 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:45.246942 20034 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:45.360241 14366 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:45.365096 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:45.255558 20126 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
W20260709 13:08:45.369108 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.371429 13857 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:45.358312 20310 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:45.373792 13862 raft_consensus.cc:1240] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:45.377321 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:45.380054 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:45.380601 14401 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:45.384433 20301 raft_consensus.cc:2243] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:45.385365 20301 pending_rounds.cc:70] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03: Trying to abort 1 pending ops.
I20260709 13:08:45.385651 20301 pending_rounds.cc:77] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03: Aborting op as it isn't in flight: id { term: 9 index: 8 } timestamp: 7305635773707042816 op_type: NO_OP noop_request { }
I20260709 13:08:45.388537 20356 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:08:45.388942 20354 log.cc:927] Time spent T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:08:45.389076 20356 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:45.389608 20356 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:45.389730 14402 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:45.244019 20357 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:45.403569 20366 log.cc:927] Time spent T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 13:08:45.404747 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 44604.5us
I20260709 13:08:45.405009 20357 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:45.406250 20328 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:45.406445 14366 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:45.411131 13856 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:45.357403 19847 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:45.411289 13680 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:45.418015 14402 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:45.422111 20227 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:45.422967 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:45.423602 14399 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:45.425000 14402 raft_consensus.cc:1275] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:45.432552 13863 raft_consensus.cc:1240] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:45.432812 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.391212 20347 consensus_queue.cc:237] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:45.440493 20334 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.441269 20334 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:45.444078 20334 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:45.444171 13861 raft_consensus.cc:1240] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:45.449120 20367 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:45.450605 19971 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.450711 14366 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:45.451855 19763 consensus_queue.cc:237] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:45.454480 20025 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:45.391011 20364 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:45.444445 20231 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:45.388168 20301 raft_consensus.cc:2889] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:08:45.458029 13757 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:45.466089 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:45.468420 19758 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:45.468993 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 57784us
I20260709 13:08:45.467406 20263 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:45.474277 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:45.474449 13791 raft_consensus.cc:2410] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:08:45.451155 19971 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:45.378701 20318 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:08:45.476786 19847 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:45.480399 20034 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:45.480993 20301 raft_consensus.cc:2272] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:45.522411 20301 ts_tablet_manager.cc:1916] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:45.391335 20242 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.081s
I20260709 13:08:45.482161 20310 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:45.206532 20333 consensus_queue.cc:260] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:45.486502 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:45.568050 14402 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:08:45.490806 13782 raft_consensus.cc:1275] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:08:45.491007 13859 raft_consensus.cc:1275] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:45.501106 14401 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:45.568771 13782 pending_rounds.cc:85] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 8
I20260709 13:08:45.569090 13782 pending_rounds.cc:107] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:08:45.569306 13782 raft_consensus.cc:2889] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:45.501511 13785 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:08:45.569789 13785 pending_rounds.cc:85] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 13
I20260709 13:08:45.570034 13785 pending_rounds.cc:107] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:08:45.570250 13785 raft_consensus.cc:2889] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:45.502183 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 44282.8us
I20260709 13:08:45.503584 13863 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
W20260709 13:08:45.510056 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 61593.5us
I20260709 13:08:45.509433 20249 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:45.518893 19971 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:45.510659 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 256495us
I20260709 13:08:45.524458 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:45.562952 13680 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:45.577016 13829 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:45.577772 20328 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:45.577777 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 62739.6us
I20260709 13:08:45.578325 20328 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:45.578511 13829 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:45.578730 20328 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:45.502954 19837 consensus_queue.cc:1059] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:08:45.579820 20376 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:45.579641 20361 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:45.581131 20361 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:45.581507 20361 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:45.566037 13783 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:45.579172 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:45.581869 20361 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:45.582739 13680 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:45.583498 20118 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:45.584728 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:45.585984 19763 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:45.587489 13680 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:45.590359 19837 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:45.590719 19837 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:45.591071 19837 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:45.592964 20078 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:45.593842 13829 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:45.595263 13829 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:45.596073 20025 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:45.596426 20025 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.596571 13680 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:45.596829 20025 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:45.599731 19758 raft_consensus.cc:2764] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:08:45.600776 20037 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:45.603325 20118 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:45.586736 20328 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:45.605085 20310 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:45.605680 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:45.515736 20309 consensus_queue.cc:1059] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.091s
I20260709 13:08:45.604238 20025 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:45.609668 13707 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:45.529011 19867 consensus_queue.cc:1059] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:08:45.622977 20309 raft_consensus.cc:3055] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:45.623175 14366 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:45.623345 19867 raft_consensus.cc:3055] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:45.623759 19867 raft_consensus.cc:740] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:45.624357 14366 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:45.624538 19867 consensus_queue.cc:260] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:45.625398 20364 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:45.625840 19867 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.626042 20364 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:45.627507 20034 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:45.627583 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:45.628008 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:45.628237 20342 consensus_queue.cc:1175] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "35ecb005831740438d7537dd4b840e03" responder_term: 14 status { last_received { term: 14 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 14 index: 10 } }
I20260709 13:08:45.628887 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:45.629465 13863 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:45.618278 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:45.622713 20037 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:45.630231 20037 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:45.630611 20037 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:45.628139 20034 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:45.571873 19847 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.614176 13790 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:45.627319 14368 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:45.616266 20263 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.631349 20309 raft_consensus.cc:740] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:45.656502 13787 raft_consensus.cc:1240] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 17. Current term is 18. Ops: []
W20260709 13:08:45.657722 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.666550 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:45.670679 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:45.677337 13710 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:08:45.668704 13757 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:45.645200 20078 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:45.618927 20376 consensus_queue.cc:1048] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:08:45.692279 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:45.637045 19837 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:45.687273 13859 raft_consensus.cc:2393] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 15: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:45.645131 19900 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:45.687862 13829 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:45.689486 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:45.651000 20318 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:45.647722 20263 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:45.687961 20347 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:45.682118 20364 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:45.697468 13857 raft_consensus.cc:1275] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:45.699976 13710 raft_consensus.cc:1275] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:45.701481 13714 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:45.702581 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:45.703967 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:45.704185 13863 raft_consensus.cc:1275] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:08:45.686546 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 88912.9us
I20260709 13:08:45.705325 13715 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 18. Current term is 19. Ops: []
W20260709 13:08:45.707933 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 75724.5us
I20260709 13:08:45.713024 14366 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:45.644109 19847 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:45.715399 13680 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:45.699898 20321 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:45.698784 19900 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:45.784411 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 132706us
I20260709 13:08:45.708070 20347 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.786048 14368 leader_election.cc:304] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:45.740064 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.718894 19763 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:45.807981 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 155941us
I20260709 13:08:45.708035 20089 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:45.755249 13680 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:45.754700 20356 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:45.800561 20344 log.cc:927] Time spent T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:08:45.808717 20347 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.717404 20020 consensus_queue.cc:1059] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.094s
I20260709 13:08:45.708837 20318 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:45.754355 20311 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:45.796728 19325 consensus_queue.cc:1059] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.082s
W20260709 13:08:45.812575 20115 consensus_meta.cc:287] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.611s	user 0.007s	sys 0.003s
I20260709 13:08:45.805150 19900 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:45.878837 13829 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:45.878309 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 123131us
I20260709 13:08:45.737641 20192 consensus_queue.cc:1048] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 13:08:45.886880 13864 raft_consensus.cc:1240] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 16. Current term is 17. Ops: []
W20260709 13:08:45.886883 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 227984us
I20260709 13:08:45.720732 20364 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:45.891997 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 179069us
I20260709 13:08:45.900671 20020 raft_consensus.cc:3055] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:45.901338 20385 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:45.878517 20328 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:45.895674 20311 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.955897 19952 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:45.798254 20309 consensus_queue.cc:260] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:45.964800 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 178811us
W20260709 13:08:45.964301 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 61612.8us
I20260709 13:08:45.908507 20192 consensus_queue.cc:1243] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer b9d194f45e044e0988d5de1a99e5cd02 log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:08:45.971165 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 116116us
I20260709 13:08:45.953688 20020 raft_consensus.cc:740] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:45.995889 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:45.964411 20159 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:45.995862 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:45.996064 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.965451 20311 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:46.003297 20263 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:46.004303 19837 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:46.004455 20378 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.005046 20378 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:46.005414 20392 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:46.006074 20392 consensus_queue.cc:1243] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer 35ecb005831740438d7537dd4b840e03 log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:08:45.989796 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:46.008665 14401 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 15: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:45.999547 14397 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:46.000162 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:46.009820 14394 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:46.013180 20361 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.002859 20389 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:46.013182 20311 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.014437 20389 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.014837 20389 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.004261 13865 raft_consensus.cc:1240] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:46.016994 20311 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:46.021047 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:46.021826 14402 raft_consensus.cc:2393] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 17: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:46.025803 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:46.026341 14402 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:45.969048 20342 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.032559 13755 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:46.026747 14396 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:08:46.007146 20378 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:45.981590 14366 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:45.972090 19952 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:45.908592 20115 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.044217 20115 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:46.045056 20115 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:46.045521 20115 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:46.045953 20115 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.040910 14397 raft_consensus.cc:1240] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:45.984381 20034 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:46.054170 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:46.056581 14396 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 20: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:46.040172 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:46.057835 13865 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:46.060379 13829 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:46.073171 20387 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.038041 20342 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.077594 20342 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:46.078833 20342 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.096642 20037 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.098156 20020 consensus_queue.cc:260] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.100082 20020 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:46.100508 13860 raft_consensus.cc:1240] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:46.101840 14397 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:08:46.103931 14400 raft_consensus.cc:1240] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:46.105530 20364 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:46.069885 20025 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:46.106714 20356 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:46.109479 20037 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:46.055505 19952 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:46.110780 20115 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:46.115900 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 83369.4us
I20260709 13:08:46.079290 20342 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.123967 19982 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:46.123402 13755 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:46.130061 13755 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:46.037722 20340 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
W20260709 13:08:46.133448 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 154977us
W20260709 13:08:46.136936 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 234759us
I20260709 13:08:46.142738 13680 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:46.143769 20378 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:46.144310 20378 raft_consensus.cc:697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:46.105794 19847 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:46.148780 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 107135us
I20260709 13:08:46.150947 13680 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:46.140115 19982 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:46.074023 20387 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.154681 20387 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:46.155851 14367 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:46.156903 19867 consensus_meta.cc:287] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.000s
I20260709 13:08:46.157473 13711 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:46.158897 20392 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.159385 20392 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.160663 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:46.160749 20389 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.161499 20392 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:46.166074 20342 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:46.167807 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:46.167933 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1489) took 1445 ms. Trace:
I20260709 13:08:46.168354 13791 rpcz_store.cc:276] 0709 13:08:44.722561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.722799 (+   238us) service_pool.cc:224] Handling call
0709 13:08:46.167721 (+1444922us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b54001b6cd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:46.167873 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1726003072}
I20260709 13:08:46.169234 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:46.170514 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:46.171119 14393 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:46.175623 20310 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:46.175763 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:46.176368 14395 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:08:46.177325 19982 raft_consensus.cc:697] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:46.178323 20361 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:46.178272 19982 consensus_queue.cc:237] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.139956 20328 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:46.176877 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:46.182493 20342 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:08:46.183820 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:46.184638 20342 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:46.125804 20034 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:46.185693 14396 pending_rounds.cc:85] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 12
I20260709 13:08:46.186088 14396 pending_rounds.cc:107] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:08:46.185770 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:46.186417 14396 raft_consensus.cc:2889] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:46.186673 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 205145us
I20260709 13:08:46.187378 14366 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:46.187573 20342 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:46.188086 20342 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.188585 20342 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.189131 14366 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:46.190779 20115 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:46.191250 20386 log.cc:927] Time spent T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:08:46.168354 14397 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.192461 19629 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:46.195592 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:46.196211 13859 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.197531 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:46.198781 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:46.199076 19952 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:46.199949 20384 log.cc:927] Time spent T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260709 13:08:46.200083 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:46.200680 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:46.201066 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:46.201335 13709 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:46.201747 13713 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 18: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:46.200644 13864 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:46.203253 13714 pending_rounds.cc:85] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 7
I20260709 13:08:46.201761 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:46.204206 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:46.203466 13756 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:46.204646 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:46.205391 20069 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:46.203430 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:46.205847 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:46.205915 20069 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:46.206153 13864 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:46.206605 20069 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:46.207101 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:46.208000 14402 raft_consensus.cc:1240] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:46.207887 20356 consensus_queue.cc:1059] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:46.204739 13711 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 20: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:46.205349 14366 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:46.161994 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:46.163084 20389 leader_election.cc:290] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:46.162901 20199 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:46.109383 19900 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.163686 20318 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:46.232160 13709 raft_consensus.cc:1275] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:46.164326 13829 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:46.186301 20378 consensus_queue.cc:237] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:46.205667 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:46.210340 13680 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:46.162446 20227 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:46.121084 20192 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.216812 14368 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:46.208855 20159 raft_consensus.cc:3055] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:46.219059 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:46.221590 13714 pending_rounds.cc:107] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 15.8
W20260709 13:08:46.263751 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 58479.8us
I20260709 13:08:46.264170 13714 raft_consensus.cc:2889] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:46.221714 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:46.225258 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 95289.6us
I20260709 13:08:46.219278 14367 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:46.229200 14393 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:08:46.201197 19952 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:46.224328 13757 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:46.236701 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:46.261509 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:46.262199 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 45470.8us
I20260709 13:08:46.265388 14394 raft_consensus.cc:1240] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:46.284231 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:46.272549 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 53365.6us
I20260709 13:08:46.285513 13712 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:46.288103 13861 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 18: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:08:46.293190 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 82908.6us
I20260709 13:08:46.198750 20342 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.308316 14368 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:46.237865 20355 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:46.310321 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 146054us
I20260709 13:08:46.305542 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 1491) took 1579 ms. Trace:
I20260709 13:08:46.319950 13785 rpcz_store.cc:276] 0709 13:08:44.726744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.727629 (+   885us) service_pool.cc:224] Handling call
0709 13:08:44.727913 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:45.573097 (+845184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:46.303866 (+730769us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b54002f9754. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:46.305490 (+  1624us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1747107584}
I20260709 13:08:46.310321 13859 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:46.316288 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:46.227782 20319 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
W20260709 13:08:46.327692 20343 log.cc:927] Time spent T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:46.328193 20376 raft_consensus.cc:3055] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:46.328590 20376 raft_consensus.cc:740] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:08:46.328531 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 63755.6us
I20260709 13:08:46.329787 20376 consensus_queue.cc:260] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:46.330338 14366 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:46.330941 20376 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:46.331565 20375 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:46.331732 20310 consensus_queue.cc:1059] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:46.332075 20375 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:46.311128 20389 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:46.332587 20375 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:46.332683 20389 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.333083 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:46.262616 19867 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.265929 20034 raft_consensus.cc:2764] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:08:46.229826 20115 consensus_queue.cc:1048] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:08:46.334059 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:46.240859 20020 consensus_queue.cc:1059] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:08:46.339803 19952 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:46.284688 20387 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:46.340337 20020 raft_consensus.cc:3055] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:46.340703 20387 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.340956 20020 raft_consensus.cc:740] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:46.341181 20387 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.342032 20020 consensus_queue.cc:260] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.343581 14397 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:08:46.326165 20340 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:08:46.344082 20397 log.cc:927] Time spent T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:08:46.344444 20340 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.242673 20231 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:46.332813 19758 raft_consensus.cc:3055] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:46.344831 20340 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:46.344995 19758 raft_consensus.cc:740] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:46.345963 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:46.333361 20389 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:46.345966 19758 consensus_queue.cc:260] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.347546 19758 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:46.263722 20159 raft_consensus.cc:740] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:08:46.327196 20377 log.cc:927] Time spent T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.540s	user 0.002s	sys 0.000s
I20260709 13:08:46.333775 14400 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:46.284562 20192 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:46.306784 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.320520 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:46.360178 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.360321 14402 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
W20260709 13:08:46.333437 20390 log.cc:927] Time spent T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 13:08:46.361721 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:46.362515 13785 raft_consensus.cc:2410] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:08:46.363536 13783 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:46.354380 14368 leader_election.cc:304] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:46.358284 13856 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:08:46.368517 13680 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:46.370138 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:46.370919 13790 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.373381 13716 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:46.377427 13708 raft_consensus.cc:1275] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:46.383070 13710 raft_consensus.cc:1240] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:46.384768 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:46.385339 13788 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.388494 13790 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:08:46.319190 20025 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.390627 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:46.319344 20227 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:46.391184 13784 raft_consensus.cc:1240] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:46.405303 13786 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:08:46.392100 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:46.414273 13785 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:46.392545 13791 raft_consensus.cc:1275] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:08:46.367863 20321 consensus_meta.cc:287] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.000s
I20260709 13:08:46.393141 13859 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:46.378587 20284 consensus_queue.cc:1059] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:08:46.394421 19325 consensus_queue.cc:1059] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:08:46.395773 20399 log.cc:927] Time spent T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:08:46.398488 13755 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:46.347560 20301 ts_tablet_manager.cc:1929] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.8
I20260709 13:08:46.376125 20402 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:08:46.399188 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:46.399698 20249 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:46.400914 20192 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:46.414695 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 57550.9us
W20260709 13:08:46.496807 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 98414us
I20260709 13:08:46.497140 14366 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:08:46.379947 20366 log.cc:927] Time spent T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:08:46.382112 20231 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:08:46.445765 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 87070.6us
I20260709 13:08:46.446429 20342 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:46.446800 20368 log.cc:927] Time spent T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 1.088s	user 0.004s	sys 0.000s
I20260709 13:08:46.420578 20361 consensus_queue.cc:1059] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:08:46.521160 20376 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:46.521278 20361 consensus_queue.cc:1243] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer b9d194f45e044e0988d5de1a99e5cd02 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:08:46.521849 20361 raft_consensus.cc:3055] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:46.522173 20361 raft_consensus.cc:740] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:46.503826 20131 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:46.420498 20037 consensus_queue.cc:1048] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:08:46.523348 20227 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:46.524092 20227 raft_consensus.cc:697] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:46.524974 20227 consensus_queue.cc:237] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.447059 20389 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.447150 20400 consensus_queue.cc:1059] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.078s
I20260709 13:08:46.448206 13791 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:46.448689 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:46.450845 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.451130 19867 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:46.456418 19900 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:46.455353 13785 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:08:46.456790 20284 raft_consensus.cc:3055] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:46.351430 20159 consensus_queue.cc:260] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.417455 20311 consensus_queue.cc:1048] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:08:46.420310 19837 consensus_queue.cc:1059] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 13:08:46.457366 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:46.458480 13786 raft_consensus.cc:1240] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:46.459316 20333 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:46.390556 20118 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:46.570057 19857 raft_consensus.cc:3055] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:46.570480 20118 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.570652 19857 raft_consensus.cc:740] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:46.570990 20118 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:46.571826 19857 consensus_queue.cc:260] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:46.573029 19857 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:46.467710 13789 raft_consensus.cc:2410] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:08:46.401741 20069 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:46.468988 20123 consensus_queue.cc:1059] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:46.576591 20123 raft_consensus.cc:3055] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:46.576957 20123 raft_consensus.cc:740] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:46.577488 20069 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:46.530426 20231 raft_consensus.cc:697] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:46.577723 20123 consensus_queue.cc:260] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:46.476011 20309 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:46.578821 20231 consensus_queue.cc:237] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.476887 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3216) took 1308 ms. Trace:
I20260709 13:08:46.584600 13787 rpcz_store.cc:276] 0709 13:08:45.168861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.168993 (+   132us) service_pool.cc:224] Handling call
0709 13:08:45.169262 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:45.656878 (+487616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:46.476654 (+819776us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b54001e6c54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:46.476828 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1120027904}
I20260709 13:08:46.585255 20020 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:46.481271 20382 log.cc:927] Time spent T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.666s	user 0.002s	sys 0.000s
W20260709 13:08:46.482870 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 55636.1us
I20260709 13:08:46.587766 19837 raft_consensus.cc:3055] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:46.498103 13755 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:46.588253 19837 raft_consensus.cc:740] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:08:46.588806 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 90805.3us
I20260709 13:08:46.589288 19758 raft_consensus.cc:3055] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:46.589116 19837 consensus_queue.cc:260] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.511705 14367 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:46.589762 19758 raft_consensus.cc:740] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:46.590317 19837 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:46.590415 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 78804.3us
I20260709 13:08:46.513727 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:46.517709 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:46.592731 20389 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:46.592880 20263 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:46.593765 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:46.594300 13864 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:46.594838 13712 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:46.416496 20025 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:46.534238 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 309868us
I20260709 13:08:46.529438 20284 raft_consensus.cc:740] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:46.600358 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:46.598763 19971 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:08:46.604578 13789 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1488) took 1885 ms (client timeout 1926 ms). Trace:
W20260709 13:08:46.604959 13789 rpcz_store.cc:269] 0709 13:08:44.720215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.720622 (+   407us) service_pool.cc:224] Handling call
0709 13:08:46.604411 (+1883789us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b54001b67d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:46.604528 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3962582912}
I20260709 13:08:46.608071 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:46.609442 20159 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:46.515588 20381 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.004s	sys 0.013s
I20260709 13:08:46.503235 20249 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:46.557242 13829 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:46.561331 20387 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.562217 20375 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:46.564061 20403 log.cc:927] Time spent T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.206s	user 0.000s	sys 0.002s
W20260709 13:08:46.563956 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 66906us
I20260709 13:08:46.599534 20218 consensus_queue.cc:1059] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:08:46.554888 20115 consensus_queue.cc:1048] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:08:46.517380 20301 log.cc:1199] T c9e22f0634b34971aed9c5b948f3275e P 35ecb005831740438d7537dd4b840e03: Deleting WAL directory at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0/minicluster-data/ts-1-root/wals/c9e22f0634b34971aed9c5b948f3275e
I20260709 13:08:46.575635 20357 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.587687 20342 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:46.589495 13755 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:46.488732 13788 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:08:46.591722 13715 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
W20260709 13:08:46.648665 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 59248.3us
I20260709 13:08:46.381271 20310 consensus_queue.cc:1059] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.063s
I20260709 13:08:46.553561 19325 raft_consensus.cc:3055] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:46.660676 14394 raft_consensus.cc:1275] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:46.578974 20123 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:46.613668 14367 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:46.590684 19758 consensus_queue.cc:260] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.629455 13864 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
W20260709 13:08:46.626850 20381 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.005s	sys 0.014s
I20260709 13:08:46.669023 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:46.669657 13786 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:46.522969 20361 consensus_queue.cc:260] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:46.636166 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:46.642204 20115 consensus_queue.cc:1243] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer b9d194f45e044e0988d5de1a99e5cd02 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:08:46.665755 14368 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:46.636180 20218 raft_consensus.cc:3055] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:46.638427 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:46.640066 13784 pending_rounds.cc:85] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 13
I20260709 13:08:46.639107 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:46.645704 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 88530.7us
I20260709 13:08:46.647058 13856 raft_consensus.cc:1240] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:46.680356 13784 pending_rounds.cc:107] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:08:46.680774 13784 raft_consensus.cc:2889] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:46.681799 13783 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.650018 20199 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
W20260709 13:08:46.664274 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 50692.4us
I20260709 13:08:46.685052 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:46.685761 13715 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:46.670608 13787 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:46.637786 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:46.676824 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:46.687624 14393 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
I20260709 13:08:46.614514 20242 consensus_queue.cc:1059] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 13:08:46.661542 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:46.633234 20263 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:08:46.650192 19952 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.660671 19971 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:46.694940 19971 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:46.695365 19971 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:46.679474 20321 consensus_queue.cc:1048] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:08:46.660907 19325 raft_consensus.cc:740] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:46.664821 19763 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:46.667128 20034 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:46.725521 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 326380us
I20260709 13:08:46.667327 20301 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48902 (request call id 97) took 2814 ms. Trace:
I20260709 13:08:46.726236 13680 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:46.727095 19837 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:46.729102 13680 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:46.727707 19837 raft_consensus.cc:697] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:46.679728 20218 raft_consensus.cc:740] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:46.740036 19837 consensus_queue.cc:237] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.740720 19325 consensus_queue.cc:260] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.742079 19325 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:46.643090 20284 consensus_queue.cc:260] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.734172 13715 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:46.651003 20357 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.734697 13783 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:46.685657 13708 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:46.750174 13680 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:46.727703 20376 consensus_queue.cc:1059] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:08:46.720820 20388 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:46.661867 20342 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:46.771997 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 91564.7us
I20260709 13:08:46.722595 19952 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.783350 13680 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:46.783540 13789 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:08:46.787550 13789 pending_rounds.cc:85] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 11
I20260709 13:08:46.787819 13789 pending_rounds.cc:107] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:08:46.788064 13789 raft_consensus.cc:2889] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:46.804360 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:46.805173 13710 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.809059 13829 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:46.851998 20413 log.cc:927] Time spent T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:08:46.852941 20411 log.cc:927] Time spent T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:08:46.777853 20388 raft_consensus.cc:697] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:46.779335 20284 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:46.807884 19971 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.808405 20115 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:46.848398 20414 log.cc:927] Time spent T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:08:46.755990 20310 consensus_queue.cc:1048] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:08:46.917830 13712 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:46.923569 13710 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:46.751897 20378 consensus_queue.cc:1059] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
I20260709 13:08:46.804706 20376 raft_consensus.cc:3055] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:46.807850 19867 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:46.959123 19867 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:46.959587 19867 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:46.961985 20387 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:46.919129 20242 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:46.962812 20242 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:46.963181 20242 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.969732 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:46.972643 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:46.973415 13865 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:46.976356 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:46.977654 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:46.929925 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 120947us
I20260709 13:08:46.804451 20422 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:46.810379 20400 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:08:46.913851 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:46.940915 20421 log.cc:927] Time spent T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
W20260709 13:08:46.942646 20417 log.cc:927] Time spent T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:08:46.944597 19952 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:47.004527 13715 pending_rounds.cc:85] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 9
I20260709 13:08:47.004933 13715 pending_rounds.cc:107] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:08:47.005251 13715 raft_consensus.cc:2889] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:46.946310 20342 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:46.949188 20347 consensus_meta.cc:287] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 1.064s	user 0.006s	sys 0.004s
W20260709 13:08:46.955078 20340 consensus_meta.cc:287] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.000s
I20260709 13:08:46.933627 20118 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.929153 20025 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:46.957597 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:47.012301 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.979301 14401 raft_consensus.cc:1240] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:47.006508 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:46.981223 14366 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:46.947202 13756 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:46.978899 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:47.013765 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 66648.1us
I20260709 13:08:46.992396 14367 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:46.993176 13829 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:46.934741 20409 log.cc:927] Time spent T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.251s	user 0.000s	sys 0.004s
I20260709 13:08:47.014909 13756 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:46.730880 20301 rpcz_store.cc:276] 0709 13:08:43.866759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.867990 (+  1231us) service_pool.cc:224] Handling call
0709 13:08:44.338521 (+470531us) ts_tablet_manager.cc:1151] Deleting tablet c9e22f0634b34971aed9c5b948f3275e
0709 13:08:44.338655 (+   134us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:08:46.091216 (+1752561us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:46.321953 (+230737us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:46.667251 (+345298us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":935729,"tablet-delete.queue_time_us":469322,"thread_start_us":144976,"threads_started":1}
I20260709 13:08:47.003252 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:46.945001 20375 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:47.007084 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:47.005034 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:46.918536 20126 consensus_queue.cc:1059] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.082s
I20260709 13:08:46.936117 20376 raft_consensus.cc:740] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:46.842998 20218 consensus_queue.cc:260] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:46.935741 20249 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:46.994979 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:47.029431 13708 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:46.934993 20115 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:47.025734 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 44553.6us
I20260709 13:08:47.031044 14366 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:47.041558 14366 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:47.044869 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.017072 20334 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:08:47.066939 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 87837.6us
I20260709 13:08:47.071171 13829 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:47.079833 20431 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:47.069948 20334 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.082875 20334 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:47.084662 13829 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:47.085953 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:08:47.069653 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 73857.4us
I20260709 13:08:47.009055 20385 consensus_queue.cc:1059] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:08:47.091337 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:47.091809 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:47.094497 20361 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:47.095404 20427 log.cc:927] Time spent T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:08:47.097332 20115 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:47.102670 20423 log.cc:927] Time spent T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
W20260709 13:08:47.121505 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 75781.1us
I20260709 13:08:47.103499 20159 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:47.104040 20037 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:47.028781 20025 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:47.010962 20347 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:47.040277 20131 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:47.115880 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:47.039582 20263 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:47.148795 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:47.056854 20034 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:47.061515 20388 consensus_queue.cc:237] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:47.128643 14401 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:08:47.130476 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:47.108467 20020 consensus_meta.cc:287] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.523s	user 0.005s	sys 0.005s
I20260709 13:08:47.133383 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:47.157034 13787 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:47.016100 20340 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:47.065230 19900 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:47.163304 14367 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:47.164898 13782 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 15: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:47.120900 13865 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:47.136775 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:47.139943 14396 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:08:47.169749 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:47.170558 14401 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 18: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:47.106859 20242 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:47.116664 20218 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:47.174815 14395 raft_consensus.cc:2393] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 14: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:47.121683 20375 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:47.087546 20400 raft_consensus.cc:697] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:47.171547 13786 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17. Ops: [14.10-16.11]
W20260709 13:08:47.171486 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 191123us
W20260709 13:08:47.196889 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.132220 20037 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:47.148398 20409 log.cc:927] Time spent T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:47.174120 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:47.175530 13785 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:47.141636 20118 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:47.179095 13791 raft_consensus.cc:1240] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:47.180346 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:47.181099 13788 raft_consensus.cc:2393] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 18: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:47.179262 13787 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:08:47.182725 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:47.183682 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:47.152892 20034 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:47.185000 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 48537.3us
I20260709 13:08:47.211400 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:47.203358 20037 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:47.212983 13865 raft_consensus.cc:1275] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:08:47.190547 19857 consensus_meta.cc:287] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.617s	user 0.011s	sys 0.003s
I20260709 13:08:47.219717 19758 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:47.164418 20422 raft_consensus.cc:697] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:08:47.189322 20309 consensus_meta.cc:287] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.610s	user 0.006s	sys 0.007s
I20260709 13:08:47.186816 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:47.154076 20131 raft_consensus.cc:697] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:47.231292 13711 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
I20260709 13:08:47.187980 19900 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:47.191919 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:47.234913 14395 raft_consensus.cc:2393] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 12: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:47.198957 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:47.207453 14401 raft_consensus.cc:1240] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17. Ops: [15.14-16.15]
I20260709 13:08:47.235697 13856 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:47.186539 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:47.236838 14396 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 20: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:47.223997 13782 raft_consensus.cc:2368] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15.
I20260709 13:08:47.225590 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:47.241700 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 54981.3us
I20260709 13:08:47.242666 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:47.148300 20376 consensus_queue.cc:260] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:47.251722 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:47.226094 20034 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:47.252465 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:47.256955 13787 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:47.258239 13857 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 16. Current term is 17. Ops: []
W20260709 13:08:47.262248 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 50957.4us
I20260709 13:08:47.224264 19971 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:47.267190 13710 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:47.240911 20433 raft_consensus.cc:3055] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:47.241089 19900 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.249848 20369 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:47.249722 20375 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:47.274173 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 110971us
I20260709 13:08:47.281674 13829 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:47.243954 20342 consensus_queue.cc:1059] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:08:47.297699 13829 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:47.300028 13787 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 20.
I20260709 13:08:47.300556 13709 raft_consensus.cc:1275] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:47.273193 20433 raft_consensus.cc:740] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:47.282431 20376 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:47.284621 20369 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.277068 19900 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:47.280200 20263 raft_consensus.cc:697] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:47.303399 13789 raft_consensus.cc:1240] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:47.312906 13789 raft_consensus.cc:1240] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:47.314420 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 53819.5us
W20260709 13:08:47.314821 20436 log.cc:927] Time spent T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 13:08:47.315660 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 52747.4us
I20260709 13:08:47.319067 20311 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.319315 19837 consensus_queue.cc:1059] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:47.319593 20311 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:47.320578 19837 raft_consensus.cc:3055] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:47.320974 19837 raft_consensus.cc:740] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:47.321705 20311 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:47.321826 19837 consensus_queue.cc:260] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:47.289896 14396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:40042
I20260709 13:08:47.323614 20310 raft_consensus.cc:3055] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:47.323884 14396 raft_consensus.cc:606] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:08:47.324048 20310 raft_consensus.cc:740] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:47.324290 14396 raft_consensus.cc:614] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:47.324949 20310 consensus_queue.cc:260] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:47.326071 20310 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:47.327849 20446 log.cc:927] Time spent T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:08:47.327992 20242 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:47.328747 20340 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:47.329191 20263 consensus_queue.cc:237] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:47.334794 20444 consensus_queue.cc:1175] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ceb06175847b428ea8bd77055fcddf58" responder_term: 16 status { last_received { term: 16 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 16 index: 12 } }
I20260709 13:08:47.288404 20123 consensus_queue.cc:1059] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260709 13:08:47.341398 20365 raft_consensus.cc:3055] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:47.341831 20365 raft_consensus.cc:740] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:47.342973 19325 raft_consensus.cc:3055] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:47.311444 20131 consensus_queue.cc:237] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:47.343560 20422 consensus_queue.cc:237] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:47.350632 13857 raft_consensus.cc:1240] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:47.304891 20435 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:47.302946 20356 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:47.352555 20433 consensus_queue.cc:260] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:47.303365 19857 consensus_queue.cc:1048] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:08:47.353973 20433 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:47.308905 20369 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:47.301851 20387 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:08:47.352588 20347 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:47.310704 20439 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:08:47.357453 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 758989us
I20260709 13:08:47.360798 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:47.361384 13859 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
W20260709 13:08:47.363363 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 67017.1us
I20260709 13:08:47.365698 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:47.366338 14395 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:08:47.366382 14401 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:47.343436 19325 raft_consensus.cc:740] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:47.377964 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:47.323243 19837 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:47.390446 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:47.391320 13861 raft_consensus.cc:3055] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:47.391737 13861 raft_consensus.cc:740] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:47.393422 19325 consensus_queue.cc:260] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:47.396620 14401 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
W20260709 13:08:47.400704 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 96816.4us
I20260709 13:08:47.400980 13858 raft_consensus.cc:2393] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 15: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:47.394742 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:47.401721 14395 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:08:47.405429 14402 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:47.408833 19325 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:47.392526 13861 consensus_queue.cc:260] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:47.410413 13861 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:47.397403 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:47.403016 20020 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.425086 13599 catalog_manager.cc:5028] TS 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): tablet c9e22f0634b34971aed9c5b948f3275e (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:08:47.425202 20020 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:47.428112 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:47.428936 13858 raft_consensus.cc:2393] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 20: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:47.429791 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:47.430923 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:47.310154 20400 consensus_queue.cc:237] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:47.425176 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:47.449569 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:47.450542 13707 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 22.
I20260709 13:08:47.453372 13757 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:47.454433 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.452095 13756 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:08:47.462908 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.409157 19971 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.455982 20435 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.467718 19971 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:47.468030 20435 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:47.470098 19971 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:47.470331 20435 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:47.470743 13790 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:47.403267 19952 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:47.471757 19952 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:47.474213 19952 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:47.474754 13680 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:47.413820 19867 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:47.343348 20334 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:47.475787 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:47.494387 13680 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:47.479609 13708 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:47.492348 13715 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:47.482443 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:47.506702 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:47.507326 13715 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:08:47.508065 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:47.508917 14395 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:47.511705 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:47.511762 13756 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:47.387176 20318 consensus_queue.cc:1059] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.064s
W20260709 13:08:47.483788 20416 log.cc:927] Time spent T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.780s	user 0.003s	sys 0.000s
I20260709 13:08:47.532364 14396 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:08:47.514254 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:47.517273 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:47.533795 13710 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 18: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:47.459510 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:47.511129 13861 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:08:47.534657 13858 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:47.487900 20131 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:47.535545 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:47.446559 20356 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.542789 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:47.523542 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 115492us
I20260709 13:08:47.535516 13856 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
W20260709 13:08:47.518935 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.485656 20334 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:47.533197 13715 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:47.536643 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:47.467110 20034 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:47.512884 20321 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:47.477761 20378 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:47.510872 20444 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:47.580710 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:47.466843 20365 consensus_queue.cc:260] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:47.599442 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.611691 13861 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:08:47.613597 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:47.479430 19867 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:47.615566 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:47.632926 13789 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:08:47.624254 13782 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:08:47.510797 20355 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:47.618213 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:47.514246 19971 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.621722 14402 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:47.635123 13682 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:47.541736 20131 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.505764 20369 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:47.638010 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:47.648083 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:47.671516 13856 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:47.674501 13858 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:47.510844 19857 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:47.633575 13782 raft_consensus.cc:606] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:47.677356 13782 raft_consensus.cc:614] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:47.620093 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:47.633970 14401 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:47.679081 13789 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 18: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:08:47.553680 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.634351 14366 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:47.634999 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:47.685519 13861 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:08:47.635972 13784 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:47.475378 20357 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:47.643659 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 345992us
I20260709 13:08:47.623720 20318 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.536098 20126 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.676013 14396 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:47.620573 20321 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.514377 20389 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:47.688521 13861 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:08:47.510608 20284 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.166s
I20260709 13:08:47.578069 20392 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:47.535797 20037 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:47.695713 13829 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:47.712812 13829 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:47.695957 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:47.631757 20444 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.631470 20378 raft_consensus.cc:697] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:47.670804 20131 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:47.637120 20242 consensus_queue.cc:1059] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.064s
I20260709 13:08:47.700615 13863 raft_consensus.cc:2393] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 18: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:47.714581 13861 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:47.702232 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 3370) took 1495 ms. Trace:
I20260709 13:08:47.691653 19867 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:47.610038 20356 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:47.692829 20422 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:47.612557 19900 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:47.700157 14401 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
W20260709 13:08:47.724920 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.696700 20321 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:47.730393 13715 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
I20260709 13:08:47.732211 13856 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
I20260709 13:08:47.739972 13782 raft_consensus.cc:1240] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:47.726676 13714 rpcz_store.cc:276] 0709 13:08:46.202590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.202785 (+   195us) service_pool.cc:224] Handling call
0709 13:08:46.203079 (+   294us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:46.323671 (+120592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:46.323699 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:46.351588 (+ 27889us) log.cc:844] Serialized 52 byte log entry
0709 13:08:46.714418 (+362830us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:46.714479 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:46.714581 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:47.483097 (+768516us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:47.692581 (+209484us) raft_consensus.cc:1685] finished
0709 13:08:47.692604 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:47.697776 (+  5172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6877,"raft.queue_time_us":15035,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":46049024,"thread_start_us":362372,"threads_started":1,"wal-append.queue_time_us":351883}
W20260709 13:08:47.752076 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.717943 19763 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:47.761266 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:47.784577 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 159756us
I20260709 13:08:47.716707 20444 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:47.793490 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:47.794371 13782 raft_consensus.cc:2368] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 20. Current term is 21.
I20260709 13:08:47.716364 20392 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:47.697367 20318 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:47.792275 14402 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:47.733109 19867 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.704236 20389 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:47.699164 20126 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:47.692795 19971 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:47.776232 19758 consensus_meta.cc:287] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.000s
I20260709 13:08:47.774749 19952 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:47.774283 20439 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:47.792842 13858 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:08:47.805151 20445 log.cc:927] Time spent T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:08:47.736964 19857 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:08:47.824043 14396 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:08:47.806754 19867 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:47.828251 13782 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 19 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:47.806156 20263 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:47.749322 20422 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:47.841576 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 3110) took 1632 ms. Trace:
I20260709 13:08:47.844573 13782 raft_consensus.cc:1275] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:47.834754 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1509) took 1198 ms. Trace:
I20260709 13:08:47.836059 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:47.821220 20361 consensus_meta.cc:287] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.694s	user 0.014s	sys 0.001s
I20260709 13:08:47.848076 13785 rpcz_store.cc:276] 0709 13:08:46.636382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.638201 (+  1819us) service_pool.cc:224] Handling call
0709 13:08:47.834550 (+1196349us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b54001e8054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:47.834680 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1135742336}
W20260709 13:08:47.890399 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 99702.5us
I20260709 13:08:47.893778 13860 raft_consensus.cc:1275] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:08:47.903620 13860 pending_rounds.cc:85] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 10
I20260709 13:08:47.903898 13860 pending_rounds.cc:107] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:08:47.904116 13860 raft_consensus.cc:2889] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:47.899163 14395 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:47.848308 13789 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:47.842110 13862 rpcz_store.cc:276] 0709 13:08:46.209449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.323166 (+113717us) service_pool.cc:224] Handling call
0709 13:08:46.332117 (+  8951us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:46.625208 (+293091us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:46.625241 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:46.625737 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:08:46.760946 (+135209us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:46.761007 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:47.833818 (+1072811us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54002d87d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:47.833877 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:47.833926 (+    49us) raft_consensus.cc:1685] finished
0709 13:08:47.833943 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:47.841483 (+  7540us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":623,"raft.queue_time_us":1388,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":672974208,"thread_start_us":117414,"threads_started":1,"wal-append.queue_time_us":357182}
W20260709 13:08:47.907604 13864 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.027s	sys 0.027s
W20260709 13:08:47.907972 13864 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.027s	sys 0.027s
I20260709 13:08:47.910439 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:47.911185 13829 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:47.836519 20263 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:47.849112 20441 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.827389 19952 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:47.921406 13829 leader_election.cc:400] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15.
I20260709 13:08:47.921761 13829 leader_election.cc:403] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:08:47.924500 13829 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:47.915470 20456 log.cc:927] Time spent T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
W20260709 13:08:47.938908 20457 log.cc:927] Time spent T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 13:08:47.939893 20459 log.cc:927] Time spent T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:08:47.941340 20333 raft_consensus.cc:3055] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:47.941828 20333 raft_consensus.cc:740] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:47.943114 20422 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:47.943727 19837 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.944279 19837 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:47.946545 19837 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:47.952288 20389 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:47.926774 20123 consensus_queue.cc:1059] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:08:47.958246 13756 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:47.913535 20034 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:47.827696 20378 consensus_queue.cc:237] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:47.921561 19763 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:47.919332 20263 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:47.988346 19971 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:47.989161 20462 log.cc:927] Time spent T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 13:08:47.989523 19837 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:47.979220 20455 log.cc:927] Time spent T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 13:08:47.992698 19758 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.995882 13863 raft_consensus.cc:3055] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:08:48.004048 20460 log.cc:927] Time spent T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:08:48.006130 13709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 3373) took 1473 ms. Trace:
I20260709 13:08:48.038981 13863 raft_consensus.cc:740] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:48.042403 13709 rpcz_store.cc:276] 0709 13:08:46.532691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.532851 (+   160us) service_pool.cc:224] Handling call
0709 13:08:46.583857 (+ 51006us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:47.302231 (+718374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.005822 (+703591us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b54000c5154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:48.006053 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1647168256}
W20260709 13:08:48.012003 20465 log.cc:927] Time spent T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:08:47.924006 20369 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:48.014191 13713 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:08:48.014590 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:47.942665 20333 consensus_queue.cc:260] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.023959 20422 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.991670 20037 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:48.029261 19837 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.072330 19837 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:48.072703 20472 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:48.073377 20472 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.073793 20472 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:48.031400 20318 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:47.984462 20310 consensus_meta.cc:287] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.655s	user 0.007s	sys 0.006s
I20260709 13:08:48.049897 19758 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:47.925678 20441 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:48.077369 19758 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:48.064311 19952 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:48.051139 20356 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:48.067689 20126 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:48.078624 13863 consensus_queue.cc:260] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:48.079598 13863 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:48.079489 20422 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.081660 20422 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:48.082943 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 176803us
W20260709 13:08:48.035867 20218 consensus_meta.cc:287] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.852s	user 0.006s	sys 0.005s
I20260709 13:08:48.068243 19900 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:48.085000 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:48.070163 20463 log.cc:927] Time spent T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 13:08:48.027341 20361 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15.
I20260709 13:08:48.036338 20389 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:48.035181 19971 raft_consensus.cc:2764] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:08:48.104672 13755 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:48.106057 13755 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:48.098796 20376 consensus_meta.cc:287] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.775s	user 0.010s	sys 0.000s
I20260709 13:08:48.108428 13755 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:48.111891 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:48.123595 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:48.172581 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 64200.9us
I20260709 13:08:48.146793 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:48.180622 13860 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:48.112321 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:48.176501 13783 raft_consensus.cc:2393] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 18: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:48.181690 13857 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:08:48.174134 13755 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:48.185124 13755 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:48.071033 20444 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.193017 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 3376) took 1582 ms. Trace:
I20260709 13:08:48.193457 13712 rpcz_store.cc:276] 0709 13:08:46.610832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.611449 (+   617us) service_pool.cc:224] Handling call
0709 13:08:46.626557 (+ 15108us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:46.931185 (+304628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.190250 (+1259065us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b5400284bd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:48.192951 (+  2701us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":669143424}
W20260709 13:08:48.195196 14366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.013s	sys 0.004s
W20260709 13:08:48.195533 14366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.013s	sys 0.005s
I20260709 13:08:48.077486 20441 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:48.196030 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 561719us
I20260709 13:08:48.176628 19971 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:48.206045 13863 raft_consensus.cc:1275] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:48.176934 20392 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:48.211583 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 287153us
I20260709 13:08:48.213903 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:48.218118 13860 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:48.146042 20218 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 13:08:48.107183 20389 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:48.220860 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 262698us
I20260709 13:08:48.224537 13829 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:48.214702 20318 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:48.241269 20487 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:48.241422 20481 consensus_queue.cc:1059] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:08:48.242257 20468 log.cc:927] Time spent T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:48.241957 20487 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.242527 20481 raft_consensus.cc:3055] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:48.242904 20481 raft_consensus.cc:740] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:48.243738 20481 consensus_queue.cc:260] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.244977 20481 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:48.246131 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:48.246856 13864 raft_consensus.cc:2393] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 17: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:48.244194 20487 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:48.248287 14393 raft_consensus.cc:1240] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:48.250201 20461 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:08:48.228048 20458 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:48.252067 20458 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.252491 20389 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:48.254181 20458 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:48.228223 20401 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:48.254855 20401 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.256812 20401 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:48.236872 20355 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:48.228117 20392 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:48.257925 20392 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:48.258615 20131 consensus_meta.cc:287] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.000s
I20260709 13:08:48.259940 20392 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:48.237875 20480 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:48.261150 20480 raft_consensus.cc:697] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 20 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:48.261742 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:48.262547 13860 raft_consensus.cc:2393] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 17: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:48.262009 20480 consensus_queue.cc:237] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:48.262266 20263 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.263549 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:48.264259 13859 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 17: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:48.257076 19867 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:48.219854 20472 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:48.238431 14366 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:48.259059 20131 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:48.239272 13829 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:48.238719 14395 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:48.240005 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:48.264415 20444 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:48.279819 14397 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:48.238888 20478 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.285284 20478 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.287369 20478 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:48.291610 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 52453.4us
I20260709 13:08:48.292491 19867 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:48.292851 13829 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:48.275861 20475 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:48.296437 20464 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:48.296794 20355 raft_consensus.cc:697] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:48.297084 20464 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:48.297528 20472 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:48.297860 20355 consensus_queue.cc:237] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.298203 20472 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:48.294836 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:48.296514 20375 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:48.238726 20069 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:48.299224 20464 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:48.264254 20263 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:48.305780 14397 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:08:48.322736 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:48.324196 13829 leader_election.cc:400] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 20. Current term is 21.
I20260709 13:08:48.345317 13859 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:48.349015 13783 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:08:48.296628 20477 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:48.316628 20318 raft_consensus.cc:697] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:48.355242 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:48.357105 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:48.357672 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:48.364881 13787 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:48.365222 13783 raft_consensus.cc:2393] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 17: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:48.365381 13785 raft_consensus.cc:2393] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 16: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:48.358431 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:48.358445 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:48.326833 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 141811us
W20260709 13:08:48.363976 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.367272 13782 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:48.299825 20483 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:48.324563 20472 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:48.370117 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:48.371150 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:48.373639 13859 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:08:48.373816 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:48.351509 20475 raft_consensus.cc:697] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:48.354061 20444 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:48.325907 20392 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:08:48.381172 13787 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:08:48.384189 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:48.385568 13790 raft_consensus.cc:2410] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:08:48.368429 20483 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:48.386626 20483 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:48.387266 20471 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
W20260709 13:08:48.386649 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 62590.4us
I20260709 13:08:48.390249 13829 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:48.391678 20472 consensus_queue.cc:1048] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:48.393438 20472 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:48.393862 20472 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:48.394265 20472 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:48.396405 20318 consensus_queue.cc:237] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.397970 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:48.398679 14397 raft_consensus.cc:2393] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 18: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:48.398881 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:48.353119 20487 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:08:48.399926 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:48.401153 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:48.402890 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:48.403182 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.407130 13785 raft_consensus.cc:2393] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 23: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:48.404003 13782 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:48.407199 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:48.407882 13786 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:08:48.404903 13791 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:08:48.404523 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:48.411949 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:48.412856 13791 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:48.442495 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:48.445892 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:48.446653 14395 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:08:48.446796 13782 raft_consensus.cc:1275] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:48.451234 14366 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:48.452168 13791 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:48.453778 14366 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:48.366113 20477 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.455724 20475 consensus_queue.cc:237] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.457145 20477 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:48.455229 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:48.442842 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:48.450186 20321 consensus_meta.cc:287] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.666s	user 0.009s	sys 0.002s
I20260709 13:08:48.463224 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:48.462461 13829 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:48.466138 14393 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:48.411078 19900 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:08:48.385715 20444 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.409122 19971 consensus_queue.cc:1048] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:08:48.693064 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:48.674067 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:48.680584 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:48.662577 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 2937) took 1322 ms. Trace:
I20260709 13:08:48.713716 13715 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:48.466987 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:48.711926 14398 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:48.692760 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:48.696998 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:48.697206 14402 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:08:48.714833 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 247939us
I20260709 13:08:48.715029 14397 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:48.684031 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:48.529824 14400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 1485) took 1439 ms. Trace:
I20260709 13:08:48.671949 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:48.607722 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 199764us
I20260709 13:08:48.673538 13716 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:48.714852 14395 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:48.472470 14366 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:48.716542 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:48.678073 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:48.739317 14399 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:48.713909 13713 rpcz_store.cc:276] 0709 13:08:47.340565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.377737 (+ 37172us) service_pool.cc:224] Handling call
0709 13:08:48.662396 (+1284659us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54002e6dd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:48.662510 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":354630912}
I20260709 13:08:48.721961 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:48.741001 13715 raft_consensus.cc:2393] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 17: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:48.730978 13711 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:48.742379 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:48.740669 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 268299us
I20260709 13:08:48.744355 13710 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 18: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:48.681468 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:48.731017 14400 rpcz_store.cc:276] 0709 13:08:47.090535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.090661 (+   126us) service_pool.cc:224] Handling call
0709 13:08:48.529596 (+1438935us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b54008c41d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:48.529757 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1498178816}
I20260709 13:08:48.746017 13791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:08:48.746837 13791 raft_consensus.cc:606] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:48.663844 20499 log.cc:927] Time spent T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:08:48.461827 20069 raft_consensus.cc:697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:48.753614 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:48.754268 13713 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:48.754426 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:48.755059 13715 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
I20260709 13:08:48.496780 19763 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:08:48.563828 20497 log.cc:927] Time spent T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:08:48.514194 20131 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:48.752143 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:48.572525 20501 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.542605 20452 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:48.542514 20489 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.722832 13755 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:48.747532 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:48.788167 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 65455.9us
I20260709 13:08:48.468396 20375 consensus_queue.cc:1059] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.307s
I20260709 13:08:48.687582 20503 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.091s
I20260709 13:08:48.492995 20321 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:48.792321 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:48.793308 13784 raft_consensus.cc:2393] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 14: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:48.679031 20422 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.664446 20333 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:48.778782 19763 raft_consensus.cc:697] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 17 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:48.535487 20493 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.307s
I20260709 13:08:48.795092 13791 raft_consensus.cc:1275] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:48.739739 13714 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:48.796277 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:48.757464 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:48.669994 19867 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.761215 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:48.718416 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:48.798332 13861 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:48.798468 13716 raft_consensus.cc:2393] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 19: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:48.764201 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:48.724731 20454 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:48.802932 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:48.803735 13716 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:48.769892 13858 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:48.752619 13864 raft_consensus.cc:1275] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:48.492810 20471 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:48.556911 20494 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.572000 20034 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.742390 20441 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.771513 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:48.718864 20479 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:48.772897 13710 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 17: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:48.807190 13709 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:08:48.781296 14398 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:08:48.542239 20486 consensus_queue.cc:1048] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.264s
I20260709 13:08:48.786509 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:48.812420 13865 raft_consensus.cc:2393] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 20: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:48.801316 13713 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:08:48.812570 13861 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 23.
I20260709 13:08:48.788331 20401 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:48.796866 13714 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
I20260709 13:08:48.814005 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:48.816319 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 97956.3us
I20260709 13:08:48.817243 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:48.783849 20452 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:48.822019 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:48.823283 14367 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:48.818171 13783 raft_consensus.cc:2393] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 20: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:48.825551 13714 raft_consensus.cc:1275] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:48.803663 20131 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:48.850772 13716 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 23.
I20260709 13:08:48.813557 20375 consensus_queue.cc:1243] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer ceb06175847b428ea8bd77055fcddf58 log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:08:48.809258 20334 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:48.856770 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 176263us
I20260709 13:08:48.811388 20318 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:48.797603 20489 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.788527 20501 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.819281 20471 raft_consensus.cc:697] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:48.806905 20422 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:48.856923 20506 log.cc:927] Time spent T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:08:48.808174 19867 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.817994 20441 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:48.886250 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 56706.6us
I20260709 13:08:48.827688 20452 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:48.834352 20131 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.832244 20123 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:48.815220 20034 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.911427 13707 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:48.814980 20479 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.817626 19763 consensus_queue.cc:237] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.811906 20494 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:48.954991 13829 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:48.912662 20131 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:48.879722 20334 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.910578 20375 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:48.875566 20511 consensus_queue.cc:1059] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.102s
I20260709 13:08:48.871290 20480 consensus_queue.cc:1059] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:08:48.871582 19971 consensus_queue.cc:1048] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:08:48.883961 20318 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.953060 20401 raft_consensus.cc:697] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:48.880364 20069 consensus_queue.cc:237] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.954594 20513 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:08:48.983100 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 83260.3us
I20260709 13:08:48.963816 20444 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:48.995565 20444 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:48.971381 20516 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:49.007997 20516 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.010175 20516 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:48.989665 20375 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.012123 20422 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:48.976632 20471 consensus_queue.cc:237] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:48.983974 20321 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:48.994580 13791 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:08:48.997321 20020 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:48.997881 20523 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:48.998380 20521 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:48.998493 20489 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:48.999305 20512 log.cc:927] Time spent T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:08:48.999526 20034 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:49.000320 19867 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:49.000967 20318 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:49.002796 20334 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:49.005712 20509 log.cc:927] Time spent T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:08:49.043640 20494 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:49.043864 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 3131) took 1106 ms. Trace:
I20260709 13:08:49.045065 20452 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:49.006974 20472 consensus_meta.cc:287] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.001s
W20260709 13:08:49.007508 20483 consensus_meta.cc:287] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.620s	user 0.007s	sys 0.003s
I20260709 13:08:49.046998 20483 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.049055 20483 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:49.020535 14367 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:49.051254 20517 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:49.051512 14367 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:08:49.052968 20510 log.cc:927] Time spent T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:49.052891 14367 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:49.053161 20517 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:49.053643 20517 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:49.053897 20448 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:49.054050 20517 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:49.054740 20472 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:48.989871 20507 log.cc:927] Time spent T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:08:49.012539 20375 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:49.032903 20521 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:49.069582 20521 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:49.074780 20490 log.cc:927] Time spent T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.619s	user 0.002s	sys 0.000s
I20260709 13:08:49.040727 20514 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:08:49.013806 20401 consensus_queue.cc:237] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.028970 20481 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:49.027773 20501 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:49.055680 13788 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:49.039577 20523 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.054097 14367 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:49.027999 13711 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:08:49.044399 13862 rpcz_store.cc:276] 0709 13:08:47.937398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.937567 (+   169us) service_pool.cc:224] Handling call
0709 13:08:47.938520 (+   953us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:48.201191 (+262671us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:48.374512 (+173321us) log.cc:844] Serialized 14 byte log entry
0709 13:08:48.788664 (+414152us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:48.814098 (+ 25434us) log.cc:844] Serialized 26 byte log entry
0709 13:08:48.814307 (+   209us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:48.814353 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.814440 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:49.043608 (+229168us) raft_consensus.cc:1685] finished
0709 13:08:49.043635 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.043790 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4162,"prepare.queue_time_us":304687,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":121820,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":12849,"thread_start_us":785585,"threads_started":3,"wal-append.queue_time_us":453514}
I20260709 13:08:49.051060 20131 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.091024 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:49.091758 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:49.092249 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.096917 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:49.083148 20514 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.101269 20514 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.102980 20520 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:49.103663 20520 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:49.104053 20520 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:49.105576 20479 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:49.106652 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:49.107919 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:49.108441 13785 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:08:49.108946 20514 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:49.109225 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:49.109844 13785 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:49.110736 13785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:08:49.112635 13785 raft_consensus.cc:606] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:08:49.112957 13785 raft_consensus.cc:614] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:49.113608 13789 raft_consensus.cc:2393] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 19: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
W20260709 13:08:49.115768 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 241750us
I20260709 13:08:49.116652 20513 consensus_queue.cc:1048] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:49.117144 13680 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:49.118402 20365 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:49.120498 20524 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:49.121052 20524 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.122476 20441 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:49.124089 14399 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:08:49.126132 20517 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.127060 20131 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:49.123147 20524 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:49.099267 20452 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:49.137719 13785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:08:49.138633 13785 raft_consensus.cc:606] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:49.139112 13785 raft_consensus.cc:614] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:49.143651 20517 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:49.133000 13680 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:49.131873 20513 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:08:49.149142 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.173103 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:49.174953 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:49.176488 14399 raft_consensus.cc:2393] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 20: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:49.176625 14394 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:49.135088 20441 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:08:49.136600 20454 consensus_queue.cc:1059] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:08:49.181414 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:49.185436 13711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "536b1fc131984687bf3b13417507e21d"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:60558
I20260709 13:08:49.186189 13711 raft_consensus.cc:606] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Received request to transfer leadership
I20260709 13:08:49.186632 13711 raft_consensus.cc:614] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:49.187357 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:49.175853 19857 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:49.171233 19763 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:49.195272 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:49.195749 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:49.177716 20513 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:49.196352 13680 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:49.196964 14399 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:49.195906 14394 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:49.196805 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:49.199437 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:49.200503 20523 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:49.201421 20472 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:49.202016 20472 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:49.202489 20472 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:49.209939 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:49.207289 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:49.210878 14402 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:49.195014 19857 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.197548 20516 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.195405 20454 consensus_queue.cc:1243] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer ceb06175847b428ea8bd77055fcddf58 log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:08:49.216728 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:49.236130 14399 raft_consensus.cc:2393] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 13: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:49.211401 14394 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:08:49.205531 20513 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:49.223459 20532 log.cc:927] Time spent T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:08:49.226987 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:49.244588 13755 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:49.229214 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2934) took 1967 ms. Trace:
I20260709 13:08:49.247049 13708 rpcz_store.cc:276] 0709 13:08:47.261430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.262546 (+  1116us) service_pool.cc:224] Handling call
0709 13:08:47.262824 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:47.496523 (+233699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.228986 (+1732463us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54001b8d54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:49.229153 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":498106112}
I20260709 13:08:49.237668 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:49.238912 20513 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:49.241281 13863 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:49.250033 14400 raft_consensus.cc:2393] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 19: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:49.232856 19857 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:49.254698 20464 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:49.203902 19763 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.255127 20464 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.245143 20535 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:49.259133 20464 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:49.206785 20531 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:08:49.265162 13755 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:49.280270 20511 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:49.266886 13755 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:49.287472 20478 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:49.287985 20478 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.288389 20478 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:49.252897 20441 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:49.283164 20511 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:49.237960 20516 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.294930 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:49.299679 13790 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:49.311709 13863 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
W20260709 13:08:49.311759 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 115462us
I20260709 13:08:49.314096 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:49.311647 14367 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:49.307404 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1665) took 1091 ms. Trace:
I20260709 13:08:49.322990 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:49.324901 13857 rpcz_store.cc:276] 0709 13:08:48.215875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.217682 (+  1807us) service_pool.cc:224] Handling call
0709 13:08:48.236065 (+ 18383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:48.300388 (+ 64323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:48.300422 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:48.300469 (+    47us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:48.300510 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.307110 (+1006600us) spinlock_profiling.cc:243] Waited 64.1 ms on lock 0x7b540004a454. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:49.307166 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.307334 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147478272}
W20260709 13:08:49.301793 20536 log.cc:927] Time spent T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:08:49.333770 13790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:08:49.338389 13790 raft_consensus.cc:606] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:08:49.338825 13790 raft_consensus.cc:614] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:49.295809 20511 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.294152 19763 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:49.308476 20516 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:49.294392 20441 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.331782 20395 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:49.352178 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:49.353282 13785 raft_consensus.cc:2410] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:08:49.291345 20520 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.362179 20520 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:49.291630 20501 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:08:49.296571 20521 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.309933 20439 consensus_queue.cc:1059] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:08:49.348977 20395 raft_consensus.cc:697] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:49.357650 20347 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.296664 20535 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.360201 20472 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:49.344846 20511 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:49.363242 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:49.344587 20533 log.cc:927] Time spent T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:08:49.307138 20478 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.303217 20513 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.378180 13711 raft_consensus.cc:1240] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:49.348290 20441 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:49.380661 13708 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:49.382596 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:49.387485 13715 raft_consensus.cc:2393] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 23: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:49.385226 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:49.387079 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:49.383764 20422 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.384193 20474 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.404240 13712 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:08:49.406612 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:49.409624 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:49.382287 20347 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.416291 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:49.422860 13830 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:49.424448 13830 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:49.427649 20546 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.428126 20546 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:49.429584 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:49.403878 20545 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:49.432796 20037 raft_consensus.cc:3055] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:49.436908 20037 raft_consensus.cc:740] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:49.432968 20242 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:49.434826 20375 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.441102 20375 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.443598 20123 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:49.443301 20545 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:49.444777 20513 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:49.445497 20545 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:49.446108 20478 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:49.447371 20347 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:49.430843 20542 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.448348 20542 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:49.450359 20542 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:49.456370 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:49.457124 13858 raft_consensus.cc:2393] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 20: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:49.457983 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:49.458990 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:49.459203 13862 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:49.460246 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:49.460989 13862 raft_consensus.cc:2410] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:08:49.461975 13862 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:08:49.463732 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:49.463835 20539 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:49.464327 13856 raft_consensus.cc:2376] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 23. Re-sending same reply.
I20260709 13:08:49.443323 20375 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:49.471988 20473 log.cc:927] Time spent T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7: Append to log took a long time: real 1.276s	user 0.000s	sys 0.003s
I20260709 13:08:49.472371 13858 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:49.473464 13858 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:49.474588 20535 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:49.474720 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:49.475518 13791 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:08:49.476112 20521 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:49.408164 20422 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.481312 20422 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:49.484565 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42104 (request call id 1664) took 1271 ms. Trace:
I20260709 13:08:49.485055 13863 rpcz_store.cc:276] 0709 13:08:48.213445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.213641 (+   196us) service_pool.cc:224] Handling call
0709 13:08:49.484372 (+1270731us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400387054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:49.484497 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2359521024}
W20260709 13:08:49.487543 13662 auto_rebalancer.cc:893] Removing replace marker failed: Replica b9d194f45e044e0988d5de1a99e5cd02 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:08:49.487970 13662 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:08:49.488216 13662 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:08:49.494002 14402 raft_consensus.cc:1275] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:49.495147 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:49.435081 20395 consensus_queue.cc:237] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.492745 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:49.501312 14394 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:49.436851 20540 raft_consensus.cc:3055] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:49.503840 20540 raft_consensus.cc:740] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:49.504776 20540 consensus_queue.cc:260] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:49.506069 20540 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:49.414538 20474 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:49.431070 20439 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.083s
I20260709 13:08:49.430799 19763 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:49.519330 13680 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:49.520275 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:49.521011 14397 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:49.528641 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:49.529428 14402 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
I20260709 13:08:49.530929 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:49.531724 13863 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:49.502835 19857 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:49.513000 20464 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.511266 20474 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:49.557476 19857 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:49.535382 19867 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:49.571290 20422 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.572594 20422 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.574712 20422 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:49.574352 20511 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.571924 13682 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:49.535211 20375 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.590296 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:49.591015 14402 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
I20260709 13:08:49.596398 14397 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:08:49.571805 19867 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:49.589684 20526 log.cc:927] Time spent T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:08:49.576220 20542 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:08:49.629292 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 57476us
I20260709 13:08:49.630892 13682 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:49.631948 20542 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.632800 13682 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:49.633510 20422 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:49.633888 20422 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.634052 20542 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:49.634271 20422 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:49.634588 20542 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:49.627985 20511 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:49.636986 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:49.627087 19867 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:49.641711 19857 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:49.642957 13682 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:49.643661 20551 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:49.644248 20551 raft_consensus.cc:697] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 20 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:49.645089 20551 consensus_queue.cc:237] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:49.647889 20422 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.651467 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:49.652004 14399 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:49.652263 20464 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:49.591770 20375 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:49.669889 20375 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:49.676813 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:49.677018 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:49.681855 13711 raft_consensus.cc:2393] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 17: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:49.678828 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:49.683281 13708 raft_consensus.cc:2410] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:08:49.674392 20422 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:49.697117 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:49.675364 20550 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:49.703715 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:49.713383 13707 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
W20260709 13:08:49.696852 20467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.483s	user 0.016s	sys 0.035s
W20260709 13:08:49.702144 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 267224us
I20260709 13:08:49.720285 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:49.718182 20467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.514s	user 0.016s	sys 0.035s
I20260709 13:08:49.720320 13830 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:49.730584 14394 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
W20260709 13:08:49.744725 13788 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1528) took 1386 ms (client timeout 1833 ms). Trace:
W20260709 13:08:49.745189 13788 rpcz_store.cc:269] 0709 13:08:48.358081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.358189 (+   108us) service_pool.cc:224] Handling call
0709 13:08:49.744564 (+1386375us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b54003df754. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:49.744666 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1583803648}
I20260709 13:08:49.748543 13830 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:49.749639 20472 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.750334 20472 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.753122 20472 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:49.753605 20472 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:49.756254 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:49.756853 13707 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:08:49.757063 20472 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:49.757850 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:49.759042 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:49.759570 13786 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:08:49.762868 20501 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.763355 20501 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.766031 20501 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:49.766992 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:49.767925 20544 log.cc:927] Time spent T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.320s	user 0.005s	sys 0.000s
I20260709 13:08:49.769052 20439 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:49.769618 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:49.759315 13755 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:49.773752 13755 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:49.775058 13756 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:49.780305 13829 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:49.781687 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:49.783339 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:49.784524 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:49.785431 13788 raft_consensus.cc:2368] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18.
I20260709 13:08:49.786532 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:49.786597 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:49.787250 13856 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:08:49.787587 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1953) took 1096 ms. Trace:
I20260709 13:08:49.789656 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:49.790491 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:49.791803 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:49.792963 13790 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 16: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:49.793594 13786 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:08:49.793943 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:49.794705 13790 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:49.794718 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:49.795848 13786 raft_consensus.cc:2410] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:08:49.803574 20464 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:49.805356 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:49.809491 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:49.810081 14397 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:49.813668 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:49.809507 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:49.814881 13707 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:49.787916 14393 rpcz_store.cc:276] 0709 13:08:48.691461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.691932 (+   471us) service_pool.cc:224] Handling call
0709 13:08:48.725445 (+ 33513us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:49.083802 (+358357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:49.083831 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:49.093651 (+  9820us) log.cc:844] Serialized 52 byte log entry
0709 13:08:49.172704 (+ 79053us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:49.172760 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.749466 (+576706us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b540060de54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:49.779311 (+ 29845us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:49.779355 (+    44us) raft_consensus.cc:1685] finished
0709 13:08:49.779369 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.787531 (+  8162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39203,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"spinlock_wait_cycles":539176832,"thread_start_us":194900,"threads_started":2,"wal-append.queue_time_us":138104}
I20260709 13:08:49.815689 14394 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 16: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:49.817816 14402 raft_consensus.cc:1240] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:49.818444 13715 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:49.820185 13680 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:08:49.823818 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 48852.5us
I20260709 13:08:49.779263 20485 raft_consensus.cc:3055] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:49.825690 13756 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:49.827715 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:49.829487 14397 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:49.829936 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:49.833546 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:49.844717 13716 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:49.847527 13707 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:08:49.789489 20475 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:49.830605 20357 raft_consensus.cc:2764] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:08:49.806656 20464 raft_consensus.cc:697] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:49.856158 14393 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:49.859066 13755 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:49.860560 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 1531) took 1115 ms. Trace:
I20260709 13:08:49.856542 13788 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:49.825870 20540 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:49.868355 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:49.870020 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:49.898452 13861 raft_consensus.cc:2410] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:08:49.872714 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:49.836480 20435 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:49.878479 14367 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:49.834095 20485 raft_consensus.cc:740] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:49.899690 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:49.900321 13856 raft_consensus.cc:2393] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 19: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:49.903136 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:49.904137 13863 raft_consensus.cc:2393] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 12: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:49.906773 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:49.898619 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:49.914211 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:49.915891 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:49.852228 20480 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:49.919704 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:49.920214 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:49.920542 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:49.920931 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:49.925036 13710 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:49.925942 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:49.921710 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:49.926815 13680 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:49.927325 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:49.927894 13713 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:49.927990 20547 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:49.928409 20547 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.928735 20547 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:49.936015 13713 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:08:49.936909 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:49.938778 20513 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:49.925570 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:49.938812 13716 raft_consensus.cc:1240] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:08:49.940979 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:49.941871 13856 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:08:49.942567 20513 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:49.943223 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:49.943850 13856 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 24.
I20260709 13:08:49.944649 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:49.854925 20481 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:49.947124 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:49.957180 13709 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 16: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:49.958742 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:49.959506 13863 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:49.860178 20535 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:49.969038 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:49.969867 13856 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:49.970361 13783 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:08:49.976491 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:49.977289 13861 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 12.
W20260709 13:08:49.916857 20525 log.cc:927] Time spent T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:49.978674 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:49.982326 20556 log.cc:927] Time spent T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
W20260709 13:08:49.984543 20558 log.cc:927] Time spent T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:08:49.861110 20218 consensus_queue.cc:1059] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.118s
I20260709 13:08:49.989288 13788 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:08:49.989130 20535 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:49.966051 20422 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:49.995185 13859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1671) took 1533 ms. Trace:
I20260709 13:08:49.995680 13859 rpcz_store.cc:276] 0709 13:08:48.462142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.463094 (+   952us) service_pool.cc:224] Handling call
0709 13:08:48.463369 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:48.463695 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:48.463721 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:48.469837 (+  6116us) log.cc:844] Serialized 26 byte log entry
0709 13:08:48.978405 (+508568us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:48.991331 (+ 12926us) log.cc:844] Serialized 14 byte log entry
0709 13:08:49.019631 (+ 28300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.019716 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:49.750567 (+730851us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b18004b5740. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f13f3 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
0709 13:08:49.994856 (+244289us) raft_consensus.cc:1685] finished
0709 13:08:49.994975 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.995109 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15460,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":38234,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":42971,"spinlock_wait_cycles":55320832,"thread_start_us":469550,"threads_started":1,"wal-append.queue_time_us":541382}
W20260709 13:08:49.923237 20441 consensus_meta.cc:287] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.001s
I20260709 13:08:50.001720 13863 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:08:49.916152 20400 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:49.916237 19763 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:49.922700 20484 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:49.916419 20375 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.922912 20474 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:49.922534 20516 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.040071 14399 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
W20260709 13:08:50.050891 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 49665.4us
I20260709 13:08:50.042541 13859 raft_consensus.cc:1275] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:49.973273 20475 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.963059 13680 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:49.956845 20435 raft_consensus.cc:697] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:49.947395 20020 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:49.941200 20547 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:50.060276 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 97536us
I20260709 13:08:50.063015 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:49.991357 20535 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:50.061786 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:50.092661 13856 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:08:50.067185 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:50.098740 13856 raft_consensus.cc:1240] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:49.973532 20481 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:50.049096 20218 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.968380 20480 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:50.119807 20218 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:50.121657 20480 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:50.122130 20218 leader_election.cc:290] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:50.125383 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:50.066656 20340 raft_consensus.cc:3055] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:50.066293 20545 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:50.137465 13830 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:50.138679 13682 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:50.056443 20400 raft_consensus.cc:697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:50.140491 20400 consensus_queue.cc:237] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:50.084905 20559 log.cc:927] Time spent T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 13:08:50.065491 20020 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.063596 20475 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:50.067024 20484 raft_consensus.cc:697] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:50.040448 20441 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:50.108565 20513 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:50.145229 13830 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:50.249542 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 104454us
I20260709 13:08:50.062469 20516 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:50.062268 20375 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:50.057718 19763 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:50.261576 20355 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.255105 20513 raft_consensus.cc:697] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:50.223266 20478 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.265604 20357 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:50.267697 20439 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.270188 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:50.213102 20020 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:50.134654 20340 raft_consensus.cc:740] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:50.144651 20545 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.273731 14399 raft_consensus.cc:1240] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:50.063824 20474 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:50.280809 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 455181us
I20260709 13:08:50.281630 13714 raft_consensus.cc:2368] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 13. Current term is 14.
I20260709 13:08:50.212689 20480 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:50.305773 13756 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:50.257272 19867 consensus_meta.cc:287] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.616s	user 0.017s	sys 0.001s
I20260709 13:08:50.064692 20485 consensus_queue.cc:260] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:50.310737 13861 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:50.078263 20464 consensus_queue.cc:237] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:50.332317 20454 consensus_queue.cc:1175] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "35ecb005831740438d7537dd4b840e03" responder_term: 18 status { last_received { term: 12 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 17. Current term is 18. Ops: [17.13-17.13]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:50.318511 20069 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:50.281929 20333 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:50.339454 20069 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:50.395079 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3262) took 1065 ms. Trace:
I20260709 13:08:50.311633 20545 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:50.280213 20355 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:50.309393 20357 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:50.280398 20435 consensus_queue.cc:237] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:50.398808 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:50.356947 20340 consensus_queue.cc:260] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:50.360400 20481 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:50.364570 20516 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:50.335803 20511 consensus_queue.cc:1048] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:08:50.366576 20547 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:50.309808 20480 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.317030 20439 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:50.367193 14396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 2193) took 1922 ms. Trace:
I20260709 13:08:50.368350 20375 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:50.336263 20485 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:50.492286 14396 rpcz_store.cc:276] 0709 13:08:48.444429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.447591 (+  3162us) service_pool.cc:224] Handling call
0709 13:08:48.447985 (+   394us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:48.460060 (+ 12075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:48.460104 (+    44us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:48.460934 (+   830us) log.cc:844] Serialized 78 byte log entry
0709 13:08:48.713379 (+252445us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:48.748695 (+ 35316us) log.cc:844] Serialized 14 byte log entry
0709 13:08:48.840593 (+ 91898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.840672 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:50.346230 (+1505558us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b180046dbc0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f13f3 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
0709 13:08:50.366895 (+ 20665us) raft_consensus.cc:1685] finished
0709 13:08:50.366984 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.367139 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11549,"prepare.queue_time_us":35931,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":47571,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":4549,"spinlock_wait_cycles":5696384,"thread_start_us":305157,"threads_started":2,"wal-append.queue_time_us":277505}
I20260709 13:08:50.370980 20474 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:50.370862 20020 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:50.372088 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:50.375626 20554 log.cc:927] Time spent T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:08:50.377791 13862 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:50.281713 20478 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:50.380836 20561 log.cc:927] Time spent T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:08:50.382777 20560 log.cc:927] Time spent T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:08:50.363305 19763 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:50.384950 20531 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:50.388772 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:50.393158 20513 consensus_queue.cc:237] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:50.394318 13829 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:50.347631 20484 consensus_queue.cc:237] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:50.400281 20550 consensus_meta.cc:287] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.682s	user 0.007s	sys 0.003s
I20260709 13:08:50.356716 20441 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:50.401552 20357 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:50.398468 20475 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:50.318087 19867 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:49.863082 13782 rpcz_store.cc:276] 0709 13:08:48.745128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.745277 (+   149us) service_pool.cc:224] Handling call
0709 13:08:48.745542 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:48.745764 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:49.595581 (+849817us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b18001d2f60. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f52320864bc 00007f522f3d448b 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3ee455 00007f5235ed63c7 00007f52324e89a7 00007f52324f80bf
0709 13:08:49.595787 (+   206us) log.cc:844] Serialized 14 byte log entry
0709 13:08:49.860227 (+264440us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:49.860275 (+    48us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:49.860331 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.860387 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.860498 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22081,"prepare.queue_time_us":125148,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":3764,"spinlock_wait_cycles":6090496,"thread_start_us":354680,"threads_started":2}
I20260709 13:08:50.395500 13785 rpcz_store.cc:276] 0709 13:08:49.329335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.402089 (+ 72754us) service_pool.cc:224] Handling call
0709 13:08:49.416975 (+ 14886us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:49.759595 (+342620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:49.759625 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:49.760159 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:08:50.215468 (+455309us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:50.216721 (+  1253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.394714 (+177993us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54000ec9d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:50.394759 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:50.394810 (+    51us) raft_consensus.cc:1685] finished
0709 13:08:50.394825 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.395021 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":237735,"raft.queue_time_us":239940,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":240319360,"thread_start_us":388346,"threads_started":1,"wal-append.queue_time_us":597236}
I20260709 13:08:50.395442 20069 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:50.414266 13757 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:50.490784 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:50.494077 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:50.494757 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 398929us
I20260709 13:08:50.397177 20546 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:50.408128 20333 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:50.492980 20480 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:50.495949 20340 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:50.512346 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 118110us
I20260709 13:08:50.513998 13788 raft_consensus.cc:1240] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 15. Ops: []
I20260709 13:08:50.501475 20375 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.512249 20355 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:50.521225 13791 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:08:50.516302 20550 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:50.518703 19763 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:50.540446 13785 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:08:50.545477 13715 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.013s	sys 0.013s
I20260709 13:08:50.545763 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3244) took 2134 ms. Trace:
W20260709 13:08:50.546185 13715 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.013s	sys 0.013s
W20260709 13:08:50.547454 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 408849us
I20260709 13:08:50.546319 13787 rpcz_store.cc:276] 0709 13:08:48.404954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.408076 (+  3122us) service_pool.cc:224] Handling call
0709 13:08:48.408318 (+   242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:48.875606 (+467288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:48.875652 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:49.362103 (+486451us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b2c000108d8. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5230dd7a11 00007f5230de7372 00007f5232519a01 00007f52324de43a 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2
0709 13:08:49.362567 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:08:49.731821 (+369254us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:49.732546 (+   725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.732612 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:50.536342 (+803730us) raft_consensus.cc:1685] finished
0709 13:08:50.536368 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.539505 (+  3137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61781,"raft.queue_time_us":84461,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":3952,"spinlock_wait_cycles":9091968,"thread_start_us":708895,"threads_started":2,"wal-append.queue_time_us":702282}
W20260709 13:08:50.700383 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.567502 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 2210) took 1048 ms. Trace:
I20260709 13:08:50.723097 13682 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:08:50.712420 13856 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.000s	sys 0.010s
W20260709 13:08:50.724917 13856 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.000s	sys 0.011s
W20260709 13:08:50.724992 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.723709 14398 rpcz_store.cc:276] 0709 13:08:49.519560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.526167 (+  6607us) service_pool.cc:224] Handling call
0709 13:08:49.526560 (+   393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:49.527011 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:49.527050 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:49.562805 (+ 35755us) log.cc:844] Serialized 52 byte log entry
0709 13:08:49.866609 (+303804us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:49.866664 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.866751 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:50.567196 (+700445us) raft_consensus.cc:1685] finished
0709 13:08:50.567225 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.567425 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3565,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":1165,"thread_start_us":239504,"threads_started":1,"wal-append.queue_time_us":556682}
I20260709 13:08:50.713492 20422 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:50.741050 20037 consensus_queue.cc:260] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:50.742303 20037 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:50.728792 20553 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:50.624966 13681 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.021s	sys 0.018s
W20260709 13:08:50.748994 13681 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.036s	sys 0.018s
I20260709 13:08:50.749058 13682 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:08:50.548992 20388 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.008s	sys 0.029s
W20260709 13:08:50.611106 20572 log.cc:927] Time spent T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:08:50.620164 20439 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:50.596438 19867 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:50.751971 20422 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:50.689709 20480 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:50.755810 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:50.604233 20478 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:50.755897 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:50.757237 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:50.537500 20531 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:50.759238 14400 raft_consensus.cc:1275] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:50.761368 20552 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:50.629755 20548 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 1.121s	user 0.011s	sys 0.000s
I20260709 13:08:50.762741 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:50.537235 20441 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:50.535898 20546 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:50.777665 19857 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:50.791937 20546 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:50.792724 19857 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:50.787429 20531 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:50.794162 20546 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:50.794751 19857 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:50.775935 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 897522us
I20260709 13:08:50.795231 20531 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:50.796065 14367 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:50.614456 20333 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:50.780342 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:50.797190 14397 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:08:50.781157 14396 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:08:50.621943 20545 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:50.760505 20388 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.009s	sys 0.030s
I20260709 13:08:50.783744 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:50.784575 13712 raft_consensus.cc:1240] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:50.758769 13682 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:50.537083 20375 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:50.814448 20375 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:50.758026 20395 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.814546 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:50.815119 13790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3270) took 1057 ms. Trace:
I20260709 13:08:50.815083 20395 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:50.816103 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 484197us
I20260709 13:08:50.817339 20395 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:50.792201 20347 raft_consensus.cc:3055] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:50.817956 20347 raft_consensus.cc:740] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:50.818709 20347 consensus_queue.cc:260] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:50.819639 20347 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:50.820741 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.820786 20545 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:50.791882 20441 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:50.823555 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.824869 20441 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:50.782277 13707 raft_consensus.cc:1240] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:08:50.825189 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:50.791811 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:50.548810 20123 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.827329 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:50.827747 20123 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:50.827956 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 69255.7us
I20260709 13:08:50.829191 20501 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:50.829751 20123 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:50.597721 20020 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:50.829686 20501 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:50.800565 14367 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:50.802618 20480 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:50.803330 20475 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:50.804700 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1672) took 2297 ms. Trace:
I20260709 13:08:50.782425 20479 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:50.833174 20389 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:50.833401 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:50.833794 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:50.834306 14401 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:50.832451 13860 rpcz_store.cc:276] 0709 13:08:48.506960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.507126 (+   166us) service_pool.cc:224] Handling call
0709 13:08:48.507537 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:48.507880 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:49.230899 (+723019us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b18004b5800. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3ee455 00007f5235ed63c7 00007f52324e89a7 00007f52324f80bf 00007f52324f8038
0709 13:08:49.328663 (+ 97764us) log.cc:844] Serialized 14 byte log entry
0709 13:08:49.431403 (+102740us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:49.437517 (+  6114us) log.cc:844] Serialized 26 byte log entry
0709 13:08:49.437691 (+   174us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:49.437733 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.437830 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:50.629065 (+1191235us) spinlock_profiling.cc:243] Waited 8.91 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:50.804493 (+175428us) raft_consensus.cc:1685] finished
0709 13:08:50.804515 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.804629 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4513,"prepare.queue_time_us":32661,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":1729,"raft.queue_time_us":5675,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":7263,"spinlock_wait_cycles":60639232,"thread_start_us":180010,"threads_started":2,"wal-append.queue_time_us":175618}
I20260709 13:08:50.829530 13682 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:50.839591 20441 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:50.839780 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 425587us
I20260709 13:08:50.840353 20511 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:50.840854 20511 raft_consensus.cc:697] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 23 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:50.841732 20511 consensus_queue.cc:237] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:50.842805 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.845978 14399 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:08:50.846334 14399 pending_rounds.cc:85] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 12
I20260709 13:08:50.846525 14399 pending_rounds.cc:107] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:08:50.846724 14399 raft_consensus.cc:2889] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:50.801100 20392 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:50.847880 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:50.848296 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:50.833397 20479 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:50.849296 20479 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:50.815665 13790 rpcz_store.cc:276] 0709 13:08:49.757990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.796162 (+ 38172us) service_pool.cc:224] Handling call
0709 13:08:49.796582 (+   420us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:49.830961 (+ 34379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:49.831008 (+    47us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:49.855056 (+ 24048us) log.cc:844] Serialized 78 byte log entry
0709 13:08:50.303650 (+448594us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:50.322382 (+ 18732us) log.cc:844] Serialized 14 byte log entry
0709 13:08:50.814572 (+492190us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b18000df960. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f36bc0a 00007f5238aab219 00007f522f3f3a40 00007f522f3ee4e4 00007f522f3ee455 00007f52324d6060 00007f52324e8716 00007f52324f9287 00007f52324f9208
0709 13:08:50.814738 (+   166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.814804 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:50.814843 (+    39us) raft_consensus.cc:1685] finished
0709 13:08:50.814931 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.815069 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99555,"prepare.queue_time_us":27831,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":529383,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":20289,"spinlock_wait_cycles":11561344,"thread_start_us":380190,"threads_started":1,"wal-append.queue_time_us":678557}
I20260709 13:08:50.807395 13789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2714) took 1005 ms. Trace:
I20260709 13:08:50.851475 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:50.788255 20551 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:50.809131 14366 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.833s (SENT) [suppressed 4 similar messages]
I20260709 13:08:50.851687 13789 rpcz_store.cc:276] 0709 13:08:49.801963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.346078 (+544115us) service_pool.cc:224] Handling call
0709 13:08:50.371657 (+ 25579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.399564 (+ 27907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:50.399599 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:50.399641 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:50.399673 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.807184 (+407511us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b54002eb8d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:50.807237 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.807342 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63671680}
I20260709 13:08:50.829996 20376 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:08:50.809923 13829 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:50.854272 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 44423.5us
I20260709 13:08:50.855190 13829 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:50.854077 14367 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:50.859994 13757 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:50.861289 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:50.862291 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:50.863204 13790 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:08:50.866755 14367 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:50.869392 20357 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:50.870160 20375 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:50.874707 20333 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:08:50.879923 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 52449.5us
I20260709 13:08:50.884228 13680 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:50.884441 14401 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:08:50.777014 20069 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:50.879459 13757 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:50.888902 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:50.883754 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:50.889590 14396 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:50.889654 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:50.855754 20376 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:50.882455 20439 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.892854 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:50.893482 14395 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:08:50.892323 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:50.894088 13682 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:50.870395 19952 raft_consensus.cc:2764] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 13:08:50.870628 20480 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:50.895875 20439 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:50.896521 20454 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:50.897449 20375 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:50.889003 20123 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:50.899250 20444 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:50.903017 19857 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:50.903470 20546 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:50.852561 20551 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:50.907634 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:50.908314 13863 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:08:50.909865 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:50.909958 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:50.955909 20564 log.cc:927] Time spent T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.906s	user 0.005s	sys 0.012s
I20260709 13:08:50.938901 19857 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:50.945284 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:50.916165 14396 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:08:50.917690 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:50.912118 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:50.932116 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:50.888919 20389 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:50.937299 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:50.995570 13857 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:50.937860 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:50.996441 13861 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:50.939334 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:50.894929 20376 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:51.000285 13858 raft_consensus.cc:2393] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 18: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:50.890988 20478 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:50.891382 20581 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:50.943338 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:50.877627 20553 consensus_queue.cc:1048] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:08:50.944459 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:50.927831 20454 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:08:50.959483 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 47453.6us
I20260709 13:08:50.929407 20501 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:50.948772 20591 log.cc:927] Time spent T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.171s	user 0.003s	sys 0.000s
I20260709 13:08:50.887603 20570 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:08:51.009843 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:51.010164 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:51.010650 13680 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:51.011823 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:51.012969 20439 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:51.068805 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 58237.2us
I20260709 13:08:51.070389 13680 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:50.993986 19857 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:51.017583 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:51.050108 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:51.077261 13859 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:51.058137 13861 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:08:50.958688 20545 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:51.061213 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.089237 13682 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:51.059636 20454 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:50.935111 20531 consensus_queue.cc:1059] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:08:51.070797 14395 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:51.072845 13707 raft_consensus.cc:1275] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:51.002451 20037 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:50.994915 20513 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.066381 20581 raft_consensus.cc:697] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:51.023200 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:51.067327 14396 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:51.061451 20480 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:51.092347 13757 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:51.128716 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:51.019052 20478 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:51.003196 20123 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:51.065527 20242 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:51.062126 20485 consensus_meta.cc:287] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.562s	user 0.011s	sys 0.000s
I20260709 13:08:51.134760 13857 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:51.129200 20516 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:51.171574 20551 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:51.148356 20513 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:51.090780 20580 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:08:51.083772 20439 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:51.173738 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 81474.9us
W20260709 13:08:51.191910 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 374941us
I20260709 13:08:51.207758 13756 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:51.210464 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 385795us
I20260709 13:08:51.163740 13712 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 21.
I20260709 13:08:51.176211 13859 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:51.085709 20576 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:51.182865 13862 raft_consensus.cc:2410] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:08:51.166622 14396 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:51.140297 20378 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:51.130321 20037 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.137403 20552 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.181082 20340 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:51.195845 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:51.221611 13714 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:08:51.198092 13707 raft_consensus.cc:2393] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 18: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:08:51.191111 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 301811us
I20260709 13:08:51.127445 20501 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.204332 13757 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:51.175037 20478 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:51.218863 13755 leader_election.cc:304] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:51.217216 13756 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:51.224138 14367 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:51.230911 14367 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:51.231029 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 421889us
I20260709 13:08:51.232295 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:51.233754 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:51.234297 14396 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:08:51.235380 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:51.235958 14396 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:51.237061 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:51.259971 13756 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:51.262634 20069 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:51.256704 20517 raft_consensus.cc:2764] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 13:08:51.263582 20523 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:51.264186 20523 raft_consensus.cc:697] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 19 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:51.264417 20069 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:51.265290 20523 consensus_queue.cc:237] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:51.267956 20592 log.cc:927] Time spent T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:08:51.218657 20439 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:51.179383 20480 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:51.276592 13709 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:08:51.275127 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:51.280452 13858 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:08:51.183199 20242 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:51.225292 20037 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:51.288568 13756 leader_election.cc:400] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 13. Current term is 14.
I20260709 13:08:51.289040 13756 leader_election.cc:403] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:51.184181 20123 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:51.225700 20347 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:51.166999 20545 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:51.192924 20584 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.097s
I20260709 13:08:51.258777 20474 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:51.315038 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:51.316814 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:51.317662 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:51.329543 13711 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:51.322254 14366 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:51.291201 20115 raft_consensus.cc:993] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03: : Instructing follower b9d194f45e044e0988d5de1a99e5cd02 to start an election
I20260709 13:08:51.237654 20576 raft_consensus.cc:697] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:51.273505 20467 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:51.285872 20444 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:51.231822 20552 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:51.335677 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:51.336488 13712 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:08:51.337296 13715 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:51.277518 20585 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:51.277591 20441 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:51.273885 20577 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:51.237493 20355 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.098s
W20260709 13:08:51.343469 20579 log.cc:927] Time spent T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:51.272795 20439 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:51.239084 20501 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:51.350064 20115 raft_consensus.cc:1081] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Signalling peer b9d194f45e044e0988d5de1a99e5cd02 to start an election
I20260709 13:08:51.345958 20347 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:51.348397 20474 raft_consensus.cc:697] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:51.279445 20581 consensus_queue.cc:237] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:51.350536 20517 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.350284 20553 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.413741 20598 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:51.414479 20598 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:51.414827 20123 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:51.415221 20545 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:51.414944 20598 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:51.417214 20598 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:51.371496 20444 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:51.386149 20595 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:51.442876 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:51.446918 13712 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:51.341833 20475 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:51.409694 20435 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:51.437575 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 221369us
I20260709 13:08:51.376139 20577 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:51.419358 20501 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:51.471325 13830 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:51.473073 13830 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:51.477125 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:51.477778 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:51.478951 13783 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:51.480597 13787 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:51.492722 13756 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:51.493028 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:51.385076 20441 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:51.388381 20585 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:51.506008 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:51.451862 20123 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.502435 20340 raft_consensus.cc:697] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 13 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:51.511876 20115 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:08:51.513093 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 190947us
I20260709 13:08:51.513316 13756 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:51.440930 13711 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:51.513896 20594 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:51.419658 20517 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:51.521072 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 350848us
I20260709 13:08:51.419121 20474 consensus_queue.cc:237] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:51.419535 20553 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:51.527453 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:51.538169 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:51.527933 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:51.530476 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:51.540337 13787 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:51.531216 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:51.531113 13756 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:51.541401 13783 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:08:51.469110 20435 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:51.534104 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:51.520761 20513 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:51.545786 13756 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:51.530040 20501 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:51.548727 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 286347us
I20260709 13:08:51.531806 20475 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:51.551337 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:51.555794 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:51.455086 20595 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:51.559911 13711 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:51.551700 13755 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:51.528718 20439 consensus_queue.cc:1059] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:08:51.526309 20123 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:51.444478 20576 consensus_queue.cc:237] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:51.592836 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 117676us
I20260709 13:08:51.593838 13830 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:51.549722 20480 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:51.554339 20115 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:51.544724 20607 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:51.552071 20333 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:51.604934 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:51.606869 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:51.608825 13787 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:08:51.579540 20608 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:51.611050 13716 raft_consensus.cc:2393] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 21: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:51.612469 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:51.587212 20467 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:51.620931 13715 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
I20260709 13:08:51.622054 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:51.622737 13715 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:08:51.578156 20475 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:51.653191 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:51.626550 20607 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.669144 20607 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:51.670243 20454 consensus_meta.cc:287] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.000s
I20260709 13:08:51.662935 20581 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:51.665892 20444 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:51.668565 20595 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:51.604303 20610 consensus_queue.cc:1048] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:08:51.692662 20610 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:51.693246 20610 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:51.671906 20630 raft_consensus.cc:3055] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:51.697309 20630 raft_consensus.cc:740] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:51.686714 20581 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:51.701571 20581 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:51.672376 20435 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:51.672894 20606 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:51.702487 20606 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.702881 20606 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:51.705956 20478 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:51.675338 13716 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:08:51.675771 20596 log.cc:927] Time spent T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:08:51.710449 20606 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:51.676594 20605 log.cc:927] Time spent T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:08:51.712743 20606 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:51.676903 20441 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:51.620756 20501 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:08:51.616889 20617 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.075s
I20260709 13:08:51.679869 20577 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:51.680948 20553 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:51.681591 20376 consensus_meta.cc:287] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.621s	user 0.007s	sys 0.001s
I20260709 13:08:51.715269 20376 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:51.715786 20553 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:51.681845 20517 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:51.716313 20553 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:51.671305 20607 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:51.672437 20626 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:51.703481 20454 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:51.718791 20626 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:51.721030 20626 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:51.682605 20585 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:51.682865 13709 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66"
dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:49488
I20260709 13:08:51.698395 20630 consensus_queue.cc:260] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:51.716326 13714 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 24. Current term is 25. Ops: []
I20260709 13:08:51.722254 13709 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:51.722600 20630 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:51.722769 13709 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:51.722896 20553 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:51.723618 20606 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.724082 20606 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:51.727113 20606 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:51.670259 19857 consensus_meta.cc:287] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.578s	user 0.005s	sys 0.002s
W20260709 13:08:51.674093 20600 log.cc:927] Time spent T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:08:51.727706 19857 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:51.707695 20610 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:51.728717 13713 raft_consensus.cc:1240] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:08:51.721180 20376 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:51.730854 13709 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:51.746245 13709 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:51.748291 20517 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:51.749511 20517 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:51.747299 19857 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:51.747040 20478 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:51.751824 20517 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:51.750233 20454 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:51.664464 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 70664.2us
W20260709 13:08:51.653592 20599 log.cc:927] Time spent T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:08:51.593978 20340 consensus_queue.cc:237] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:51.758627 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:51.760547 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2955) took 1996 ms. Trace:
I20260709 13:08:51.760954 13708 rpcz_store.cc:276] 0709 13:08:49.764264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.764953 (+   689us) service_pool.cc:224] Handling call
0709 13:08:49.765225 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:49.765569 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:49.765599 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:50.871149 (+1105550us) spinlock_profiling.cc:243] Waited 9.1 ms on lock 0x7b2c00000f48. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5230dd7a11 00007f5230de7372 00007f5232519a01 00007f52324de43a 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2
0709 13:08:50.879878 (+  8729us) log.cc:844] Serialized 26 byte log entry
0709 13:08:51.219341 (+339463us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:08:51.237315 (+ 17974us) log.cc:844] Serialized 14 byte log entry
0709 13:08:51.257805 (+ 20490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.257899 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:51.760193 (+502294us) raft_consensus.cc:1685] finished
0709 13:08:51.760309 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:51.760471 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20222,"prepare.queue_time_us":17992,"prepare.run_wall_time_us":34,"raft.queue_time_us":24484,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":11889,"spinlock_wait_cycles":49358592,"thread_start_us":320388,"threads_started":1,"wal-append.queue_time_us":471464}
I20260709 13:08:51.762668 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:51.764557 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.763255 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:51.768088 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:51.768944 13708 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:51.796056 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:51.655805 20608 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.796751 13864 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:08:51.800879 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:51.801543 13787 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:08:51.807159 13829 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:51.818316 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:51.819046 13716 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 23.
W20260709 13:08:51.819636 20588 log.cc:927] Time spent T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.616s	user 0.004s	sys 0.000s
I20260709 13:08:51.819996 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:51.820585 13716 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:08:51.830844 20475 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:51.833730 20597 log.cc:927] Time spent T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.279s	user 0.000s	sys 0.000s
I20260709 13:08:51.835039 20552 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:51.845264 14401 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:51.846937 13708 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:08:51.853214 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:51.803915 20604 log.cc:927] Time spent T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
W20260709 13:08:51.918115 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 75459.2us
I20260709 13:08:51.918133 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:51.804821 20602 log.cc:927] Time spent T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
I20260709 13:08:51.798276 20610 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:51.812175 20479 consensus_meta.cc:287] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.959s	user 0.006s	sys 0.006s
I20260709 13:08:51.857004 13864 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:08:51.996479 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:52.003619 13790 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.004s	sys 0.007s
I20260709 13:08:52.051170 13857 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
W20260709 13:08:52.051501 13790 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.004s	sys 0.010s
I20260709 13:08:52.052052 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:52.052634 13857 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:08:52.054665 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:51.804858 20454 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:52.031090 13682 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:08:52.000747 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 136476us
W20260709 13:08:52.005648 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 198594us
W20260709 13:08:52.075241 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 44239.2us
I20260709 13:08:52.032955 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:52.080806 14397 raft_consensus.cc:2393] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 20: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:08:52.042695 14367 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.012s	sys 0.016s
W20260709 13:08:52.049278 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 204886us
W20260709 13:08:52.099041 14367 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.012s	sys 0.016s
W20260709 13:08:52.066486 20347 consensus_meta.cc:287] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.668s	user 0.010s	sys 0.008s
W20260709 13:08:52.121385 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 579543us
I20260709 13:08:52.121594 20347 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 13. Current term is 14.
I20260709 13:08:52.122536 13784 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:52.124686 13829 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:52.125173 20454 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:52.125782 20439 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:52.127631 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:52.128368 20439 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:52.128466 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:52.129256 13857 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 23.
I20260709 13:08:52.129328 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:52.129500 13830 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:52.130177 20606 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:52.130395 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:52.130749 20606 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.131122 20606 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:52.131502 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:52.132038 13864 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:08:52.135298 13712 consensus_meta.cc:287] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.681s	user 0.011s	sys 0.000s
I20260709 13:08:51.928246 20475 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:51.918000 20131 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:52.135710 13712 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:08:52.128790 20439 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.130215 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:52.150844 13830 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:52.151952 13857 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
W20260709 13:08:52.137451 14366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.005s	sys 0.029s
W20260709 13:08:52.152863 14366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.005s	sys 0.029s
W20260709 13:08:52.137679 14368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.014s	sys 0.020s
W20260709 13:08:52.136967 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 60916.6us
W20260709 13:08:52.153534 14368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.015s	sys 0.020s
I20260709 13:08:52.146653 13864 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 25.
I20260709 13:08:52.153898 13682 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:08:52.153152 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 606456us
I20260709 13:08:52.034646 20632 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:52.171988 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 72574.6us
I20260709 13:08:52.175855 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:52.180372 13787 raft_consensus.cc:3055] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:52.180713 13787 raft_consensus.cc:740] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:08:52.183599 13789 consensus_meta.cc:287] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.663s	user 0.005s	sys 0.005s
I20260709 13:08:52.184090 13789 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:08:52.185266 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:52.190040 13680 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:51.805302 20608 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:52.139940 20552 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:52.181521 13787 consensus_queue.cc:260] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:52.145802 20523 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:52.209554 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 59339.5us
I20260709 13:08:52.225639 13787 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:52.161401 20439 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:52.059433 20479 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:52.173054 19857 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.059001 20610 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:52.190896 20454 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:52.186980 20553 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.194468 20441 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.293272 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:52.312479 13789 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:08:52.204715 20634 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:52.205708 20435 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:52.146840 20470 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.093s
I20260709 13:08:52.283608 13830 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:52.160758 20131 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:52.321621 14398 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:08:52.241183 20480 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:08:52.338903 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 89401.9us
I20260709 13:08:52.288352 20577 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:52.345960 13682 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:08:52.348546 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.160302 20475 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:52.276669 20552 raft_consensus.cc:697] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:52.205812 20581 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.116s
I20260709 13:08:52.376118 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:52.328490 20435 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:52.331105 20037 consensus_meta.cc:287] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 1.003s	user 0.011s	sys 0.000s
I20260709 13:08:52.315089 20123 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:52.360860 20454 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:52.358723 20480 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:52.305531 19857 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:52.389711 20435 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:52.278059 20523 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:52.384285 20585 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:08:52.431632 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 269995us
I20260709 13:08:52.390962 20638 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:52.449123 13787 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:52.463924 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:52.441018 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:52.330529 20441 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:52.322279 20553 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:52.342495 20634 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:52.437526 20480 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:52.486661 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:52.447351 20454 raft_consensus.cc:697] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 19 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:52.407846 20037 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:52.487648 13789 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:08:52.495059 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:52.495863 13787 raft_consensus.cc:2376] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13. Re-sending same reply.
W20260709 13:08:52.514365 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 324398us
I20260709 13:08:52.478369 20123 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.484915 20376 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:08:52.521545 14395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.004s	sys 0.019s
I20260709 13:08:52.440110 20640 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.080s
W20260709 13:08:52.523597 14395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.004s	sys 0.019s
W20260709 13:08:52.513278 20630 consensus_meta.cc:287] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.790s	user 0.003s	sys 0.008s
I20260709 13:08:52.519093 13680 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:52.530423 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:52.478886 20585 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:52.488905 20552 consensus_queue.cc:237] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:52.570919 13785 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.011s	sys 0.027s
I20260709 13:08:52.477949 20638 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:52.531374 20631 log.cc:927] Time spent T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
I20260709 13:08:52.522017 20376 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:08:52.562170 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 99830.9us
I20260709 13:08:52.563139 20479 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:52.581226 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 62208.8us
I20260709 13:08:52.563366 13789 raft_consensus.cc:2410] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:08:52.493278 20470 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:52.571523 13785 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.012s	sys 0.027s
I20260709 13:08:52.530409 20641 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:08:52.525018 20123 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:52.558442 13787 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:52.582278 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:52.573935 20644 log.cc:927] Time spent T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 13:08:52.584029 14366 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:08:52.581251 20647 log.cc:927] Time spent T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:08:52.578048 20376 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:52.586551 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 240646us
I20260709 13:08:52.599186 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:52.588111 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 180708us
I20260709 13:08:52.589877 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:52.599373 14366 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:52.585222 20581 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:52.605684 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:52.587697 20628 log.cc:927] Time spent T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:08:52.608152 13789 raft_consensus.cc:1240] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:52.610514 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:52.621182 13789 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:08:52.599828 13682 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:52.607043 20479 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:52.563666 20454 consensus_queue.cc:237] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:52.641489 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:52.604794 20640 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:52.607292 20630 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:08:52.661849 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 62126.8us
I20260709 13:08:52.620766 19857 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:52.587841 20470 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:52.622900 20523 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:52.623600 20653 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:52.622412 20131 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:52.627103 20441 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:52.634593 20637 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:52.694749 13789 raft_consensus.cc:1275] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:52.665225 20375 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.627374 20655 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:08:52.706065 20648 log.cc:927] Time spent T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:08:52.723552 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 1542) took 1247 ms. Trace:
I20260709 13:08:52.665891 20577 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:52.665829 20664 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.665829 20662 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:52.705219 20640 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:52.705384 20475 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:52.664695 20479 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:52.659852 20661 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:52.627103 20610 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:52.763113 13788 rpcz_store.cc:276] 0709 13:08:51.476024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.476136 (+   112us) service_pool.cc:224] Handling call
0709 13:08:51.476600 (+   464us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:51.501204 (+ 24604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:51.501251 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:51.501989 (+   738us) log.cc:844] Serialized 52 byte log entry
0709 13:08:51.606036 (+104047us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:51.606081 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.606165 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.723281 (+1117116us) raft_consensus.cc:1685] finished
0709 13:08:52.723306 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.723492 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24121,"raft.queue_time_us":27987,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":16269,"thread_start_us":73998,"threads_started":1,"wal-append.queue_time_us":782042}
I20260709 13:08:52.795557 20661 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:52.795950 20635 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:52.797050 20658 log.cc:927] Time spent T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:08:52.798095 20606 consensus_meta.cc:287] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.666s	user 0.009s	sys 0.000s
I20260709 13:08:52.799585 20608 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:52.762753 20655 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:52.721992 20634 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:52.802410 13707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 2967) took 1674 ms. Trace:
W20260709 13:08:52.780004 20645 log.cc:927] Time spent T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.222s	user 0.001s	sys 0.001s
I20260709 13:08:52.820935 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:52.822240 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.822243 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:52.780963 20626 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:52.770906 20577 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.828673 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:52.830232 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:52.834597 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:52.808580 20585 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:52.843384 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:52.716135 20630 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:52.806927 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:52.719162 19857 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.076s
W20260709 13:08:52.794492 20650 log.cc:927] Time spent T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:08:52.809438 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:52.791553 20640 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:52.811761 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:52.814239 13707 rpcz_store.cc:276] 0709 13:08:51.128312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.128507 (+   195us) service_pool.cc:224] Handling call
0709 13:08:52.802215 (+1673708us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b54001536d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:52.802358 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65694976}
I20260709 13:08:52.763813 20642 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:52.856220 20378 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:08:52.856613 20652 log.cc:927] Time spent T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:08:52.856524 20642 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:52.802312 20654 log.cc:927] Time spent T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:08:52.801265 20479 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:52.860205 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:52.843569 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:52.752075 20637 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:52.813671 20606 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:52.780977 20662 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:52.813651 20610 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:52.813788 20655 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:52.765318 20664 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:52.835642 20667 raft_consensus.cc:3055] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:52.763067 20375 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:52.853459 20630 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:52.854040 20470 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:52.855223 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:52.855746 20480 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:52.858669 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 49356.4us
I20260709 13:08:52.911651 13709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 2973) took 1149 ms. Trace:
I20260709 13:08:52.920915 20375 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:52.803144 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 96349.4us
I20260709 13:08:52.762477 20653 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:52.924212 14396 raft_consensus.cc:2410] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:52.837136 20577 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:52.858224 14399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 2236) took 1014 ms. Trace:
I20260709 13:08:52.811443 20635 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:52.837476 20626 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:52.924085 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:52.927227 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 3166) took 1132 ms. Trace:
I20260709 13:08:52.944576 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:52.940116 20531 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:52.940474 14399 rpcz_store.cc:276] 0709 13:08:51.843718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.843976 (+   258us) service_pool.cc:224] Handling call
0709 13:08:52.033280 (+189304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:52.059077 (+ 25797us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.059108 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:52.059608 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:08:52.580485 (+520877us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:52.580675 (+   190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.580884 (+   209us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.858036 (+277152us) raft_consensus.cc:1685] finished
0709 13:08:52.858055 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.858169 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25394,"raft.queue_time_us":28298,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":85179,"thread_start_us":378148,"threads_started":1,"wal-append.queue_time_us":528265}
W20260709 13:08:52.915072 20670 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:08:52.940891 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:52.946637 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:52.957269 14401 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:52.945133 13858 rpcz_store.cc:276] 0709 13:08:51.795244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.796670 (+  1426us) service_pool.cc:224] Handling call
0709 13:08:51.835488 (+ 38818us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:51.835963 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:51.836361 (+   398us) log.cc:844] Serialized 14 byte log entry
0709 13:08:52.052995 (+216634us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:52.063192 (+ 10197us) log.cc:844] Serialized 26 byte log entry
0709 13:08:52.072393 (+  9201us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:52.072442 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.072515 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.927028 (+854513us) raft_consensus.cc:1685] finished
0709 13:08:52.927048 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.927168 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17768,"prepare.queue_time_us":175,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":24513,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":10780,"thread_start_us":198403,"threads_started":1,"wal-append.queue_time_us":715465}
W20260709 13:08:52.942193 13600 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 536b1fc131984687bf3b13417507e21d with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b9d194f45e044e0988d5de1a99e5cd02 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:52.959533 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:52.960444 13712 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:08:52.949894 13829 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:52.944547 13682 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:52.945681 20666 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:52.943924 20458 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:52.972536 14401 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:08:52.947956 20641 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.953440 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:52.917433 20608 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:52.955397 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3870) took 1927 ms. Trace:
I20260709 13:08:52.924536 20667 raft_consensus.cc:740] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:52.963646 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:52.964457 13829 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:52.979321 14396 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:08:52.920334 13709 rpcz_store.cc:276] 0709 13:08:51.762065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.763704 (+  1639us) service_pool.cc:224] Handling call
0709 13:08:51.764036 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:51.764440 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:51.764478 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:51.800394 (+ 35916us) log.cc:844] Serialized 26 byte log entry
0709 13:08:52.055656 (+255262us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:52.055710 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.055794 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.911322 (+855528us) raft_consensus.cc:1685] finished
0709 13:08:52.911353 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.911570 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":799,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":6753,"thread_start_us":254853,"threads_started":1,"wal-append.queue_time_us":692552}
I20260709 13:08:52.958886 20531 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:52.968804 20480 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:52.952483 20664 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:52.989136 20634 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:52.910122 20672 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:52.989800 20672 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:52.991948 20672 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:52.954221 20653 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:52.848201 20638 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:52.859531 20656 log.cc:927] Time spent T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:08:52.963353 13682 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:52.993686 13682 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:52.994627 20581 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:52.995023 20581 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:52.995386 20581 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:52.995639 20585 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:08:52.996143 20585 raft_consensus.cc:697] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 25 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:52.997025 20585 consensus_queue.cc:237] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.000141 20661 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:52.972472 19857 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:08:53.005436 20435 consensus_meta.cc:287] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.000s
I20260709 13:08:52.977659 20666 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.008564 20666 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:52.949154 20470 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:53.010617 20470 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.012431 20635 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:53.013744 13862 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 3864) took 2078 ms (client timeout 2612 ms). Trace:
W20260709 13:08:53.014307 13862 rpcz_store.cc:269] 0709 13:08:50.935625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.936934 (+  1309us) service_pool.cc:224] Handling call
0709 13:08:53.013520 (+2076586us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54002d8cd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:53.013687 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515496320}
I20260709 13:08:53.016496 20577 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:53.018693 20577 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:52.981990 20458 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.022276 20458 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:53.024394 20662 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:53.026942 13715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 3424) took 1541 ms. Trace:
I20260709 13:08:53.027704 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:53.028899 20123 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:53.029074 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:53.029875 14393 raft_consensus.cc:2410] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:08:53.030654 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:53.033279 20470 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:53.034812 20606 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:53.036664 20439 consensus_meta.cc:287] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.740s	user 0.011s	sys 0.000s
I20260709 13:08:53.037091 20439 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.039198 20439 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:53.042528 20651 log.cc:927] Time spent T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.488s	user 0.002s	sys 0.000s
I20260709 13:08:53.044164 20376 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.045840 13786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3274) took 1443 ms. Trace:
I20260709 13:08:53.046618 20376 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:53.048357 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3278) took 1431 ms. Trace:
I20260709 13:08:53.048861 20523 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.049474 20523 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:52.981957 20641 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.048751 13785 rpcz_store.cc:276] 0709 13:08:51.616742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.616929 (+   187us) service_pool.cc:224] Handling call
0709 13:08:51.617186 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:51.617392 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:08:52.059724 (+442332us) log.cc:844] Serialized 14 byte log entry
0709 13:08:53.048025 (+988301us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:53.048078 (+    53us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:53.048132 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.048194 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.048302 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":484866,"prepare.queue_time_us":773094,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":906,"raft.queue_time_us":462565,"raft.run_cpu_time_us":43,"raft.run_wall_time_us":43,"thread_start_us":937250,"threads_started":2,"wal-append.queue_time_us":645289}
I20260709 13:08:53.052011 13856 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:53.053586 20642 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:53.054009 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:53.055562 13788 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:08:53.056051 13790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2729) took 1908 ms. Trace:
I20260709 13:08:53.056452 13790 rpcz_store.cc:276] 0709 13:08:51.147936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.148082 (+   146us) service_pool.cc:224] Handling call
0709 13:08:51.148400 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:51.418625 (+270225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:51.418670 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:51.419116 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:08:52.051971 (+632855us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:52.052016 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.055592 (+1003576us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b540023b4d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:53.055677 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:53.055739 (+    62us) raft_consensus.cc:1685] finished
0709 13:08:53.055755 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.055989 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62554,"raft.queue_time_us":31798,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":30111,"spinlock_wait_cycles":552596352,"thread_start_us":632551,"threads_started":1,"wal-append.queue_time_us":942738}
I20260709 13:08:53.059850 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:53.061316 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:53.063031 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:53.063657 13782 raft_consensus.cc:2376] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17. Re-sending same reply.
W20260709 13:08:53.064073 20669 log.cc:927] Time spent T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:08:53.065122 20641 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:53.065747 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:53.067082 20523 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:52.988970 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:53.005502 19857 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.976809 13860 rpcz_store.cc:276] 0709 13:08:51.027874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.124634 (+ 96760us) service_pool.cc:224] Handling call
0709 13:08:51.124983 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:51.291040 (+166057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:51.291068 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:51.291544 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:08:51.555210 (+263666us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:51.555265 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.948155 (+1392890us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b540006f254. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:52.948215 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.948259 (+    44us) raft_consensus.cc:1685] finished
0709 13:08:52.948277 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.955336 (+  7059us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381268352,"thread_start_us":212789,"threads_started":1,"wal-append.queue_time_us":492697,"wal-append.run_cpu_time_us":1962,"wal-append.run_wall_time_us":1030060}
I20260709 13:08:53.001963 20626 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:52.986461 13829 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:52.955794 20037 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:53.033391 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 1693) took 1757 ms. Trace:
I20260709 13:08:53.049875 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3285) took 1366 ms. Trace:
I20260709 13:08:53.031152 14393 raft_consensus.cc:2376] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13. Re-sending same reply.
I20260709 13:08:53.021123 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 1686) took 1747 ms. Trace:
I20260709 13:08:52.988639 20531 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:52.981289 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:53.080432 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:53.013885 20242 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:52.939998 20610 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.073813 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:53.078190 13787 rpcz_store.cc:276] 0709 13:08:51.683217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.595874 (+912657us) service_pool.cc:224] Handling call
0709 13:08:52.609471 (+ 13597us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.609633 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:52.627986 (+ 18353us) log.cc:844] Serialized 14 byte log entry
0709 13:08:53.049555 (+421569us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:53.049607 (+    52us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:53.049650 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.049710 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.049808 (+    98us) inbound_call.cc:177] Queueing success response
0709 13:08:53.059311 (+  9503us) spinlock_profiling.cc:243] Waited 9.46 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
Metrics: {"mutex_wait_us":242573,"prepare.queue_time_us":18171,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":243337,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":69,"spinlock_wait_cycles":21756800,"thread_start_us":178634,"threads_started":1,"wal-append.queue_time_us":212658}
I20260709 13:08:53.091104 14399 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:08:53.027340 13715 rpcz_store.cc:276] 0709 13:08:51.485439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.659614 (+174175us) service_pool.cc:224] Handling call
0709 13:08:51.681955 (+ 22341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:51.700319 (+ 18364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:51.700349 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:51.700387 (+    38us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:51.700420 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.026716 (+1326296us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b54000c5154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:53.026766 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.026886 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41806592}
I20260709 13:08:53.091723 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:53.092301 13787 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 20.
I20260709 13:08:53.082968 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:53.083143 13756 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:53.080791 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:53.079643 13714 rpcz_store.cc:276] 0709 13:08:51.273717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.281439 (+  7722us) service_pool.cc:224] Handling call
0709 13:08:51.281797 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:51.722502 (+440705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.020855 (+1298353us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b54000c6a54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:53.021034 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":998943104}
I20260709 13:08:53.093119 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:53.006034 20435 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:53.078043 13713 rpcz_store.cc:276] 0709 13:08:51.275917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.276774 (+   857us) service_pool.cc:224] Handling call
0709 13:08:51.277021 (+   247us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:51.729120 (+452099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.033148 (+1304028us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b540008e154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:53.033321 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1038328704}
I20260709 13:08:53.097190 13680 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:53.074712 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:53.097013 14366 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:53.098721 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:53.099534 20435 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:53.100098 20069 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:53.100625 20069 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:53.100031 20667 consensus_queue.cc:260] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:53.073400 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:53.100991 20069 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:53.101259 20667 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:53.101508 13789 raft_consensus.cc:2393] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 13: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:53.102311 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:53.103235 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:53.097548 13756 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:53.104218 20020 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:53.104368 13756 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:53.104749 20020 raft_consensus.cc:697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 20 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:53.073164 19857 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:53.105440 14394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 2239) took 1252 ms. Trace:
I20260709 13:08:53.105659 20020 consensus_queue.cc:237] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.105834 14394 rpcz_store.cc:276] 0709 13:08:51.853489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.853660 (+   171us) service_pool.cc:224] Handling call
0709 13:08:51.853955 (+   295us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:51.854289 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:51.854313 (+    24us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:51.917344 (+ 63031us) log.cc:844] Serialized 52 byte log entry
0709 13:08:52.328775 (+411431us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:52.328815 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.328882 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:53.041929 (+713047us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:53.104995 (+ 63066us) raft_consensus.cc:1685] finished
0709 13:08:53.105017 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.105292 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27404,"raft.queue_time_us":653,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":85003,"spinlock_wait_cycles":3548544,"thread_start_us":256001,"threads_started":1,"wal-append.queue_time_us":440045}
I20260709 13:08:53.096664 20570 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:53.107678 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:52.865957 20378 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:53.099785 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:53.109028 13785 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 21.
I20260709 13:08:53.110011 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:53.110641 13785 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:53.094425 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:53.095757 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 109353us
I20260709 13:08:53.046213 13786 rpcz_store.cc:276] 0709 13:08:51.603199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.603454 (+   255us) service_pool.cc:224] Handling call
0709 13:08:51.603742 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:51.603924 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:51.854310 (+250386us) log.cc:844] Serialized 14 byte log entry
0709 13:08:52.159335 (+305025us) log.cc:844] Serialized 14 byte log entry
0709 13:08:53.045364 (+886029us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b18003c69a0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f36bc0a 00007f5238aab219 00007f522f3f3a40 00007f522f3ee4e4 00007f522f3ee455 00007f52324d6060 00007f52324e8716 00007f52324f9287 00007f52324f9208
0709 13:08:53.045514 (+   150us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:53.045560 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:53.045610 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.045673 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.045784 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":862531,"prepare.queue_time_us":1013917,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":2579,"raft.queue_time_us":899769,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":8689,"spinlock_wait_cycles":31058304,"thread_start_us":512669,"threads_started":2,"wal-append.queue_time_us":543846}
I20260709 13:08:53.072861 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:52.983363 20608 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:53.103806 13789 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:08:53.121851 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:53.119316 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:53.131278 14366 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:53.132998 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:53.133153 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:53.088853 13830 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:53.120637 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:53.134456 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 45675.7us
I20260709 13:08:53.135455 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:53.137706 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:53.138062 13830 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:53.138345 13714 raft_consensus.cc:2393] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 18: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:53.138615 13715 raft_consensus.cc:2393] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 21: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:53.136096 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:53.139860 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:53.140379 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:53.141434 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 44311.7us
I20260709 13:08:53.142117 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:53.144349 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:53.144891 13864 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:53.145155 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:53.145882 13708 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:53.146831 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:53.147806 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:53.148072 13713 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:08:53.108065 20570 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.150235 14400 raft_consensus.cc:1275] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:53.099715 20242 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:53.152783 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:53.153720 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:53.156374 13716 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 21.
I20260709 13:08:53.157135 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:53.155222 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:53.172910 13785 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:08:53.173656 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:53.175120 13864 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:08:53.097906 20523 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.060s
I20260709 13:08:53.176167 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:53.133141 20577 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:53.179747 20577 raft_consensus.cc:697] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:53.132150 20392 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:53.173763 13680 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:53.188443 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:53.206318 13712 raft_consensus.cc:2368] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18.
I20260709 13:08:53.207269 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:53.207633 20642 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.208197 20642 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:53.210135 20642 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:53.210773 20671 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:53.180626 20577 consensus_queue.cc:237] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.211189 20671 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.203686 13682 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:53.136776 20037 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:53.191092 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:53.210475 20378 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.223681 20661 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:53.071374 20581 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.182440 20611 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:08:53.229529 19857 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:53.183198 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:53.233669 20666 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:53.234405 20666 raft_consensus.cc:697] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:53.235311 20666 consensus_queue.cc:237] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.215503 13864 raft_consensus.cc:2393] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 18: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:53.211567 20671 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:53.236917 13790 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:53.155113 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:53.238417 13714 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 29.
I20260709 13:08:53.238734 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:53.153764 20435 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:53.239518 13787 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:53.239741 13713 raft_consensus.cc:2393] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 24: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:53.151844 20123 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:53.240294 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:53.223740 20479 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.262620 13790 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
W20260709 13:08:53.238534 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 65392.9us
I20260709 13:08:53.249285 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:53.249433 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:53.263760 13859 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:53.255451 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:53.263800 13785 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:08:53.265226 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:53.266125 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:53.267388 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:53.267725 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:53.267123 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 47228.7us
I20260709 13:08:53.154383 20441 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:53.110402 20655 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.271435 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:53.275324 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:53.293399 13714 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:53.294843 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:53.296643 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:53.297291 13708 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:08:53.282369 13859 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:08:53.283632 13787 raft_consensus.cc:2393] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 18: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:53.298336 13708 raft_consensus.cc:1240] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:53.300164 13716 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18. Ops: []
W20260709 13:08:53.289446 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.302450 14397 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:08:53.303041 13682 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:53.269241 20392 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.305949 13712 raft_consensus.cc:1240] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:53.256229 20661 raft_consensus.cc:697] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:53.306565 13863 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:53.256209 20123 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:53.266985 19857 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:53.268788 20584 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:53.311594 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:53.352393 14395 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 10.
I20260709 13:08:53.354547 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:53.355967 20552 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:53.341029 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:53.304657 13830 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:08:53.366854 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 62276.4us
I20260709 13:08:53.367573 13830 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:53.328118 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:53.368914 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:53.370216 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:53.285631 20441 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.372031 20441 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:53.355926 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:53.376149 14395 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:08:53.381327 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:53.385854 13829 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:53.388367 13715 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:08:53.327692 20657 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.400525 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:53.394698 13829 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:53.310762 20637 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:53.380878 20123 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:53.283658 20640 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.387778 20439 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:53.384131 20552 raft_consensus.cc:697] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:53.405589 20657 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.384439 20676 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:53.391808 20635 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:53.401486 20642 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:53.367177 20584 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:53.404466 20570 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:53.439442 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 136450us
W20260709 13:08:53.469772 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:53.446247 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 51595.6us
W20260709 13:08:53.409317 20665 log.cc:927] Time spent T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.596s	user 0.002s	sys 0.000s
I20260709 13:08:53.382879 20392 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.454129 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:53.432211 20475 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:53.461841 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:53.462191 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:53.525007 13860 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:53.526132 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:53.422948 20553 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:53.464828 13784 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1546) took 1987 ms (client timeout 2061 ms). Trace:
I20260709 13:08:53.431754 20610 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:53.431938 20608 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:53.471459 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:53.521123 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:08:53.521605 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 185826us
I20260709 13:08:53.522048 14399 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:08:53.529520 13858 raft_consensus.cc:1240] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:53.446795 20439 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:53.532202 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:53.446837 20454 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:53.465467 20676 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.520807 20378 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:53.565923 13859 raft_consensus.cc:2410] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:08:53.459091 20637 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:53.472560 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:53.726658 13712 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:08:51.237509 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:53.578934 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3871) took 2345 ms. Trace:
W20260709 13:08:53.520754 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 49152.2us
I20260709 13:08:53.691896 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:53.528264 13784 rpcz_store.cc:269] 0709 13:08:51.477360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.477504 (+   144us) service_pool.cc:224] Handling call
0709 13:08:53.464671 (+1987167us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54001b71d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:53.464765 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1480931072}
W20260709 13:08:53.698338 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 226723us
I20260709 13:08:53.702208 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:53.764041 13858 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:53.757920 13861 rpcz_store.cc:276] 0709 13:08:51.233773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.234417 (+   644us) service_pool.cc:224] Handling call
0709 13:08:51.284071 (+ 49654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:51.284339 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:08:51.548044 (+263705us) log.cc:844] Serialized 14 byte log entry
0709 13:08:53.473860 (+1925816us) spinlock_profiling.cc:243] Waited 7.69 ms on lock 0x7b18002b6fc0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e23a 00007f52324e8a2a
0709 13:08:53.578618 (+104758us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:53.578668 (+    50us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:08:53.578717 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.578784 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.578883 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25238,"prepare.queue_time_us":251976,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":3051,"raft.queue_time_us":6499,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":31601,"spinlock_wait_cycles":17686272,"thread_start_us":313292,"threads_started":2,"wal-append.queue_time_us":2104801}
I20260709 13:08:53.764251 13829 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:53.765625 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:53.765829 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:53.766000 20242 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:53.571355 13860 raft_consensus.cc:2368] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18.
I20260709 13:08:53.766647 20242 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:53.766831 13859 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 21.
I20260709 13:08:53.767282 20242 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:53.769402 13860 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 24. Current term is 25. Ops: []
I20260709 13:08:53.771072 13860 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:53.567459 14395 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:53.577628 14399 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:53.781420 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:53.782883 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:53.615324 20552 consensus_queue.cc:237] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:53.438496 20069 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.766672 13858 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 10.
I20260709 13:08:53.788487 20069 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:53.523263 20611 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.789999 20611 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.790723 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:53.579682 20375 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:53.468375 20642 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:53.794425 13830 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:53.795106 20642 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:53.812197 20637 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.618232 20389 consensus_queue.cc:1059] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:53.621258 20458 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.538544 20479 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:53.817282 20470 raft_consensus.cc:3055] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:08:53.817898 20470 raft_consensus.cc:740] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:53.570538 20655 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:53.646499 20677 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:08:53.822779 20611 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:53.830600 20392 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:53.646293 20678 log.cc:927] Time spent T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:08:53.464253 20660 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.099s
I20260709 13:08:53.831733 20470 consensus_queue.cc:260] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.433516 20661 consensus_queue.cc:237] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:53.650202 20675 log.cc:927] Time spent T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:08:53.575955 20676 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:53.710892 20635 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:53.655614 20671 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.837587 13714 raft_consensus.cc:2393] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 19: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:53.582382 14400 raft_consensus.cc:1275] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:53.730197 20441 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.736336 20580 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.840080 20580 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.840451 20671 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:53.841364 20441 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:53.741966 14368 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:53.842876 20580 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:53.843427 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 101910us
I20260709 13:08:53.712563 20666 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:53.750061 20640 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:53.646189 20584 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:53.750765 20570 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.857857 20570 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.722137 20632 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.739938 13711 raft_consensus.cc:1275] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:53.755156 13614 catalog_manager.cc:5697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.758419 13757 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:53.758527 20594 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:53.767104 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:53.570447 20439 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:53.654182 20657 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:53.871688 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 104857us
I20260709 13:08:53.872289 20635 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:53.872717 13829 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:53.796597 20454 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:53.873512 20454 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:53.874123 20454 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:53.873716 20632 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.874774 13829 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:53.875751 20610 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:53.796204 13755 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:53.787624 13862 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:53.803491 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:53.816478 20458 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.879129 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:53.879279 14368 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:53.880584 14368 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:53.881466 20458 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:53.882082 14395 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:08:53.882448 20660 consensus_queue.cc:1059] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:08:53.883812 20697 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:53.884404 20697 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.884822 20697 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:53.886257 20686 log.cc:927] Time spent T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.474s	user 0.003s	sys 0.000s
I20260709 13:08:53.867028 20666 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.903671 20657 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.904404 20657 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:53.905614 20666 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:53.867556 20570 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:53.872824 20635 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.907142 20612 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:53.907631 20635 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:53.887665 20392 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:53.866334 20395 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:53.818364 13861 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
W20260709 13:08:53.900358 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 142358us
W20260709 13:08:53.901952 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 106246us
W20260709 13:08:53.902308 20684 log.cc:927] Time spent T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
I20260709 13:08:53.902858 14397 raft_consensus.cc:1275] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:53.910945 20584 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:53.911288 20657 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:53.908435 20570 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:53.912878 20439 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.909595 20395 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:08:53.917243 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 332073us
I20260709 13:08:53.918139 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:53.876994 20632 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:53.919842 14368 leader_election.cc:400] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18.
I20260709 13:08:53.950768 14368 leader_election.cc:403] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:08:53.874974 20123 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.926180 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:53.927526 20475 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:08:53.930039 20659 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 1.295s	user 0.004s	sys 0.000s
I20260709 13:08:53.950827 20395 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:53.958097 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 3170) took 2111 ms. Trace:
I20260709 13:08:53.958652 13865 rpcz_store.cc:276] 0709 13:08:51.846492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.846645 (+   153us) service_pool.cc:224] Handling call
0709 13:08:51.846957 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:51.994959 (+148002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:51.994991 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:52.002134 (+  7143us) log.cc:844] Serialized 26 byte log entry
0709 13:08:52.518175 (+516041us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:52.518240 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.518303 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:53.928889 (+1410586us) spinlock_profiling.cc:243] Waited 5.66 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:53.957460 (+ 28571us) raft_consensus.cc:1685] finished
0709 13:08:53.957487 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.957843 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147571,"raft.queue_time_us":157162,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":37300,"spinlock_wait_cycles":13009152,"thread_start_us":378142,"threads_started":1,"wal-append.queue_time_us":536265}
I20260709 13:08:53.961376 13856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1688) took 2948 ms. Trace:
I20260709 13:08:53.961934 13856 rpcz_store.cc:276] 0709 13:08:51.013112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.122125 (+109013us) service_pool.cc:224] Handling call
0709 13:08:53.018760 (+1896635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.052407 (+ 33647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.960977 (+908570us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b54002d8cd0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:53.961198 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4360022400}
I20260709 13:08:53.964519 20606 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:53.964871 14367 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:53.932739 20470 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:53.966289 19952 consensus_queue.cc:1059] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:53.934973 20642 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:53.954826 20475 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:53.955119 14395 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:08:53.955291 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 80747.3us
I20260709 13:08:53.970417 13709 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:53.973381 13863 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:53.967373 14367 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:53.975638 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 56845.2us
I20260709 13:08:53.968653 19952 raft_consensus.cc:3055] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:53.995915 20570 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.996187 19952 raft_consensus.cc:740] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:53.996837 13857 raft_consensus.cc:1240] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:53.996860 20570 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:53.974537 20123 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:53.997570 19952 consensus_queue.cc:260] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:54.014385 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 47147.2us
I20260709 13:08:54.016345 20666 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:54.016398 20458 consensus_queue.cc:1059] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:54.018266 20458 raft_consensus.cc:3055] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:54.018682 20458 raft_consensus.cc:740] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:54.015241 14368 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:54.020648 14368 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:54.022177 20479 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:54.022746 20479 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:54.018956 14367 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:54.023268 20479 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:54.025484 14367 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:54.026584 20622 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:54.027112 20622 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:54.027576 20622 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:54.027741 20621 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:54.028728 20621 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:08:54.029136 20621 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 29 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:54.029587 20621 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:08:53.999228 19952 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:53.976706 20517 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:54.036286 14367 leader_election.cc:400] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18.
I20260709 13:08:53.967712 20392 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:54.046645 13865 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:54.041977 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:54.048126 13856 raft_consensus.cc:2410] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:08:53.971100 20676 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:54.041687 20392 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:54.056767 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:54.019011 20666 consensus_queue.cc:1059] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 13:08:54.058369 20458 consensus_queue.cc:260] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:54.036720 20454 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:54.077696 20439 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:54.084312 20454 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:54.084422 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 584030us
W20260709 13:08:54.084981 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 71483.6us
I20260709 13:08:54.063556 20458 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:54.093518 13856 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:54.060839 20392 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:54.092851 13709 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:54.098557 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:54.068409 20570 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:54.064391 20637 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:54.118551 20242 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:54.120985 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 47617us
I20260709 13:08:54.152464 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:54.152716 20242 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:54.154289 20242 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:54.154932 20242 raft_consensus.cc:697] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:54.156114 20642 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:54.157051 20581 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:54.160091 14398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 1510) took 3405 ms (client timeout 2667 ms). Trace:
I20260709 13:08:54.160840 13858 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 19 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:08:54.126039 20523 raft_consensus.cc:3055] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:54.128465 13715 raft_consensus.cc:1240] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:54.128693 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:54.129791 13862 raft_consensus.cc:2368] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 20. Current term is 21.
I20260709 13:08:54.129889 20676 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:54.130787 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:54.134322 20395 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:54.144095 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:54.146443 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:54.147432 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:54.147622 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:54.148378 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:54.154456 13829 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:54.160553 14398 rpcz_store.cc:269] 0709 13:08:50.754217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.755596 (+  1379us) service_pool.cc:224] Handling call
0709 13:08:54.159715 (+3404119us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54007aab54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:54.159860 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3533670400}
I20260709 13:08:54.174335 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:54.188179 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:54.188870 13858 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:54.190830 14396 raft_consensus.cc:1240] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:54.191391 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 71172us
I20260709 13:08:54.163159 20523 raft_consensus.cc:740] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:54.202313 13783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 1565) took 1007 ms. Trace:
I20260709 13:08:54.202490 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:54.205476 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:54.185911 20570 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:54.209030 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:54.209748 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 50145.2us
I20260709 13:08:54.209947 13865 raft_consensus.cc:2393] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 19: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:54.213160 20115 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:54.214090 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:54.213943 20115 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:54.215785 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:54.216526 14399 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:54.215265 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:54.213546 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:54.222868 13865 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:54.223518 13707 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:54.242516 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:54.244007 20523 consensus_queue.cc:260] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:54.245257 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:54.246440 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:54.247854 20454 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:54.247663 20570 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:54.248353 20454 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:54.248816 20454 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:54.249038 13863 raft_consensus.cc:1240] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:54.249840 20570 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:54.247701 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 82196.9us
I20260709 13:08:54.251223 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:54.251925 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 97639.8us
I20260709 13:08:54.252285 20581 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:54.252547 13857 raft_consensus.cc:1240] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:54.253147 13829 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:54.254315 20676 raft_consensus.cc:2764] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
W20260709 13:08:54.254964 13710 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58552 (request call id 1689) took 2980 ms (client timeout 2061 ms). Trace:
I20260709 13:08:54.238899 13716 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 23. Current term is 24. Ops: []
I20260709 13:08:54.238300 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49490 (request call id 2991) took 1088 ms. Trace:
I20260709 13:08:54.228731 13614 catalog_manager.cc:5697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.245397 20523 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:54.208103 20635 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:54.220553 13861 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:08:54.262072 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:54.174453 20666 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:08:54.273380 13856 raft_consensus.cc:2368] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20.
I20260709 13:08:54.263948 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:54.243217 13707 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:54.258258 13757 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:54.269192 13709 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:08:54.277457 20470 consensus_queue.cc:1059] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:54.278419 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:54.278697 20470 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:54.280541 20470 raft_consensus.cc:3055] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:54.290876 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 1983) took 1369 ms. Trace:
I20260709 13:08:54.292622 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:54.291324 14393 rpcz_store.cc:276] 0709 13:08:52.921142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.158306 (+237164us) service_pool.cc:224] Handling call
0709 13:08:53.172677 (+ 14371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:53.173143 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:53.800987 (+627844us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b180033afc0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3ee455 00007f5235ed63c7 00007f52324e89a7 00007f52324f80bf 00007f52324f8038
0709 13:08:53.963570 (+162583us) log.cc:844] Serialized 14 byte log entry
0709 13:08:54.070934 (+107364us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:54.143807 (+ 72873us) log.cc:844] Serialized 52 byte log entry
0709 13:08:54.144026 (+   219us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:54.144353 (+   327us) log.cc:844] Serialized 14 byte log entry
0709 13:08:54.185620 (+ 41267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.197220 (+ 11600us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:54.290454 (+ 93234us) raft_consensus.cc:1685] finished
0709 13:08:54.290483 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:54.290655 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89630,"prepare.queue_time_us":185363,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":96,"raft.queue_time_us":52256,"raft.run_cpu_time_us":417,"raft.run_wall_time_us":66678,"spinlock_wait_cycles":37968128,"thread_start_us":223115,"threads_started":2,"wal-append.queue_time_us":323851}
I20260709 13:08:54.293296 13784 raft_consensus.cc:1240] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:54.294035 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:54.294605 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:54.292073 13715 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:08:54.264833 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:54.295861 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:54.297200 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:54.297508 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:54.297806 13786 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:08:54.298229 14398 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:54.298735 13716 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:54.298893 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:54.294646 13788 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:54.295279 13790 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
W20260709 13:08:54.255386 13710 rpcz_store.cc:269] 0709 13:08:51.274704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.274849 (+   145us) service_pool.cc:224] Handling call
0709 13:08:54.254645 (+2979796us) spinlock_profiling.cc:243] Waited 2.63 s on lock 0x7b54002e81d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:54.254782 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6058701056}
I20260709 13:08:54.308118 14402 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 13:08:54.310070 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 51957.8us
I20260709 13:08:54.310595 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:54.258355 13713 rpcz_store.cc:276] 0709 13:08:53.150072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.152573 (+  2501us) service_pool.cc:224] Handling call
0709 13:08:54.237908 (+1085335us) spinlock_profiling.cc:243] Waited 83.3 ms on lock 0x7b5400041854. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:54.238114 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191676800}
W20260709 13:08:54.312481 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 48023us
I20260709 13:08:54.232307 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:54.202747 13783 rpcz_store.cc:276] 0709 13:08:53.065434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.747675 (+682241us) service_pool.cc:224] Handling call
0709 13:08:53.748595 (+   920us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.749255 (+   660us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:08:53.949043 (+199788us) log.cc:844] Serialized 14 byte log entry
0709 13:08:54.064664 (+115621us) log.cc:844] Serialized 14 byte log entry
0709 13:08:54.069612 (+  4948us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:54.069682 (+    70us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:08:54.069732 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.070095 (+   363us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:54.072696 (+  2601us) inbound_call.cc:177] Queueing success response
0709 13:08:54.176249 (+103553us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b18002e3f60. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f13f3 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
Metrics: {"mutex_wait_us":10634,"prepare.queue_time_us":197451,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":75,"raft.queue_time_us":17288,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":35187,"spinlock_wait_cycles":23266048,"thread_start_us":218472,"threads_started":2,"wal-append.queue_time_us":144815}
W20260709 13:08:54.334199 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 81132.8us
I20260709 13:08:54.280908 20470 raft_consensus.cc:740] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:54.334350 13757 leader_election.cc:400] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 20. Current term is 21.
I20260709 13:08:54.333050 14398 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:08:54.336643 13757 leader_election.cc:403] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:54.339190 13860 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:54.237025 20640 raft_consensus.cc:3055] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:54.344264 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:54.344575 13714 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:54.261482 20635 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:54.260588 20395 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:54.340663 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:54.350515 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:54.388667 14395 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
W20260709 13:08:54.351528 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 100451us
I20260709 13:08:54.354765 20594 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:08:54.355453 13757 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:54.356101 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 3432) took 1030 ms. Trace:
I20260709 13:08:54.356326 13858 raft_consensus.cc:2393] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 24: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:54.356437 20464 consensus_queue.cc:1059] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 13:08:54.357012 20020 consensus_queue.cc:1059] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:08:54.358719 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:54.361241 20115 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:54.363018 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:54.263031 20622 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:54.227918 20242 consensus_queue.cc:237] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:54.363909 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:54.407582 13860 raft_consensus.cc:2410] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:08:54.365513 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:54.347749 20640 raft_consensus.cc:740] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:54.335480 20666 consensus_queue.cc:1243] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer b5029654a4384e43a68eb67b794949b7 log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:08:54.303490 20478 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:54.429754 20470 consensus_queue.cc:260] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:54.431250 20347 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:54.431663 20635 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:08:54.432291 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 77034.7us
I20260709 13:08:54.432894 20020 raft_consensus.cc:3055] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:54.226613 20697 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:54.433073 20478 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:54.435081 13863 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:54.367749 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:54.367901 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:54.368448 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:54.367389 13862 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 13:08:54.436816 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.377790 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:54.377949 20676 consensus_queue.cc:1059] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:54.382513 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:54.383740 20598 consensus_queue.cc:1059] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:08:54.372825 13609 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49428 (request call id 356) took 38632 ms (client timeout 15000 ms). Trace:
I20260709 13:08:54.396736 13707 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:08:54.393060 13708 rpcz_store.cc:276] 0709 13:08:53.325635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.327903 (+  2268us) service_pool.cc:224] Handling call
0709 13:08:54.355757 (+1027854us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b54001b8d54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:54.355930 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2230162304}
W20260709 13:08:54.402729 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.403834 13714 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:54.375725 20357 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:54.417608 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:54.418565 13789 raft_consensus.cc:1240] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:54.420521 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:54.422309 13614 catalog_manager.cc:5697] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 14 to 15, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 15 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:08:54.432291 13860 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:54.440816 13861 raft_consensus.cc:2393] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 17: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:54.444932 13864 raft_consensus.cc:2393] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 16: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:54.431270 20470 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:54.447296 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:54.447580 13782 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:08:54.447896 20531 raft_consensus.cc:2764] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:54.448827 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:54.433395 20020 raft_consensus.cc:740] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:54.449419 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:54.450196 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 50303.3us
I20260709 13:08:54.453166 20517 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18.
I20260709 13:08:54.464244 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:54.464951 20622 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:54.434288 20478 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:08:54.457448 13856 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:08:54.470391 13784 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:08:54.372009 20475 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:54.494764 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:54.498872 13829 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:54.495748 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:54.496280 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:54.496416 20020 consensus_queue.cc:260] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:54.505333 13862 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:54.498425 13830 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:54.449916 20115 consensus_queue.cc:1059] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:08:54.508879 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:54.510296 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:54.512292 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:54.512619 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:54.491151 20697 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:54.524892 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:54.527925 13790 raft_consensus.cc:2368] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18.
I20260709 13:08:54.506162 20523 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:54.540505 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:54.465940 20581 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 13:08:54.545459 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:54.526806 20676 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:54.548933 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:54.550254 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:54.565248 14399 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:08:54.566650 14395 raft_consensus.cc:1240] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:08:54.505934 20357 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:54.572916 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:54.570287 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 95843.6us
I20260709 13:08:54.550628 20637 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:08:54.568933 20479 consensus_meta.cc:287] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.005s
W20260709 13:08:54.581653 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 98734.6us
I20260709 13:08:54.554124 20020 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:54.576146 13785 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:54.581478 13784 raft_consensus.cc:2376] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13. Re-sending same reply.
I20260709 13:08:54.566524 13614 catalog_manager.cc:5697] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 10 to 11, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 11 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.590869 13830 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:54.511200 20640 consensus_queue.cc:260] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:54.548625 20464 consensus_queue.cc:1048] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:08:54.569727 20657 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:08:54.601730 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:54.584470 20621 consensus_meta.cc:287] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.554s	user 0.007s	sys 0.006s
I20260709 13:08:54.584160 20517 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:54.602478 13830 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:54.564718 20523 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:54.612507 20661 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:08:54.617859 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:54.612689 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:54.613574 20719 log.cc:927] Time spent T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:08:54.619699 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:54.622318 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:54.628793 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:54.630722 13713 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:08:54.630879 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 196386us
I20260709 13:08:54.633589 13614 catalog_manager.cc:5697] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 9 to 10, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 10 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.621414 20642 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:54.596097 20479 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:54.638712 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.626068 20357 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:54.647722 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:54.648576 13790 raft_consensus.cc:2410] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:08:54.651860 13614 catalog_manager.cc:5697] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 9 to 12, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 12 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.653198 14398 raft_consensus.cc:1240] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:54.653601 13614 catalog_manager.cc:5697] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 12 to 14, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 14 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.655303 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:54.655966 20716 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:08:54.656018 14399 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:54.658560 20642 raft_consensus.cc:697] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:54.659545 20642 consensus_queue.cc:237] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:54.618525 20517 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:54.664537 20517 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:54.648852 20123 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.665730 20123 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:54.667670 20577 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.668323 20577 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:54.668758 20357 consensus_queue.cc:1059] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:54.670269 20666 raft_consensus.cc:3055] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:54.670656 20666 raft_consensus.cc:740] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:54.670732 20577 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:54.671664 20666 consensus_queue.cc:260] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:54.672987 20666 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:54.628610 20640 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:54.680464 20475 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:54.681279 20720 log.cc:927] Time spent T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
W20260709 13:08:54.685235 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 46078.4us
W20260709 13:08:54.690858 20392 consensus_meta.cc:287] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.529s	user 0.007s	sys 0.004s
I20260709 13:08:54.691342 20392 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:54.692085 20612 raft_consensus.cc:3055] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:54.692440 14401 raft_consensus.cc:1240] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:54.692483 20612 raft_consensus.cc:740] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:54.693501 20612 consensus_queue.cc:260] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:54.694747 20612 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:54.667694 20123 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:54.696372 20123 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:54.696817 20123 raft_consensus.cc:697] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:54.697642 20123 consensus_queue.cc:237] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:54.699393 20637 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:54.699961 20637 raft_consensus.cc:697] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 19 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:54.700855 20637 consensus_queue.cc:237] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:54.706266 20611 raft_consensus.cc:3055] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:54.706764 20611 raft_consensus.cc:740] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:54.707758 20611 consensus_queue.cc:260] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:54.708943 20611 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:54.711213 14394 raft_consensus.cc:1240] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:54.711136 20626 raft_consensus.cc:3055] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:54.712210 20626 raft_consensus.cc:740] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:54.713454 20626 consensus_queue.cc:260] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:54.714756 20626 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:54.715126 20722 log.cc:927] Time spent T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:08:54.643688 20687 consensus_queue.cc:1059] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.176s
I20260709 13:08:54.717555 20687 raft_consensus.cc:3055] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:54.717916 20687 raft_consensus.cc:740] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:08:54.445338 13609 rpcz_store.cc:269] 0709 13:08:15.740414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.743678 (+  3264us) service_pool.cc:224] Handling call
0709 13:08:16.762014 (+1018336us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b54003edd54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232448090 00007f52324e6f3a 00007f523829d1cc 00007f523839b37e 00007f523685c2a4 00007f523685c232 00007f523685c161 00007f523685c0dc 00007f523685b392 00007f523081948c 00007f52308188c6
0709 13:08:54.372559 (+37610545us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:44.613407 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:44.614132 (+   725us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:44.614185 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:08:44.614204 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:44.622745 (+  8541us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:44.639845 (+ 17100us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:44.643730 (+  3885us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:08:44.704851 (+ 61121us) tablet.cc:701] Row locks acquired
0709 13:08:44.704923 (+    72us) write_op.cc:260] PREPARE: finished
0709 13:08:44.705100 (+   177us) write_op.cc:270] Start()
0709 13:08:44.705255 (+   155us) write_op.cc:276] Timestamp: P: 1783602524705024 usec, L: 0
0709 13:08:44.705301 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 13:08:44.706113 (+   812us) log.cc:844] Serialized 4853 byte log entry
0709 13:08:45.408755 (+702642us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b180044b900. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f13f3 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
0709 13:08:45.686165 (+277410us) op_driver.cc:464] REPLICATION: finished
0709 13:08:46.330311 (+644146us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f522f3d40ac 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f5235f14ef0
0709 13:08:46.564959 (+234648us) write_op.cc:301] APPLY: starting
0709 13:08:46.565064 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:46.574115 (+  9051us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:46.574153 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:47.479450 (+905297us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b180044b900. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f523221d0ec 00007f5232269c0a 00007f52322694f7 00007f5232269490 00007f5232220f48 00007f5235f351bb 00007f5235f7c5d4 00007f5235e288da 00007f5235e2b3cb
0709 13:08:47.481944 (+  2494us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:47.482428 (+   484us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:08:47.491920 (+  9492us) write_op.cc:312] APPLY: finished
0709 13:08:47.715315 (+223395us) log.cc:844] Serialized 113 byte log entry
0709 13:08:47.919277 (+203962us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:48.100705 (+181428us) write_op.cc:454] Released schema lock
0709 13:08:48.110906 (+ 10201us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:48.214322 (+103416us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:48.216772 (+  2450us) write_op.cc:454] Released schema lock
0709 13:08:49.471245 (+1254473us) spinlock_profiling.cc:243] Waited 6.42 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
Metrics: {"mutex_wait_us":860112,"reported_tablets":26,"spinlock_wait_cycles":5962624,"child_traces":[["op",{"apply.queue_time_us":847680,"apply.run_cpu_time_us":43357,"apply.run_wall_time_us":1629884,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54287,"num_ops":12,"prepare.queue_time_us":487711,"prepare.run_cpu_time_us":8485,"prepare.run_wall_time_us":229414,"raft.queue_time_us":217283,"raft.run_cpu_time_us":20067,"raft.run_wall_time_us":1027932,"replication_time_us":939741,"spinlock_wait_cycles":448378368,"thread_start_us":1590227,"threads_started":5,"wal-append.queue_time_us":573079,"wal-append.run_cpu_time_us":41653,"wal-append.run_wall_time_us":3602897}]]}
I20260709 13:08:54.615341 20621 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:54.718783 20687 consensus_queue.cc:260] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:54.775372 13862 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:54.777208 13713 raft_consensus.cc:1240] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:54.780228 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:54.681195 20475 raft_consensus.cc:3055] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:54.784471 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:54.751699 20517 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:54.797595 13680 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:54.801307 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.783803 20475 raft_consensus.cc:740] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:08:54.817203 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 120525us
I20260709 13:08:54.821606 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:54.832518 13865 raft_consensus.cc:1240] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:54.784034 20598 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:08:54.840307 13755 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:54.839401 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 236987us
I20260709 13:08:54.841463 13830 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:54.845767 13861 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 23. Current term is 24. Ops: []
I20260709 13:08:54.817555 20581 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:54.862000 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.859372 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:54.862910 13710 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 21.
I20260709 13:08:54.865779 14400 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 30 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 29. Current term is 30. Ops: []
I20260709 13:08:54.866258 20475 consensus_queue.cc:260] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:54.832048 19952 consensus_queue.cc:1059] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:08:54.870411 13783 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:08:54.853801 20357 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:54.817262 20517 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:54.873618 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:54.875064 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 260841us
I20260709 13:08:54.860741 20642 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:08:54.887646 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 104901us
I20260709 13:08:54.908336 20479 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:54.936441 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:54.969667 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.850100 20464 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
W20260709 13:08:55.004320 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 441021us
W20260709 13:08:55.013813 14368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.009s	sys 0.041s
I20260709 13:08:55.055034 20676 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:55.081311 14368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.009s	sys 0.042s
I20260709 13:08:55.040411 20642 raft_consensus.cc:697] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:55.086210 13680 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:55.086669 20642 consensus_queue.cc:237] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:55.015190 20594 consensus_meta.cc:287] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.614s	user 0.015s	sys 0.002s
W20260709 13:08:55.014184 20454 consensus_meta.cc:287] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.765s	user 0.012s	sys 0.008s
I20260709 13:08:55.089509 20594 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 20. Current term is 21.
I20260709 13:08:55.089952 20454 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:55.091128 13859 raft_consensus.cc:1240] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:55.072949 20523 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:55.072942 13756 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:55.049726 20392 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:55.087244 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 47023.3us
I20260709 13:08:55.092162 20478 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:55.092619 20478 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.092986 13680 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:55.093022 20478 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:55.094197 20475 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:55.094658 20576 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:55.095438 20576 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:55.097102 20576 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:55.097175 19952 raft_consensus.cc:3055] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:55.097695 19952 raft_consensus.cc:740] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:55.052554 20621 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 30 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:55.098511 19952 consensus_queue.cc:260] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:55.099886 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 178347us
W20260709 13:08:55.100497 20729 log.cc:927] Time spent T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.191s	user 0.008s	sys 0.000s
W20260709 13:08:55.099049 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 661628us
W20260709 13:08:55.103811 20470 consensus_meta.cc:287] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.615s	user 0.011s	sys 0.011s
I20260709 13:08:55.104388 20470 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:55.105387 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:55.074900 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.106264 14398 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:08:55.105312 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:55.111126 14368 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:55.015059 20686 log.cc:927] Time spent T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.152s	user 0.006s	sys 0.000s
W20260709 13:08:55.113173 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 272944us
I20260709 13:08:55.112769 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:55.113914 13755 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:55.014671 13714 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 18: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:55.124729 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:55.154234 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:55.155130 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:55.152379 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:55.157073 13859 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:08:55.158087 13715 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:55.160208 20454 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:55.160580 20594 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:55.161845 20464 consensus_queue.cc:1059] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:55.162760 20464 raft_consensus.cc:3055] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:55.163087 20464 raft_consensus.cc:740] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:55.163748 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:55.164327 14397 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:55.163930 20464 consensus_queue.cc:260] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:55.164678 20357 consensus_queue.cc:1059] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:55.165223 20464 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:55.167572 20020 raft_consensus.cc:3055] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:08:55.167965 20020 raft_consensus.cc:740] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:55.168798 20020 consensus_queue.cc:260] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:55.169389 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:55.170006 20020 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:55.170951 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:55.163094 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:55.172748 13710 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:55.173400 14366 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:55.177045 20723 log.cc:927] Time spent T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.269s	user 0.005s	sys 0.001s
I20260709 13:08:55.178228 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:55.178403 14400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 2245) took 1033 ms. Trace:
I20260709 13:08:55.178791 14400 rpcz_store.cc:276] 0709 13:08:54.144695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.144869 (+   174us) service_pool.cc:224] Handling call
0709 13:08:54.145106 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.866214 (+721108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.178198 (+311984us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b540044fcd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:55.178349 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1502917376}
I20260709 13:08:55.179508 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:55.105367 20479 consensus_queue.cc:1059] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:08:55.181594 13710 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:55.181897 13708 raft_consensus.cc:1240] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:08:55.181823 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:55.183552 20737 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:55.184100 20737 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:55.184692 13829 connection.cc:256] RPC call timeout handler was delayed by -1.0853223720000642s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
I20260709 13:08:55.185464 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:55.186275 20737 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:55.186877 20737 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:55.189626 20687 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:55.193337 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:55.193982 13786 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:55.194274 20517 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:55.194821 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:55.066442 20727 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.187139 13830 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:55.203661 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:55.205786 13785 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:55.206084 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:55.199872 14399 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 16. (term mismatch)
I20260709 13:08:55.200029 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:55.197491 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:55.195400 13786 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 21.
I20260709 13:08:55.186946 13829 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:55.214598 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 103553us
I20260709 13:08:55.215585 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:55.198570 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:55.216635 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 57538.8us
I20260709 13:08:55.218729 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:55.215603 14368 leader_election.cc:400] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20.
I20260709 13:08:55.219540 14368 leader_election.cc:403] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 13:08:55.221249 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 107418us
I20260709 13:08:55.223065 20395 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:55.105513 20598 consensus_queue.cc:1059] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.102s
I20260709 13:08:55.217177 13787 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:08:55.222380 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:55.226073 20666 consensus_meta.cc:287] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.005s
I20260709 13:08:55.228260 13680 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:55.228731 13756 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:55.207297 14399 pending_rounds.cc:85] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 15
I20260709 13:08:55.105680 20470 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:55.221146 20635 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:55.214269 20727 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:55.303220 20731 consensus_queue.cc:1059] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:08:55.307405 20531 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:55.240302 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:55.318356 20570 raft_consensus.cc:3055] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:55.254582 14368 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:55.223493 20395 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.318811 20115 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:55.310274 20676 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:55.319597 20570 raft_consensus.cc:740] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:55.319914 20115 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:55.320520 20115 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:55.320426 20676 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:55.320976 20570 consensus_queue.cc:260] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:55.322278 20570 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:55.231369 20740 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 13:08:55.234726 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:55.279294 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:55.328852 20115 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:55.329676 13716 raft_consensus.cc:2393] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 17: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:08:55.308231 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 80004.3us
I20260709 13:08:55.331046 20115 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:55.247093 20475 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:55.259585 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 403227us
I20260709 13:08:55.250479 13782 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
W20260709 13:08:55.346647 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 173318us
I20260709 13:08:55.351269 14366 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:55.249300 14397 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 20.
W20260709 13:08:55.232672 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.246258 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:55.274173 13784 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:55.245242 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:08:55.332787 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 83410.7us
W20260709 13:08:55.304715 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 117865us
I20260709 13:08:55.231628 14401 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
W20260709 13:08:55.332810 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 104143us
I20260709 13:08:55.233307 20479 raft_consensus.cc:3055] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:08:55.334913 13757 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.013s	sys 0.015s
W20260709 13:08:55.366528 13757 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.013s	sys 0.016s
I20260709 13:08:55.338732 13715 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:08:55.366869 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:55.244026 13713 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:08:55.332582 20612 consensus_meta.cc:287] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.637s	user 0.012s	sys 0.001s
W20260709 13:08:55.343291 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 88750.5us
W20260709 13:08:55.333968 20242 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.025s	sys 0.039s
I20260709 13:08:55.371080 14368 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:55.323096 20676 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:55.372690 13714 raft_consensus.cc:1240] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:55.307401 14399 pending_rounds.cc:107] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 18.16
I20260709 13:08:55.373927 14399 raft_consensus.cc:2889] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:55.248487 13755 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:55.330417 20727 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:55.299539 20737 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:55.370865 20731 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:55.319833 20395 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:55.335083 20705 log.cc:927] Time spent T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:08:55.375983 14367 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:55.377130 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.416596 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:55.366380 20479 raft_consensus.cc:740] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:55.318943 20635 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.380764 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:55.365906 20123 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.014s	sys 0.022s
W20260709 13:08:55.384207 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 135780us
I20260709 13:08:55.385105 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:55.370095 20621 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:55.411624 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:55.366474 20697 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20.
I20260709 13:08:55.373261 20740 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.079s
W20260709 13:08:55.375351 20242 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.025s	sys 0.039s
I20260709 13:08:55.414067 13858 raft_consensus.cc:1240] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 19 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:55.412701 13829 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:55.370713 20475 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:55.373132 20464 consensus_queue.cc:1059] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.083s
I20260709 13:08:55.378929 20577 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:08:55.389917 20612 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:55.370978 20458 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:55.494108 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:55.559881 20464 raft_consensus.cc:3055] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:08:55.560101 20738 log.cc:927] Time spent T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:08:55.560784 20464 raft_consensus.cc:740] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:55.561796 20464 consensus_queue.cc:260] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:55.563891 20730 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:55.564404 20730 raft_consensus.cc:697] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 15 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:08:55.565515 20747 log.cc:927] Time spent T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:55.565356 20730 consensus_queue.cc:237] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:55.567276 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 191374us
W20260709 13:08:55.418597 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.569077 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 3303) took 1124 ms. Trace:
W20260709 13:08:55.444171 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 56755.1us
I20260709 13:08:55.447949 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:55.417966 14366 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:55.448709 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:55.560943 20735 log.cc:927] Time spent T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 13:08:55.397414 13790 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:55.551918 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:55.569832 13755 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:55.582672 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.386121 20392 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:55.569959 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:55.569530 13782 rpcz_store.cc:276] 0709 13:08:54.444335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.543182 (+ 98847us) service_pool.cc:224] Handling call
0709 13:08:55.568931 (+1025749us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b5400205154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:55.569024 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1234202880}
I20260709 13:08:55.452059 13859 pending_rounds.cc:85] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 12
I20260709 13:08:55.614172 13859 pending_rounds.cc:107] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:08:55.614544 13859 raft_consensus.cc:2889] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:55.501152 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:55.563179 20464 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:55.603966 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:55.604648 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:55.605269 13709 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:55.494949 20731 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:55.607717 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:55.596290 13863 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
W20260709 13:08:55.544027 20611 consensus_meta.cc:287] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.835s	user 0.012s	sys 0.000s
I20260709 13:08:55.525486 20347 consensus_queue.cc:1059] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.117s
I20260709 13:08:55.642367 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 3008) took 1054 ms. Trace:
I20260709 13:08:55.642901 20611 raft_consensus.cc:3055] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:55.643546 20611 raft_consensus.cc:740] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:55.644785 20611 consensus_queue.cc:260] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:55.578706 20635 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:55.642772 13711 rpcz_store.cc:276] 0709 13:08:54.587860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.598114 (+ 10254us) service_pool.cc:224] Handling call
0709 13:08:54.610184 (+ 12070us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:54.624245 (+ 14061us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:54.624273 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:54.636140 (+ 11867us) log.cc:844] Serialized 26 byte log entry
0709 13:08:55.109274 (+473134us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:08:55.109324 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.109389 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:55.642157 (+532768us) raft_consensus.cc:1685] finished
0709 13:08:55.642177 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:55.642293 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5317,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":5288,"thread_start_us":330496,"threads_started":1,"wal-append.queue_time_us":781387}
I20260709 13:08:55.569340 20621 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:55.623920 14401 raft_consensus.cc:1275] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:55.615350 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:55.625138 20439 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:55.627043 20736 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:08:55.628641 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 58936.9us
I20260709 13:08:55.629643 13757 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:55.630219 20727 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:55.631593 20470 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:55.662335 13755 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:55.633158 20666 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:55.633663 20657 consensus_queue.cc:1059] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:55.413520 20598 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:08:55.577926 20123 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.015s	sys 0.031s
I20260709 13:08:55.643608 20731 leader_election.cc:290] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:55.680365 20475 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:55.622850 13784 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 22.
I20260709 13:08:55.651218 13783 raft_consensus.cc:2410] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:55.661453 13857 raft_consensus.cc:2393] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 17: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:55.669232 13713 raft_consensus.cc:2393] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 19: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:55.677116 20479 consensus_queue.cc:260] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:55.501304 20552 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.160s
I20260709 13:08:55.662534 20687 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:55.685396 13714 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:55.687712 20736 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:08:55.690188 20478 consensus_meta.cc:287] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.579s	user 0.009s	sys 0.001s
I20260709 13:08:55.690788 20478 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:55.692113 20743 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:55.694118 20657 raft_consensus.cc:3055] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:55.696045 13789 raft_consensus.cc:1240] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:55.701511 13785 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 20.
I20260709 13:08:55.701670 13708 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:55.675308 14397 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:08:55.659396 20621 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:55.727908 13755 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:55.726830 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 97277.7us
I20260709 13:08:55.729163 13757 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:55.664556 20666 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.694636 20657 raft_consensus.cc:740] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:55.723182 20598 raft_consensus.cc:697] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:55.729817 20611 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:55.729976 20357 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:55.748369 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:55.751504 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 364953us
I20260709 13:08:55.753158 13864 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 16: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:55.730430 20687 raft_consensus.cc:697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:55.734431 20464 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:55.755695 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:55.693677 20478 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:55.739832 20475 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:08:55.740713 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 140420us
I20260709 13:08:55.739995 20666 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:55.738739 20612 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:55.726711 20660 consensus_queue.cc:1059] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:08:55.743083 20736 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:55.734887 20727 consensus_queue.cc:1059] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.026s
W20260709 13:08:55.766069 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 348190us
I20260709 13:08:55.793859 14366 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:55.791474 20347 consensus_queue.cc:1059] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:08:55.792078 20736 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:55.797976 20736 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:55.804073 20748 log.cc:927] Time spent T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:08:55.812420 13829 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:55.813956 13829 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:55.818630 20687 consensus_queue.cc:237] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:55.823671 20123 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:55.824579 20123 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:55.824965 20123 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:55.825397 20123 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:55.830636 20570 consensus_meta.cc:287] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.003s
I20260709 13:08:55.754073 20642 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:55.832134 20642 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:55.835883 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 231137us
W20260709 13:08:55.877565 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 84505.7us
I20260709 13:08:55.880853 13682 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:55.882619 13682 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:55.883574 20552 consensus_queue.cc:1059] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:55.884315 20731 raft_consensus.cc:3055] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:55.761950 20475 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:55.884368 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 90634.8us
I20260709 13:08:55.884960 20744 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:55.891680 13865 raft_consensus.cc:1275] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:08:55.944593 13865 raft_consensus.cc:1275] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:08:55.884845 20731 raft_consensus.cc:740] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:08:55.920197 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 503884us
W20260709 13:08:55.964395 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 150519us
I20260709 13:08:55.887506 20517 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:08:55.968722 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 66198.1us
I20260709 13:08:55.895092 20475 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:55.966825 13680 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:55.972437 14366 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:55.978322 20594 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:55.979457 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.979152 20594 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:55.885366 20478 consensus_queue.cc:1059] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 29.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.082s
W20260709 13:08:56.005837 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.815193 20598 consensus_queue.cc:237] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:55.966701 20642 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:56.007331 13829 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:55.970675 20517 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:56.039031 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 72374.3us
I20260709 13:08:56.046113 13680 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:55.980360 20759 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:55.983688 20757 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:55.901098 20657 consensus_queue.cc:260] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:56.074555 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 102221us
I20260709 13:08:56.033942 20660 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:56.076704 14366 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:55.952960 20744 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.007040 20666 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.052850 20517 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:56.101538 20552 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:56.109401 20687 raft_consensus.cc:3055] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:56.111370 20242 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:56.100953 20123 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.116876 20657 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:56.140720 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 157892us
I20260709 13:08:56.144358 20772 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:56.144585 20666 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:56.145009 20772 raft_consensus.cc:697] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:56.146369 13864 raft_consensus.cc:1240] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:56.146056 20772 consensus_queue.cc:237] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.149709 20770 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:56.126243 20552 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.090520 20757 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:56.153151 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 107117us
I20260709 13:08:56.124176 20687 raft_consensus.cc:740] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:56.159526 13829 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:08:56.147480 20123 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:56.150254 20770 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:56.160997 13680 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:56.160979 20766 consensus_queue.cc:1059] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:08:56.129745 20777 raft_consensus.cc:2764] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:08:56.163468 20725 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.164763 13783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 2755) took 1042 ms. Trace:
I20260709 13:08:56.183804 13783 rpcz_store.cc:276] 0709 13:08:55.153188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.153383 (+   195us) service_pool.cc:224] Handling call
0709 13:08:56.164505 (+1011122us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b540033c054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:56.164689 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1077021440}
I20260709 13:08:56.166574 20458 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:56.167485 20756 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:08:56.170928 20760 log.cc:927] Time spent T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:08:56.185106 20458 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:56.093000 20759 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.175606 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:56.097165 20731 consensus_queue.cc:260] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.157821 20552 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:56.217195 20766 consensus_queue.cc:1048] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:56.218086 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:56.157027 20115 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:56.239904 20115 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.183317 20242 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:56.241490 20242 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:56.241871 20242 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:56.242393 20115 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:56.243705 20765 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:56.181146 20770 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:56.220847 13863 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:56.221722 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:56.232189 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 132425us
W20260709 13:08:56.227877 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 151315us
I20260709 13:08:56.236366 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:56.256697 13785 raft_consensus.cc:2410] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 24 because replica has last-logged OpId of term: 23 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 13:08:56.236997 20773 raft_consensus.cc:3055] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:08:56.237481 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 81815.8us
I20260709 13:08:56.237785 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:56.238262 20778 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:56.185196 20756 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.260008 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:56.272965 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.273710 13680 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:08:56.281744 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 122303us
I20260709 13:08:56.280162 13791 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:08:56.317624 20475 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:56.355993 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 96724.5us
W20260709 13:08:56.284806 20395 consensus_meta.cc:287] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.766s	user 0.009s	sys 0.002s
I20260709 13:08:56.276175 20731 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:56.265190 20773 raft_consensus.cc:740] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:56.221433 20725 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.371065 14366 leader_election.cc:400] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18.
I20260709 13:08:56.371488 14366 leader_election.cc:403] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:08:56.282732 20756 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:56.376727 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:56.375504 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 101868us
I20260709 13:08:56.383701 13791 raft_consensus.cc:1275] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:08:56.385440 13782 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:08:56.328436 20594 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:56.385501 13680 connection.cc:256] RPC call timeout handler was delayed by -1.5745349559999795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1779s for a response
I20260709 13:08:56.361765 20759 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:56.392062 20790 consensus_queue.cc:1059] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.121s
W20260709 13:08:56.392782 20764 log.cc:927] Time spent T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.174s	user 0.003s	sys 0.000s
I20260709 13:08:56.396003 13790 raft_consensus.cc:1240] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:08:56.398104 13786 raft_consensus.cc:1275] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:08:56.315933 20778 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.404284 20757 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:56.420526 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 62867.5us
I20260709 13:08:56.424263 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:56.421281 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:56.362936 20743 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:56.440093 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 1584) took 1213 ms. Trace:
I20260709 13:08:56.319998 20772 consensus_queue.cc:1048] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.100s
I20260709 13:08:56.375180 20783 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.314222 20765 consensus_queue.cc:1048] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:08:56.462182 20778 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:56.464457 20475 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:56.465238 20744 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:56.445979 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 147335us
W20260709 13:08:56.441708 20621 consensus_meta.cc:287] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.703s	user 0.010s	sys 0.001s
I20260709 13:08:56.387025 20598 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18.
W20260709 13:08:56.454288 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.371618 20395 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:56.477205 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:56.477614 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.478904 14397 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
W20260709 13:08:56.457472 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 88573.7us
I20260709 13:08:56.452627 20784 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.455145 20787 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.357080 20687 consensus_queue.cc:260] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:56.481086 14368 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:56.460080 20242 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.461018 20777 consensus_queue.cc:1059] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:56.461660 20743 raft_consensus.cc:697] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:56.490428 20743 consensus_queue.cc:237] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.486011 20773 consensus_queue.cc:260] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:56.492376 20784 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.448293 20454 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:56.471709 14366 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:56.494270 20777 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 13:08:56.494709 14366 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:56.495637 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:56.495841 20660 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:56.496276 13858 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:56.496819 20517 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.498427 14398 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 17. Current term is 18. Ops: []
W20260709 13:08:56.454916 13680 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 2.025s (SENT) [suppressed 16 similar messages]
I20260709 13:08:56.443089 20458 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.488013 14399 raft_consensus.cc:1240] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:08:56.488803 20687 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:56.489378 20598 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:56.492750 20773 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:56.484896 14368 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:56.504774 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:56.487303 20635 consensus_meta.cc:287] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.841s	user 0.011s	sys 0.000s
I20260709 13:08:56.483194 20640 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:56.510454 14368 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:56.479599 20621 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.511232 20660 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.514792 13829 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:56.538834 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:56.539287 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.539446 14368 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:56.455338 13787 rpcz_store.cc:276] 0709 13:08:55.226414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.450943 (+224529us) service_pool.cc:224] Handling call
0709 13:08:55.452480 (+  1537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:55.452705 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:08:55.751624 (+298919us) log.cc:844] Serialized 14 byte log entry
0709 13:08:56.123828 (+372204us) log.cc:844] Serialized 14 byte log entry
0709 13:08:56.423045 (+299217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:56.423119 (+    74us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:56.439771 (+ 16652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:56.439859 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:56.440021 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":958,"prepare.queue_time_us":235069,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":85,"raft.queue_time_us":342558,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":34523,"thread_start_us":903554,"threads_started":4,"wal-append.queue_time_us":337796}
I20260709 13:08:56.494903 20777 raft_consensus.cc:3055] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:08:56.526873 20611 consensus_meta.cc:287] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.773s	user 0.010s	sys 0.000s
I20260709 13:08:56.471987 20783 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.485488 20531 raft_consensus.cc:476] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Not starting pre-election -- already a leader
I20260709 13:08:56.494922 20787 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:56.529711 20725 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:56.530187 14401 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:56.527643 20640 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.530807 20242 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:56.528337 20523 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:56.531270 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:56.494652 20784 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:56.536899 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:56.538054 20517 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:56.559765 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:56.562433 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:56.576520 13860 raft_consensus.cc:2410] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:08:56.509532 20770 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.544394 20777 raft_consensus.cc:740] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:56.556751 20666 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:08:56.552776 20790 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:08:56.595757 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 91772.4us
I20260709 13:08:56.579783 13785 raft_consensus.cc:1275] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:08:56.581724 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 126812us
I20260709 13:08:56.561956 20676 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:56.528257 20635 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:56.594940 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 54492.8us
I20260709 13:08:56.556367 20660 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.595707 20523 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:56.613584 13680 connection.cc:256] RPC call timeout handler was delayed by -1.4566349559999026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.191s for a response
W20260709 13:08:56.614145 13680 connection.cc:256] RPC call timeout handler was delayed by -1.4355775590000803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.215s for a response
W20260709 13:08:56.614526 13680 connection.cc:256] RPC call timeout handler was delayed by -1.3153349559999015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20670000000000002s for a response
W20260709 13:08:56.614917 13680 connection.cc:256] RPC call timeout handler was delayed by -1.2213110339999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
W20260709 13:08:56.615280 13680 connection.cc:256] RPC call timeout handler was delayed by -1.1830725109999776s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
W20260709 13:08:56.615706 13680 connection.cc:256] RPC call timeout handler was delayed by -1.1335725110000112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15600000000000003s for a response
W20260709 13:08:56.616088 13680 connection.cc:256] RPC call timeout handler was delayed by -1.026011034000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
W20260709 13:08:56.616454 13680 connection.cc:256] RPC call timeout handler was delayed by -1.0202708179999718s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
I20260709 13:08:56.596261 20790 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:56.625715 20790 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:56.651252 20621 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:56.634519 20517 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.655943 13680 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:56.638234 20598 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.651909 20635 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:56.665815 20770 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:56.646260 20725 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.668700 20725 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.674079 19952 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:56.675967 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:56.676087 13680 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:56.676564 13709 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:08:56.678260 20803 log.cc:927] Time spent T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:08:56.678580 13680 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:56.679903 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:56.680522 13858 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:08:56.681514 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:56.682422 20761 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:56.682694 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:56.625942 20523 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:56.717774 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.683882 13789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 1587) took 1456 ms. Trace:
I20260709 13:08:56.725200 13756 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:56.703061 13709 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 22.
W20260709 13:08:56.728242 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 68264.8us
I20260709 13:08:56.728955 13829 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:56.694556 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:56.690582 13715 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:56.724881 13789 rpcz_store.cc:276] 0709 13:08:55.227143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.517762 (+290619us) service_pool.cc:224] Handling call
0709 13:08:55.518100 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:55.696538 (+178438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:56.683639 (+987101us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b540033b654. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:56.683805 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408666496}
I20260709 13:08:56.731361 13714 raft_consensus.cc:2393] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 20: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:56.683323 20761 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:56.737483 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:56.737977 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:56.738221 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:56.738560 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:56.738970 13786 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 17: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:56.737661 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:56.730203 13830 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:56.745606 13756 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:56.749280 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:56.751227 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:56.751569 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.730055 20357 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.683557 20657 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:56.750520 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:56.756343 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:56.757104 13858 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:56.688876 20676 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:56.758596 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 80108.3us
I20260709 13:08:56.753304 20357 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:56.753418 20478 consensus_queue.cc:1059] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.008s
I20260709 13:08:56.744273 20810 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:56.706574 20725 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:56.715404 20611 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:56.750259 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:56.726624 20770 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:56.737870 20635 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.753500 20637 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:56.774729 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:56.744086 20785 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:56.664119 20517 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.636430 20777 consensus_queue.cc:260] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.753608 20778 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:56.727530 20598 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.769596 20676 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:56.796665 14398 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:56.796744 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:56.820566 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:56.821421 14399 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:08:56.770241 20810 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:56.822533 20810 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:56.772639 20793 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:56.827052 20598 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:56.740799 20552 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:56.781185 20475 raft_consensus.cc:3055] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:56.810472 14402 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:56.785171 20242 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:56.813299 20357 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:56.837579 20242 raft_consensus.cc:697] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 20 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:56.838770 20242 consensus_queue.cc:237] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.783849 20807 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.868824 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:56.803323 20660 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:56.802892 20785 raft_consensus.cc:697] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:56.831930 20777 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:56.785892 20770 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.784229 20611 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:56.876936 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:56.876387 14399 raft_consensus.cc:1240] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:56.889662 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:56.878592 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:56.881003 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:56.885164 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:56.886538 13783 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:56.831514 20743 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:08:56.786070 20635 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:56.829253 20622 consensus_queue.cc:1175] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b9d194f45e044e0988d5de1a99e5cd02" responder_term: 18 status { last_received { term: 18 index: 14 } last_committed_idx: 14 last_received_current_leader { term: 18 index: 14 } }
I20260709 13:08:56.889070 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:56.898137 13716 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:56.894639 20637 raft_consensus.cc:697] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 22 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:56.896536 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:56.896449 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:56.834614 20475 raft_consensus.cc:740] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:08:56.899127 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 118450us
I20260709 13:08:56.899996 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:56.919857 13711 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:56.909339 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 134706us
I20260709 13:08:56.871870 20458 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:56.832857 20123 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 13:08:56.900801 13788 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:08:56.872220 20787 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:56.921344 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 70799.1us
I20260709 13:08:56.832635 20778 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.924782 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:56.927973 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:08:56.929262 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.911556 20357 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.936015 14402 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 17: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:56.880008 20807 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.931988 14366 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:56.941022 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:56.941278 14366 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:56.929267 20731 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.942201 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:56.942955 13784 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:56.945029 13755 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:56.946097 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:56.952037 13755 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:56.954854 13680 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:56.938237 20743 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:08:56.967590 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.969000 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:56.970160 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:56.971591 20772 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:08:56.972134 20756 consensus_meta.cc:287] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.528s	user 0.009s	sys 0.001s
I20260709 13:08:56.972555 20756 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.974591 20756 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:56.949873 20813 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.976253 13680 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:56.976961 20813 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.977433 20740 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:56.977618 20642 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:56.978080 20642 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:56.978474 20642 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:56.978554 13829 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:56.979043 20813 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:56.964286 20773 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.953001 20805 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:56.979959 20454 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:56.979956 20773 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.980615 20454 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:56.953722 20785 consensus_queue.cc:237] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:56.981060 20454 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:56.982146 20773 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:56.984675 20811 log.cc:927] Time spent T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:08:56.956127 20787 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:56.986464 20787 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:08:56.986632 20817 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:56.986912 20787 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:56.950475 20458 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:56.988191 20812 log.cc:927] Time spent T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:08:56.988796 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:56.990176 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:56.990751 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:56.935606 20660 consensus_queue.cc:1059] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:08:56.972175 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:56.996117 13861 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 24.
I20260709 13:08:56.996183 20464 raft_consensus.cc:3055] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:56.996678 20464 raft_consensus.cc:740] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:56.997114 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:56.997735 13861 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:08:56.997594 20464 consensus_queue.cc:260] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:56.998610 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:56.977468 13857 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:57.000373 14397 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
W20260709 13:08:57.003937 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.003952 20637 consensus_queue.cc:237] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:57.005755 20395 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:57.007869 20770 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:57.008056 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:57.008666 14402 raft_consensus.cc:1240] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 30 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 29. Current term is 30. Ops: []
I20260709 13:08:56.971149 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:57.009449 13788 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:56.990754 13709 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:08:57.011564 13829 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:57.014113 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:57.014273 13858 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:08:57.014706 13712 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:08:57.015548 13680 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:57.019187 14395 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:08:57.020063 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:57.020512 13829 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:57.021190 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:57.021783 13709 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 24.
I20260709 13:08:57.023144 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:57.034319 13784 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:08:56.962914 20523 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:57.042241 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:57.042968 13707 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:08:56.941715 20357 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.017620 20793 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:57.046319 13861 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:56.949246 20731 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:57.022773 20020 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:57.016855 20576 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:57.036425 20439 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:08:57.085161 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.089691 20783 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:57.091699 20454 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.096486 13709 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:56.961540 20478 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:08:57.100816 20357 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:57.101190 20778 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:57.104287 20517 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:57.106346 13859 raft_consensus.cc:1240] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:57.114563 20611 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:57.115824 20635 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:57.119926 20552 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:57.120106 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:56.966135 20475 consensus_queue.cc:260] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.120949 14402 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:57.121547 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:57.122323 14400 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:08:57.123764 14400 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:08:57.047030 20823 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:57.126538 20731 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:57.127029 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.127885 14367 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:57.129559 14367 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:57.132105 20807 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:57.132884 20517 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:57.133029 20807 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:57.133437 20517 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.133625 20807 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.134017 20517 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:57.064262 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:57.065752 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:57.066098 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:57.135871 13707 raft_consensus.cc:2393] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 19: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:57.067378 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:57.136066 20759 raft_consensus.cc:3055] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:57.136507 14399 raft_consensus.cc:2393] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 19: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:57.136602 20759 raft_consensus.cc:740] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:56.965917 20594 consensus_queue.cc:1059] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.082s
W20260709 13:08:57.074764 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 59281us
I20260709 13:08:57.137804 20594 raft_consensus.cc:3055] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:57.137693 20759 consensus_queue.cc:260] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.138170 20594 raft_consensus.cc:740] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:57.138882 20759 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:57.075399 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:57.139817 14396 raft_consensus.cc:2393] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 11: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:57.059497 20743 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:57.136121 14398 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 22: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:57.140837 20743 consensus_queue.cc:1048] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:57.139060 20594 consensus_queue.cc:260] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.141898 20594 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:57.142620 20743 consensus_queue.cc:1059] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:57.143393 20740 consensus_queue.cc:1048] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:57.145175 13756 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:57.146015 20347 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:57.146322 13756 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:57.146934 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:57.147184 13788 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 22.
I20260709 13:08:57.046241 19952 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.147794 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:57.149041 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:57.150115 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:57.150669 14399 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:57.147814 19952 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.153415 19952 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:57.154776 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:57.155532 20464 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:57.172025 14399 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:08:57.081835 20774 raft_consensus.cc:3055] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 13:08:57.065773 20793 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.084213 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:57.083724 20576 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.181576 13785 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 11.
I20260709 13:08:57.184214 13756 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:57.134162 20807 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:57.175673 13711 raft_consensus.cc:2410] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:08:57.177814 13714 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 20.
I20260709 13:08:57.044873 13757 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:57.179957 14399 raft_consensus.cc:1240] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:08:57.180156 14401 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:08:57.176297 20743 consensus_queue.cc:1059] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:08:57.179454 20242 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.176847 20781 consensus_queue.cc:1059] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
W20260709 13:08:57.189848 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 145049us
I20260709 13:08:57.095162 20454 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:57.202473 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:57.204619 14367 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:57.204768 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:08:57.191301 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 239316us
I20260709 13:08:57.150835 20570 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:57.213167 14400 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:08:57.180887 20774 raft_consensus.cc:740] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:57.191246 20778 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:57.218397 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:57.219507 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:57.222678 13714 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:08:57.181638 20823 raft_consensus.cc:697] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:08:57.220551 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.198671 20347 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:08:57.238250 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:57.226867 13830 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:08:57.227746 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.222733 14393 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
W20260709 13:08:57.228435 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 207972us
I20260709 13:08:57.243913 13829 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:57.257577 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:57.217348 20730 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:57.265345 14400 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:57.260087 14393 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 18: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:08:57.264643 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.227568 20778 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.207578 20776 consensus_queue.cc:1059] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:08:57.271771 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:57.267165 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:57.267655 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:57.207500 20470 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:08:57.236577 20347 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.231943 20637 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:57.287680 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:57.287752 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:57.217506 20810 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.290181 13785 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 13:08:57.296931 13863 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 18: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:57.289438 13858 raft_consensus.cc:2393] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 21: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:57.297394 14400 raft_consensus.cc:1240] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:57.265256 20730 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.225414 20773 consensus_queue.cc:1059] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
W20260709 13:08:57.329448 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 62766.1us
I20260709 13:08:57.329011 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:57.330447 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:57.333712 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:57.301863 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:57.269855 20818 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:57.332391 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:57.337159 13785 pending_rounds.cc:85] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 15
I20260709 13:08:57.337436 13785 pending_rounds.cc:107] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 13:08:57.337730 13785 raft_consensus.cc:2889] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:57.334487 13860 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:57.207731 20242 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.247577 20743 consensus_queue.cc:1059] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:08:57.334321 13859 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:57.340250 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 72865.4us
I20260709 13:08:57.342350 13829 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:57.266897 20454 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:57.336189 13755 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:57.344811 13829 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:57.258824 20676 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.263232 20740 consensus_queue.cc:1048] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:08:57.290540 20785 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.347711 13755 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:57.365811 13755 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:57.290723 20731 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:57.277070 20778 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:57.349102 20832 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:57.355835 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:57.296998 20347 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:57.335107 20730 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:57.362739 14395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 1549) took 2259 ms (client timeout 1680 ms). Trace:
I20260709 13:08:57.295759 20594 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:57.353005 20439 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:08:57.422958 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 78190.4us
I20260709 13:08:57.346143 20454 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.374920 13680 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:57.376986 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:57.331489 20637 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.413779 13788 raft_consensus.cc:2393] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 18: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:57.420182 14400 raft_consensus.cc:1240] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
W20260709 13:08:57.412528 14395 rpcz_store.cc:269] 0709 13:08:55.103818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.113679 (+  9861us) service_pool.cc:224] Handling call
0709 13:08:57.362546 (+2248867us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b54006883d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:57.362654 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4287161088}
I20260709 13:08:57.428301 13863 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:08:57.421573 14402 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:57.367930 20784 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.367728 20818 raft_consensus.cc:697] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 22 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:57.370481 20776 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:57.374631 20828 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:57.436467 14393 raft_consensus.cc:1240] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:08:57.437597 20829 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.328902 20774 consensus_queue.cc:260] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 29.20, Last appended by leader: 20, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.373229 20736 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:57.354847 13785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:08:57.403124 20832 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:57.473717 13785 raft_consensus.cc:606] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:57.477372 13785 raft_consensus.cc:614] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:57.371495 20642 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.374011 20731 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:57.475745 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:57.431285 20454 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:57.368292 20785 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.436193 20781 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:57.436440 20464 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.450029 20776 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:57.497383 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 127513us
W20260709 13:08:57.497711 20799 log.cc:927] Time spent T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:08:57.498371 20831 log.cc:927] Time spent T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:08:57.499310 20830 log.cc:927] Time spent T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:57.499770 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:57.591817 13863 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
W20260709 13:08:57.555636 20657 consensus_meta.cc:287] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.790s	user 0.011s	sys 0.000s
I20260709 13:08:57.430579 20552 consensus_queue.cc:1059] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 13:08:57.366250 20823 consensus_queue.cc:237] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:57.583597 13786 raft_consensus.cc:2410] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:08:57.433564 20594 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:57.589488 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3901) took 1513 ms. Trace:
I20260709 13:08:57.480746 20793 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:57.492693 14400 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 19: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:57.480180 20832 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:57.462435 20784 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:57.593708 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 159049us
I20260709 13:08:57.479800 20611 consensus_queue.cc:1059] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 29.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.112s
I20260709 13:08:57.587044 20776 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:57.599856 13864 rpcz_store.cc:276] 0709 13:08:56.056148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.056325 (+   177us) service_pool.cc:224] Handling call
0709 13:08:56.074559 (+ 18234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:56.146784 (+ 72225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.569252 (+1422468us) spinlock_profiling.cc:243] Waited 71.6 ms on lock 0x7b54000d02d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:57.569493 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164673280}
I20260709 13:08:57.595237 20479 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:57.609036 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 104790us
I20260709 13:08:57.638355 13863 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:57.476696 20829 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:57.641875 20758 log.cc:927] Time spent T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 1.554s	user 0.007s	sys 0.001s
I20260709 13:08:57.645349 13863 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:57.653640 20776 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.640936 13757 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:08:57.659430 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 231183us
I20260709 13:08:57.563370 20464 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:57.628592 20787 consensus_meta.cc:287] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.641s	user 0.009s	sys 0.001s
I20260709 13:08:57.663401 20570 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:57.599176 20657 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:57.665050 20640 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:57.673040 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:08:57.679059 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 112694us
W20260709 13:08:57.662042 20790 consensus_meta.cc:287] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 1.002s	user 0.010s	sys 0.001s
I20260709 13:08:57.705693 13829 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:57.708149 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:57.713776 13860 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:08:57.707576 13829 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:57.659768 20576 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:57.723126 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:57.723762 13863 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:08:57.721529 13856 raft_consensus.cc:2393] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 19: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:57.674403 20242 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:57.672583 20570 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:57.662148 20552 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.059s
I20260709 13:08:57.678045 20787 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:57.716146 20759 consensus_meta.cc:287] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.577s	user 0.011s	sys 0.000s
I20260709 13:08:57.733700 14401 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:08:57.750145 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.757081 13789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:08:57.757757 13789 raft_consensus.cc:606] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:08:57.758155 13789 raft_consensus.cc:614] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:57.750723 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:57.751822 13858 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:57.752080 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 3460) took 1062 ms. Trace:
I20260709 13:08:57.760416 13711 rpcz_store.cc:276] 0709 13:08:56.689777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.698907 (+  9130us) service_pool.cc:224] Handling call
0709 13:08:57.751891 (+1052984us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54002e7cd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:57.752026 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":417585408}
I20260709 13:08:57.752781 13712 raft_consensus.cc:1240] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:57.759512 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:57.764593 14368 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:57.754261 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:57.765647 13864 raft_consensus.cc:2393] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 19: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:57.767212 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:57.767220 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:57.768442 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:57.771027 13863 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 19: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:57.774360 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:57.775069 14398 raft_consensus.cc:2393] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 18: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:57.753417 20570 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:57.781466 20835 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:57.782776 20808 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:57.759478 20576 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.792728 13859 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
W20260709 13:08:57.788007 20834 log.cc:927] Time spent T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
I20260709 13:08:57.787127 14368 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:08:57.798569 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.775712 20810 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:57.804210 14368 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:57.775982 20829 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:57.808024 20840 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:57.808328 20784 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:57.808496 20840 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:57.809056 20840 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:57.809163 19952 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:57.811185 14368 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:57.811539 20833 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.091s
I20260709 13:08:57.811971 19952 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:57.795336 20759 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:57.816751 14368 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:57.823204 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:57.825649 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:57.826633 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 144306us
I20260709 13:08:57.830366 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:57.801290 20785 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:57.806061 20637 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:57.715133 20790 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.824460 20475 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:57.816375 20621 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:57.636996 20818 consensus_queue.cc:237] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:57.848457 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:08:57.840289 20837 log.cc:927] Time spent T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:08:57.827716 20731 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:57.849987 20594 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:57.862694 20454 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:57.863510 20839 log.cc:927] Time spent T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 13:08:57.878537 14400 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
W20260709 13:08:57.890995 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 49871.6us
I20260709 13:08:57.850342 20621 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:57.868933 20347 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:57.802984 20576 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.848066 20777 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:08:57.871873 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:57.854739 20807 consensus_meta.cc:287] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.656s	user 0.004s	sys 0.004s
I20260709 13:08:57.892023 14368 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:57.898662 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:57.873216 20814 raft_consensus.cc:3055] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:57.878158 20842 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.909135 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:57.895815 20464 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:57.898322 20621 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:57.901733 20759 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:57.902576 20807 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.912526 20842 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.918166 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:57.915403 20517 consensus_meta.cc:287] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.781s	user 0.010s	sys 0.000s
I20260709 13:08:57.920205 20832 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.896836 19952 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:08:57.919610 20576 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:57.929921 13785 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:08:57.942212 20570 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.959707 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:57.960354 13785 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 22.
I20260709 13:08:57.960639 20454 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:57.960848 20570 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:57.961217 13785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3618fd55609843fca70082d3565b459b"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:08:57.946972 20517 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:57.930802 20850 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:08:57.963282 20517 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:57.913388 20808 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:57.964284 14396 raft_consensus.cc:2393] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 19: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:57.906137 20814 raft_consensus.cc:740] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:08:57.960505 20730 consensus_meta.cc:287] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.000s
I20260709 13:08:57.917304 20731 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.983224 20731 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.948905 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 3215) took 1474 ms. Trace:
I20260709 13:08:57.986881 13785 raft_consensus.cc:606] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:57.987460 13785 raft_consensus.cc:614] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:57.949608 20774 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:08:57.957108 14397 raft_consensus.cc:2368] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 17. Current term is 18.
W20260709 13:08:57.944550 20778 consensus_meta.cc:287] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.000s
W20260709 13:08:57.945905 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 187754us
I20260709 13:08:57.971366 14394 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:57.991333 13829 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:57.973913 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:57.992208 13863 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:57.974852 20814 consensus_queue.cc:260] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.979527 20730 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:57.961434 20576 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.982390 20676 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:57.982568 20790 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:57.987139 13862 rpcz_store.cc:276] 0709 13:08:56.474764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.475011 (+   247us) service_pool.cc:224] Handling call
0709 13:08:56.475353 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:56.484868 (+  9515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:56.484896 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:56.485342 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:08:56.618985 (+133643us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:56.619020 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.948459 (+1329439us) spinlock_profiling.cc:243] Waited 9.16 ms on lock 0x7b5400375fd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:57.948518 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:57.948568 (+    50us) raft_consensus.cc:1685] finished
0709 13:08:57.948592 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:57.948834 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":2477,"spinlock_wait_cycles":21079296,"thread_start_us":90615,"threads_started":1,"wal-append.queue_time_us":155869,"wal-append.run_cpu_time_us":1762,"wal-append.run_wall_time_us":1002806}
I20260709 13:08:58.032887 13783 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:08:57.981524 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:58.025429 20840 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.005199 14399 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:57.999769 20778 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:58.042027 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 60564.3us
I20260709 13:08:57.986325 20807 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:58.042784 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:57.973647 20842 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:58.004463 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:57.965051 20787 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:58.043820 20842 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:58.044317 14401 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 22: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:58.043208 13861 raft_consensus.cc:1240] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:58.006006 14395 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:08:58.042786 13680 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:58.001463 20570 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:58.045639 20570 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:58.046116 13680 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:58.046770 20773 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:58.010253 20856 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 13:08:58.047593 20773 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:58.047828 20842 consensus_queue.cc:1059] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:58.047999 20687 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:58.048105 20773 raft_consensus.cc:697] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:58.025699 20576 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:58.049216 20773 consensus_queue.cc:237] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.044428 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:58.050449 20576 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:58.008344 20730 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:58.004106 20814 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:58.001389 20621 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.052889 20842 raft_consensus.cc:3055] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:58.053314 20842 raft_consensus.cc:740] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:58.053617 20621 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:58.018380 20785 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:58.054219 20842 consensus_queue.cc:260] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.001088 20808 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:58.050690 14399 raft_consensus.cc:2393] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 14: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:58.050381 20743 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:58.055104 20785 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.055920 20842 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:58.057848 20785 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:57.976606 20761 raft_consensus.cc:3055] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:58.058646 20808 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:58.059010 20761 raft_consensus.cc:740] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:58.059182 20808 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.059988 20761 consensus_queue.cc:260] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.060894 20743 consensus_queue.cc:1059] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:58.043311 20840 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:58.015084 14402 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:58.041431 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:58.062983 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:58.063895 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:58.040455 14398 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:58.036003 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:58.065248 13829 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:58.010479 13788 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
W20260709 13:08:58.025153 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.004182 20517 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.074811 13863 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 25.
I20260709 13:08:58.065537 14393 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:08:58.083807 20676 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:58.084431 20676 raft_consensus.cc:697] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:58.085417 20676 consensus_queue.cc:237] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.092222 20815 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:58.099524 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:58.100135 13862 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:58.098778 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:58.102874 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:58.104851 13680 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:58.108489 13860 raft_consensus.cc:2393] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 19: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:58.110188 13791 raft_consensus.cc:1240] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:08:58.024309 20731 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:58.034883 20770 raft_consensus.cc:3055] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:58.114074 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:58.138566 13860 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 19: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:08:58.043463 20778 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:58.115540 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:58.007573 20832 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:58.001827 20835 raft_consensus.cc:697] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:58.098335 20787 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.143728 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:58.162745 13860 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:08:58.147523 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:58.147634 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:58.103371 20594 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.172180 13788 raft_consensus.cc:2393] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 19: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:58.110337 20576 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:58.184172 13862 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:08:58.195910 13860 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:08:58.137959 20770 raft_consensus.cc:740] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:58.144622 20779 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:08:58.201153 13857 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 3899) took 2434 ms (client timeout 1705 ms). Trace:
I20260709 13:08:58.142740 20808 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:58.103742 20517 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.208489 13863 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:08:58.212988 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:58.211629 13857 rpcz_store.cc:269] 0709 13:08:55.737488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.742743 (+  5255us) service_pool.cc:224] Handling call
0709 13:08:58.170915 (+2428172us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540035af54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:58.171799 (+   884us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2808298752}
I20260709 13:08:58.225888 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:58.197329 20687 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:58.229883 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:58.231653 13791 raft_consensus.cc:2393] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 19: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:58.214355 20779 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.179519 20743 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:08:58.180613 20787 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.187258 20594 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.250237 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:58.230785 20808 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:58.244738 20779 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:58.230744 20635 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:58.203243 20848 consensus_queue.cc:1059] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:08:58.257953 20531 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:58.265622 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:58.265497 20531 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:58.266248 13791 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:58.267833 20531 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:58.212846 20576 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.304553 20570 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:58.305073 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:58.305878 13790 raft_consensus.cc:2393] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 19: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:58.306898 20576 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:58.317767 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:58.318023 20517 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:58.333258 13787 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:08:58.335052 13787 raft_consensus.cc:1240] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:08:58.337011 20808 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:58.338472 20773 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:58.341533 20612 raft_consensus.cc:3055] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:58.346542 13785 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:08:58.349409 13788 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:08:58.355162 13791 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:08:58.356366 20773 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.252931 20687 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.360263 20635 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:58.354594 20612 raft_consensus.cc:740] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:58.258697 20835 consensus_queue.cc:237] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.364289 20858 consensus_queue.cc:1059] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:08:58.374239 20594 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:58.375032 20858 raft_consensus.cc:3055] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:58.375468 20858 raft_consensus.cc:740] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:58.376330 20858 consensus_queue.cc:260] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 13, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.377617 20858 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:58.365576 20815 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:08:58.371706 20612 consensus_queue.cc:260] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.380134 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 3021) took 2786 ms. Trace:
I20260709 13:08:58.384743 20577 raft_consensus.cc:3055] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:58.385257 20577 raft_consensus.cc:740] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:58.386232 20577 consensus_queue.cc:260] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.389734 14394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 1561) took 1344 ms. Trace:
I20260709 13:08:58.390179 14394 rpcz_store.cc:276] 0709 13:08:57.044875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.044990 (+   115us) service_pool.cc:224] Handling call
0709 13:08:57.070418 (+ 25428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.991136 (+920718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.389446 (+398310us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b54008c41d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:08:58.389669 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2038468480}
I20260709 13:08:58.393062 13783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 3331) took 1105 ms. Trace:
I20260709 13:08:58.393469 13783 rpcz_store.cc:276] 0709 13:08:57.287880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.289642 (+  1762us) service_pool.cc:224] Handling call
0709 13:08:58.392870 (+1103228us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b5400161a54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:58.392978 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1587391872}
I20260709 13:08:58.396997 20642 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:58.381331 13710 rpcz_store.cc:276] 0709 13:08:55.592423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.592549 (+   126us) service_pool.cc:224] Handling call
0709 13:08:55.592849 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:55.593054 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:55.593080 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:55.624120 (+ 31040us) log.cc:844] Serialized 26 byte log entry
0709 13:08:55.754339 (+130219us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:55.754375 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.754455 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:57.601391 (+1846936us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:08:58.377286 (+775895us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b240017eda8. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f2779c4 00007f522f275acb 00007f522f430dc9 00007f522f430a55 00007f522f42ffb0 00007f52320a6488 00007f52320a6be8 00007f523207e398 00007f523207976a 00007f5232078bb6
0709 13:08:58.378199 (+   913us) raft_consensus.cc:1685] finished
0709 13:08:58.378215 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.378375 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40902656,"thread_start_us":129887,"threads_started":1,"wal-append.queue_time_us":356555}
I20260709 13:08:58.414916 20577 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:58.418331 20779 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:58.420063 20773 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:58.421030 20787 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:58.383322 20612 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:58.421749 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:58.419348 20687 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:58.428884 20860 log.cc:927] Time spent T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.184s	user 0.002s	sys 0.000s
I20260709 13:08:58.432044 20761 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:58.436156 13786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 3330) took 1148 ms. Trace:
I20260709 13:08:58.436570 13786 rpcz_store.cc:276] 0709 13:08:57.287321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.287645 (+   324us) service_pool.cc:224] Handling call
0709 13:08:58.435889 (+1148244us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b54003bc754. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:58.436084 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":572595072}
I20260709 13:08:58.439297 13782 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:08:58.439740 13782 pending_rounds.cc:85] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 13
I20260709 13:08:58.439965 13782 pending_rounds.cc:107] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:08:58.440214 13782 raft_consensus.cc:2889] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:58.442883 20577 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:58.483067 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:58.495895 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:58.474102 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:58.482699 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:58.525055 13787 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 22.
I20260709 13:08:58.483258 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:58.525766 14402 raft_consensus.cc:2376] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19. Re-sending same reply.
I20260709 13:08:58.525992 13783 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:08:58.524660 14393 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:08:58.527657 13757 leader_election.cc:304] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:58.530184 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:08:58.532336 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.537631 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:58.538558 14399 raft_consensus.cc:2368] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 20. Current term is 21.
I20260709 13:08:58.533205 13757 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:58.543967 20611 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:08:58.544518 20611 raft_consensus.cc:697] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 25 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:58.545394 20611 consensus_queue.cc:237] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:58.548019 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:58.550493 20642 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:58.550773 20808 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:58.551033 20642 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:58.551370 20808 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:58.552423 20779 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:58.553224 20642 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:58.553617 20808 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:08:58.556041 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.536903 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:58.485303 20807 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.559933 13860 raft_consensus.cc:1240] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:58.486085 20517 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:58.564692 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.466413 20577 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:58.528537 20687 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:58.539779 20594 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:58.566812 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.569643 13755 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:58.571619 13680 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:58.573428 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:58.530099 20815 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:08:58.575723 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:58.576150 14394 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 19: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:58.577473 13783 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 19: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:58.577057 13755 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:58.578686 13755 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:58.576359 20842 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:58.580708 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:58.581298 13783 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:08:58.580158 20842 raft_consensus.cc:697] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:58.485070 20770 consensus_queue.cc:260] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.583349 20842 consensus_queue.cc:237] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.568472 20570 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.563865 20807 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.587550 20814 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.588160 20814 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.589202 20807 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:58.589395 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 1.40362e+06us
I20260709 13:08:58.590207 13756 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:58.590365 20814 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:58.593176 13680 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:58.572744 20464 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:58.575062 20778 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.570582 20773 consensus_queue.cc:1059] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 13:08:58.576673 20731 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:58.627854 13756 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:58.585126 20785 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:58.630787 20785 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.631175 20785 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:58.603641 20849 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:58.631821 20849 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.632166 20849 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:58.632294 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3335) took 1343 ms. Trace:
I20260709 13:08:58.627849 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:58.568719 20517 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.595719 13680 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:58.573232 20687 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.604911 20594 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:58.632726 13782 rpcz_store.cc:276] 0709 13:08:57.288833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.423306 (+134473us) service_pool.cc:224] Handling call
0709 13:08:58.437752 (+1014446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:58.443291 (+  5539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.632104 (+188813us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54003bc750. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:58.632238 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2326891904}
I20260709 13:08:58.641256 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:58.635794 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:58.641445 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.595206 13783 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 22.
W20260709 13:08:58.643553 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 47911us
I20260709 13:08:58.644155 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:58.644233 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:58.645567 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:58.646163 13783 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 20.
I20260709 13:08:58.645023 14394 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:08:58.645195 20881 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:58.647763 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:58.649487 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:58.651628 13782 raft_consensus.cc:1240] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:58.652796 13782 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:58.653877 13782 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:58.648720 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:58.598167 20570 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.661288 13782 raft_consensus.cc:1240] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:08:58.637548 20475 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:58.665577 13783 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 22.
I20260709 13:08:58.659799 20773 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:58.658607 20849 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:58.667950 20773 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.668331 20773 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:58.616566 20464 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.671926 13790 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:58.681146 20464 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:58.684934 20570 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:58.685590 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:58.686221 13856 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:58.686519 20517 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:58.687453 13757 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:58.687659 20577 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:58.625648 20778 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.689786 20778 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:58.644383 20848 raft_consensus.cc:3055] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:58.698711 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:58.699309 13856 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:08:58.678576 20773 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:58.709302 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 130688us
I20260709 13:08:58.708760 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:58.712154 13755 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:58.707871 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:58.713024 13790 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:58.712199 13757 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:58.716773 13710 raft_consensus.cc:2368] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 21. Current term is 22.
I20260709 13:08:58.716810 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:58.717661 13709 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:58.719105 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:58.720017 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:58.670953 20475 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:58.721508 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:58.723919 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:58.725056 13755 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:58.725492 13707 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
W20260709 13:08:58.725154 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 105482us
I20260709 13:08:58.727360 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:58.727965 13716 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:58.729918 13708 raft_consensus.cc:1240] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:58.697891 20848 raft_consensus.cc:740] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:58.700189 20778 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:58.730724 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:58.734575 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:58.734510 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:58.735348 13707 raft_consensus.cc:2393] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 23: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:58.735697 13790 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 21.
I20260709 13:08:58.733093 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:58.732438 13755 leader_election.cc:400] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 20. Current term is 21.
I20260709 13:08:58.700348 20570 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:58.737488 13755 leader_election.cc:403] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:08:58.737054 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:58.774912 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:58.775694 13716 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:58.728767 20475 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:58.738168 13714 raft_consensus.cc:2393] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 20: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:58.783918 13707 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:58.733018 20612 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:58.787572 13856 raft_consensus.cc:1240] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:58.729305 20858 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:58.790999 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:58.791205 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:58.729533 20731 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:58.733831 20778 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.729123 20594 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:58.791960 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 59712.7us
I20260709 13:08:59.002890 13755 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:59.004037 13755 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:08:58.978372 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.951639 20787 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.729212 20464 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:59.016099 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:59.016218 20787 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.017503 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:59.018442 20787 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:59.018994 20787 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:59.020174 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:59.005182 20778 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:59.025151 13710 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:08:58.992740 20835 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:59.029238 20835 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.034338 20778 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.041029 13756 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:59.040891 20835 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:59.041455 20778 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:59.042253 13756 leader_election.cc:400] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 21. Current term is 22.
I20260709 13:08:59.042548 13756 leader_election.cc:403] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:59.043788 14397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 1560) took 1999 ms (client timeout 1694 ms). Trace:
W20260709 13:08:59.044166 14397 rpcz_store.cc:269] 0709 13:08:57.044622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.044729 (+   107us) service_pool.cc:224] Handling call
0709 13:08:59.043612 (+1998883us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b540059a454. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:59.043724 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888612224}
I20260709 13:08:58.949630 20878 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.045295 20787 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:59.045742 20787 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:59.045436 20878 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.046152 20787 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:59.047652 20778 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 21. Current term is 22.
I20260709 13:08:59.047924 20878 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:59.048496 13784 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:58.796958 20774 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 20. Current term is 21.
I20260709 13:08:58.865855 20841 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:59.051007 20841 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.053406 20841 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:58.918797 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.056206 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:08:59.057550 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.796643 20858 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.059594 20858 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:59.060132 13756 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:59.039245 20475 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:59.061153 20687 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:59.061242 13756 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:59.062103 20832 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:59.062362 20475 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:59.062494 20832 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:59.062924 20832 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:59.063005 20475 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:59.063442 20475 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.063779 20475 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:59.063882 20849 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:59.065567 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:59.066155 14401 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:08:59.068204 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:59.068512 13709 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:08:59.069310 20790 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.069825 20790 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.070394 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:59.071825 20790 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:59.073866 20790 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.793454 13713 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:08:58.876883 20785 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.857101 13716 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 25.
I20260709 13:08:58.840258 20848 consensus_queue.cc:260] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:58.856407 20020 consensus_queue.cc:1059] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:08:58.881130 20773 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:08:58.965049 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.949903 20640 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.875909 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:58.885183 20776 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:58.854709 20795 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.828810 13791 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:08:58.800014 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:58.800490 20612 consensus_queue.cc:1059] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:59.121131 14395 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:59.125895 20770 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:59.127717 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:59.128393 14397 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:08:59.132025 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:59.074822 20517 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:59.081583 20807 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:08:59.140618 13830 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:59.160248 13716 raft_consensus.cc:1240] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:08:59.114455 20635 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.158077 20784 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:59.172241 13713 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:58.998838 13707 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:08:58.792951 20577 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:59.005004 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:59.006745 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1728) took 2831 ms. Trace:
I20260709 13:08:59.182531 13865 rpcz_store.cc:276] 0709 13:08:56.175051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.181649 (+  6598us) service_pool.cc:224] Handling call
0709 13:08:58.171078 (+1989429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:58.171318 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:58.171343 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:58.171387 (+    44us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:08:58.171435 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.171494 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:59.006612 (+835118us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b540035af50. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:59.006700 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4574533888}
I20260709 13:08:59.007884 20594 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.008663 20881 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:59.010876 20347 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 25 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:58.993000 20731 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.037218 14396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 2026) took 1890 ms. Trace:
I20260709 13:08:59.050452 14400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 1573) took 1317 ms. Trace:
I20260709 13:08:58.782876 20570 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:59.077189 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:59.161638 20778 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:59.221714 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:59.158356 20858 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.222472 13710 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:59.077777 13715 raft_consensus.cc:1275] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:59.202855 14395 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:59.224071 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:59.224751 13715 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:59.076283 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:59.078366 14366 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:08:59.225570 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.225767 13714 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
W20260709 13:08:59.226120 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 147859us
I20260709 13:08:59.226589 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:59.226832 14366 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:59.078176 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:59.079721 13756 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:08:59.228371 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 148781us
I20260709 13:08:59.229480 13756 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:58.937592 20661 raft_consensus.cc:3055] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:59.107200 13708 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
W20260709 13:08:59.077836 20676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.981s	user 0.009s	sys 0.022s
W20260709 13:08:59.074051 20877 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.398s	user 0.000s	sys 0.002s
I20260709 13:08:59.112015 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:59.254312 13861 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:08:59.114810 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:59.183322 20123 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:59.179737 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:59.181324 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:59.184413 13784 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:59.074496 20790 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:59.217965 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 393687us
W20260709 13:08:59.280431 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.219836 14400 rpcz_store.cc:276] 0709 13:08:57.733257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.733398 (+   141us) service_pool.cc:224] Handling call
0709 13:08:59.050303 (+1316905us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400664254. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:59.050401 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251661184}
I20260709 13:08:59.122896 20795 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:59.119771 20640 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.221007 14396 rpcz_store.cc:276] 0709 13:08:57.146547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.154557 (+  8010us) service_pool.cc:224] Handling call
0709 13:08:59.036992 (+1882435us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b540068a1d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:08:59.037129 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1860072704}
W20260709 13:08:59.248297 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 244317us
I20260709 13:08:59.231372 13756 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:59.255664 13859 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 16: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:08:59.252157 20676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.155s	user 0.010s	sys 0.023s
I20260709 13:08:59.116411 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:59.299263 13755 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:59.299786 14393 raft_consensus.cc:2393] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 19: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:08:59.247947 20878 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:59.170482 20848 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:59.241765 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:59.309499 13707 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 18: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:59.309540 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:59.161724 20611 consensus_queue.cc:1059] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:08:59.281113 13790 pending_rounds.cc:85] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 8
I20260709 13:08:59.312218 13790 pending_rounds.cc:107] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:08:59.312526 13790 raft_consensus.cc:2889] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:59.265022 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:59.314031 13713 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:59.283797 13682 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:59.158062 20517 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.293623 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:59.249892 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:59.247676 20612 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:59.322458 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:59.222364 20731 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:59.162868 20807 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.200565 20577 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.303470 13610 catalog_manager.cc:5697] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:59.304597 20570 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:59.305269 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:59.255129 20814 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:59.187240 20635 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.252264 20661 raft_consensus.cc:740] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:08:59.310897 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 79591.7us
I20260709 13:08:59.347234 13756 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:59.348655 13756 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:59.319617 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:59.314884 13755 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:59.291652 20773 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.254763 20778 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.326637 20347 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:59.327452 20785 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:59.327988 20840 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:59.328761 20886 log.cc:927] Time spent T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:08:59.264494 20858 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:08:59.332612 13614 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49436 (request call id 350) took 33848 ms (client timeout 15000 ms). Trace:
I20260709 13:08:59.358812 13711 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:08:59.183741 20784 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.292202 20835 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:08:59.339285 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 112524us
I20260709 13:08:59.320351 20887 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:59.337122 13610 catalog_manager.cc:5697] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 9 to 14, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 14 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:08:59.344452 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 202386us
I20260709 13:08:59.351342 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:59.355294 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:59.364979 14396 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:59.333489 20795 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:08:59.359228 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 44433us
W20260709 13:08:59.359872 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 219313us
I20260709 13:08:59.340742 20774 raft_consensus.cc:3055] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:59.306903 13715 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 21.
I20260709 13:08:59.362458 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:59.364910 13785 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:08:59.340663 20740 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:59.357117 14368 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:59.394831 14368 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:59.364787 14395 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:08:59.350647 20687 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.376387 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:59.374845 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:59.377559 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:08:59.397193 13783 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:59.381215 20774 raft_consensus.cc:740] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:59.382184 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:59.361024 20881 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:08:59.358762 13614 rpcz_store.cc:269] 0709 13:08:25.484448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.516269 (+ 31821us) service_pool.cc:224] Handling call
0709 13:08:59.332500 (+33816231us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:55.629327 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:55.629993 (+   666us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:55.630044 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:08:55.630065 (+    21us) tablet.cc:662] Decoding operations
0709 13:08:55.630928 (+   863us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:55.631026 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:55.631056 (+    30us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:08:55.644701 (+ 13645us) tablet.cc:701] Row locks acquired
0709 13:08:55.644747 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:08:55.644909 (+   162us) write_op.cc:270] Start()
0709 13:08:55.645049 (+   140us) write_op.cc:276] Timestamp: P: 1783602535644844 usec, L: 0
0709 13:08:55.645080 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:08:55.645768 (+   688us) log.cc:844] Serialized 2855 byte log entry
0709 13:08:56.416476 (+770708us) op_driver.cc:464] REPLICATION: finished
0709 13:08:56.526381 (+109905us) write_op.cc:301] APPLY: starting
0709 13:08:56.526478 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:56.666718 (+140240us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:56.666880 (+   162us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:56.936988 (+270108us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:57.016607 (+ 79619us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:08:57.016653 (+    46us) write_op.cc:312] APPLY: finished
0709 13:08:57.160450 (+143797us) log.cc:844] Serialized 73 byte log entry
0709 13:08:57.160633 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:57.160742 (+   109us) write_op.cc:454] Released schema lock
0709 13:08:57.160813 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:57.161257 (+   444us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:57.161285 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2961966,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":109574,"apply.run_cpu_time_us":14945,"apply.run_wall_time_us":634873,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33387,"num_ops":7,"prepare.queue_time_us":849631,"prepare.run_cpu_time_us":8060,"prepare.run_wall_time_us":133329,"raft.queue_time_us":236613,"raft.run_cpu_time_us":20898,"raft.run_wall_time_us":41993,"replication_time_us":771228,"spinlock_wait_cycles":1920,"thread_start_us":707757,"threads_started":4,"wal-append.queue_time_us":438112,"wal-append.run_cpu_time_us":21601,"wal-append.run_wall_time_us":2076409}]]}
I20260709 13:08:59.379113 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:59.382246 13789 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:08:59.369998 13610 catalog_manager.cc:5697] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 14 to 21, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 21 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:59.394832 13707 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 29.
I20260709 13:08:59.370688 20835 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:59.401624 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:59.405314 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:59.360827 20814 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:59.406352 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:59.422569 14400 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:08:59.363097 20464 raft_consensus.cc:697] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 19 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:59.414577 13709 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:08:59.362115 20776 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:59.417039 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:59.418256 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:59.408099 13782 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:59.423336 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:59.360625 20570 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:59.423808 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:59.427798 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:59.453528 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:59.455264 13782 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 30.
I20260709 13:08:59.429076 13783 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:08:59.429683 13680 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:59.430369 20552 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:59.356042 20773 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:59.419667 13610 catalog_manager.cc:5697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 21 to 29. New cstate: current_term: 29 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:59.453306 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:59.453517 13791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:08:59.454514 14395 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:08:59.509279 14393 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 30.
I20260709 13:08:59.363392 20840 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.454200 20570 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:59.475071 13712 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:08:59.457290 20881 raft_consensus.cc:697] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 19 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:59.479775 20517 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:59.483723 20898 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:59.481374 20858 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:59.483217 20778 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:59.480126 20441 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:59.463868 20552 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:59.487833 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:59.575055 14397 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:59.461037 20577 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:59.492923 13861 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:08:59.494939 13710 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:08:59.370075 20892 consensus_queue.cc:1059] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.094s
I20260709 13:08:59.457448 20640 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:59.482292 20814 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:59.407457 20740 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.469063 13777 tablet_service.cc:1558] Processing DeleteTablet for tablet c9e22f0634b34971aed9c5b948f3275e with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 7 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:48902
I20260709 13:08:59.483629 20807 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:59.481943 20835 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:59.465428 20635 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:59.444182 20832 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:59.497874 14396 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:08:59.475618 13713 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:08:59.455498 14400 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 11.
I20260709 13:08:59.509302 13791 raft_consensus.cc:606] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:08:59.509651 13610 catalog_manager.cc:5697] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:59.415480 20687 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.595230 13610 catalog_manager.cc:5697] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 13 to 18, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 18 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:59.515645 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:59.516942 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:59.512416 20787 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:59.517601 13755 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:08:59.602918 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 85391.8us
I20260709 13:08:59.605451 13755 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:08:59.551635 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.553408 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 170928us
I20260709 13:08:59.558447 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:59.559406 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:08:59.560822 13860 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
W20260709 13:08:59.566679 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 222147us
I20260709 13:08:59.608177 13865 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
W20260709 13:08:59.611018 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.580922 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 186152us
I20260709 13:08:59.479305 20439 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.087s
I20260709 13:08:59.522408 20570 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:59.587531 13757 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:59.453231 20776 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.614557 20611 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 13:08:59.618878 20776 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:59.619213 20611 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.619668 20611 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:08:59.587173 20441 raft_consensus.cc:697] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 22 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:08:59.622056 20784 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:59.623622 20787 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:59.574187 20898 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.599186 13610 catalog_manager.cc:5697] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 12 to 17, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 17 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:59.540841 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 179214us
I20260709 13:08:59.631500 20895 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.631588 20778 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:59.631863 14366 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:59.630676 13610 catalog_manager.cc:5697] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:59.632282 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:59.575388 20517 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:59.632403 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:59.633059 13785 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:08:59.633137 13610 catalog_manager.cc:5697] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:59.634191 14401 raft_consensus.cc:1240] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:59.634773 20835 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:59.632095 20895 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:59.636209 20896 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:59.636763 20832 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:59.637315 20895 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:08:59.637539 20896 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:59.637343 20832 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:59.637974 20896 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:59.638489 20896 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:59.638330 20881 consensus_queue.cc:237] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:59.639971 20807 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:59.640486 20807 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.504405 20661 consensus_queue.cc:260] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.583865 20774 consensus_queue.cc:260] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.642448 20661 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:59.585253 20849 raft_consensus.cc:2764] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:08:59.618916 14367 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:59.613108 14368 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:59.644068 13791 raft_consensus.cc:1240] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:59.634845 13610 catalog_manager.cc:5697] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 13 to 16, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 16 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:59.646229 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:59.650141 14368 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:59.650588 13790 raft_consensus.cc:2393] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 22: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:08:59.650947 14368 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:59.650628 13610 catalog_manager.cc:5697] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 12 to 15, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 15 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:59.652675 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:59.653443 13788 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 22: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:08:59.654562 13787 raft_consensus.cc:1240] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:59.596287 20020 raft_consensus.cc:3055] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:59.655619 20020 raft_consensus.cc:740] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:59.656737 20774 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:59.655666 20570 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.632110 20778 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:59.661407 20778 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:59.611292 20464 consensus_queue.cc:237] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:59.664088 20890 log.cc:927] Time spent T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:08:59.664592 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:59.656528 20020 consensus_queue.cc:260] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:59.667254 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:08:59.667968 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 49123us
I20260709 13:08:59.674278 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:59.669879 14397 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:08:59.631242 20898 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:59.622071 20441 consensus_queue.cc:237] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:59.683869 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:59.675072 13789 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
W20260709 13:08:59.686261 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 303318us
I20260709 13:08:59.638350 20832 raft_consensus.cc:697] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 19 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:08:59.616091 20840 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:59.694123 13789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:08:59.696259 13789 raft_consensus.cc:606] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:08:59.696688 13789 raft_consensus.cc:614] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:59.697500 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 235331us
I20260709 13:08:59.697515 13829 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:08:59.709884 13610 catalog_manager.cc:5697] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 14 to 16, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 16 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:59.677260 20895 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:08:59.712363 13610 catalog_manager.cc:5697] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 11 to 14, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 14 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:59.702654 13830 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:59.720934 13610 catalog_manager.cc:5697] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 9 to 16, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 16 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:59.700086 13680 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:08:59.730252 13610 catalog_manager.cc:5697] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 13 to 16, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 16 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:59.732136 13610 catalog_manager.cc:5697] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 9 to 11, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 11 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:08:59.741624 13610 catalog_manager.cc:5697] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:59.700343 20020 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:59.716809 20790 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:59.776916 20439 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:59.777654 20439 raft_consensus.cc:697] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:08:59.647665 20761 consensus_queue.cc:1175] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "35ecb005831740438d7537dd4b840e03" responder_term: 18 status { last_received { term: 17 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:59.788460 20898 consensus_queue.cc:1059] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:59.735247 20895 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.790720 20687 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:59.746662 20784 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:59.791788 20784 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:59.791944 20903 log.cc:927] Time spent T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:08:59.792197 20784 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:59.700390 20123 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:08:59.702540 20858 consensus_queue.cc:1059] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.066s
I20260709 13:08:59.716403 20840 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:59.791110 20895 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:59.795569 14367 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:08:59.763856 20841 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:59.794458 20635 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.798799 20841 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:59.799222 20635 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.801883 20635 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:59.802495 20790 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:59.802624 20731 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.803268 20790 raft_consensus.cc:697] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 19 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:59.804486 20790 consensus_queue.cc:237] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.806541 20611 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.767030 20907 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:08:59.807485 20814 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:59.807893 20814 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:08:59.807789 20907 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.808336 20814 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:59.810214 20907 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:59.810789 20907 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:59.778775 20439 consensus_queue.cc:237] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.810817 13714 raft_consensus.cc:2410] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:08:59.815718 20840 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.816257 20840 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:59.819602 13757 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:59.788569 20778 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.821497 13790 raft_consensus.cc:1240] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:08:59.822079 20612 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:59.822693 20807 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:08:59.823655 20612 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:59.824067 20612 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:08:59.824107 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 284391us
I20260709 13:08:59.824615 20612 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:59.824676 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:08:59.825024 13756 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:59.826300 13756 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:59.827711 20887 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:59.828402 20887 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:59.824411 20778 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:59.829742 13756 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:08:59.795092 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:59.835404 20832 consensus_queue.cc:237] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.836220 20902 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:59.836808 20902 raft_consensus.cc:697] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:59.837793 20902 consensus_queue.cc:237] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:08:59.839361 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.840046 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.840970 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:59.841718 20687 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.842453 20897 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 13:08:59.842244 20687 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.842927 20897 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.843058 20888 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:59.843400 20897 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:08:59.763696 13610 catalog_manager.cc:5697] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 16 to 19, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 19 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:59.846446 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.834703 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:08:59.846937 13610 catalog_manager.cc:5697] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 11 to 17, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 17 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:59.850950 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:08:59.854346 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.855914 13714 raft_consensus.cc:1240] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
W20260709 13:08:59.819746 20475 consensus_meta.cc:287] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.755s	user 0.012s	sys 0.000s
I20260709 13:08:59.872784 20687 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:59.823311 20807 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:59.883870 13756 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:59.811352 20907 raft_consensus.cc:697] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:08:59.895613 13756 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:59.896713 13610 catalog_manager.cc:5697] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:59.897912 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 266107us
I20260709 13:08:59.878748 20635 raft_consensus.cc:3055] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:59.924500 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:59.934108 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:59.935312 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:59.946774 13712 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 21.
I20260709 13:08:59.737119 13680 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:08:59.947522 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 210650us
I20260709 13:08:59.946849 13610 catalog_manager.cc:5697] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 12 to 17, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 17 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:59.926874 13755 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:08:59.883257 20887 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.880693 20676 raft_consensus.cc:3055] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:59.952584 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:59.954814 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:08:59.955651 14366 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:08:59.956898 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:08:59.957468 14401 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:59.798473 20776 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:08:59.957494 14366 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:08:59.955664 13714 raft_consensus.cc:2410] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:08:59.880693 20475 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:08:59.945133 20635 raft_consensus.cc:740] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:08:59.979250 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 328354us
I20260709 13:08:59.982256 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:08:59.947064 20778 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:00.003540 20916 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:00.038355 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 313934us
I20260709 13:09:00.087915 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:08:59.994560 14366 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:00.088557 14402 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
W20260709 13:09:00.089030 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.954015 20913 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:00.036545 14401 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 12.
W20260709 13:08:59.999713 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.954367 20676 raft_consensus.cc:740] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:08:59.971215 20807 raft_consensus.cc:697] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 21 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:00.053567 14395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:40042
I20260709 13:09:00.096457 14395 raft_consensus.cc:606] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:09:00.096962 14395 raft_consensus.cc:614] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:59.983240 20517 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:00.004712 20611 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 31 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:08:59.995951 13784 raft_consensus.cc:2368] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 18. Current term is 19.
I20260709 13:09:00.090260 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:00.090772 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:00.092011 13790 raft_consensus.cc:1240] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:09:00.094301 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:00.095257 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:00.111073 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:00.112254 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:00.112891 13791 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:09:00.114346 13789 raft_consensus.cc:2368] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 30. Current term is 31.
I20260709 13:09:00.114807 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:00.115883 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:00.119809 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:00.120579 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:00.121496 14401 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:09:00.116559 13791 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:09:00.123383 20773 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:00.078874 20894 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.016s	sys 0.011s
W20260709 13:09:00.116016 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.088222 13830 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:00.125286 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:00.128067 13790 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:08:59.956403 20887 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.120569 14399 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:09:00.100063 13755 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:00.082979 20594 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:00.143724 20594 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:00.144356 20594 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.140501 13680 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:00.148146 13680 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:00.146761 20773 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:09:00.150512 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 50566us
W20260709 13:09:00.151645 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 63564.5us
W20260709 13:09:00.159287 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 263850us
I20260709 13:09:00.162446 13830 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:00.151245 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:09:00.151611 20911 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:00.152112 13828 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.009s	sys 0.012s
I20260709 13:09:00.125258 20464 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:00.153424 13777 thread.cc:641] tablet-delete [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.016s	sys 0.004s
W20260709 13:09:00.166373 13828 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.009s	sys 0.012s
W20260709 13:09:00.155822 20912 log.cc:927] Time spent T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:09:00.169771 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:00.154668 20888 raft_consensus.cc:697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:00.164949 13830 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:00.157472 20577 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:00.172804 20888 consensus_queue.cc:237] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:00.173823 20577 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:00.174407 20577 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:00.179929 20892 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.007s	sys 0.028s
W20260709 13:09:00.180294 20892 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.007s	sys 0.029s
I20260709 13:09:00.167351 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:00.120637 20778 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:00.117043 20913 raft_consensus.cc:697] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:09:00.127526 20894 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.017s	sys 0.011s
I20260709 13:09:00.140859 20916 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.180742 20914 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:00.168756 13777 thread.cc:608] tablet-delete [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.016s	sys 0.004s
I20260709 13:09:00.189586 13680 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:00.169646 20773 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:00.169332 20917 log.cc:927] Time spent T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:09:00.141397 20517 raft_consensus.cc:697] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:09:00.185022 20877 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:09:00.182116 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 187672us
I20260709 13:09:00.080482 20907 consensus_queue.cc:237] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.214485 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:00.139926 20635 consensus_queue.cc:260] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:00.196743 20878 consensus_meta.cc:287] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.886s	user 0.009s	sys 0.002s
I20260709 13:09:00.207181 20916 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:00.227658 20901 log.cc:927] Time spent T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:00.182721 20905 consensus_queue.cc:1048] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:09:00.284343 20878 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:00.185091 20835 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:00.192999 20441 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:00.259852 20886 log.cc:927] Time spent T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:09:00.235283 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 70454.5us
I20260709 13:09:00.306823 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:00.240655 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:00.308313 13862 raft_consensus.cc:2410] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:09:00.182104 20761 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 13:09:00.259663 13856 raft_consensus.cc:1240] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:00.189862 20731 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:00.188474 20921 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:00.247339 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 140793us
W20260709 13:09:00.322746 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.243637 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:00.244547 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:00.324014 14395 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:00.324743 13858 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 25.
I20260709 13:09:00.264632 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:00.283241 20922 log.cc:927] Time spent T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:09:00.268961 20577 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.285921 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:00.264568 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:00.239821 20773 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:00.221920 20807 consensus_queue.cc:237] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.246544 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:00.285431 20931 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:00.289134 20835 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:00.295105 20840 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:00.296815 20640 raft_consensus.cc:3055] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:00.189045 20676 consensus_queue.cc:260] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:00.301136 20612 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.301657 14366 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:00.301959 20790 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:00.302389 20887 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:00.302676 20941 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:00.397652 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:00.398943 20941 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:00.306814 13830 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:00.239032 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:00.400605 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:00.307714 14398 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:09:00.309929 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:09:00.312062 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.245239 20795 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:00.403573 20795 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:00.403651 14395 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:09:00.404237 20795 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:00.325816 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:00.259366 20776 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:00.326462 13857 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 21.
I20260709 13:09:00.261399 20778 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:00.340592 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:00.409654 13858 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:09:00.342684 13859 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:09:00.331663 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:00.410859 13856 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:00.343807 13786 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 23.
I20260709 13:09:00.336068 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:00.344432 14368 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:00.416590 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 72229.8us
W20260709 13:09:00.344761 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 139396us
I20260709 13:09:00.418769 20612 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:00.243882 20894 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:00.298707 20916 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:00.420274 20916 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:09:00.325940 20905 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.420768 13757 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:00.421095 20905 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.422793 14368 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:00.420763 20916 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:00.424460 14368 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:00.425160 20916 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:00.426805 14368 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:00.427935 14368 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:00.420264 13755 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:00.424135 20905 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:00.425539 20941 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:00.432610 20941 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:00.432958 20941 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:00.433285 20941 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:00.441501 20916 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.442464 13856 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
I20260709 13:09:00.444089 20941 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.446697 20778 raft_consensus.cc:697] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:00.332182 20898 consensus_queue.cc:1059] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:09:00.444691 20914 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:00.445698 20916 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 26 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:00.445787 20731 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:00.287314 20897 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.305027 20814 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:00.565299 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 146547us
I20260709 13:09:00.556613 13757 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:00.554127 13755 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:00.321368 20892 consensus_queue.cc:1059] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.070s
I20260709 13:09:00.352974 20835 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:00.353739 20896 consensus_meta.cc:287] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.715s	user 0.008s	sys 0.004s
W20260709 13:09:00.566538 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 230572us
I20260709 13:09:00.448825 20914 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:00.354637 20640 raft_consensus.cc:740] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:00.555370 20887 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:00.447559 20940 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:09:00.566227 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 259574us
W20260709 13:09:00.578652 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 277038us
I20260709 13:09:00.579779 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:00.580219 14366 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:00.569995 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:00.351482 20858 consensus_queue.cc:1059] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.209s
I20260709 13:09:00.573120 13599 catalog_manager.cc:5028] TS 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): tablet c9e22f0634b34971aed9c5b948f3275e (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:09:00.578162 14367 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:00.581009 13783 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
W20260709 13:09:00.581938 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.582052 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:00.582656 13862 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:09:00.583546 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:00.562986 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 135148us
I20260709 13:09:00.576056 14401 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:00.576776 14402 raft_consensus.cc:2368] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 30. Current term is 31.
I20260709 13:09:00.580346 13856 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:09:00.574328 20948 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:00.588029 20948 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:00.588562 13856 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:09:00.574796 20930 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:00.590237 20948 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:00.590444 20930 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:00.590889 20930 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:00.564222 20841 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:00.592535 13864 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:00.593436 14395 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:09:00.265031 20913 consensus_queue.cc:237] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.597139 14401 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
I20260709 13:09:00.568390 20919 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:00.334340 20921 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.600325 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:00.598007 14366 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:00.567019 20935 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:00.603596 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:00.571754 20439 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:00.571480 20914 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:00.575989 20878 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:00.355014 20931 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.593592 20552 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.612699 13856 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:09:00.577246 20776 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:00.625782 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:00.565825 20731 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.553093 20795 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.602267 20902 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:00.570005 20687 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:09:00.601429 20919 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:00.609449 20946 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.568547 20945 consensus_queue.cc:1059] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
I20260709 13:09:00.639855 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:00.635789 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 62991.5us
I20260709 13:09:00.615271 20935 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:00.569895 20896 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.554190 20517 consensus_queue.cc:237] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.647310 20951 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:00.653971 20795 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:00.655216 20928 log.cc:927] Time spent T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:09:00.613302 20787 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:09:00.621814 20439 raft_consensus.cc:697] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:00.601470 20778 consensus_queue.cc:237] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.679791 20439 consensus_queue.cc:237] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.656672 20953 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:00.643253 20776 raft_consensus.cc:697] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 19 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:00.602912 20940 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:00.657877 13865 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:09:00.658236 20784 consensus_meta.cc:287] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.865s	user 0.006s	sys 0.006s
I20260709 13:09:00.659555 20950 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:00.651499 13787 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 22. Current term is 23. Ops: [21.11-22.12]
W20260709 13:09:00.653342 20926 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:09:00.653527 20933 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.381s	user 0.000s	sys 0.001s
I20260709 13:09:00.660861 20931 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:00.650349 13786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 3356) took 1274 ms. Trace:
I20260709 13:09:00.678810 20814 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:00.677086 20740 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:00.662985 20731 leader_election.cc:290] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:00.663961 20947 log.cc:927] Time spent T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:09:00.663626 20946 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.627615 20878 raft_consensus.cc:697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 20 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:00.664619 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:00.633365 20640 consensus_queue.cc:260] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.644960 20919 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:00.641420 20909 raft_consensus.cc:3055] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:00.657271 20441 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:00.687822 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:00.696781 20570 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:00.726450 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:00.689513 13861 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:00.631598 20552 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.692056 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:09:00.691109 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 93158.3us
I20260709 13:09:00.729245 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:00.727564 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:00.694939 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:00.698501 13786 rpcz_store.cc:276] 0709 13:08:59.376006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.376139 (+   133us) service_pool.cc:224] Handling call
0709 13:09:00.650126 (+1273987us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b54000b2f54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:00.650277 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2045547776}
I20260709 13:09:00.649369 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:00.685316 20907 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:00.664737 20935 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:00.732849 13856 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:00.738996 20907 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.740454 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:00.741183 13782 raft_consensus.cc:2393] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 20: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:00.741252 20907 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:00.741686 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:00.742771 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:00.743782 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:00.744138 14399 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:00.744724 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:00.745046 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:00.745764 14399 raft_consensus.cc:2368] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 22. Current term is 23.
I20260709 13:09:00.745816 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:00.747095 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:09:00.749140 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.702745 20577 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:00.697085 20784 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:00.687206 20953 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.751782 20661 raft_consensus.cc:2804] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:00.761343 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:00.793896 20661 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:00.794390 20661 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:00.794961 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:00.795785 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:00.796114 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:00.722539 20840 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:00.725636 20909 raft_consensus.cc:740] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:00.797958 13716 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:00.797763 20878 consensus_queue.cc:237] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.728534 13865 raft_consensus.cc:2376] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18. Re-sending same reply.
I20260709 13:09:00.796499 20776 consensus_queue.cc:237] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.805436 13710 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:09:00.796890 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:00.806363 13711 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:09:00.801532 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:00.793284 20640 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:00.755997 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:00.756866 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:00.808708 13709 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 21.
I20260709 13:09:00.756524 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:09:00.812081 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.797956 20909 consensus_queue.cc:260] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:00.819569 14394 raft_consensus.cc:1240] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:00.819676 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:00.820657 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:00.796068 20958 log.cc:927] Time spent T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:09:00.821905 13711 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:00.725028 20941 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:00.823843 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:00.824002 13856 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 22.
I20260709 13:09:00.824150 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:09:00.825543 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.819188 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:00.823491 13714 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:09:00.741400 20952 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:00.846481 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:00.848438 13680 leader_election.cc:400] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 18. Current term is 19.
I20260709 13:09:00.850121 13860 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 17: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:09:01.550836 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 702569us
I20260709 13:09:01.025331 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:01.552021 13680 leader_election.cc:400] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 30 pre-election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 30. Current term is 31.
I20260709 13:09:00.752033 20687 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:00.850226 13715 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 17: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:09:01.286044 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:01.048023 13830 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:00.951320 13859 raft_consensus.cc:1240] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:00.862324 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:00.907012 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:01.562556 14394 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:01.564291 14399 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
W20260709 13:09:01.148411 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:01.107327 13829 leader_election.cc:336] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): Timed out: RequestConsensusVote RPC to 127.12.76.132:43039 timed out after 1.694s (SENT)
W20260709 13:09:01.567552 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 519621us
I20260709 13:09:01.567935 13829 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:01.193674 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.570245 13680 leader_election.cc:403] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 30 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:01.346731 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:00.841807 20832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.013s	sys 0.021s
I20260709 13:09:01.581549 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:01.582717 13860 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:09:01.583824 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:00.793170 20946 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:01.402500 20640 consensus_meta.cc:287] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.001s
W20260709 13:09:01.397931 20778 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.020s	sys 0.032s
I20260709 13:09:01.589951 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:00.962108 20959 log.cc:927] Time spent T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
W20260709 13:09:01.336730 20773 consensus_meta.cc:287] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.984s	user 0.010s	sys 0.000s
I20260709 13:09:01.591312 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:00.849665 20894 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.584379 13680 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:00.845363 20911 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.603432 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:01.163203 20897 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 31 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:00.947762 20961 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:01.020170 20936 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.024089 20815 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.412670 20953 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:01.439239 20784 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:01.668025 13712 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.014s	sys 0.006s
I20260709 13:09:01.566161 20952 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.608566 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:01.566859 20687 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:01.590636 20832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.312s	user 0.020s	sys 0.025s
I20260709 13:09:01.611944 13860 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:09:01.579532 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:01.626062 20878 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.033s	sys 0.059s
I20260709 13:09:01.613107 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:01.594594 20778 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.022s	sys 0.039s
W20260709 13:09:01.606508 20439 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.910s	user 0.029s	sys 0.047s
I20260709 13:09:01.581007 20898 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:01.577630 20976 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 29 FOLLOWER]: Advancing to term 31
I20260709 13:09:01.590755 20909 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:01.181540 20921 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:01.623013 13857 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.006s	sys 0.012s
I20260709 13:09:01.624259 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:00.908116 20761 consensus_queue.cc:1059] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.740s
I20260709 13:09:01.646298 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 2056) took 1556 ms. Trace:
I20260709 13:09:01.610297 20773 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:01.636368 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:01.662663 13756 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:00.917191 20935 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:01.754716 20935 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:00.935557 20552 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:01.668885 13712 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.014s	sys 0.006s
I20260709 13:09:01.752375 14402 rpcz_store.cc:276] 0709 13:09:00.089937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.090043 (+   106us) service_pool.cc:224] Handling call
0709 13:09:01.626711 (+1536668us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b540044fcd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:01.646238 (+ 19527us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1074918144}
W20260709 13:09:01.669217 14397 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.000s	sys 0.008s
W20260709 13:09:01.756494 14397 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.001s	sys 0.009s
I20260709 13:09:01.756551 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:01.757228 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 1596) took 1015 ms. Trace:
I20260709 13:09:01.757571 14397 rpcz_store.cc:276] 0709 13:09:00.741719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.746719 (+  5000us) service_pool.cc:224] Handling call
0709 13:09:00.746974 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.747162 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:09:00.940828 (+193666us) log.cc:844] Serialized 14 byte log entry
0709 13:09:01.756906 (+816078us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.756961 (+    55us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:09:01.757010 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.757075 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.757178 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":587810,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"thread_start_us":1009060,"threads_started":2}
I20260709 13:09:01.612218 20940 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:01.613438 20841 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:01.679558 14399 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:09:01.760257 20841 raft_consensus.cc:697] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:01.589299 20905 consensus_queue.cc:1059] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:09:01.684808 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:01.685390 13859 raft_consensus.cc:2376] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 22. Re-sending same reply.
I20260709 13:09:00.915983 20965 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:01.698431 14400 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 26: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:01.761862 20965 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:01.761132 20905 raft_consensus.cc:3055] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:01.764001 20905 raft_consensus.cc:740] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:01.764210 20965 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:01.764900 20905 consensus_queue.cc:260] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:01.765468 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 1600) took 1022 ms. Trace:
I20260709 13:09:01.766181 20905 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:01.761106 20841 consensus_queue.cc:237] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:01.669541 20815 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:01.685447 20687 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:01.745898 13857 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.023s	user 0.006s	sys 0.015s
I20260709 13:09:01.768864 20815 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:01.683109 20952 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:01.717602 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 109593us
W20260709 13:09:01.687317 20878 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.033s	sys 0.059s
W20260709 13:09:01.686491 20930 consensus_meta.cc:287] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 1.092s	user 0.011s	sys 0.001s
I20260709 13:09:01.762197 13859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 3250) took 1019 ms. Trace:
I20260709 13:09:01.614874 20894 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:01.739001 20661 consensus_meta.cc:287] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.944s	user 0.010s	sys 0.002s
W20260709 13:09:01.779474 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 116907us
W20260709 13:09:01.783870 20439 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.095s	user 0.031s	sys 0.049s
I20260709 13:09:01.682237 20123 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:01.765877 14397 rpcz_store.cc:276] 0709 13:09:00.742777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.758870 (+1016093us) service_pool.cc:224] Handling call
0709 13:09:01.759111 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.759268 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.759292 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.759329 (+    37us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:01.759371 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.765316 (+  5945us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.765418 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.621500 20911 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:01.786697 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 3231) took 1206 ms. Trace:
I20260709 13:09:01.746544 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 3253) took 1003 ms. Trace:
I20260709 13:09:01.812129 13865 rpcz_store.cc:276] 0709 13:09:00.743376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.621816 (+878440us) service_pool.cc:224] Handling call
0709 13:09:01.746480 (+124664us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.786847 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 3245) took 1103 ms. Trace:
I20260709 13:09:01.780802 20935 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.789928 14396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 2060) took 1052 ms. Trace:
I20260709 13:09:01.790027 20986 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:01.790408 20992 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:01.793125 20773 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:01.793619 20835 consensus_meta.cc:287] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 1.222s	user 0.010s	sys 0.002s
I20260709 13:09:01.836535 20835 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:01.793639 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 3062) took 1004 ms. Trace:
I20260709 13:09:01.841246 13862 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 19: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:01.806955 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58552 (request call id 1765) took 1497 ms. Trace:
I20260709 13:09:01.843575 13710 rpcz_store.cc:276] 0709 13:09:00.309495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.309648 (+   153us) service_pool.cc:224] Handling call
0709 13:09:01.806744 (+1497096us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54001c43d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:01.806880 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":926784896}
I20260709 13:09:01.808494 20930 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:01.845338 20914 consensus_meta.cc:287] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 1.219s	user 0.011s	sys 0.001s
I20260709 13:09:01.845893 20914 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:01.847570 20911 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:01.847765 14395 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:09:01.811942 20661 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:01.839260 20835 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:01.698215 20881 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.012s	sys 0.064s
I20260709 13:09:01.806583 13859 rpcz_store.cc:276] 0709 13:09:00.742657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.579121 (+836464us) service_pool.cc:224] Handling call
0709 13:09:01.762012 (+182891us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.850688 20661 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:01.809110 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 701767us
I20260709 13:09:01.624867 20961 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:01.647285 20936 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:01.780464 20965 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.778985 20832 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.813249 13858 rpcz_store.cc:276] 0709 13:09:00.683294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.622899 (+939605us) service_pool.cc:224] Handling call
0709 13:09:01.786789 (+163890us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.851447 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:01.851508 13829 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.132:43039 timed out after 1.933s (SENT) [suppressed 17 similar messages]
I20260709 13:09:01.821074 14396 rpcz_store.cc:276] 0709 13:09:00.737068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.737232 (+   164us) service_pool.cc:224] Handling call
0709 13:09:00.737577 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:00.825134 (+ 87557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.825165 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:00.825602 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:09:01.240318 (+414716us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:01.240426 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.240633 (+   207us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:01.789696 (+549063us) raft_consensus.cc:1685] finished
0709 13:09:01.789720 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.789867 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90337,"raft.queue_time_us":87224,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":20153,"thread_start_us":162016,"threads_started":1,"wal-append.queue_time_us":844855}
I20260709 13:09:01.811730 13857 rpcz_store.cc:276] 0709 13:09:00.580268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.581767 (+  1499us) service_pool.cc:224] Handling call
0709 13:09:00.614969 (+ 33202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.615250 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:09:00.721595 (+106345us) log.cc:844] Serialized 14 byte log entry
0709 13:09:01.786310 (+1064715us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.786366 (+    56us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:01.786412 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.786476 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.786631 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":46118,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":1948,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"thread_start_us":1145739,"threads_started":2,"wal-append.queue_time_us":1039530}
I20260709 13:09:01.829926 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:01.869130 13865 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:09:01.869774 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 3953) took 1198 ms. Trace:
I20260709 13:09:01.870183 13865 rpcz_store.cc:276] 0709 13:09:00.671233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.824987 (+1153754us) service_pool.cc:224] Handling call
0709 13:09:01.869693 (+ 44706us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.814841 13680 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:01.832374 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:01.808902 13756 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:01.876199 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 61426.7us
W20260709 13:09:01.876536 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 67710.8us
I20260709 13:09:01.877327 13680 leader_election.cc:400] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 30 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 30. Current term is 31.
I20260709 13:09:01.842468 20992 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:01.879244 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:01.884701 13859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 3261) took 1139 ms. Trace:
I20260709 13:09:01.880069 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:01.882380 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:01.882930 13757 leader_election.cc:304] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:01.885154 13859 rpcz_store.cc:276] 0709 13:09:00.745514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.851107 (+1105593us) service_pool.cc:224] Handling call
0709 13:09:01.884642 (+ 33535us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.887303 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:01.887652 14394 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:09:01.888242 13859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 3254) took 1144 ms. Trace:
I20260709 13:09:01.888388 14394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 2064) took 1128 ms. Trace:
I20260709 13:09:01.888942 14394 rpcz_store.cc:276] 0709 13:09:00.759791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.823029 (+ 63238us) service_pool.cc:224] Handling call
0709 13:09:01.888315 (+1065286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.889511 14399 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:09:01.888705 13859 rpcz_store.cc:276] 0709 13:09:00.743655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.887016 (+1143361us) service_pool.cc:224] Handling call
0709 13:09:01.888175 (+  1159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.886041 13858 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:09:01.891572 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 3955) took 1088 ms. Trace:
I20260709 13:09:01.881539 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 1597) took 1139 ms. Trace:
I20260709 13:09:01.892176 13858 rpcz_store.cc:276] 0709 13:09:00.803518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.865094 (+1061576us) service_pool.cc:224] Handling call
0709 13:09:01.891520 (+ 26426us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.891754 13859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3954) took 1220 ms. Trace:
I20260709 13:09:01.894141 13859 rpcz_store.cc:276] 0709 13:09:00.671594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.890893 (+1219299us) service_pool.cc:224] Handling call
0709 13:09:01.891148 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.891291 (+   143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.891312 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.891354 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:01.891561 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.891619 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.891710 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.824754 20878 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:01.856482 20979 log.cc:927] Time spent T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:01.896626 13859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 3256) took 1152 ms. Trace:
I20260709 13:09:01.908571 13859 rpcz_store.cc:276] 0709 13:09:00.744155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.895739 (+1151584us) service_pool.cc:224] Handling call
0709 13:09:01.896048 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.896218 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.896245 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.896281 (+    36us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:01.896308 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.896480 (+   172us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.896581 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.892678 14402 rpcz_store.cc:276] 0709 13:09:00.741977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.757485 (+1015508us) service_pool.cc:224] Handling call
0709 13:09:01.757730 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.757900 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:09:01.758160 (+   260us) log.cc:844] Serialized 14 byte log entry
0709 13:09:01.880905 (+122745us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.880971 (+    66us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:01.881030 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.881113 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.881265 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":618,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":5581,"thread_start_us":122446,"threads_started":1}
I20260709 13:09:01.910156 13859 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:09:01.880512 20881 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.016s	sys 0.064s
I20260709 13:09:01.907150 14397 raft_consensus.cc:1275] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:09:01.891360 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 3055) took 1136 ms. Trace:
I20260709 13:09:01.898587 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:01.912535 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 3244) took 1238 ms. Trace:
I20260709 13:09:01.854537 20894 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:01.879737 20924 raft_consensus.cc:3055] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:01.915853 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:01.886919 20948 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:01.913220 13865 rpcz_store.cc:276] 0709 13:09:00.674190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.890455 (+1216265us) service_pool.cc:224] Handling call
0709 13:09:01.912462 (+ 22007us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.921530 20991 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:01.921729 20661 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.930990 20661 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:01.930948 20991 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:01.930306 20948 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:01.932605 20948 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:01.895931 20475 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:01.895720 20776 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:01.905367 20911 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.934240 20914 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:01.905773 20909 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.914556 20986 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.835278 20935 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:01.884446 20832 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:01.952450 20661 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:01.918192 20881 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:01.884553 20965 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:01.970095 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:01.922843 20924 raft_consensus.cc:740] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:01.974818 20976 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 31 FOLLOWER]: Leader pre-election lost for term 30. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 30. Current term is 31.
I20260709 13:09:01.976315 20991 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:01.940166 20930 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:01.979619 20945 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.980156 20594 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:01.981376 20992 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:01.982843 20916 raft_consensus.cc:3055] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:09:01.947644 20919 consensus_meta.cc:287] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 1.196s	user 0.007s	sys 0.004s
I20260709 13:09:01.977862 20776 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:01.942798 20784 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.915155 20878 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:02.013779 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 130920us
I20260709 13:09:02.005309 13786 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 22.
I20260709 13:09:01.976356 20961 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:02.018208 13757 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:01.950201 20911 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:01.969911 20909 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:02.024308 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 3249) took 1282 ms. Trace:
I20260709 13:09:02.001976 20916 raft_consensus.cc:740] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:02.026803 13858 rpcz_store.cc:276] 0709 13:09:00.742356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.893117 (+1150761us) service_pool.cc:224] Handling call
0709 13:09:01.893373 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.893566 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:09:01.920949 (+ 27383us) log.cc:844] Serialized 14 byte log entry
0709 13:09:02.023855 (+102906us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.023918 (+    63us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:02.023990 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.024077 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.024234 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":90036,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":2711,"thread_start_us":114027,"threads_started":2}
W20260709 13:09:02.028064 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 176547us
I20260709 13:09:02.034935 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:02.039568 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:02.015321 20776 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:01.956521 20986 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:01.998845 20881 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:02.016750 20784 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:02.017676 20919 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:02.013619 20945 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:02.041085 14397 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:09:02.124799 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 122315us
I20260709 13:09:02.220966 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:02.221549 13791 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:02.221503 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:02.221971 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:02.210850 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 2059) took 1478 ms. Trace:
I20260709 13:09:02.217058 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2806) took 2543 ms. Trace:
I20260709 13:09:02.207113 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1754) took 1969 ms. Trace:
I20260709 13:09:02.222604 14394 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:09:02.222458 14393 rpcz_store.cc:276] 0709 13:09:00.732940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.733099 (+   159us) service_pool.cc:224] Handling call
0709 13:09:00.733377 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.752844 (+ 19467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.752889 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:00.752943 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:00.752998 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.210562 (+1457564us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b54004c18d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:02.210621 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.210784 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44225408}
I20260709 13:09:02.223074 13787 rpcz_store.cc:276] 0709 13:08:59.673175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.675595 (+  2420us) service_pool.cc:224] Handling call
0709 13:09:00.651123 (+975528us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:00.694232 (+ 43109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.216834 (+1522602us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b54000b2f50. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:02.216976 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2196857600}
I20260709 13:09:01.913136 13712 rpcz_store.cc:276] 0709 13:09:00.754908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.755058 (+   150us) service_pool.cc:224] Handling call
0709 13:09:00.755322 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.755561 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:01.756013 (+1000452us) log.cc:844] Serialized 14 byte log entry
0709 13:09:01.891065 (+135052us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.891109 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:01.891149 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.891205 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.891305 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":162496,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":44,"raft.queue_time_us":100,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":1619,"thread_start_us":1070232,"threads_started":2}
I20260709 13:09:02.225301 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:02.225948 13787 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:09:02.223829 13861 rpcz_store.cc:276] 0709 13:09:00.237719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.237847 (+   128us) service_pool.cc:224] Handling call
0709 13:09:00.238120 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.728325 (+490205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.206813 (+1478488us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b540024f254. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:02.207039 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1037609344}
I20260709 13:09:02.041314 13783 raft_consensus.cc:2393] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 14: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
W20260709 13:09:02.226114 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.043079 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:02.223336 13789 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:09:02.227643 13790 raft_consensus.cc:2410] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:09:02.022121 20594 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:02.228008 13680 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:02.228206 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:02.066638 13788 raft_consensus.cc:1240] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:02.229799 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:02.261775 20993 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:02.262349 20993 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:02.264632 20993 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:02.221814 20635 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:09:02.268500 14401 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 2301) took 2080 ms (client timeout 1714 ms). Trace:
I20260709 13:09:02.269747 13785 raft_consensus.cc:1240] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 17. Current term is 18. Ops: []
W20260709 13:09:02.201196 20997 log.cc:927] Time spent T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 13:09:02.231182 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:09:02.271694 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:02.270205 14401 rpcz_store.cc:269] 0709 13:09:00.188533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.188678 (+   145us) service_pool.cc:224] Handling call
0709 13:09:02.268317 (+2079639us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b54006b5154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:02.268431 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":722651904}
I20260709 13:09:02.271848 13791 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 20.
I20260709 13:09:02.271973 14394 raft_consensus.cc:2368] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 18. Current term is 19.
W20260709 13:09:02.277894 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 49950.2us
I20260709 13:09:02.064472 20936 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:02.281816 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:02.279197 14400 raft_consensus.cc:1240] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:02.202236 20832 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:02.261494 13861 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 22.
I20260709 13:09:02.225534 20965 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:02.284796 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:02.286661 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:02.066666 20961 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.066148 20935 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:02.067456 20776 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:02.281478 20894 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.287866 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:02.243124 20594 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.069926 20930 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:02.269423 20905 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.225740 20909 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:02.291132 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:02.290527 20761 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:02.292536 13680 leader_election.cc:400] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 18. Current term is 19.
I20260709 13:09:02.292734 14401 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:09:02.305953 13680 leader_election.cc:403] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:09:02.158428 20687 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:02.281737 20976 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:02.294349 13757 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:02.193204 20916 consensus_queue.cc:260] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:02.067267 20924 consensus_queue.cc:260] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:02.296705 20948 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:02.297557 20878 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:02.300158 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.214278 20952 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:02.281610 20020 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:02.064020 20998 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.277s
I20260709 13:09:02.308022 20761 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.313300 20902 raft_consensus.cc:3055] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:02.302750 20594 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:02.313024 20552 raft_consensus.cc:3060] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:02.322705 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:02.357780 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 2065) took 1597 ms. Trace:
W20260709 13:09:02.325445 14395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 1603) took 1582 ms (client timeout 1977 ms). Trace:
W20260709 13:09:02.361999 14395 rpcz_store.cc:269] 0709 13:09:00.774001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.795902 (+ 21901us) service_pool.cc:224] Handling call
0709 13:09:02.325238 (+1529336us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400596854. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:02.325375 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2417142144}
I20260709 13:09:02.363306 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:02.292723 20961 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:02.316035 20976 raft_consensus.cc:697] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:02.321310 20916 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:02.313186 20990 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:09:02.361020 14398 rpcz_store.cc:276] 0709 13:09:00.760728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.804669 (+1043941us) service_pool.cc:224] Handling call
0709 13:09:01.805018 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.805428 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:09:01.811722 (+  6294us) log.cc:844] Serialized 14 byte log entry
0709 13:09:01.914031 (+102309us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.915107 (+  1076us) log.cc:844] Serialized 26 byte log entry
0709 13:09:01.915260 (+   153us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:01.915295 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.915358 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.203846 (+288488us) spinlock_profiling.cc:243] Waited 8.01 ms on lock 0x7b18004ba540. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3f13f3 00007f522f3f37c1 00007f522f3f3779 00007f522f3f3709 00007f522f3f36d1 00007f522f3f29cd 000000000038f354 000000000038f199 00007f522f3d483a
0709 13:09:02.352351 (+148505us) raft_consensus.cc:1685] finished
0709 13:09:02.357550 (+  5199us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.357703 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48554,"prepare.queue_time_us":9668,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":1232,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":1818,"spinlock_wait_cycles":18418944,"thread_start_us":93029,"threads_started":1,"wal-append.queue_time_us":173154}
I20260709 13:09:02.312913 20936 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:02.389991 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:02.390564 13710 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:09:02.393627 13830 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:02.387104 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:02.398011 13711 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 19: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:09:02.398219 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:02.399276 14401 raft_consensus.cc:2410] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:09:02.400254 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:02.374540 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:02.305706 20930 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:02.377817 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:02.378881 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:02.402365 13712 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:09:02.380232 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:02.403913 13790 raft_consensus.cc:2368] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20.
I20260709 13:09:02.404876 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:02.406160 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:02.381378 13783 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:02.383929 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:02.407685 13785 raft_consensus.cc:2368] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19.
I20260709 13:09:02.384842 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:02.408643 13787 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 20.
I20260709 13:09:02.402037 13707 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 17: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:09:02.308182 20905 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:02.301559 20894 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:02.322829 20988 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:02.354050 20902 raft_consensus.cc:740] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:02.388689 13784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3372) took 2289 ms. Trace:
I20260709 13:09:02.352608 20761 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:02.387790 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:02.416316 13788 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 22.
I20260709 13:09:02.416975 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:02.408046 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:02.418388 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:02.419448 13783 raft_consensus.cc:1240] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:02.412979 13790 raft_consensus.cc:2393] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 31: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:02.419916 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:02.420727 14401 raft_consensus.cc:2376] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20. Re-sending same reply.
I20260709 13:09:02.421727 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:02.423928 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 103622us
I20260709 13:09:02.425580 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:02.426290 13788 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:02.425558 14395 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 26 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 25. Current term is 26. Ops: []
I20260709 13:09:02.428413 13790 raft_consensus.cc:1240] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:09:02.409982 20895 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:02.414880 13784 rpcz_store.cc:276] 0709 13:09:00.099482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.121733 (+ 22251us) service_pool.cc:224] Handling call
0709 13:09:00.121993 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:00.201313 (+ 79320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.201342 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:00.201771 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:09:00.347171 (+145400us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:00.347210 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.366539 (+2019329us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x7b5400161a54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:02.366587 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.366626 (+    39us) raft_consensus.cc:1685] finished
0709 13:09:02.366640 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.388618 (+ 21978us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79276,"raft.queue_time_us":73840,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":35441,"spinlock_wait_cycles":158850304,"thread_start_us":145112,"threads_started":1,"wal-append.queue_time_us":365332,"wal-append.run_cpu_time_us":2641,"wal-append.run_wall_time_us":1353093}
I20260709 13:09:02.365476 20940 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:02.434082 13785 raft_consensus.cc:2393] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 20: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:02.352057 20020 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:02.402010 20936 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.389575 20924 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:02.415637 21008 log.cc:927] Time spent T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:09:02.436542 20993 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.430478 20986 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:02.435927 21002 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.471129 20020 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:02.476348 20773 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.476861 20945 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:02.477667 20976 consensus_queue.cc:237] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:02.496062 20881 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:02.497321 20952 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:02.498473 20948 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:02.499480 20902 consensus_queue.cc:260] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:02.500414 20911 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:02.445485 20936 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:09:02.507370 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 106825us
I20260709 13:09:02.534387 13788 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 23.
I20260709 13:09:02.534765 14400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 2063) took 1775 ms. Trace:
W20260709 13:09:02.506863 20994 log.cc:927] Time spent T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.530s	user 0.002s	sys 0.002s
I20260709 13:09:02.462937 20919 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:02.539954 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:02.430945 20988 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:02.503957 20784 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:02.544628 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 118901us
I20260709 13:09:02.546345 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:02.546003 14400 rpcz_store.cc:276] 0709 13:09:00.758998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.763496 (+1004498us) service_pool.cc:224] Handling call
0709 13:09:01.763776 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.282752 (+518976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.534470 (+251718us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b540070eed4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:02.534692 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1178654592}
I20260709 13:09:02.546515 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:02.566501 13786 raft_consensus.cc:2368] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20.
I20260709 13:09:02.567381 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:02.567955 13786 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:09:02.548549 13830 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:02.566159 14367 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:02.554205 13785 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
W20260709 13:09:02.570770 13682 connection.cc:256] RPC call timeout handler was delayed by -1.7114686349999602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
I20260709 13:09:02.445650 20940 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:02.571406 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.572300 13788 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
W20260709 13:09:02.575104 13682 connection.cc:256] RPC call timeout handler was delayed by -1.6261988610000344s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260709 13:09:02.575629 13682 connection.cc:256] RPC call timeout handler was delayed by -1.5965752209999664s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
W20260709 13:09:02.576233 13682 connection.cc:256] RPC call timeout handler was delayed by -1.4561752209999668s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
W20260709 13:09:02.576870 13682 connection.cc:256] RPC call timeout handler was delayed by -1.395875220999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
W20260709 13:09:02.577317 13682 connection.cc:256] RPC call timeout handler was delayed by -1.1647685489999731s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
W20260709 13:09:02.577711 13682 connection.cc:256] RPC call timeout handler was delayed by -1.1161685490000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
W20260709 13:09:02.578106 13682 connection.cc:256] RPC call timeout handler was delayed by -1.0172729600000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
W20260709 13:09:02.578514 13682 connection.cc:256] RPC call timeout handler was delayed by -1.001868548999937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1746s for a response
I20260709 13:09:02.545976 20878 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.505980 20993 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:02.556288 20676 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:02.586354 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:02.593672 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.590760 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:02.596568 13786 raft_consensus.cc:1240] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:09:02.597031 13755 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:02.597889 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:02.598601 13786 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:02.572016 20952 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.599939 20952 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:02.556423 20911 consensus_queue.cc:1059] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.047s
I20260709 13:09:02.539090 20773 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:02.606621 20773 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:02.594717 14395 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 13.
I20260709 13:09:02.608151 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:02.593001 20878 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:02.609100 13788 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:02.602792 20952 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:02.591795 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:02.616860 14400 raft_consensus.cc:2410] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:09:02.608184 14395 raft_consensus.cc:1275] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:02.623293 20784 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:09:02.624608 20940 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:02.624727 20784 raft_consensus.cc:3055] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:02.519436 21002 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:02.632387 13682 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:09:02.642269 13682 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:02.643229 20952 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:09:02.643939 13788 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:09:02.634003 13786 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:09:02.569290 20687 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:02.559695 20948 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.648491 20948 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:02.650625 20948 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:02.638809 13755 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:02.658924 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:02.623091 20594 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:02.640005 21007 log.cc:927] Time spent T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
I20260709 13:09:02.661953 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:02.638401 20784 raft_consensus.cc:740] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:02.661895 20881 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:02.640821 20940 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:02.630766 21015 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:02.653185 20577 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:02.733331 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:02.771783 13788 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
W20260709 13:09:02.734642 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.778523 13789 raft_consensus.cc:2393] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 20: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:02.662276 20020 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.099s
W20260709 13:09:02.783710 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 213622us
I20260709 13:09:02.785945 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 26 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:02.789579 13830 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:09:02.777334 21010 log.cc:927] Time spent T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:09:02.766539 20881 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:02.771145 21015 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.784919 20930 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:02.766278 21018 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:02.781715 20894 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:02.795343 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 153141us
I20260709 13:09:02.848119 13682 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:09:02.850096 13682 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:02.822312 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.826536 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:02.854857 13682 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:09:02.839638 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.858016 14366 leader_election.cc:400] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20.
I20260709 13:09:02.860467 14366 leader_election.cc:400] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19.
I20260709 13:09:02.861291 14366 leader_election.cc:403] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:09:02.795008 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 139929us
I20260709 13:09:02.868984 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:02.869256 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:02.834647 20911 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:09:02.832600 21011 log.cc:927] Time spent T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
W20260709 13:09:02.838053 20635 consensus_meta.cc:287] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.555s	user 0.003s	sys 0.007s
I20260709 13:09:02.871768 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:02.872552 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:02.822971 20905 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:02.843106 20881 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:02.829267 20577 raft_consensus.cc:697] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 18 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:02.863689 20952 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:02.885426 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:02.838723 21025 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:02.827486 20790 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.882493 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:02.878793 20841 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.893352 21002 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:02.826041 20612 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:02.839042 20594 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:02.918212 13711 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 31.
I20260709 13:09:02.837182 20961 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:02.844686 21015 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:02.920583 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:02.838452 20988 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:02.898717 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 44047.3us
I20260709 13:09:02.861001 20990 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:02.885041 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:02.923234 13865 raft_consensus.cc:2368] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20.
I20260709 13:09:02.904768 13716 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:09:02.896270 21013 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:02.886015 13864 raft_consensus.cc:2410] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 23 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 13:09:02.906782 13709 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
I20260709 13:09:02.880141 14366 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:02.908118 13783 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:02.909289 13714 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:09:02.909328 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:02.911868 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:02.916942 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:02.919128 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:02.813498 20687 consensus_queue.cc:1059] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 13:09:02.828156 21016 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:02.921916 13682 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:02.974974 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 53167us
I20260709 13:09:02.975754 20948 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:02.976166 20948 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:02.976512 20948 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:02.961261 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:02.978113 13682 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:09:02.873840 20807 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.940s	user 0.021s	sys 0.036s
I20260709 13:09:02.978756 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:02.894265 20921 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:02.863284 20892 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.891034 20761 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:02.960536 20916 consensus_meta.cc:287] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.000s
I20260709 13:09:02.918027 20790 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:02.920178 20612 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:02.962272 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:02.966954 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:02.968976 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:01.839587 13708 rpcz_store.cc:276] 0709 13:09:00.789553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.801177 (+ 11624us) service_pool.cc:224] Handling call
0709 13:09:00.823252 (+ 22075us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:01.038368 (+215116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.038420 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:01.039316 (+   896us) log.cc:844] Serialized 52 byte log entry
0709 13:09:01.623143 (+583827us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:01.688235 (+ 65092us) log.cc:844] Serialized 14 byte log entry
0709 13:09:01.688603 (+   368us) log.cc:844] Serialized 14 byte log entry
0709 13:09:01.688786 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.688879 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:01.793430 (+104551us) raft_consensus.cc:1685] finished
0709 13:09:01.793451 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.793583 (+   132us) inbound_call.cc:177] Queueing success response
0709 13:09:01.801687 (+  8104us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b18000c29e0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f36bc0a 00007f5238aab219 00007f5237407328 00007f52373fe901 00007f52373fe8a7 00007f52374f6288 00007f52374f5f37 00007f523750a55c 00007f523750a508
Metrics: {"mutex_wait_us":25030,"prepare.queue_time_us":183049,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":55020,"raft.run_cpu_time_us":2903,"raft.run_wall_time_us":148783,"spinlock_wait_cycles":30483200,"thread_start_us":518330,"threads_started":2,"wal-append.queue_time_us":604406}
I20260709 13:09:02.972203 13715 raft_consensus.cc:1275] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:09:02.979389 13859 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:09:02.911145 21025 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.925596 13861 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19. Ops: []
W20260709 13:09:02.981798 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 101777us
I20260709 13:09:02.986107 20936 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:02.980145 20807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.046s	user 0.021s	sys 0.036s
I20260709 13:09:02.866627 21018 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:02.991008 13783 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:03.033331 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:03.035006 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:02.873926 20911 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:02.992370 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:02.910979 20952 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:03.025700 13714 raft_consensus.cc:1240] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:03.026399 13682 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:09:02.994560 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 80588.5us
W20260709 13:09:02.980767 21031 log.cc:927] Time spent T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:09:02.879354 21020 consensus_queue.cc:1059] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.116s
I20260709 13:09:03.032037 14394 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:09:03.051728 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:03.052435 13861 raft_consensus.cc:2368] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20.
W20260709 13:09:03.052678 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 263182us
I20260709 13:09:03.035643 13857 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 13.
I20260709 13:09:03.036079 13856 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:09:02.921108 21022 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:02.923058 21033 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.044697 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:03.045387 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:03.047608 20961 consensus_queue.cc:1059] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:09:03.042783 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:02.990702 20950 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:02.920682 21002 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:03.059800 13707 raft_consensus.cc:2393] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 23: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:09:03.060784 13785 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:09:02.988683 20967 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.061887 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:02.920272 20841 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.026492 21016 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:03.077868 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:03.078506 13713 raft_consensus.cc:2376] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 31 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 31. Re-sending same reply.
I20260709 13:09:03.056838 21013 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:03.069875 13859 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 23.
I20260709 13:09:02.964426 20577 consensus_queue.cc:237] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:03.073222 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:03.052204 20952 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:03.074168 14366 leader_election.cc:400] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20.
I20260709 13:09:03.088404 14366 leader_election.cc:403] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:09:03.053447 13830 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:03.032378 21025 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:02.994752 20892 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.070367 20950 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:03.089138 14366 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:03.098459 14366 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:03.087599 13716 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 22.
I20260709 13:09:03.068672 21014 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:03.077344 20740 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:03.100594 14366 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:03.104805 13713 raft_consensus.cc:1275] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:09:03.105250 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:03.105614 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:03.106460 13713 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:09:03.106990 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:03.107712 13861 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 17: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:03.110641 13682 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:03.112088 13859 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:09:03.112205 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:03.088282 21017 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.113082 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:03.122004 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:03.123317 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:03.126505 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:03.127635 13714 raft_consensus.cc:1240] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:03.097417 20961 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:03.095830 20776 consensus_meta.cc:287] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.785s	user 0.012s	sys 0.000s
I20260709 13:09:03.119287 13682 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:03.129339 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:03.130306 13708 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 17: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:09:03.098532 20950 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:03.073290 21002 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:03.072381 21022 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.136479 14399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 1601) took 2393 ms. Trace:
W20260709 13:09:03.137769 21027 log.cc:927] Time spent T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:09:03.079377 20967 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:03.138072 20761 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:03.138680 20896 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:03.099466 20858 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:03.122390 20740 raft_consensus.cc:697] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:03.112900 20988 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:03.101503 21036 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:03.141216 13858 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19. Ops: []
W20260709 13:09:03.140673 13862 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 3234) took 2559 ms (client timeout 2400 ms). Trace:
I20260709 13:09:03.141940 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:03.168341 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:03.156055 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:09:03.219815 13862 rpcz_store.cc:269] 0709 13:09:00.581070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.583328 (+  2258us) service_pool.cc:224] Handling call
0709 13:09:03.140480 (+2557152us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400343d54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:03.140612 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2890582912}
I20260709 13:09:03.220350 13783 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:03.148967 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:03.112427 21029 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:03.221155 13708 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 25.
I20260709 13:09:03.221160 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:03.121644 21016 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:03.062804 21033 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:03.184954 14399 rpcz_store.cc:276] 0709 13:09:00.743004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.760434 (+1017430us) service_pool.cc:224] Handling call
0709 13:09:01.889218 (+128784us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.894284 (+  5066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.136297 (+1242013us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54008c41d0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:03.136421 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":295404288}
I20260709 13:09:03.209312 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:03.139401 20892 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:03.108938 20897 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:03.112965 21020 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:03.126822 21014 raft_consensus.cc:697] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:03.219364 20988 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:03.218782 20976 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:09:03.148162 20676 consensus_meta.cc:287] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.000s
I20260709 13:09:03.239590 21014 consensus_queue.cc:237] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.240721 13860 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
W20260709 13:09:03.187229 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.101737 20919 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:09:03.223845 14396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 2309) took 1392 ms (client timeout 1552 ms). Trace:
I20260709 13:09:03.239727 20347 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.222668 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:03.145267 20790 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:03.244235 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:09:03.244581 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.244594 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:09:03.243069 14396 rpcz_store.cc:269] 0709 13:09:01.831499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.141023 (+1309524us) service_pool.cc:224] Handling call
0709 13:09:03.223788 (+ 82765us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:03.245021 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:03.240221 20988 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:03.148303 20911 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:03.172605 20612 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:03.254438 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:03.254808 13791 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:09:03.219560 21036 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.255677 13859 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:09:03.256778 20740 consensus_queue.cc:237] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:03.257319 21030 log.cc:927] Time spent T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:09:03.257838 20936 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:03.258805 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:03.222142 20858 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:03.231835 20897 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.259498 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:03.273111 21033 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:03.275717 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:03.280373 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:03.291642 13862 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:03.139926 21017 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.309829 21017 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:03.286037 20807 raft_consensus.cc:3055] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:03.243296 20347 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.300247 20841 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:03.301911 21022 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:03.303580 20790 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:03.304126 20881 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.305395 21018 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:03.151549 20776 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.305585 13862 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
I20260709 13:09:03.264490 21036 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:03.312296 20858 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:03.312820 13713 raft_consensus.cc:2393] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 31: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:03.328526 20965 raft_consensus.cc:3055] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:03.268893 20921 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19.
I20260709 13:09:03.328950 20965 raft_consensus.cc:740] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:03.313344 20897 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:03.329885 20965 consensus_queue.cc:260] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.331010 20965 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:03.329818 20776 leader_election.cc:290] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:03.322376 20612 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:03.331986 20881 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:03.332316 20612 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.314608 13756 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:03.314798 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:03.278710 20952 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:03.317001 13783 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 23.
I20260709 13:09:03.249670 21020 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:03.164426 21015 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:03.313376 20996 log.cc:927] Time spent T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 1.331s	user 0.009s	sys 0.002s
I20260709 13:09:03.379802 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:03.324524 13757 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:09:03.384603 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 60156.7us
I20260709 13:09:03.325342 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:03.326987 20902 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:03.327596 13784 raft_consensus.cc:1240] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:03.327775 20347 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:03.328202 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:03.283957 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 2068) took 1180 ms. Trace:
I20260709 13:09:03.333395 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:03.335289 13791 raft_consensus.cc:2393] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 20: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:03.336386 13756 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:03.411696 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:09:03.334970 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 72053us
W20260709 13:09:03.418208 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.420126 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2818) took 1383 ms. Trace:
W20260709 13:09:03.424165 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.424523 13710 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:03.337762 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:03.234608 21029 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:03.318881 20807 raft_consensus.cc:740] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:03.349567 21020 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:03.390708 20887 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:03.391968 20612 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:03.392782 20552 consensus_meta.cc:287] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 1.027s	user 0.009s	sys 0.002s
I20260709 13:09:03.392414 21036 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:03.375936 21025 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.333745 20790 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.394290 21039 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.076s
W20260709 13:09:03.396241 13864 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 3237) took 2801 ms (client timeout 1565 ms). Trace:
W20260709 13:09:03.446375 13864 rpcz_store.cc:269] 0709 13:09:00.594577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.600087 (+  5510us) service_pool.cc:224] Handling call
0709 13:09:03.395986 (+2795899us) spinlock_profiling.cc:243] Waited 2.27 s on lock 0x7b540004b854. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:03.396161 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5230312320}
I20260709 13:09:03.447955 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:03.433246 20991 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:03.397981 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 26 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:03.451458 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:03.452499 13858 raft_consensus.cc:2410] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 26 because replica has last-logged OpId of term: 25 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 13:09:03.402356 21002 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:03.403558 20858 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:09:03.405712 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.425477 13785 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
W20260709 13:09:03.453696 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.424099 13782 rpcz_store.cc:276] 0709 13:09:02.037043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.037198 (+   155us) service_pool.cc:224] Handling call
0709 13:09:02.037514 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.275833 (+238319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.275877 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.275933 (+    56us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:02.275987 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.419919 (+1143932us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b540023b4d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:03.419965 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.420076 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":547523968}
I20260709 13:09:03.421648 14402 rpcz_store.cc:276] 0709 13:09:02.103341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.103534 (+   193us) service_pool.cc:224] Handling call
0709 13:09:02.115660 (+ 12126us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.412433 (+296773us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.412478 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.412535 (+    57us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:02.412602 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.283756 (+871154us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54006cf2d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:03.283798 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.283907 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":681929600}
I20260709 13:09:03.421509 13862 raft_consensus.cc:2393] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 15: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:09:03.423013 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 86692.1us
I20260709 13:09:03.456248 13756 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:03.441748 20961 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20.
I20260709 13:09:03.432112 14368 leader_election.cc:400] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20.
I20260709 13:09:03.458873 14368 leader_election.cc:403] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:09:03.458791 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:03.456264 13863 raft_consensus.cc:2393] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 19: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:03.459990 14368 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:03.417384 20976 consensus_queue.cc:1059] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 13:09:03.461781 13858 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:03.433578 13708 raft_consensus.cc:2393] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 31: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:03.462273 14368 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:03.436779 13861 raft_consensus.cc:2393] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 19: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:09:03.438477 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.418717 20992 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:03.430482 20687 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.449347 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:03.467958 13864 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:03.397778 20950 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.432832 21018 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.407397 20897 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.409775 13830 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:03.442328 20552 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 18. Current term is 19.
I20260709 13:09:03.409621 21028 consensus_queue.cc:1059] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
W20260709 13:09:03.474530 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 64805.2us
I20260709 13:09:03.338910 20881 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:03.418485 21016 consensus_queue.cc:1059] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:09:03.460271 13756 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:03.480818 13682 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:03.460938 13865 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:03.340255 20776 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.113s
I20260709 13:09:03.444532 20887 raft_consensus.cc:697] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 20 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:03.471287 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:03.471292 13858 raft_consensus.cc:2468] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 20.
I20260709 13:09:03.453719 20991 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:03.489537 20991 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:03.492164 20774 consensus_queue.cc:1059] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:03.493463 20986 raft_consensus.cc:3055] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:03.493803 20986 raft_consensus.cc:740] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:03.494647 13864 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:09:03.494524 20986 consensus_queue.cc:260] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:03.496572 21022 raft_consensus.cc:3055] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:09:03.497020 21022 raft_consensus.cc:740] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:03.497927 21022 consensus_queue.cc:260] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.500337 21029 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:03.500765 20919 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:03.501298 20919 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:03.502719 14402 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:09:03.443986 20916 consensus_queue.cc:1059] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:09:03.460304 20778 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:03.505960 13790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 1631) took 1123 ms. Trace:
I20260709 13:09:03.506265 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:03.506330 13790 rpcz_store.cc:276] 0709 13:09:02.382551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.429359 (+ 46808us) service_pool.cc:224] Handling call
0709 13:09:02.429657 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.581535 (+151878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.581566 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.581608 (+    42us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:02.581651 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.505767 (+924116us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b5400370d54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:03.505806 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.505909 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348865792}
I20260709 13:09:03.483502 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:03.507712 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:03.508291 14398 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:09:03.508374 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:03.509240 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:03.509438 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:03.509943 13862 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:09:03.510135 20952 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:03.460753 20347 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:09:03.510757 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:03.474267 21018 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.458184 20858 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:03.512727 20790 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:03.512945 21018 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:03.483338 21033 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:09:03.487341 21045 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.487500 21002 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:03.473091 20687 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.488962 20950 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:03.500794 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:03.471515 20992 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.408584 20924 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:09:03.466338 20612 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:09:03.462447 20921 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20.
I20260709 13:09:03.494678 21036 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:03.513857 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:03.536262 13862 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:09:03.537261 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:03.537459 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:03.537842 13862 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:09:03.472435 20892 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:09:03.472262 20961 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:03.539835 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:03.540021 20687 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:03.542053 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:03.544255 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:03.545464 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:03.545559 20784 consensus_queue.cc:260] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.546473 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:03.546729 20784 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:03.547145 13716 raft_consensus.cc:2393] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 20: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:09:03.538174 13715 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:03.550501 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:03.553105 20676 raft_consensus.cc:3055] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:09:03.553351 21047 log.cc:927] Time spent T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:09:03.553565 20676 raft_consensus.cc:740] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:03.554394 20946 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:09:03.555128 20807 consensus_queue.cc:260] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.556339 20807 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:03.557267 20897 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:03.558142 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:03.558712 14393 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:03.561738 20919 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.563681 20993 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:03.563776 21013 consensus_queue.cc:1059] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:09:03.543146 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:03.540373 13862 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:09:03.518460 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 55112.9us
I20260709 13:09:03.518306 13682 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:03.519994 13757 leader_election.cc:304] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:03.527770 21045 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.488909 21025 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:03.513875 21033 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:03.567098 13707 raft_consensus.cc:2368] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 22. Current term is 23.
I20260709 13:09:03.484045 21014 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:09:03.525170 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.506971 14394 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:09:03.527145 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:03.467774 20948 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.528373 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:03.528303 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:03.530663 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:03.533689 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:03.576220 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:09:03.523078 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 60882us
I20260709 13:09:03.575186 13857 raft_consensus.cc:1240] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
W20260709 13:09:03.569082 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 49143.6us
I20260709 13:09:03.569422 14393 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
I20260709 13:09:03.577863 13715 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 20.
I20260709 13:09:03.513913 20858 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:03.523787 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:03.584132 13858 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 19: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:03.579581 20993 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:03.586091 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:03.569654 21013 raft_consensus.cc:3055] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:03.609365 13830 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:03.609740 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:03.511660 20887 consensus_queue.cc:237] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:03.586591 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 68364.4us
I20260709 13:09:03.611363 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:03.612205 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:03.613009 13757 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:03.584383 13829 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:03.608793 14398 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:09:03.609441 14368 leader_election.cc:400] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20.
I20260709 13:09:03.617806 14402 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:09:03.574499 21043 log.cc:927] Time spent T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.317s	user 0.000s	sys 0.003s
I20260709 13:09:03.572590 21033 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:09:03.636762 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:03.670944 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 62015.1us
W20260709 13:09:03.639950 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.671757 14368 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:03.672508 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:03.673755 13707 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
W20260709 13:09:03.625007 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.675253 13682 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:03.674737 13830 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:09:03.676864 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 63897.8us
I20260709 13:09:03.572054 21045 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:03.553105 20992 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:03.678012 14368 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:03.676523 13682 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:09:03.678891 13714 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:09:03.665527 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 184450us
I20260709 13:09:03.679900 20955 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:09:03.688773 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.584250 20687 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.096s
I20260709 13:09:03.680563 20950 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:03.667186 21013 raft_consensus.cc:740] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:03.683676 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:03.684351 20919 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:03.684688 13715 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:09:03.610276 20952 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:03.685058 20832 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:09:03.689508 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 105201us
I20260709 13:09:03.690135 13708 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:03.690105 14368 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:03.690603 13756 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:03.691954 21036 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:03.703361 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:03.673584 21014 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:03.695447 13862 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 23.
I20260709 13:09:03.707341 13829 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:03.701500 13715 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:03.708002 13859 raft_consensus.cc:1240] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 22. Current term is 23. Ops: []
I20260709 13:09:03.694492 20878 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:03.676084 20858 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:03.705839 13756 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:03.720490 13756 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:03.695935 13863 raft_consensus.cc:1240] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:03.709146 13757 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:03.711230 13682 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:03.673023 20993 raft_consensus.cc:697] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:03.713654 14368 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:03.717855 13829 leader_election.cc:400] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 22. Current term is 23.
I20260709 13:09:03.606500 20740 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 13:09:03.554394 20676 consensus_queue.cc:260] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:03.804713 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 103017us
I20260709 13:09:03.797003 13829 leader_election.cc:403] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:03.699146 20911 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:03.666821 20841 consensus_queue.cc:1059] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 13:09:03.709830 20776 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:03.803854 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:03.830938 13862 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 23.
I20260709 13:09:03.699028 20950 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:03.689189 20955 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:03.806878 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 97805us
I20260709 13:09:03.699958 21045 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:09:03.809954 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:03.810616 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 97042.5us
I20260709 13:09:03.702425 20832 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:03.811360 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 90938.1us
I20260709 13:09:03.845494 14368 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:03.846966 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:03.673980 20988 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.848565 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:03.849215 13791 raft_consensus.cc:2410] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:09:03.850167 13791 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:03.851220 13783 raft_consensus.cc:1240] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:03.705541 21016 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:03.821193 13714 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 23.
W20260709 13:09:03.832912 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 115249us
I20260709 13:09:03.843955 13862 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:09:03.854202 13790 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:03.847591 13782 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:09:03.852819 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:03.721843 21014 raft_consensus.cc:697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 23 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:03.857583 21014 consensus_queue.cc:237] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.797410 20915 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:03.813333 20858 raft_consensus.cc:697] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 20 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:03.861022 20858 consensus_queue.cc:237] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.862738 20676 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:03.844874 21013 consensus_queue.cc:260] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:03.818019 20911 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.868606 20911 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:03.868732 21013 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:03.830040 20731 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:03.870595 20731 raft_consensus.cc:697] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 23 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:03.852674 20687 raft_consensus.cc:3055] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:09:03.871832 20687 raft_consensus.cc:740] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:03.871502 20731 consensus_queue.cc:237] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:03.872606 20687 consensus_queue.cc:260] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:03.873760 20687 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:03.853853 20955 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:03.876396 20965 consensus_meta.cc:287] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.002s
I20260709 13:09:03.853394 20832 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:03.830211 20347 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:03.884044 13708 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:03.885057 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:03.885811 13783 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 18: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:09:03.886452 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:03.886968 13790 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:03.888998 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:03.854808 13829 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:03.891754 13829 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:03.899802 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:03.810057 20924 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.830224 20878 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 13:09:03.907488 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:03.907454 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:03.913893 14401 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:03.907948 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:03.915171 13785 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:09:03.908731 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:03.916153 14394 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:03.916282 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:03.917112 14396 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:09:03.840371 20992 raft_consensus.cc:2804] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:03.910645 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:03.721649 20849 consensus_queue.cc:1059] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.131s
I20260709 13:09:03.830358 20976 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:03.913985 13786 raft_consensus.cc:2393] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 19: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:09:03.720073 21025 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.133s
I20260709 13:09:03.839663 21029 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 22. Current term is 23.
I20260709 13:09:03.908835 13829 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:03.843925 20950 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:03.924975 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 213767us
I20260709 13:09:03.853708 21016 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.927457 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:03.970969 14393 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 18: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:03.931396 13710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 3502) took 1058 ms. Trace:
I20260709 13:09:03.936787 13784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 1633) took 1553 ms. Trace:
I20260709 13:09:03.971827 13710 rpcz_store.cc:276] 0709 13:09:02.873251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.895692 (+ 22441us) service_pool.cc:224] Handling call
0709 13:09:02.896071 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.425080 (+529009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.931044 (+505964us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b54001c48d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:03.931320 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1214880128}
I20260709 13:09:03.971946 13784 rpcz_store.cc:276] 0709 13:09:02.383137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.431791 (+ 48654us) service_pool.cc:224] Handling call
0709 13:09:02.432140 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.427548 (+995408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.936490 (+508942us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b540033b154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:03.936713 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2058946816}
I20260709 13:09:03.853832 21045 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:03.946228 13862 raft_consensus.cc:1240] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 17. Current term is 18. Ops: []
W20260709 13:09:03.950740 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.901485 20896 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:03.957168 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:03.903949 20915 raft_consensus.cc:697] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 23 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:03.919682 20924 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:03.915834 21051 consensus_queue.cc:1059] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.197s
I20260709 13:09:03.964012 14366 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:03.906354 20897 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:09:03.966391 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 57663.9us
I20260709 13:09:03.907653 20935 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.958850 20909 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.919579 21036 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:03.984000 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:03.971040 20887 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.987654 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:04.034430 14393 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:09:04.034686 14396 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Advancing to term 23
W20260709 13:09:03.988888 21050 log.cc:927] Time spent T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 13:09:03.989672 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 458241us
I20260709 13:09:03.945071 20892 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:03.966969 20992 raft_consensus.cc:697] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 20 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:03.967218 20878 raft_consensus.cc:697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 31 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:09:03.999960 20991 consensus_meta.cc:287] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.000s
W20260709 13:09:04.062988 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 99104.1us
I20260709 13:09:04.064937 14366 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:04.069518 13755 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:03.994271 13859 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 12. (term mismatch)
I20260709 13:09:04.030834 13862 raft_consensus.cc:1240] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:04.036624 14401 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:09:04.070250 13859 pending_rounds.cc:85] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 11
I20260709 13:09:04.070555 13859 pending_rounds.cc:107] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 13:09:04.070804 13859 raft_consensus.cc:2889] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:04.071128 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:04.036942 14394 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:09:04.072077 13859 raft_consensus.cc:1275] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:09:04.072479 13859 pending_rounds.cc:85] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 10
I20260709 13:09:04.035889 13829 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:04.043919 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:04.028117 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.044345 13711 raft_consensus.cc:2410] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:09:03.979149 20840 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:03.975099 21016 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:04.034080 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:04.007570 13863 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19. Ops: []
W20260709 13:09:04.092236 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.080994 13755 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:04.083292 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:04.092941 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:04.096727 14401 raft_consensus.cc:1240] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:04.097072 14393 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:09:03.999264 13861 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:09:04.011821 21020 consensus_meta.cc:287] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.000s
I20260709 13:09:04.072690 13859 pending_rounds.cc:107] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:09:04.009511 20948 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:04.006376 20988 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:03.983134 21045 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:04.028967 20897 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.094619 14400 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:09:04.097922 14401 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:09:04.005000 21015 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:04.099689 20915 consensus_queue.cc:237] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:04.100993 21062 log.cc:927] Time spent T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:09:03.991334 20967 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:04.101806 20676 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:04.104684 14366 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:04.169245 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 64616.7us
I20260709 13:09:04.170212 14366 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:04.105295 20965 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:03.982664 20993 consensus_queue.cc:237] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.034080 21036 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.124316 14393 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:04.038939 20935 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:04.037875 20909 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.108611 20347 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:04.128328 14401 pending_rounds.cc:85] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 12
I20260709 13:09:04.177557 14401 pending_rounds.cc:107] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:09:04.177799 14401 raft_consensus.cc:2889] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:04.080492 20991 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.077659 20961 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:04.139658 20992 consensus_queue.cc:237] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.148002 20878 consensus_queue.cc:237] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 29.20, Last appended by leader: 20, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.110844 20832 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.160362 20897 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:04.063262 20892 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.112282 20881 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:04.091558 20896 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:04.048105 21029 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:09:04.172652 14396 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 23.
I20260709 13:09:04.063351 20887 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.061659 20955 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.114449 21051 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
W20260709 13:09:04.173347 20902 consensus_meta.cc:287] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.741s	user 0.011s	sys 0.001s
I20260709 13:09:04.113536 21016 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:04.176642 20911 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:04.237015 20935 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:04.238642 20911 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:04.239095 20832 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:04.242863 20991 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:04.244985 20909 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:04.245105 20881 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:04.245628 20881 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:04.175683 21036 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:04.253110 20952 consensus_meta.cc:287] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 13:09:04.253584 20952 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:04.257121 21045 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.247366 20892 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:04.259150 21036 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.265105 20881 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.116248 21020 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.171964 20965 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:09:04.225063 21033 consensus_meta.cc:287] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.001s
I20260709 13:09:04.279896 21033 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:04.282666 21033 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 26 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:04.181146 20988 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:04.283836 20965 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:04.212571 20961 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:04.290277 21020 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:04.291769 21016 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:04.293376 21036 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:04.293376 20955 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:04.294528 21045 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:04.333721 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:04.334759 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.334658 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 3513) took 1436 ms. Trace:
I20260709 13:09:04.335386 13711 rpcz_store.cc:276] 0709 13:09:02.898383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.967552 (+ 69169us) service_pool.cc:224] Handling call
0709 13:09:04.333991 (+1366439us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540012e154. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:04.334372 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2340784000}
I20260709 13:09:04.342643 13714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58552 (request call id 1768) took 1174 ms. Trace:
W20260709 13:09:04.345120 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 264111us
I20260709 13:09:04.344950 13714 rpcz_store.cc:276] 0709 13:09:03.167938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.168074 (+   136us) service_pool.cc:224] Handling call
0709 13:09:04.342156 (+1174082us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b54001c5cd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:04.342414 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1054655232}
W20260709 13:09:04.351547 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.358701 13784 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:09:04.360702 13784 raft_consensus.cc:606] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:04.099452 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:04.108803 13786 raft_consensus.cc:1240] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:04.374418 13787 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 20 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 20. Ops: []
I20260709 13:09:04.068626 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:09:04.375429 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.376235 13791 raft_consensus.cc:2368] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 22. Current term is 23.
I20260709 13:09:04.376370 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 1635) took 1971 ms. Trace:
I20260709 13:09:04.377070 13787 rpcz_store.cc:276] 0709 13:09:02.404929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.433555 (+ 28626us) service_pool.cc:224] Handling call
0709 13:09:04.373864 (+1940309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:04.374953 (+  1089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.376071 (+  1118us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b54000b2550. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:04.376274 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4461248384}
I20260709 13:09:04.371753 13784 raft_consensus.cc:614] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:03.967752 13790 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 21.
I20260709 13:09:04.372995 13788 raft_consensus.cc:1240] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
W20260709 13:09:04.373271 13789 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 2823) took 2149 ms (client timeout 2749 ms). Trace:
W20260709 13:09:04.386044 13789 rpcz_store.cc:269] 0709 13:09:02.224061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.227977 (+  3916us) service_pool.cc:224] Handling call
0709 13:09:04.372801 (+2144824us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b54000b2554. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:04.373051 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1189206784}
I20260709 13:09:04.078780 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:09:04.391194 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 312360us
I20260709 13:09:04.116951 13859 raft_consensus.cc:2889] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:04.400501 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:04.404055 13857 raft_consensus.cc:1240] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 19. Current term is 20. Ops: []
W20260709 13:09:04.406227 13860 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 3262) took 3660 ms (client timeout 2081 ms). Trace:
W20260709 13:09:04.406797 13860 rpcz_store.cc:269] 0709 13:09:00.745798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.684500 (+938702us) service_pool.cc:224] Handling call
0709 13:09:04.405831 (+2721331us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54003dccd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:04.406044 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3402048384}
I20260709 13:09:04.408620 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3970) took 1198 ms. Trace:
I20260709 13:09:04.409053 13857 rpcz_store.cc:276] 0709 13:09:03.209840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.695668 (+485828us) service_pool.cc:224] Handling call
0709 13:09:03.695899 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:04.405740 (+709841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.408258 (+  2518us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b54001accd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:04.408532 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1627216640}
I20260709 13:09:04.409618 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:04.410434 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:04.410913 13788 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 20: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:04.411682 13789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:09:04.412425 13789 raft_consensus.cc:606] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:04.412853 13789 raft_consensus.cc:614] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:04.413952 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1771) took 1419 ms. Trace:
I20260709 13:09:04.414013 13680 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:04.414515 13865 rpcz_store.cc:276] 0709 13:09:02.994421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.994540 (+   119us) service_pool.cc:224] Handling call
0709 13:09:03.025843 (+ 31303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.483072 (+457229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.413447 (+930375us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b54000d16d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:04.413743 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":994280320}
I20260709 13:09:04.415333 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:04.403244 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.417313 13680 leader_election.cc:400] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 22. Current term is 23.
I20260709 13:09:04.422329 13680 leader_election.cc:403] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:09:04.428664 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:04.429205 14394 raft_consensus.cc:1240] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:04.429464 14393 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:09:04.429772 13856 raft_consensus.cc:2368] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 22. Current term is 23.
I20260709 13:09:04.431751 21037 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:04.432981 20776 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:04.433661 14395 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:09:04.434106 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:04.433812 20776 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.435175 13715 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:09:04.436599 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:04.437254 20807 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.437515 13713 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:04.438444 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 3273) took 1328 ms. Trace:
I20260709 13:09:04.438140 20807 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.440232 20832 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.436823 20787 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:04.431061 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:04.431262 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:04.438874 13864 rpcz_store.cc:276] 0709 13:09:03.109753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.630813 (+521060us) service_pool.cc:224] Handling call
0709 13:09:03.631209 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:03.667432 (+ 36223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.667479 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:03.668047 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 13:09:03.902886 (+234839us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:04.398417 (+495531us) log.cc:844] Serialized 14 byte log entry
0709 13:09:04.399005 (+   588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.399174 (+   169us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:04.399281 (+   107us) raft_consensus.cc:1685] finished
0709 13:09:04.399295 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:04.438230 (+ 38935us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59779,"prepare.queue_time_us":324787,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":41108,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":19023,"thread_start_us":522363,"threads_started":2,"wal-append.queue_time_us":296378}
I20260709 13:09:04.446866 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:04.447114 13860 raft_consensus.cc:1240] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:04.447589 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:04.448693 13716 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 20: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:09:04.451022 20909 raft_consensus.cc:2764] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:09:04.451700 20687 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.453948 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:04.455031 20924 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:04.458961 20784 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:04.436856 20676 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:04.472769 20676 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.472805 20464 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:04.473421 20676 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:04.473938 20464 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.475615 20832 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.476953 20993 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:04.477662 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 24 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:04.477778 20993 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:04.478726 20832 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:04.478960 13861 raft_consensus.cc:2410] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 24 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:09:04.480029 14397 raft_consensus.cc:2393] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 14: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:04.480855 13865 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:09:04.482015 20993 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:04.482286 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:04.482057 20464 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:04.483649 20687 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.471218 13863 raft_consensus.cc:2410] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 19 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:09:04.179922 20347 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:09:04.468880 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 119582us
I20260709 13:09:04.484105 13714 raft_consensus.cc:2393] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 20: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:09:04.485275 13865 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 20: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:04.459585 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:04.470898 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:04.486970 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:04.488111 20347 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:04.496017 20731 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.003s	sys 0.002s
W20260709 13:09:04.496548 20731 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.003s	sys 0.002s
I20260709 13:09:04.245012 20887 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:04.503787 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:09:04.506843 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 89911.1us
W20260709 13:09:04.515043 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 47794.5us
I20260709 13:09:04.515656 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:04.519634 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:04.522769 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:04.459616 20952 consensus_queue.cc:1059] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:09:04.501075 13707 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:09:04.532017 13713 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 26.
I20260709 13:09:04.526259 20976 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 22. Current term is 23.
I20260709 13:09:04.526531 20731 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:09:04.530802 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:04.531057 14401 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:04.537096 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:04.538129 13709 raft_consensus.cc:2410] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:09:04.538863 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:04.539885 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:04.533299 13863 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 20: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:04.540503 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:04.540014 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:04.541666 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:04.542554 21026 raft_consensus.cc:3055] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:04.543017 21026 raft_consensus.cc:740] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:04.543212 20776 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:04.530885 13861 raft_consensus.cc:2393] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 20: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:04.541852 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:04.548079 14396 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
I20260709 13:09:04.549012 14396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac"
dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:40042
I20260709 13:09:04.549062 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:04.551776 20687 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:04.552443 13716 raft_consensus.cc:2410] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 19 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 13:09:04.552611 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:04.553532 13714 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
I20260709 13:09:04.554180 14396 raft_consensus.cc:606] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 19 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
W20260709 13:09:04.550467 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 380246us
I20260709 13:09:04.532701 20909 consensus_queue.cc:1059] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.024s
I20260709 13:09:04.558197 20919 raft_consensus.cc:3055] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:04.558708 20919 raft_consensus.cc:740] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:04.550850 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 3962) took 1401 ms. Trace:
I20260709 13:09:04.551126 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:04.560492 14394 raft_consensus.cc:1275] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:04.555908 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:04.561741 14367 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:04.559401 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.542742 13710 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 20: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:09:04.549907 20881 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:04.561851 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:04.567664 20731 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.595602 21069 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 13:09:04.595304 20774 consensus_queue.cc:1059] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:04.598662 20887 raft_consensus.cc:3055] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:04.599116 20887 raft_consensus.cc:740] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:04.600162 20887 consensus_queue.cc:260] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:04.601657 20887 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:04.602941 13712 raft_consensus.cc:2468] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:09:04.605691 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:04.608047 13713 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:09:04.541723 21022 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:04.617653 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:04.618260 13784 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:09:04.608412 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:04.624203 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:04.623721 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:04.559654 13858 rpcz_store.cc:276] 0709 13:09:03.149712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.622141 (+472429us) service_pool.cc:224] Handling call
0709 13:09:03.622431 (+   290us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:03.667054 (+ 44623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.667085 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:03.667772 (+   687us) log.cc:844] Serialized 52 byte log entry
0709 13:09:03.926898 (+259126us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:03.997302 (+ 70404us) spinlock_profiling.cc:243] Waited 9.51 ms on lock 0x7b4800061158. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5237407aa1 00007f52373feb37 00007f52373fe9ca 00007f52374f626f 00007f52374f5f37 00007f523750a55c 00007f523750a508 00007f523750a488 00007f523750a443 00007f52375096ec 00007f5236433a96
0709 13:09:04.402858 (+405556us) log.cc:844] Serialized 14 byte log entry
0709 13:09:04.403397 (+   539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.403551 (+   154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:04.548969 (+145418us) spinlock_profiling.cc:243] Waited 8.07 ms on lock 0x7b24001f4a98. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f2779c4 00007f522f275acb 00007f522f430dc9 00007f522f430a55 00007f522f42ffb0 00007f52320a6488 00007f52320a6be8 00007f523207e398 00007f523207976a 00007f5232078bb6
0709 13:09:04.550536 (+  1567us) raft_consensus.cc:1685] finished
0709 13:09:04.550557 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:04.550694 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99107,"prepare.queue_time_us":316544,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":90955,"raft.run_cpu_time_us":10159,"raft.run_wall_time_us":324851,"spinlock_wait_cycles":40421888,"thread_start_us":634753,"threads_started":2,"wal-append.queue_time_us":315895}
I20260709 13:09:04.633551 20897 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.638661 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:04.616772 20731 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.639923 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:04.640309 20986 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:04.642107 20731 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:04.644209 13710 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 19: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:09:04.645843 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 84392.8us
I20260709 13:09:04.647833 14367 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:04.648944 21069 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:04.649633 14367 leader_election.cc:400] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 22. Current term is 23.
I20260709 13:09:04.649968 14367 leader_election.cc:403] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:04.651124 20909 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:04.652525 13830 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:04.655720 21029 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:04.656116 21029 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.656481 21029 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:04.656749 21014 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:04.657248 20965 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.660355 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:04.661098 13860 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:09:04.661947 13682 leader_election.cc:400] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 22. Current term is 23.
I20260709 13:09:04.662142 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:04.662398 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:04.664080 14401 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
W20260709 13:09:04.681020 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 58696.8us
I20260709 13:09:04.687909 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:04.689682 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:04.692047 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.694614 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:04.694656 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:04.701488 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:04.692636 20952 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 13:09:04.706094 14401 raft_consensus.cc:2393] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 20: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:04.708688 20888 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.709299 20888 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:04.710126 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:04.710923 13859 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:09:04.711618 20965 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:04.713235 13783 raft_consensus.cc:1275] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:09:04.713572 13783 pending_rounds.cc:85] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 11
I20260709 13:09:04.713804 13783 pending_rounds.cc:107] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:09:04.714573 21045 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 22. Current term is 23.
I20260709 13:09:04.715343 21013 raft_consensus.cc:3055] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:04.715866 21013 raft_consensus.cc:740] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:09:04.716874 20950 consensus_meta.cc:287] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.725s	user 0.013s	sys 0.000s
I20260709 13:09:04.717356 20950 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.720541 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:04.721125 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:04.721282 14401 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:04.704373 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:04.724129 13710 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 20.
I20260709 13:09:04.722325 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:04.716362 20347 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.714057 13783 raft_consensus.cc:2889] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:04.731825 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:04.732525 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:04.733196 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:04.733880 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:04.734493 14400 raft_consensus.cc:1240] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 19. Current term is 20. Ops: [19.17-19.17]
I20260709 13:09:04.734544 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:04.739941 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:04.740655 13790 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 21.
W20260709 13:09:04.742928 20840 consensus_meta.cc:287] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.629s	user 0.002s	sys 0.016s
I20260709 13:09:04.743367 20840 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:09:04.744058 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:04.744251 13857 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 26 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 25. Current term is 26. Ops: []
I20260709 13:09:04.744793 13785 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:04.745064 13711 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:04.748921 20676 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.749898 13757 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:04.752357 20998 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:04.753298 14398 raft_consensus.cc:1240] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:04.753923 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:04.756479 13755 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:04.757607 13790 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:09:04.759142 21075 log.cc:927] Time spent T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:09:04.728588 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:04.768906 14401 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
W20260709 13:09:04.773093 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 46742us
I20260709 13:09:04.774775 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:04.776832 20807 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:04.778985 20347 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:04.779855 21077 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:09:04.780239 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 74569.5us
I20260709 13:09:04.790141 21069 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:04.781041 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 79643.8us
I20260709 13:09:04.781152 20902 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:04.784651 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:04.785589 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:04.701155 20948 consensus_queue.cc:1059] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:09:04.797241 20948 raft_consensus.cc:3055] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:04.797639 20948 raft_consensus.cc:740] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:04.798454 14368 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:04.798698 20948 consensus_queue.cc:260] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:04.787676 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49488 (request call id 3500) took 1918 ms. Trace:
I20260709 13:09:04.798489 21020 consensus_queue.cc:1059] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:09:04.799785 20785 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:04.800385 20785 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.796533 20998 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:04.800479 21051 raft_consensus.cc:2764] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:09:04.799494 20992 consensus_queue.cc:1059] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 13:09:04.787618 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:04.800616 21020 raft_consensus.cc:3055] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:04.802157 21020 raft_consensus.cc:740] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:04.802292 13680 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:04.802752 20992 raft_consensus.cc:3055] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:04.802845 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:04.803339 20992 raft_consensus.cc:740] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:09:04.772146 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 122603us
I20260709 13:09:04.788664 20577 raft_consensus.cc:3055] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:04.803989 20577 raft_consensus.cc:740] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:04.800856 20785 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:04.806574 20992 consensus_queue.cc:260] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.807253 20577 consensus_queue.cc:260] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:04.808133 20992 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:04.808416 20577 raft_consensus.cc:3060] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:04.811590 20976 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:04.811429 20961 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:04.812057 20976 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.812534 20976 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:04.799716 13712 rpcz_store.cc:276] 0709 13:09:02.868765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.868968 (+   203us) service_pool.cc:224] Handling call
0709 13:09:04.787494 (+1918526us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b540034d0d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:04.787623 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3627825536}
I20260709 13:09:04.814254 14367 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:04.814718 20948 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:04.780524 21072 log.cc:927] Time spent T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.501s	user 0.003s	sys 0.000s
I20260709 13:09:04.815683 20897 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:04.795463 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 45610.9us
I20260709 13:09:04.796025 20965 consensus_queue.cc:1059] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:09:04.796494 13708 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 23.
I20260709 13:09:04.801493 20998 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.789402 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:04.790262 13716 raft_consensus.cc:1275] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:09:04.819762 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.831048 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:04.834757 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:04.831899 13830 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:04.835810 13712 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 20: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:09:04.800987 20950 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:04.766776 20888 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:04.839144 13865 raft_consensus.cc:2393] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 18: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:04.850389 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 24 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:09:04.851279 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.851643 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:04.852397 13860 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:09:04.852581 13789 raft_consensus.cc:2410] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:09:04.854738 13859 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:09:04.836207 20998 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:04.855949 13711 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 20.
I20260709 13:09:04.856688 13714 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:09:04.859735 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:04.860684 13863 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 26 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 25. Current term is 26. Ops: []
I20260709 13:09:04.803309 21020 consensus_queue.cc:260] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:04.861653 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 59540.4us
I20260709 13:09:04.862210 21020 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:04.862658 13785 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:09:04.875370 20807 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:04.875730 13680 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:04.878263 13680 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:09:04.883327 13783 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:09:04.884006 13783 raft_consensus.cc:606] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 31 LEADER]: Received request to transfer leadership to TS b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:04.885571 20988 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.886039 20988 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:04.890146 20952 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:04.890304 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:09:04.891983 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 46565.7us
W20260709 13:09:04.894659 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:04.895669 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 121811us
I20260709 13:09:04.816461 20897 consensus_queue.cc:1059] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:09:04.893615 13757 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:04.897816 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:04.907840 13830 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:04.921988 13709 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 26 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 25. Current term is 26. Ops: [23.12-25.13]
I20260709 13:09:04.905445 20909 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:04.926477 20909 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.926854 20909 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:04.929302 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:04.930145 13785 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 20: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:04.935565 21064 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:04.935859 14366 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:04.938437 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:04.939929 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:04.940721 14367 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:04.941089 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:04.920086 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:09:04.863291 21051 consensus_queue.cc:1175] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b9d194f45e044e0988d5de1a99e5cd02" responder_term: 18 status { last_received { term: 17 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 17 index: 12 } }
I20260709 13:09:04.901664 21045 consensus_queue.cc:1059] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.055s
I20260709 13:09:04.946923 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:04.945073 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 66891.4us
I20260709 13:09:04.953397 13787 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d07097a615d345468e43de064c67057d"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:09:04.984720 13787 raft_consensus.cc:606] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:09:04.962469 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:04.942883 14396 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:09:04.942483 14367 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:04.947569 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:09:04.943070 13829 connection.cc:256] RPC call timeout handler was delayed by -2.0739462970000204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
I20260709 13:09:04.915354 20840 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.993422 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:04.994082 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:09:04.997102 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 100512us
I20260709 13:09:04.952050 20841 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:05.001695 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:04.919292 20986 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:04.944698 20950 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:04.953366 20965 consensus_queue.cc:1059] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 13:09:04.921077 20887 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.086s
I20260709 13:09:05.007951 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 2329) took 1485 ms. Trace:
I20260709 13:09:04.948613 20676 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:05.011700 13829 connection.cc:256] RPC call timeout handler was delayed by -1.9460705170000665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
I20260709 13:09:05.011950 14402 raft_consensus.cc:1240] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14. Ops: []
W20260709 13:09:05.012876 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 70522.1us
I20260709 13:09:04.956565 20347 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.014142 20552 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:05.019682 20841 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:05.042188 20841 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:05.014253 20952 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:04.896728 20687 consensus_queue.cc:1059] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 13:09:05.026432 20986 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.044569 20986 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:05.044809 20687 raft_consensus.cc:3055] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:05.045250 20687 raft_consensus.cc:740] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:05.046207 20687 consensus_queue.cc:260] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.015743 13756 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:05.048669 13756 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:05.016674 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 2075) took 1126 ms. Trace:
I20260709 13:09:05.048906 20998 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.049647 20965 raft_consensus.cc:3055] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:05.049861 20881 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:05.050173 20965 raft_consensus.cc:740] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:05.051868 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:05.052058 20991 consensus_queue.cc:1059] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 25.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:05.053292 20991 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:05.054977 20887 raft_consensus.cc:3055] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:09:05.055397 20887 raft_consensus.cc:740] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:05.055869 13862 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:09:05.018890 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:05.007256 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:05.056438 20887 consensus_queue.cc:260] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:05.021543 14393 raft_consensus.cc:2410] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:09:04.952725 20902 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:05.011005 13863 raft_consensus.cc:1240] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:09:05.030566 13786 raft_consensus.cc:2393] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 14: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:05.033607 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:05.013473 20897 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:04.927103 20785 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.030279 14397 rpcz_store.cc:276] 0709 13:09:03.522820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.524281 (+  1461us) service_pool.cc:224] Handling call
0709 13:09:05.007726 (+1483445us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b5400147654. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:05.007878 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1915109632}
I20260709 13:09:05.038955 20858 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:09:05.039503 13784 raft_consensus.cc:1240] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:09:05.039384 20840 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.041293 14367 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:09:05.043851 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:05.017931 20988 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.014256 13680 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:05.057031 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:05.063819 13755 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:05.060773 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:05.065799 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:09:05.116436 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 52732.1us
I20260709 13:09:05.072517 13707 raft_consensus.cc:1240] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:09:05.072540 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:05.072760 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:05.118616 14396 raft_consensus.cc:2410] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:09:05.111110 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:05.117535 13755 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:05.122407 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:05.068332 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3406) took 1001 ms. Trace:
I20260709 13:09:05.049643 14398 rpcz_store.cc:276] 0709 13:09:03.889916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.890016 (+   100us) service_pool.cc:224] Handling call
0709 13:09:03.890343 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:04.770471 (+880128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.016371 (+245900us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b54004c18d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:05.016598 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1919665024}
I20260709 13:09:05.075194 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:05.124639 13791 raft_consensus.cc:2393] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 20: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:05.061569 13856 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:09:05.120710 14400 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 20: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:05.122943 13863 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:05.127205 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:05.115131 20687 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:05.130278 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 78192.7us
I20260709 13:09:05.067926 20998 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:05.132556 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:05.028853 20888 consensus_queue.cc:1059] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.100s
I20260709 13:09:05.128598 20731 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:05.135664 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 121479us
I20260709 13:09:05.072341 20976 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:05.139256 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 90746.3us
I20260709 13:09:05.141855 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:05.142573 14397 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:09:05.142787 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:05.122949 13782 rpcz_store.cc:276] 0709 13:09:04.066349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.066453 (+   104us) service_pool.cc:224] Handling call
0709 13:09:04.066743 (+   290us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:04.348026 (+281283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:04.348098 (+    72us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:04.349380 (+  1282us) log.cc:844] Serialized 52 byte log entry
0709 13:09:04.468768 (+119388us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:04.808511 (+339743us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b18004360c0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f52320864bc 00007f522f3d448b 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3ee455 00007f5235ed63c7 00007f52324e89a7 00007f52324f80bf
0709 13:09:04.808649 (+   138us) log.cc:844] Serialized 14 byte log entry
0709 13:09:04.832787 (+ 24138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.067910 (+235123us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54000b2f54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:05.067956 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:05.067996 (+    40us) raft_consensus.cc:1685] finished
0709 13:09:05.068005 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.068173 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39973,"prepare.queue_time_us":227526,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":3359,"raft.queue_time_us":114393,"raft.run_cpu_time_us":393,"raft.run_wall_time_us":2864,"spinlock_wait_cycles":646834432,"thread_start_us":206525,"threads_started":2,"wal-append.queue_time_us":261483}
I20260709 13:09:05.145622 13711 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 22.
I20260709 13:09:05.078502 20347 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.129211 20858 raft_consensus.cc:697] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 26 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:05.141783 13783 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:09:05.078601 21029 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.086211 21026 consensus_queue.cc:260] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.147351 20897 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.132361 20902 raft_consensus.cc:697] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 21 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:05.149399 13829 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:05.149677 13858 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:09:05.150249 21001 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:05.151976 13710 raft_consensus.cc:1240] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:09:05.059804 21013 consensus_queue.cc:260] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.166800 14397 raft_consensus.cc:1240] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15. Ops: [13.11-14.12]
I20260709 13:09:05.164968 14398 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:09:05.171448 20936 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 13:09:05.171895 20976 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:05.175570 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.176214 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.152249 20992 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:05.177142 13857 raft_consensus.cc:1240] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:09:05.183907 14394 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 19. Current term is 20. Ops: []
W20260709 13:09:05.186400 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 145216us
I20260709 13:09:05.167178 20887 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:09:05.196533 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 54976.4us
I20260709 13:09:05.175922 21001 raft_consensus.cc:697] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:05.198000 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:05.198966 14397 raft_consensus.cc:2393] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 20: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:05.195991 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:05.180317 20992 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:05.194233 20952 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.206979 20902 consensus_queue.cc:237] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.189548 20976 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:09:05.208432 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:05.196408 21013 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:05.178539 20897 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.209693 13756 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:05.177197 20909 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:05.211043 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:05.191450 20676 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:05.215204 20858 consensus_queue.cc:237] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:05.185678 20936 consensus_queue.cc:1059] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.031s
I20260709 13:09:05.216472 20785 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:05.183831 21026 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:05.180292 21064 consensus_queue.cc:1059] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:09:05.239856 21064 raft_consensus.cc:3055] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:05.240227 21064 raft_consensus.cc:740] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:05.241022 21064 consensus_queue.cc:260] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.242488 21064 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:05.243453 20661 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:09:05.244367 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 95101.2us
I20260709 13:09:05.249255 20897 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:05.218994 20841 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.231703 20840 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:05.236574 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:05.330473 14397 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:05.237313 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:05.330642 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 105706us
W20260709 13:09:05.251832 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 65663.7us
I20260709 13:09:05.289177 14398 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:09:05.331955 13680 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:05.252492 20919 consensus_queue.cc:260] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.258339 13863 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
W20260709 13:09:05.264171 14395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 2321) took 2605 ms (client timeout 2115 ms). Trace:
I20260709 13:09:05.264496 21029 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:05.265368 20988 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:05.266248 20915 raft_consensus.cc:3055] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:05.268132 21033 consensus_queue.cc:1059] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:05.268810 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:05.273340 20909 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:05.276115 20965 consensus_queue.cc:260] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.276302 21001 consensus_queue.cc:237] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.228343 13714 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
W20260709 13:09:05.230377 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.346329 13713 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
W20260709 13:09:05.281086 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.348325 13757 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:05.285766 20347 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:05.221503 20992 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:05.289906 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.320760 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.252264 20952 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:05.334164 14395 rpcz_store.cc:269] 0709 13:09:02.658447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.658628 (+   181us) service_pool.cc:224] Handling call
0709 13:09:05.263881 (+2605253us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b54004c2554. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:05.264047 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4079055744}
W20260709 13:09:05.306748 20774 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.028s	sys 0.028s
I20260709 13:09:05.339468 14367 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:05.335362 13782 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:09:05.330072 20881 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:05.356037 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:05.365332 14394 raft_consensus.cc:2410] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:09:05.351112 20919 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:05.396992 20785 raft_consensus.cc:3055] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:05.397437 20785 raft_consensus.cc:740] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:05.398342 20785 consensus_queue.cc:260] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.399945 20840 raft_consensus.cc:3055] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:05.400348 20840 raft_consensus.cc:740] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:05.401255 20840 consensus_queue.cc:260] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:05.402539 20840 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:05.404517 20841 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:05.338653 20915 raft_consensus.cc:740] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:05.405872 20915 consensus_queue.cc:260] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.406796 20888 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:09:05.407366 20915 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:05.411856 20998 consensus_queue.cc:1059] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:09:05.412770 20998 raft_consensus.cc:3055] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:05.413069 20998 raft_consensus.cc:740] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:05.413951 20998 consensus_queue.cc:260] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:05.415527 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 205964us
I20260709 13:09:05.416265 13756 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:05.417622 13756 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:05.418498 21019 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:05.421110 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 152444us
I20260709 13:09:05.363965 20965 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:05.429536 20952 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:05.430517 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:05.366707 20934 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:05.353291 20740 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:05.369313 21029 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:05.431898 21029 raft_consensus.cc:697] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 20 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:05.431855 20740 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.433094 21029 consensus_queue.cc:237] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.435856 20934 raft_consensus.cc:697] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:05.437148 20934 consensus_queue.cc:237] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.372550 13711 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:09:05.374892 21051 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:05.377131 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.377843 20849 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:05.379532 13786 raft_consensus.cc:1275] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:05.452003 13715 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:05.379956 14367 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:09:05.423233 13829 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:05.380170 13755 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:05.355660 20986 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:05.380963 13782 raft_consensus.cc:1240] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:05.382272 20776 raft_consensus.cc:3055] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:09:05.383554 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.391683 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:05.404595 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 2074) took 1515 ms. Trace:
I20260709 13:09:05.454739 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:05.430713 20785 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:05.431173 14395 raft_consensus.cc:2376] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19. Re-sending same reply.
W20260709 13:09:05.364949 20774 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.028s	sys 0.029s
I20260709 13:09:05.358186 20687 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.364406 13783 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:09:05.435024 20740 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:05.345633 20552 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:05.415210 20998 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:05.462898 13756 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:05.458415 14402 rpcz_store.cc:276] 0709 13:09:03.889647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.889756 (+   109us) service_pool.cc:224] Handling call
0709 13:09:05.011597 (+1121841us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:05.056700 (+ 45103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.404389 (+347689us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400147650. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:05.404538 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2504940800}
I20260709 13:09:05.464038 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:05.459896 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:05.462175 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 82088.1us
I20260709 13:09:05.505430 13755 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:05.500707 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:09:05.502302 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 44583.3us
I20260709 13:09:05.507802 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:05.508901 14398 raft_consensus.cc:2393] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 18: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:05.504438 13859 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:09:05.510751 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:05.457574 20776 raft_consensus.cc:740] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:05.513754 14368 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:05.513643 13829 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:05.467975 20881 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:05.526645 14397 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:09:05.470886 20731 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:05.544507 13682 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:05.508167 21051 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:05.547729 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:05.547025 14402 raft_consensus.cc:1240] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 20 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: []
W20260709 13:09:05.547639 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 170740us
W20260709 13:09:05.556527 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.558516 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.560196 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:05.561555 21097 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.562216 21097 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.564950 21051 raft_consensus.cc:697] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 20 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:05.566184 21051 consensus_queue.cc:237] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:05.568015 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.568485 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.569252 21045 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.569821 21045 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.532478 20740 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.580874 14396 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:09:05.504180 20687 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.577337 14398 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:09:05.582602 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:05.547140 20347 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:05.584173 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:05.587620 13708 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:09:05.584443 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:09:05.585632 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 80314us
I20260709 13:09:05.590993 13755 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:05.558936 20991 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:05.556275 20988 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:05.574103 20887 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:05.598357 14397 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:09:05.577965 20552 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:05.605247 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:05.607523 21017 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:05.607779 13713 raft_consensus.cc:1240] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:09:05.607969 20896 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:09:05.613263 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 99604.3us
W20260709 13:09:05.617405 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 103880us
I20260709 13:09:05.621603 13829 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:05.618918 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 175307us
I20260709 13:09:05.625787 13712 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:09:05.627597 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:05.628358 13864 raft_consensus.cc:2393] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 19: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:05.630206 14402 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:09:05.631203 14396 raft_consensus.cc:1240] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:09:05.601747 20887 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.601419 20881 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:05.638518 20967 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:05.638806 20881 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.614230 20552 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.635947 14368 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:05.593900 20776 consensus_queue.cc:260] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:05.637708 13829 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:05.637766 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:05.617468 20740 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.639086 20934 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:05.660794 13711 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:09:05.652124 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:05.663030 13680 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:05.615139 20986 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:05.639279 20881 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:05.633986 21036 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:09:05.677482 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.681293 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 43667.2us
I20260709 13:09:05.681994 13829 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:05.723376 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 62331.8us
I20260709 13:09:05.643765 20887 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:05.727079 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:05.727321 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:05.728739 13711 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:09:05.724059 13859 raft_consensus.cc:1275] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:09:05.713467 14367 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:05.659090 20687 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:05.639506 21097 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:05.673110 20552 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:05.738235 13858 raft_consensus.cc:2393] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 18: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:05.679946 20849 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:05.675215 20967 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:05.652549 20773 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.745246 13783 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e689999f416446c9bf87d759da2844ae"
dest_uuid: "35ecb005831740438d7537dd4b840e03"
mode: GRACEFUL
new_leader_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:54782
W20260709 13:09:05.756250 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 74322.8us
I20260709 13:09:05.756351 13783 raft_consensus.cc:606] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 23 LEADER]: Received request to transfer leadership to TS b5029654a4384e43a68eb67b794949b7
I20260709 13:09:05.757262 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:05.711179 20807 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:05.750973 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:05.651674 20896 consensus_queue.cc:1059] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.087s
I20260709 13:09:05.745875 13857 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:09:05.759436 13791 raft_consensus.cc:2368] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 20. Current term is 21.
I20260709 13:09:05.633622 21017 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.683522 20841 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:09:05.676280 21029 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.068s
I20260709 13:09:05.738499 21019 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:05.775910 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 62538.9us
I20260709 13:09:05.683827 21036 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:05.751935 20849 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.713788 20915 consensus_queue.cc:1059] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:09:05.682860 20934 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.717644 20965 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:09:05.778998 13829 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:05.773823 13858 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 26.
I20260709 13:09:05.752599 21001 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.740685 20909 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:05.777477 13680 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:05.759811 20807 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.787672 21036 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:05.777045 20902 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.779857 20919 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:05.798123 13682 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:05.752884 21013 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.035s
I20260709 13:09:05.774943 21045 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:05.831573 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:05.830896 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 150456us
I20260709 13:09:05.793403 20849 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:05.781967 20952 consensus_queue.cc:1059] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:09:05.800055 20807 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:05.806584 20950 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.846825 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 1625) took 1062 ms. Trace:
W20260709 13:09:05.848860 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 71466.2us
I20260709 13:09:05.830653 20986 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.787715 20773 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:05.833636 20858 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:05.831382 21022 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:09:05.855017 13680 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:05.834360 20976 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:05.804000 20988 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:09:05.797356 21019 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.872450 20740 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:05.873091 20740 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:05.873564 20740 raft_consensus.cc:697] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:05.874414 20740 consensus_queue.cc:237] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:05.876031 21112 log.cc:927] Time spent T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:09:05.862794 21022 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.879844 21022 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:09:05.881006 21109 log.cc:927] Time spent T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.233s	user 0.003s	sys 0.000s
I20260709 13:09:05.882339 21017 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:05.883309 21110 log.cc:927] Time spent T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:09:05.884702 21103 log.cc:927] Time spent T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:09:05.884562 13680 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:05.885916 21097 consensus_queue.cc:1048] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:09:05.888520 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 55381.6us
I20260709 13:09:05.889315 13756 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:05.889752 21019 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:05.890669 21019 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:05.891013 21019 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.849866 14393 rpcz_store.cc:276] 0709 13:09:04.784564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.244402 (+459838us) service_pool.cc:224] Handling call
0709 13:09:05.244778 (+   376us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:05.245280 (+   502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:05.245307 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:05.246048 (+   741us) log.cc:844] Serialized 52 byte log entry
0709 13:09:05.573478 (+327430us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:05.733579 (+160101us) log.cc:844] Serialized 14 byte log entry
0709 13:09:05.846535 (+112956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.846603 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:05.846644 (+    41us) raft_consensus.cc:1685] finished
0709 13:09:05.846655 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.846772 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66439,"prepare.queue_time_us":35628,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":100531,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":3371,"spinlock_wait_cycles":35918080,"thread_start_us":519042,"threads_started":3,"wal-append.queue_time_us":388172}
W20260709 13:09:05.891438 21064 consensus_meta.cc:287] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.649s	user 0.010s	sys 0.003s
I20260709 13:09:05.895524 21064 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:05.891391 21019 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:09:05.897432 21101 log.cc:927] Time spent T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:09:05.832369 20902 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.854395 20909 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.893817 13680 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:05.902428 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 145445us
I20260709 13:09:05.902631 14399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 2339) took 1257 ms. Trace:
I20260709 13:09:05.860812 20858 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:05.859788 20986 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:05.831485 21001 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.916733 13829 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:05.891031 13756 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:05.924552 13757 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.926693 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.938328 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:05.861613 20950 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.942627 13680 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:05.946514 20773 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:05.947553 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:09:05.931658 20858 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:05.912093 14399 rpcz_store.cc:276] 0709 13:09:04.645156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.142290 (+497134us) service_pool.cc:224] Handling call
0709 13:09:05.142561 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:05.168035 (+ 25474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:05.168080 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:05.179960 (+ 11880us) log.cc:844] Serialized 26 byte log entry
0709 13:09:05.586672 (+406712us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:05.586711 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.586768 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:05.896808 (+310040us) spinlock_profiling.cc:243] Waited 7.18 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:09:05.900328 (+  3520us) raft_consensus.cc:1685] finished
0709 13:09:05.900348 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.902568 (+  2220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":3084,"spinlock_wait_cycles":16520960,"thread_start_us":398902,"threads_started":1,"wal-append.queue_time_us":503080}
I20260709 13:09:05.952618 13857 raft_consensus.cc:3055] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:05.953107 13857 raft_consensus.cc:740] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:05.954028 13857 consensus_queue.cc:260] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.955044 13857 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:05.954737 21036 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.933202 20909 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.989272 20909 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:05.960868 20986 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:05.915390 21064 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:05.962560 21001 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:05.962836 20976 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:05.966688 20967 raft_consensus.cc:3055] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:05.947077 20934 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:05.952710 20965 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:09:05.972616 14395 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:09:05.979542 20773 consensus_queue.cc:1059] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:05.981350 13680 leader_election.cc:400] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 20. Current term is 21.
I20260709 13:09:06.021050 13680 leader_election.cc:403] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:09:05.969813 13830 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:09:06.021973 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 52216.9us
W20260709 13:09:05.991027 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.991933 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:06.010941 20998 consensus_meta.cc:287] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.000s
I20260709 13:09:05.993239 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:05.994663 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:05.991016 14396 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 26.
W20260709 13:09:06.001988 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 111072us
I20260709 13:09:06.003360 13864 raft_consensus.cc:1240] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:05.913408 20992 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:05.977887 21013 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:09:05.992686 21111 log.cc:927] Time spent T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:05.990938 21029 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:06.023761 14393 raft_consensus.cc:2410] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:09:05.992667 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:05.951272 20887 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:06.025053 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 113244us
I20260709 13:09:06.029027 13756 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:06.027493 13786 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:09:06.033144 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:06.088958 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.012452 20774 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:05.983439 20687 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:09:06.011430 20967 raft_consensus.cc:740] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:06.038527 13783 raft_consensus.cc:2393] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 22: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:06.031706 21064 raft_consensus.cc:3055] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:09:06.079945 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 98739.7us
I20260709 13:09:06.078846 13829 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:06.053259 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.982867 21017 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 13:09:06.092510 13787 raft_consensus.cc:2410] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:09:06.026837 20909 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:06.031250 21013 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:06.090523 14394 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
W20260709 13:09:06.124785 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 45999.7us
I20260709 13:09:06.128285 14399 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:09:06.132177 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:06.132889 14398 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:09:06.095314 20976 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:06.107030 20347 consensus_meta.cc:287] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.513s	user 0.012s	sys 0.004s
I20260709 13:09:06.139683 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:06.143227 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.144954 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:06.105598 21064 raft_consensus.cc:740] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:06.145988 14399 raft_consensus.cc:2410] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 21 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:09:06.146667 14401 raft_consensus.cc:2393] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 17: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:09:06.146579 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 117645us
I20260709 13:09:06.148413 14393 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 31 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 29 index: 20. Preceding OpId from leader: term: 31 index: 21. (index mismatch)
I20260709 13:09:06.148702 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:06.124485 21013 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:06.146559 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 123776us
I20260709 13:09:06.144272 20347 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:06.151458 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:06.134109 20661 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.161158 14402 raft_consensus.cc:3060] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:06.160615 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 61478.5us
I20260709 13:09:06.120034 20881 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:06.140556 20840 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:06.136830 20909 raft_consensus.cc:697] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 19 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:06.183454 13756 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:06.173432 14402 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
I20260709 13:09:06.150117 20965 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:09:06.174263 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.174362 20948 raft_consensus.cc:3055] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:06.198060 20731 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:06.198150 20948 raft_consensus.cc:740] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:06.199242 20948 consensus_queue.cc:260] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:06.175669 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:06.259509 21129 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:06.259867 20909 consensus_queue.cc:237] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:06.261040 21127 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.261694 21127 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:06.192983 20661 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:06.264853 21019 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:06.266362 21130 log.cc:927] Time spent T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:09:06.266961 20661 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:06.268409 21125 log.cc:927] Time spent T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:09:06.269078 21019 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:06.272194 20858 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:06.274230 20858 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:06.275791 20902 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:06.276916 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:06.290841 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 107515us
W20260709 13:09:06.300773 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 212380us
W20260709 13:09:06.314725 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 174845us
I20260709 13:09:06.323210 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:06.324312 13782 raft_consensus.cc:2393] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 19: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:06.325192 20950 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:06.325796 20881 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:06.327009 21131 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:09:06.327687 21137 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.328163 21137 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:06.328526 20807 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:06.330122 21137 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:06.330565 20992 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:09:06.334821 20552 consensus_meta.cc:287] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.585s	user 0.006s	sys 0.004s
I20260709 13:09:06.336028 20887 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:06.246335 20965 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:06.338382 20965 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:06.338157 21022 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:06.356174 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:06.337862 20849 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:06.294236 21036 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:06.341318 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:06.186851 20967 consensus_queue.cc:260] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:06.355237 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:06.361138 13782 raft_consensus.cc:2393] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 18: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:06.357004 13860 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:09:06.362147 13857 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:09:06.364171 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:06.364938 13865 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:09:06.365268 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:06.366008 13783 raft_consensus.cc:2393] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 19: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:06.367280 13785 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 26 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:09:06.365278 13787 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:06.314258 21064 consensus_queue.cc:260] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:06.368468 21064 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:06.369590 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:06.370402 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:06.371104 13785 raft_consensus.cc:2393] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 24: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:06.359540 21029 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:06.360347 13859 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 26.
I20260709 13:09:06.371896 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:06.371992 21029 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:06.372519 13783 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:06.373658 20849 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:06.374352 21029 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:06.375427 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 54379.3us
I20260709 13:09:06.380786 14368 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:09:06.387722 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:06.391026 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.390851 14368 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:06.424644 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:06.393956 14368 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:06.426230 14401 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:09:06.412539 14398 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:06.336036 21127 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:06.429720 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:06.429529 14399 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:09:06.430675 14399 pending_rounds.cc:85] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 14
I20260709 13:09:06.430989 14399 pending_rounds.cc:107] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:09:06.431298 14399 raft_consensus.cc:2889] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:06.431005 14402 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 21 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:06.433353 14402 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:09:06.434754 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:06.488368 13783 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:09:06.488794 14395 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:06.489959 14394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 2098) took 1135 ms. Trace:
I20260709 13:09:06.437704 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:06.440313 20991 raft_consensus.cc:993] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03: : Instructing follower b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:09:06.442239 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:06.442934 14393 raft_consensus.cc:1240] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:06.335285 20552 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:06.500869 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:06.411814 20976 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 20. Current term is 21.
I20260709 13:09:06.447139 13784 raft_consensus.cc:1240] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:06.447687 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:06.449865 20887 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.450930 13756 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:06.451040 21139 log.cc:927] Time spent T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.183s	user 0.004s	sys 0.004s
I20260709 13:09:06.427421 20897 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:09:06.471159 21105 log.cc:927] Time spent T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.723s	user 0.008s	sys 0.007s
I20260709 13:09:06.435395 20950 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:06.461824 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:06.457788 20807 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:06.432245 20965 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 13:09:06.458410 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.456610 21022 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 27 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:06.473276 13680 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:09:06.469233 21133 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.192s	user 0.000s	sys 0.009s
I20260709 13:09:06.462531 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:06.474645 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:06.502136 21029 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.478037 20902 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.470988 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:06.457255 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.465471 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:06.464789 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:06.486579 13858 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 21. Current term is 22. Ops: []
W20260709 13:09:06.539278 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 66064.1us
I20260709 13:09:06.491868 13860 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:09:06.540884 13865 raft_consensus.cc:2410] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:09:06.541198 14399 raft_consensus.cc:1240] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:06.506587 14395 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:09:06.494925 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:06.542382 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:06.503587 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:06.523061 13829 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:06.529138 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 78314.7us
I20260709 13:09:06.536502 13862 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:06.475669 21122 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:09:06.533479 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:06.546303 14402 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:06.480188 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:06.547902 13714 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 27: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:09:06.490435 14394 rpcz_store.cc:276] 0709 13:09:05.354138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.464804 (+110666us) service_pool.cc:224] Handling call
0709 13:09:06.489802 (+1024998us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54005145d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:06.489904 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1338664320}
I20260709 13:09:06.471261 21013 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:06.549644 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:06.549994 13710 raft_consensus.cc:2368] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 20. Current term is 21.
I20260709 13:09:06.526177 21019 raft_consensus.cc:1081] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Signalling peer b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:09:06.521343 20897 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.550354 13861 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:09:06.524113 20858 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.527540 20965 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.527755 20992 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.525913 20950 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:06.530517 20936 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:06.554025 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:06.551283 20740 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:06.556377 13612 catalog_manager.cc:5697] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 13 to 14, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 14 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:06.581343 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:06.584682 13860 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:06.585384 13708 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:06.590150 13858 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:09:06.579068 13756 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:06.545027 20577 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:06.526049 20887 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:06.539053 20976 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.557138 21137 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:06.600255 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:06.578328 20897 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:06.603757 13864 raft_consensus.cc:3055] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:06.613692 13864 raft_consensus.cc:740] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:06.590314 20950 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:06.571336 21129 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.581184 20965 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:06.556892 20902 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:06.606539 20881 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:06.611389 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:06.611512 13861 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:06.628844 13786 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:06.610246 13755 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:06.603960 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:06.629593 13785 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
W20260709 13:09:06.615659 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.630653 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:06.631392 13863 raft_consensus.cc:2393] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 18: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:06.615329 20976 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:06.570580 21029 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:06.608255 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:06.570818 21128 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.553129 20840 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:06.593530 20740 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.635316 13755 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:06.618381 13864 consensus_queue.cc:260] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:06.590476 20992 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:06.701313 13864 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:06.591281 20858 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:06.694618 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:06.695042 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:09:06.695925 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 145980us
W20260709 13:09:06.613332 21051 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.012s	sys 0.021s
I20260709 13:09:06.703176 13756 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:06.699877 21128 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:06.704241 21122 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.704834 21122 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:06.706552 20998 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:06.706964 20998 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:06.707335 20998 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:06.707978 21122 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:06.711609 20731 consensus_queue.cc:1048] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:09:06.714838 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 84156.6us
W20260709 13:09:06.718788 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 166532us
I20260709 13:09:06.720047 13829 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:06.721055 13858 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:06.721304 13756 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:06.724172 14402 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:09:06.613610 20577 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:06.713716 21051 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.013s	sys 0.028s
W20260709 13:09:06.762542 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 127330us
I20260709 13:09:06.719646 13716 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:09:06.776969 13755 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:09:06.779137 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.713699 20740 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:06.701507 21097 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.628418 21129 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:06.795867 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 75262.5us
I20260709 13:09:06.714524 20841 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.694159 21124 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:06.741925 21033 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.803440 13789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3426) took 1059 ms. Trace:
W20260709 13:09:06.809556 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 89575.7us
W20260709 13:09:06.796116 21107 log.cc:927] Time spent T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:09:06.804531 21102 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:09:06.795944 20731 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:06.815191 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:06.796267 20881 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:06.770241 20807 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:06.828928 20807 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:06.831303 21051 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.831888 21051 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:06.809217 21124 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.834342 21051 leader_election.cc:290] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:06.834657 21124 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:06.809537 13789 rpcz_store.cc:276] 0709 13:09:05.744265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.744426 (+   161us) service_pool.cc:224] Handling call
0709 13:09:05.772641 (+ 28215us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:06.014014 (+241373us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:09:06.037704 (+ 23690us) log.cc:844] Serialized 14 byte log entry
0709 13:09:06.191869 (+154165us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:06.273283 (+ 81414us) log.cc:844] Serialized 52 byte log entry
0709 13:09:06.273448 (+   165us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:06.273485 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.450426 (+176941us) spinlock_profiling.cc:243] Waited 34.4 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:09:06.528417 (+ 77991us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b540033b654. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:06.528495 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:06.803188 (+274693us) raft_consensus.cc:1685] finished
0709 13:09:06.803214 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:06.803362 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52874,"prepare.queue_time_us":15931,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":4645,"raft.queue_time_us":51060,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":12409,"spinlock_wait_cycles":516383872,"thread_start_us":64688,"threads_started":1,"wal-append.queue_time_us":162205}
I20260709 13:09:06.816512 13682 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:09:06.813575 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 179638us
I20260709 13:09:06.803574 21122 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:06.840627 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:06.840971 13682 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:06.841372 13863 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:06.831099 20807 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:06.841959 13682 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:09:06.847915 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.818854 20552 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:06.852850 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 131649us
I20260709 13:09:06.810491 21097 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:06.862946 14366 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:06.835903 20881 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:06.830947 21128 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:06.813102 20841 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:06.846652 20919 raft_consensus.cc:3055] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:06.848856 21014 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:06.816488 21033 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:06.849165 20849 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:09:06.878005 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.852119 21064 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:06.890278 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:06.890607 21097 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:06.891642 13787 raft_consensus.cc:1240] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:09:06.892107 13785 raft_consensus.cc:1240] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:06.893309 13790 raft_consensus.cc:1240] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:06.894012 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:06.875430 20881 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:06.896313 20858 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:06.917479 13784 raft_consensus.cc:2393] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 18: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:06.849013 21136 consensus_queue.cc:1059] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
W20260709 13:09:06.913349 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 136456us
I20260709 13:09:06.902472 21033 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:06.858862 20774 raft_consensus.cc:2804] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:06.914820 13863 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:09:06.916553 13858 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
I20260709 13:09:06.849731 21122 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:06.900203 20992 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:06.886099 21014 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.912810 21064 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.852344 21053 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.060s
I20260709 13:09:06.887470 20849 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.940873 13862 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:09:06.879738 20919 raft_consensus.cc:740] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:09:06.934885 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 46381.2us
W20260709 13:09:06.949839 13831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.977162 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:06.948292 21014 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:06.980796 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:06.982394 13710 raft_consensus.cc:2393] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 19: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:06.952893 21064 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:06.956190 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:09:06.956848 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 108697us
W20260709 13:09:06.961951 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.985838 13785 raft_consensus.cc:2393] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 14: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:06.932411 20858 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:06.958582 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:06.913291 20888 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.945194 20887 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:06.953275 21164 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:06.989058 13715 raft_consensus.cc:1275] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 31 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 29 index: 20. Preceding OpId from leader: term: 31 index: 21. (index mismatch)
W20260709 13:09:07.005103 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 194692us
I20260709 13:09:06.989358 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:06.958505 20849 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:07.033209 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:07.033818 13784 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:06.995910 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:07.035168 13709 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:09:06.996177 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:06.995950 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:07.036616 13707 raft_consensus.cc:2410] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
W20260709 13:09:06.977881 21146 log.cc:927] Time spent T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 13:09:06.997300 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:06.971597 20976 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:06.979343 20948 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:06.999684 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 81185.6us
I20260709 13:09:06.971277 21029 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:09:06.989502 21147 log.cc:927] Time spent T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 13:09:07.005940 20888 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:06.994118 20577 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:07.045059 13716 raft_consensus.cc:2393] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 19: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:07.046164 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:07.046422 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:07.062141 13715 raft_consensus.cc:3060] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:07.005162 20902 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:07.053969 13710 pending_rounds.cc:85] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02: Aborting all ops after (but not including) 12
W20260709 13:09:07.066164 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 60340.7us
I20260709 13:09:07.066398 13710 pending_rounds.cc:107] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 13:09:07.066700 13710 raft_consensus.cc:2889] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:07.065079 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:07.067360 13709 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 26.
I20260709 13:09:07.033113 21136 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.034109 21033 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:07.073396 13786 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:09:07.076016 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:07.076654 13716 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:09:07.050431 20774 raft_consensus.cc:697] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:09:07.060602 21145 log.cc:927] Time spent T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 13:09:07.096127 13709 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:09:07.104014 13713 raft_consensus.cc:2468] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
I20260709 13:09:07.108429 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:07.109418 13716 raft_consensus.cc:2393] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 19: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:09:07.112727 20888 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:07.115525 21142 log.cc:927] Time spent T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 13:09:07.063053 20976 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:07.120754 21173 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.121268 21173 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.123805 20936 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.123935 21122 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:07.124289 20936 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.124854 20774 consensus_queue.cc:237] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.126343 20936 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:07.129069 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.074829 21129 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:07.119867 20976 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:07.137190 20976 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:07.123358 21173 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:07.147740 21137 consensus_meta.cc:287] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.529s	user 0.001s	sys 0.007s
I20260709 13:09:07.148234 21137 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:07.117799 20950 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.150738 20950 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:07.067705 20919 consensus_queue.cc:260] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.152452 20919 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:07.162576 13711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58552 (request call id 1812) took 1245 ms. Trace:
I20260709 13:09:07.163153 13711 rpcz_store.cc:276] 0709 13:09:05.916894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.917080 (+   186us) service_pool.cc:224] Handling call
0709 13:09:05.917488 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:05.932433 (+ 14945us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:05.932470 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:05.942419 (+  9949us) log.cc:844] Serialized 26 byte log entry
0709 13:09:06.178005 (+235586us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b18003183a0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e0d1 00007f5232499a0f
0709 13:09:06.485736 (+307731us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:06.485785 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.485869 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:07.162167 (+676298us) raft_consensus.cc:1685] finished
0709 13:09:07.162196 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.162481 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14453,"raft.queue_time_us":15207,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":8007,"spinlock_wait_cycles":37304064,"thread_start_us":307478,"threads_started":1,"wal-append.queue_time_us":656195}
I20260709 13:09:07.167769 20998 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:07.088155 21136 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.034665 20858 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.173489 20858 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:07.187816 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 120960us
I20260709 13:09:07.188977 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:07.190538 13829 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:07.192579 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3429) took 1188 ms. Trace:
I20260709 13:09:07.193101 13791 rpcz_store.cc:276] 0709 13:09:06.004241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.004462 (+   221us) service_pool.cc:224] Handling call
0709 13:09:06.021016 (+ 16554us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:06.040005 (+ 18989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:06.079538 (+ 39533us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:06.120352 (+ 40814us) log.cc:844] Serialized 52 byte log entry
0709 13:09:06.489412 (+369060us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:06.489451 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.491696 (+  2245us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:07.192284 (+700588us) raft_consensus.cc:1685] finished
0709 13:09:07.192312 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.192505 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27011,"raft.queue_time_us":6275,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":41876,"thread_start_us":338962,"threads_started":1,"wal-append.queue_time_us":501133}
I20260709 13:09:07.203186 21137 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.203946 21137 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.207890 13756 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:07.208896 21173 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:07.209417 13756 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:07.210399 21173 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:07.210770 21173 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:07.211110 21173 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:07.211648 21159 log.cc:927] Time spent T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 13:09:07.213063 20841 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:07.214013 20887 consensus_queue.cc:1048] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 13:09:07.214655 21164 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:07.215484 21164 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:07.220003 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:07.225427 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:07.226002 13713 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
I20260709 13:09:07.226469 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:07.228636 13756 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:07.230785 13756 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:07.259619 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
W20260709 13:09:07.259227 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 417144us
I20260709 13:09:07.260262 13713 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:07.262259 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:07.263739 13709 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
I20260709 13:09:07.254954 13756 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:07.267503 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:09:07.267808 13861 consensus_meta.cc:287] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.634s	user 0.011s	sys 0.000s
I20260709 13:09:07.277958 13861 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 27.
W20260709 13:09:07.268586 13864 consensus_meta.cc:287] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.002s
I20260709 13:09:07.270638 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:07.258383 21172 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.252728 21166 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:07.252413 20887 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:09:07.273741 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 2353) took 1142 ms. Trace:
I20260709 13:09:07.281090 14397 rpcz_store.cc:276] 0709 13:09:06.131077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.138641 (+  7564us) service_pool.cc:224] Handling call
0709 13:09:06.153267 (+ 14626us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:06.153576 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:06.153604 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:06.180694 (+ 27090us) log.cc:844] Serialized 26 byte log entry
0709 13:09:06.504640 (+323946us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:06.756259 (+251619us) log.cc:844] Serialized 14 byte log entry
0709 13:09:06.756632 (+   373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.756761 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:07.273542 (+516781us) raft_consensus.cc:1685] finished
0709 13:09:07.273561 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.273690 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17733,"prepare.queue_time_us":306654,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":537,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":18460,"thread_start_us":406470,"threads_started":2,"wal-append.queue_time_us":405706}
I20260709 13:09:07.285880 13864 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:09:07.274055 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.273788 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 83352.9us
I20260709 13:09:07.275725 13713 raft_consensus.cc:2468] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 23.
I20260709 13:09:07.276238 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:07.207393 21137 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:07.286767 13715 raft_consensus.cc:2468] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
I20260709 13:09:07.271971 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:07.304162 20849 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:07.306401 20849 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:07.284075 21175 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:09:07.307129 21175 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:07.307883 20897 consensus_meta.cc:287] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.681s	user 0.001s	sys 0.009s
I20260709 13:09:07.308625 21175 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:07.308403 20897 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.309196 21128 raft_consensus.cc:3055] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:07.309634 21128 raft_consensus.cc:740] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:07.310400 20897 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:07.310953 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:07.311573 13711 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 20.
I20260709 13:09:07.312110 21173 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.313908 21014 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:07.314261 21173 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:07.314704 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:07.332475 13711 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:09:07.315712 13784 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:09:07.326776 20881 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.309646 21124 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.318220 21128 consensus_queue.cc:260] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:07.319792 13709 raft_consensus.cc:2393] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 21: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:07.335815 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:07.326376 21064 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:07.321405 13829 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:07.323169 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:07.343405 13713 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:09:07.325585 21175 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:07.285748 21172 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.326988 20887 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:07.329519 20740 consensus_meta.cc:287] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.000s
I20260709 13:09:07.326855 13756 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:07.286549 20998 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:07.334385 13830 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:07.359588 20998 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:07.359874 13830 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:07.360014 20998 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.360689 20998 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:07.360853 21178 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:07.320173 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:07.361332 21178 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.361685 21178 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:07.360699 20858 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:07.363864 20858 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:07.364230 20858 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:07.367681 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 46364.2us
I20260709 13:09:07.368701 13708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 3119) took 1205 ms. Trace:
I20260709 13:09:07.358016 20887 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.369251 13708 rpcz_store.cc:276] 0709 13:09:06.163645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.163753 (+   108us) service_pool.cc:224] Handling call
0709 13:09:06.192376 (+ 28623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:06.605813 (+413437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.368474 (+762661us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b540017a054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:07.368633 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":903292800}
I20260709 13:09:07.369834 13829 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:07.349445 21170 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:07.333571 20965 consensus_meta.cc:287] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.002s
I20260709 13:09:07.356739 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:07.354878 13791 raft_consensus.cc:2393] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 20: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:07.342269 13716 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 18: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:09:07.374912 13784 raft_consensus.cc:2393] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 20: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:07.368758 21124 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:07.358881 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 77383.9us
I20260709 13:09:07.360112 21172 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:07.375725 13756 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:07.376012 13829 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:07.376519 13756 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:07.373878 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:07.377483 13756 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:07.373104 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:07.380749 13789 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 20.
I20260709 13:09:07.384846 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:07.385471 13784 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:09:07.386873 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:07.387923 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:07.383049 21173 raft_consensus.cc:2804] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:07.389438 21173 raft_consensus.cc:697] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:07.389580 13789 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:09:07.390362 21173 consensus_queue.cc:237] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:07.389456 13787 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:09:07.381378 21166 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:09:07.391983 13680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.373806 21064 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:07.391978 21166 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.394536 21166 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:07.396096 21144 log.cc:927] Time spent T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.423s	user 0.003s	sys 0.000s
I20260709 13:09:07.397315 13856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1802) took 1217 ms. Trace:
I20260709 13:09:07.397639 13856 rpcz_store.cc:276] 0709 13:09:06.180308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.180794 (+   486us) service_pool.cc:224] Handling call
0709 13:09:06.192376 (+ 11582us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:06.263792 (+ 71416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:06.263822 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:06.264274 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:09:06.573139 (+308865us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:06.573181 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.573250 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:07.395597 (+822347us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:09:07.397039 (+  1442us) raft_consensus.cc:1685] finished
0709 13:09:07.397059 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.397260 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18736,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":7337216,"thread_start_us":308481,"threads_started":1,"wal-append.queue_time_us":615805}
I20260709 13:09:07.374321 20740 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.400417 13680 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:07.401439 20740 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:07.401957 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.402570 21166 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:07.379273 21128 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:07.407655 21165 raft_consensus.cc:2804] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:07.408185 21165 raft_consensus.cc:697] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 23 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:07.409040 21165 consensus_queue.cc:237] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:07.410111 13757 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:07.379681 20965 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.411767 13756 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:07.412395 21013 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:07.413623 14393 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 27: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:07.414638 13712 raft_consensus.cc:2393] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 20: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
W20260709 13:09:07.378620 20909 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.115s	user 0.011s	sys 0.010s
I20260709 13:09:07.371400 20887 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:07.423906 21181 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:07.425434 13829 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:07.443056 20965 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 27 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:07.443708 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:07.444473 21136 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:07.372669 20881 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:07.425776 20849 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:07.427095 21175 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 27 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:07.372195 21036 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:07.448076 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:07.428434 21162 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:07.448503 13757 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:07.448076 21175 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:09:07.436995 21123 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:07.451509 20967 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:07.438675 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.377803 21014 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:07.452340 21121 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:07.452919 21121 raft_consensus.cc:697] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:07.453958 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:07.453819 21121 consensus_queue.cc:237] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.446503 21019 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:07.454772 21019 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.455188 21019 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:07.457820 20776 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:07.427678 21179 consensus_queue.cc:1059] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:09:07.460247 21161 log.cc:927] Time spent T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.485s	user 0.002s	sys 0.000s
I20260709 13:09:07.460330 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:07.448231 21036 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:07.461879 21036 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:07.426206 20785 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.466171 20785 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.451767 21169 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:07.459298 21179 raft_consensus.cc:3055] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:07.433903 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:07.448745 13714 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:07.452597 21033 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:07.451197 21175 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:07.469460 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:07.491708 13715 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
W20260709 13:09:07.500949 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 527845us
I20260709 13:09:07.501713 14366 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:07.463251 21019 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.510944 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:07.512753 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:07.516110 13790 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:09:07.516618 13791 raft_consensus.cc:1240] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:07.483357 20849 raft_consensus.cc:697] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:07.529270 20849 consensus_queue.cc:237] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.532483 21166 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:07.533104 21169 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:07.535183 21127 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:07.512593 21122 consensus_queue.cc:1059] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:09:07.540254 21127 raft_consensus.cc:3055] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:07.540616 21127 raft_consensus.cc:740] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:07.540473 21178 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:07.541445 21127 consensus_queue.cc:260] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.542564 21178 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:07.468345 21179 raft_consensus.cc:740] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:07.525275 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 2121) took 1046 ms. Trace:
I20260709 13:09:07.543457 14393 rpcz_store.cc:276] 0709 13:09:06.478458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.494610 (+ 16152us) service_pool.cc:224] Handling call
0709 13:09:07.525091 (+1030481us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b54005942d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:07.525218 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2001808128}
I20260709 13:09:07.526911 20887 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:07.528018 20347 raft_consensus.cc:993] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: : Instructing follower b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:09:07.545406 20347 raft_consensus.cc:1081] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 23 LEADER]: Signalling peer b5029654a4384e43a68eb67b794949b7 to start an election
I20260709 13:09:07.545650 21179 consensus_queue.cc:260] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.546859 21179 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:07.542568 21127 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:07.468830 21156 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:07.559479 20807 consensus_queue.cc:1059] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:09:07.560317 20807 raft_consensus.cc:3055] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:09:07.509109 20902 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.550091 13782 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:09:07.562904 14366 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:09:07.571295 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.573004 14366 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:07.574066 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 32 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:07.575757 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:07.577729 13715 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 27: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:09:07.407316 20998 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.553956 13709 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:09:07.580320 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:07.467396 20858 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:07.439567 20909 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.176s	user 0.012s	sys 0.010s
I20260709 13:09:07.562848 20902 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.579664 13829 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:07.580658 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:07.580993 13858 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:09:07.579655 13756 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:07.558131 13714 raft_consensus.cc:2468] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 27.
I20260709 13:09:07.609927 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:07.608815 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:07.611538 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:07.587641 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:07.612200 13712 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:07.603442 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:07.615737 13756 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:07.616081 13715 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:09:07.618647 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 3435) took 1037 ms. Trace:
I20260709 13:09:07.618719 13829 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:07.619375 13782 rpcz_store.cc:276] 0709 13:09:06.580926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.581093 (+   167us) service_pool.cc:224] Handling call
0709 13:09:07.618435 (+1037342us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b5400205654. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:07.618575 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2198729088}
I20260709 13:09:07.625970 13716 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 26. Current term is 27. Ops: []
I20260709 13:09:07.609701 13864 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
I20260709 13:09:07.629138 13714 raft_consensus.cc:1240] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 22. Current term is 23. Ops: []
I20260709 13:09:07.581338 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:07.630685 13709 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:07.625267 13756 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:07.634723 13789 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 20. Current term is 21. Ops: []
W20260709 13:09:07.637004 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 64102us
I20260709 13:09:07.637583 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:07.641080 20919 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:07.641824 20919 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.632380 21029 consensus_queue.cc:1059] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:09:07.643754 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:07.633459 20840 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:07.644390 21029 raft_consensus.cc:3055] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:07.644752 21029 raft_consensus.cc:740] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:07.645728 20919 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:07.645533 21029 consensus_queue.cc:260] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.636456 21165 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:07.623929 20887 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:07.647389 13865 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e689999f416446c9bf87d759da2844ae"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:59780
I20260709 13:09:07.648000 13865 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:07.648368 13865 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:07.650480 13788 raft_consensus.cc:1240] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 27 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 26. Current term is 27. Ops: [26.14-26.14]
I20260709 13:09:07.653666 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:07.646854 21029 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:07.657886 13860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d07097a615d345468e43de064c67057d"
dest_uuid: "b5029654a4384e43a68eb67b794949b7"
 from {username='slave'} at 127.0.0.1:59780
I20260709 13:09:07.661877 13612 catalog_manager.cc:5697] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 11 to 14, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 14 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:07.663703 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:07.579864 20773 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.611302 20992 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:07.705204 13782 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:09:07.666677 13865 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:07.667682 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:07.726316 13785 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:07.668444 21019 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:07.668166 21036 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.639765 20915 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:07.608438 21122 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:07.670090 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 47297.5us
I20260709 13:09:07.638988 14366 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:09:07.670830 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 45648.2us
I20260709 13:09:07.671701 13712 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
I20260709 13:09:07.672053 13858 raft_consensus.cc:1240] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:09:07.560657 20807 raft_consensus.cc:740] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:07.674410 13860 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:07.674443 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:09:07.666790 13610 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57116 (request call id 257) took 13280 ms (client timeout 15000 ms). Trace:
I20260709 13:09:07.875526 13860 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:07.877055 13756 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:07.709283 13829 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:07.718452 14393 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:09:07.719666 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:07.878093 13785 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:09:07.624882 21051 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.719081 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:07.879606 14399 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:07.729548 13709 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 20.
I20260709 13:09:07.733588 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:07.734511 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:07.882620 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:07.883180 13709 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:07.889880 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:07.890472 13858 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:07.890588 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:07.892560 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 253658us
I20260709 13:09:07.894281 13789 raft_consensus.cc:2368] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 17. Current term is 18.
I20260709 13:09:07.897092 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:07.901687 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:07.902719 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:07.902904 13865 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:07.903283 14402 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:07.773700 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:07.776065 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:07.904423 13864 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:07.904847 14397 raft_consensus.cc:2393] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 20: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:07.776168 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:07.905563 14401 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:07.777016 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:07.906229 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:07.715474 21175 raft_consensus.cc:2804] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:09:07.673826 21165 raft_consensus.cc:697] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:07.705029 20785 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:07.926671 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 32 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:07.928910 21036 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:07.722610 20887 raft_consensus.cc:697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 20 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:07.930073 20887 consensus_queue.cc:237] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.722536 21162 consensus_queue.cc:1059] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:09:07.932240 21162 raft_consensus.cc:3055] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:09:07.932438 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:07.932621 21162 raft_consensus.cc:740] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:07.933459 21162 consensus_queue.cc:260] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 26.14, Last appended by leader: 14, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:07.934605 21162 raft_consensus.cc:3060] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:09:07.938306 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:07.927268 14397 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 31.
I20260709 13:09:07.938922 13783 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:07.889015 21181 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:07.732070 20773 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.732542 20897 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.703657 20840 consensus_queue.cc:1059] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.124s
I20260709 13:09:07.723378 13682 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:07.943943 13864 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
W20260709 13:09:07.953751 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 230434us
I20260709 13:09:07.905963 21127 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:07.954602 13682 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:07.955006 21127 raft_consensus.cc:697] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:07.870996 13715 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:09:07.640556 21134 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:07.956020 21127 consensus_queue.cc:237] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.871697 13857 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:09:07.956651 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:07.957266 13865 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:09:07.957317 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:07.902436 21167 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:07.878387 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 169180us
I20260709 13:09:07.903180 14366 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:07.906792 13785 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:07.906252 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:07.960088 13712 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:07.901777 14393 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:09:07.906361 14396 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:09:07.906708 13856 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
I20260709 13:09:07.912923 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:07.962536 13789 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:07.919760 13612 catalog_manager.cc:5697] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 17 to 20, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 20 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:07.921051 20807 consensus_queue.cc:260] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.882375 21097 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.924201 21165 consensus_queue.cc:237] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.941632 14401 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:09:07.942742 14399 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:09:07.952220 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 32 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:07.940887 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:07.872200 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:07.857658 13713 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.028s	sys 0.020s
I20260709 13:09:07.959636 13790 raft_consensus.cc:2393] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 20: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:07.958802 13830 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:07.957774 14402 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:09:07.969672 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:07.674185 13757 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:07.972597 13783 raft_consensus.cc:2410] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:09:07.977934 13858 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:09:07.987504 13709 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 24.
I20260709 13:09:07.896047 21051 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:08.010222 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 107126us
I20260709 13:09:08.011045 14366 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:07.992539 13786 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
W20260709 13:09:08.013233 21173 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.031s	sys 0.060s
W20260709 13:09:08.013814 21173 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.031s	sys 0.060s
W20260709 13:09:07.992741 13713 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.029s	sys 0.020s
W20260709 13:09:08.015134 14365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.009s	sys 0.010s
W20260709 13:09:08.015561 14365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.009s	sys 0.010s
W20260709 13:09:07.875777 13610 rpcz_store.cc:269] 0709 13:08:54.385867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.404760 (+ 18893us) service_pool.cc:224] Handling call
0709 13:09:07.666475 (+13261715us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:00.560088 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:00.682872 (+122784us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:00.685400 (+  2528us) write_op.cc:435] Acquired schema lock
0709 13:09:00.687229 (+  1829us) tablet.cc:662] Decoding operations
0709 13:09:00.748711 (+ 61482us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:00.748775 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:00.748800 (+    25us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:09:00.750244 (+  1444us) tablet.cc:701] Row locks acquired
0709 13:09:00.750262 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:09:00.750400 (+   138us) write_op.cc:270] Start()
0709 13:09:00.750509 (+   109us) write_op.cc:276] Timestamp: P: 1783602540750352 usec, L: 0
0709 13:09:00.750532 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:09:00.789474 (+ 38942us) log.cc:844] Serialized 8256 byte log entry
0709 13:09:02.099882 (+1310408us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b54003ee2a0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f5232453dbe 00007f523245e930 00007f523245e8d8 00007f523245e858 00007f523245e813 00007f523245da9c 00007f5238349626 00007f5238343dd8 00007f523249a7cb 00007f523249d2c0
0709 13:09:02.435252 (+335370us) op_driver.cc:464] REPLICATION: finished
0709 13:09:02.932035 (+496783us) write_op.cc:301] APPLY: starting
0709 13:09:02.978411 (+ 46376us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:03.378082 (+399671us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:03.378120 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:03.412653 (+ 34533us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:03.413095 (+   442us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:09:03.413155 (+    60us) write_op.cc:312] APPLY: finished
0709 13:09:03.413595 (+   440us) log.cc:844] Serialized 188 byte log entry
0709 13:09:03.677961 (+264366us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:03.705190 (+ 27229us) write_op.cc:454] Released schema lock
0709 13:09:03.717093 (+ 11903us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:03.853098 (+136005us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:03.885605 (+ 32507us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":40870,"reported_tablets":44,"spinlock_wait_cycles":36096,"child_traces":[["op",{"apply.queue_time_us":460510,"apply.run_cpu_time_us":53281,"apply.run_wall_time_us":911826,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91907,"num_ops":21,"prepare.queue_time_us":189444,"prepare.run_cpu_time_us":18658,"prepare.run_wall_time_us":782104,"raft.queue_time_us":252057,"raft.run_cpu_time_us":25286,"raft.run_wall_time_us":290715,"replication_time_us":1636728,"spinlock_wait_cycles":25139328,"thread_start_us":708352,"threads_started":5,"wal-append.queue_time_us":620716,"wal-append.run_cpu_time_us":43679,"wal-append.run_wall_time_us":3568056}]]}
I20260709 13:09:07.904505 20915 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:08.021234 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.000058 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:08.007506 13785 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
W20260709 13:09:08.023442 14367 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.000s	sys 0.018s
W20260709 13:09:08.024003 14367 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.000s	sys 0.019s
I20260709 13:09:08.024808 14367 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:07.956826 21134 raft_consensus.cc:697] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 17 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:07.967986 21172 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:07.981894 21137 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:09:08.034878 14366 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:08.035857 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:08.036375 14366 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:09:08.036821 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 159710us
I20260709 13:09:08.037886 14366 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:08.041143 13712 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:09:08.043227 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:08.043933 13709 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:08.028825 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:08.048554 14398 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:09:08.049536 13865 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:09:08.050002 14366 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:08.026358 21169 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:08.058311 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:08.068674 13783 raft_consensus.cc:3055] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:09:08.069077 13783 raft_consensus.cc:740] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:08.051684 13860 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.959334 20897 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:07.990496 21195 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:08.066488 13709 raft_consensus.cc:2468] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
I20260709 13:09:08.032238 21179 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:08.083686 21156 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:09:08.085903 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 411815us
I20260709 13:09:08.029152 21178 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:08.000062 21167 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:08.069957 13783 consensus_queue.cc:260] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:08.068154 13612 catalog_manager.cc:5697] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:09:08.091444 13860 leader_election.cc:290] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:08.054260 20888 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:08.052662 20950 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:08.085253 20858 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:08.088915 21179 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:08.090476 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 73954us
I20260709 13:09:08.099715 13756 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:08.127472 13756 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:08.100915 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: true dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:08.128927 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:08.129403 13786 raft_consensus.cc:3055] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:08.129838 13786 raft_consensus.cc:740] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:08.103089 21013 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:08.103223 20774 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.108814 13757 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:08.109580 20807 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:08.111701 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:08.139663 13865 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:09:08.114908 20773 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:08.052418 21122 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:08.050769 21175 raft_consensus.cc:697] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 27 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:08.059978 20919 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:07.999584 21097 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:08.059060 20992 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:08.125052 13783 raft_consensus.cc:3060] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:08.026707 20909 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 13:09:08.069831 20998 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:08.103597 21078 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:08.204782 14400 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:09:08.205168 21078 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:08.132165 13857 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 27: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:09:08.209177 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:08.210212 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:08.210580 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:08.132759 13709 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:09:08.134333 13715 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:09:08.131980 13612 catalog_manager.cc:5697] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 9 to 13, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 13 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:08.150812 21195 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:08.117776 21136 raft_consensus.cc:2764] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:09:08.150199 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:08.141300 13830 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:08.221088 20773 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:09:08.245177 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 103957us
I20260709 13:09:08.094391 21173 raft_consensus.cc:2764] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:09:08.245422 21078 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:08.122088 20849 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.011s	sys 0.012s
I20260709 13:09:08.245843 21029 raft_consensus.cc:2804] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:09:08.246131 20849 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.011s	sys 0.013s
I20260709 13:09:08.246428 21029 raft_consensus.cc:697] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 24 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:08.247382 21029 consensus_queue.cc:237] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:08.248976 21173 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:08.249271 20998 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:09:08.251209 13709 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260709 13:09:08.135906 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 179742us
W20260709 13:09:08.160900 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.119637 21178 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:08.122391 20881 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:08.185523 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:08.135241 20347 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:08.128418 20902 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:08.137862 21129 raft_consensus.cc:2804] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:08.135509 20888 raft_consensus.cc:697] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:08.210884 13857 raft_consensus.cc:2393] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 19: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:08.155710 21122 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.151600 20991 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:08.138532 13856 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:09:08.183068 20919 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.180765 20774 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:08.180454 21013 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:08.151366 21053 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.181953 20950 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:08.199239 21134 consensus_queue.cc:237] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:08.211144 13865 raft_consensus.cc:3060] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:08.228582 13612 catalog_manager.cc:5697] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 11 to 12, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 12 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:09:08.223402 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:08.199908 13786 consensus_queue.cc:260] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:08.224328 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:08.224628 13783 raft_consensus.cc:2468] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 24.
I20260709 13:09:08.156497 20776 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:08.223919 20992 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.237779 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:08.239946 13785 raft_consensus.cc:1240] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 23 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 22. Current term is 23. Ops: []
I20260709 13:09:08.245453 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:08.252468 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.253827 13682 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:09:08.306529 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 52815.7us
I20260709 13:09:08.254725 13789 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:09:08.235050 13859 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:09:08.258225 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
W20260709 13:09:08.213868 21193 log.cc:927] Time spent T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:09:08.255153 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:08.220885 20897 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:08.222231 20909 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:08.224838 21179 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:08.234133 21170 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:08.285591 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:08.332218 13857 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 13.
I20260709 13:09:08.332723 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:08.245496 20773 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:08.302402 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 361567us
I20260709 13:09:08.304705 13786 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:08.307399 13682 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:08.308955 13862 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:08.346602 13786 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:09:08.263980 20881 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:08.287557 21129 raft_consensus.cc:697] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:08.281045 20991 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.280573 21122 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:08.312721 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:08.355103 13783 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:09:08.312201 14368 leader_election.cc:304] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:09:08.355438 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 48095.1us
I20260709 13:09:08.356277 13682 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:09:08.356405 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 44291us
I20260709 13:09:08.287962 20347 raft_consensus.cc:697] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:08.333329 13858 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:09:08.336036 13865 raft_consensus.cc:2468] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 20.
I20260709 13:09:08.284803 20919 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:08.315469 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.348147 13829 leader_election.cc:304] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:08.348568 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:08.361440 13857 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:09:08.350571 13862 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:09:08.315495 20849 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:09:08.359773 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 311344us
I20260709 13:09:08.365178 13682 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:08.366266 13829 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:08.301957 21053 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:08.367450 13757 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:08.350883 20915 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:08.311164 20776 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:08.367381 13682 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:08.324065 21173 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.046s
I20260709 13:09:08.364547 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:08.359978 20991 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:08.349869 21179 consensus_queue.cc:1059] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:09:08.357066 21172 raft_consensus.cc:697] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:08.361816 20897 raft_consensus.cc:3060] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:08.294306 21175 consensus_queue.cc:237] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:08.359247 20950 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:08.315672 20992 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:08.364737 20840 raft_consensus.cc:2804] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:08.369565 21064 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:08.367729 21207 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:08.379930 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:08.373202 20967 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:08.373589 21166 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:08.349687 21170 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:08.349891 20909 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:08.385983 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 32 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:08.399981 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:08.371615 20849 raft_consensus.cc:697] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 20 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:08.390829 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:08.372997 21198 consensus_queue.cc:1059] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.013s
I20260709 13:09:08.389287 21128 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:08.394511 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3441) took 1342 ms. Trace:
I20260709 13:09:08.363963 21206 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:09:08.388818 13783 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 22.
I20260709 13:09:08.399587 13612 catalog_manager.cc:5697] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 11 to 12, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 12 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:08.393256 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 368550us
I20260709 13:09:08.390482 20967 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:08.406836 13785 raft_consensus.cc:1240] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 13:09:08.394429 20840 raft_consensus.cc:697] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 19 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:08.408694 14402 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:08.392513 21179 consensus_queue.cc:1243] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer 35ecb005831740438d7537dd4b840e03 log is divergent from this leader: its last log entry 23.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:09:08.408144 21207 raft_consensus.cc:697] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:08.392869 21166 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:08.430331 21166 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:08.430706 21207 consensus_queue.cc:237] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:08.410558 21064 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 13:09:08.431955 21064 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 31 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:08.431699 20849 consensus_queue.cc:237] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:08.432376 21064 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 31 FOLLOWER]: Advancing to term 32
I20260709 13:09:08.363211 20888 consensus_queue.cc:237] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:08.407219 13787 rpcz_store.cc:276] 0709 13:09:07.052095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.391783 (+339688us) service_pool.cc:224] Handling call
0709 13:09:07.392151 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.392375 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:09:07.392678 (+   303us) log.cc:844] Serialized 14 byte log entry
0709 13:09:08.393203 (+1000525us) log.cc:844] Serialized 14 byte log entry
0709 13:09:08.393445 (+   242us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:08.393503 (+    58us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:09:08.393571 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.393649 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.394447 (+   798us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78175,"prepare.queue_time_us":357817,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":74,"raft.queue_time_us":296141,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":20387,"spinlock_wait_cycles":55229440,"thread_start_us":707622,"threads_started":2,"wal-append.queue_time_us":514515}
I20260709 13:09:08.436991 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:08.397239 21169 raft_consensus.cc:697] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:09:08.408315 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.400489 21078 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.422199 14393 raft_consensus.cc:1240] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:08.424353 21013 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:08.424950 21033 raft_consensus.cc:3055] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:09:08.426213 20992 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:08.409384 21128 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.390260 20950 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:08.428118 21097 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:08.449538 13612 catalog_manager.cc:5697] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 10 to 13, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 13 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:08.458464 21199 log.cc:927] Time spent T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:09:08.375092 21129 consensus_queue.cc:237] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:08.461158 14393 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17. Ops: []
W20260709 13:09:08.461212 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 50321.8us
I20260709 13:09:08.462498 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:08.524544 14395 raft_consensus.cc:2393] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 20: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:08.525739 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: true dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:08.463621 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:08.527773 14402 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:09:08.528620 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:08.529289 14402 raft_consensus.cc:2393] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 17: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:08.530009 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:08.422137 20967 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:08.463878 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:08.535804 14397 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:09:08.536605 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:08.537225 14397 raft_consensus.cc:2393] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 20: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:09:08.469184 20776 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:08.405464 13713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49490 (request call id 3127) took 1133 ms. Trace:
I20260709 13:09:08.482545 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:08.524588 14367 leader_election.cc:400] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 20. Current term is 21.
I20260709 13:09:08.540547 14394 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 20.
I20260709 13:09:08.540752 14367 leader_election.cc:403] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:09:08.527133 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:08.546502 14395 raft_consensus.cc:2393] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 20: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:08.531131 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:08.465222 21078 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:08.483497 21162 consensus_meta.cc:287] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.001s
I20260709 13:09:08.565433 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:08.559902 13612 catalog_manager.cc:5697] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:08.566294 14393 raft_consensus.cc:2393] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 20: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:08.464401 21033 raft_consensus.cc:740] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:08.469202 20773 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:08.479658 21128 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:08.421669 20347 consensus_queue.cc:237] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:08.576471 13612 catalog_manager.cc:5697] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:08.567276 14367 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:08.586901 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:08.587631 14402 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
I20260709 13:09:08.565120 20992 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533) with higher term. Message: Invalid argument: T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 20. Current term is 21.
I20260709 13:09:08.569792 21208 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:08.588614 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 224127us
I20260709 13:09:08.601723 14367 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:08.598604 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:08.603523 13707 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 20.
I20260709 13:09:08.605641 13612 catalog_manager.cc:5697] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 13 to 14, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 14 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:08.605204 13680 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:08.605113 13830 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:08.610723 13680 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:08.619639 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:08.620361 14399 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
W20260709 13:09:08.630796 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 233443us
I20260709 13:09:08.631845 14366 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:08.632030 13680 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:08.567787 21097 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:09:08.635885 13680 leader_election.cc:400] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 17. Current term is 18.
I20260709 13:09:08.638376 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:08.636430 13612 catalog_manager.cc:5697] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 13 to 16, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 16 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:09:08.639268 13708 raft_consensus.cc:2410] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:09:08.637147 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:08.483186 21172 consensus_queue.cc:237] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:08.638446 13680 leader_election.cc:403] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:08.575173 20881 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:08.639747 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:08.646225 14393 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
W20260709 13:09:08.640198 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.640662 14366 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:08.612215 14367 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:08.642254 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:08.644793 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:08.615747 21014 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:08.613801 21206 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:08.615574 21198 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 13:09:08.637331 21203 log.cc:927] Time spent T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
W20260709 13:09:08.702841 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 54351us
I20260709 13:09:08.631153 21214 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:08.709916 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:08.711521 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:08.760252 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:08.712929 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:08.634948 21136 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:08.719178 13612 catalog_manager.cc:5697] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 14 to 16, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 16 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:09:08.579021 20840 consensus_queue.cc:237] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:08.715018 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:08.714573 14393 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:08.631050 21179 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:08.761576 13783 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 20.
W20260709 13:09:08.730072 13682 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.76.131:46015 timed out after 1.735s (SENT) [suppressed 28 similar messages]
I20260709 13:09:08.703547 21213 raft_consensus.cc:2804] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:08.578476 21169 consensus_queue.cc:237] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:08.781576 14399 raft_consensus.cc:1275] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:09:08.784471 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:08.754643 20909 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:08.651324 21078 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:08.609465 21208 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:08.703385 20992 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:08.786559 21195 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:08.828866 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:08.872710 13711 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 20.
I20260709 13:09:08.717967 21216 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 13:09:08.832214 21207 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 17. Current term is 18.
W20260709 13:09:08.881798 21232 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:09:08.882218 21210 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.294s	user 0.000s	sys 0.000s
I20260709 13:09:08.872270 20992 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.883496 20992 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:09:08.886519 20807 consensus_meta.cc:287] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.731s	user 0.005s	sys 0.002s
W20260709 13:09:08.887850 21211 log.cc:927] Time spent T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.324s	user 0.001s	sys 0.000s
W20260709 13:09:08.889251 21204 log.cc:927] Time spent T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
I20260709 13:09:08.836496 20991 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:08.826215 13709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:08.891517 13709 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 20.
I20260709 13:09:08.892868 20991 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:08.893215 21208 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:08.895243 20902 raft_consensus.cc:3055] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:08.895815 20902 raft_consensus.cc:740] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:08.896759 20902 consensus_queue.cc:260] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:08.897912 20902 raft_consensus.cc:3060] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:08.898849 21121 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.899356 21121 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:08.785938 13714 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:09:08.901046 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 4026) took 1267 ms. Trace:
I20260709 13:09:08.901417 13861 rpcz_store.cc:276] 0709 13:09:07.633381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.633693 (+   312us) service_pool.cc:224] Handling call
0709 13:09:07.634046 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:07.634446 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.634486 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:07.721669 (+ 87183us) log.cc:844] Serialized 26 byte log entry
0709 13:09:08.130273 (+408604us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:08.130314 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.130374 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:08.900848 (+770474us) raft_consensus.cc:1685] finished
0709 13:09:08.900870 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.900990 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":9997,"thread_start_us":233825,"threads_started":1,"wal-append.queue_time_us":572674}
I20260709 13:09:08.762688 21206 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.903614 21206 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:08.904770 21121 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:08.759680 20858 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:08.909693 13856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42104 (request call id 1812) took 1178 ms. Trace:
I20260709 13:09:08.910075 13856 rpcz_store.cc:276] 0709 13:09:07.731526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.969412 (+237886us) service_pool.cc:224] Handling call
0709 13:09:08.909523 (+940111us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b5400234954. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:08.909624 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":321878784}
W20260709 13:09:08.837931 21185 log.cc:927] Time spent T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:09:08.873862 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:08.875105 14367 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:08.839164 21213 raft_consensus.cc:697] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 20 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:09:08.890959 21219 log.cc:927] Time spent T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:09:08.715677 21033 consensus_queue.cc:260] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:08.899729 21227 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
I20260709 13:09:08.838666 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:09:08.881788 21229 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.243s	user 0.000s	sys 0.000s
I20260709 13:09:08.836125 21179 raft_consensus.cc:697] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 20 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:08.760756 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:08.903321 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:08.703689 20773 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:09:08.913251 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 183183us
I20260709 13:09:08.914345 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:08.911139 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:08.930158 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 55176.6us
W20260709 13:09:08.904911 21186 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.820s	user 0.003s	sys 0.000s
I20260709 13:09:08.944236 21033 raft_consensus.cc:3060] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:09:08.944862 21166 consensus_meta.cc:287] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.000s
I20260709 13:09:08.949698 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:08.949652 14393 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:08.950502 14367 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:08.839666 21136 raft_consensus.cc:697] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:08.953603 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:08.836653 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 128004us
I20260709 13:09:08.944969 21179 consensus_queue.cc:237] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:08.958684 13856 raft_consensus.cc:2393] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 19: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:08.965893 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 3330) took 1084 ms. Trace:
I20260709 13:09:08.971824 13865 rpcz_store.cc:276] 0709 13:09:07.881558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.372719 (+491161us) service_pool.cc:224] Handling call
0709 13:09:08.373019 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:08.420294 (+ 47275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:08.420332 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:08.420387 (+    55us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:08.420436 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.965578 (+545142us) spinlock_profiling.cc:243] Waited 47 ms on lock 0x7b540004ae54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:08.965643 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.965820 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108196608}
I20260709 13:09:08.967746 13861 raft_consensus.cc:2410] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:09:08.939821 20807 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:08.961671 20919 consensus_meta.cc:287] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.588s	user 0.008s	sys 0.002s
I20260709 13:09:08.926322 20858 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.027377 13856 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:09.028406 14398 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:09:08.938885 21165 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.044s
W20260709 13:09:09.032670 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 197261us
I20260709 13:09:09.041399 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:09.042537 14398 raft_consensus.cc:2410] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:09:09.043496 20773 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:08.958348 21166 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:09.056528 20967 consensus_meta.cc:287] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.002s
I20260709 13:09:09.050261 21243 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:09:09.089510 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.066689 21214 raft_consensus.cc:697] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:09.050657 21228 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:09.072286 21173 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:09.100533 13787 raft_consensus.cc:1240] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:09.107405 21214 consensus_queue.cc:237] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.108980 21246 consensus_queue.cc:1059] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:09.084643 21198 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.110486 21198 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.112855 21217 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:09.078891 21127 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:09.113646 21198 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:09.115272 20858 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:09.117056 21064 consensus_meta.cc:287] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.684s	user 0.008s	sys 0.001s
W20260709 13:09:09.117928 20897 consensus_meta.cc:287] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.732s	user 0.004s	sys 0.004s
I20260709 13:09:09.117527 21064 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 32 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.118284 20897 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:09.118955 14401 raft_consensus.cc:1240] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:09.115197 21169 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:09:09.113013 21122 consensus_meta.cc:287] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.748s	user 0.007s	sys 0.004s
I20260709 13:09:09.113461 21217 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.034188 20919 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.126137 13856 raft_consensus.cc:1275] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:09:09.140497 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 84668.8us
I20260709 13:09:09.087973 20967 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:09.150131 13856 raft_consensus.cc:1275] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:09:09.067075 21213 consensus_queue.cc:237] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.155575 21064 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 32 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:09.169770 21217 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:09.104648 21243 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:09.181126 21064 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:09.181737 21064 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:09.182380 20992 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.123337 21173 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:09.104470 20773 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.185827 21173 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:09.186409 21173 raft_consensus.cc:3055] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:09.186765 21173 raft_consensus.cc:740] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:09.188642 14399 raft_consensus.cc:2410] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 21 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
W20260709 13:09:09.200462 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 159599us
I20260709 13:09:09.129254 21122 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.201536 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:09.210553 13856 raft_consensus.cc:2376] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17. Re-sending same reply.
I20260709 13:09:09.128306 21169 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.213943 13755 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:09.215924 21166 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:09.121234 21228 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.217151 21167 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:09.221276 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:09.147768 21206 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:09.237558 21251 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:09:09.239142 21243 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:09.240669 14366 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:09.349386 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 108778us
I20260709 13:09:09.240897 20992 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:09.242259 20967 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:09.243929 20950 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:09.244223 20919 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:09.246290 21169 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:09.247037 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.247980 14394 raft_consensus.cc:1240] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:09:09.249368 13862 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 23.
W20260709 13:09:09.236315 21128 consensus_meta.cc:287] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.657s	user 0.007s	sys 0.004s
I20260709 13:09:09.367164 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:09.367487 21128 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.367175 21248 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.368765 21248 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:09.369831 21128 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:09.371039 21253 log.cc:927] Time spent T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:09:09.371095 21248 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:09.240937 21122 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 6
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:09:09.393035 12594 tablet_server.cc:179] TabletServer@127.12.76.129:0 shutting down...
I20260709 13:09:09.250612 13859 raft_consensus.cc:1240] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 19 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 18. Current term is 19. Ops: []
W20260709 13:09:09.252507 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.252843 13755 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:09.253342 21259 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:09.401192 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:09.401753 13707 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:09.403313 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:09.404105 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:09.404690 13862 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:09:09.405764 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:09.406517 13858 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 22.
I20260709 13:09:09.272828 21014 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.409305 13707 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 20.
I20260709 13:09:09.266047 20731 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.124816 21136 consensus_queue.cc:237] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.351696 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:09.351894 13708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:09.352898 13716 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 20. Current term is 21. Ops: [19.15-20.16]
I20260709 13:09:09.296912 20773 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:09.356169 21064 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:09.362365 14393 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 15.
I20260709 13:09:09.366513 20992 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.400170 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:09.400838 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:09.437760 13789 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:09.403333 13857 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:09:09.412750 21014 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:09.462617 13862 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:09:09.446946 20992 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.435115 20731 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.476104 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 3333) took 1219 ms. Trace:
I20260709 13:09:09.476537 13865 rpcz_store.cc:276] 0709 13:09:08.257150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.031251 (+774101us) service_pool.cc:224] Handling call
0709 13:09:09.031740 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.032127 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.032169 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.044001 (+ 11832us) log.cc:844] Serialized 26 byte log entry
0709 13:09:09.084300 (+ 40299us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:09.084347 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.084436 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:09.475886 (+391450us) raft_consensus.cc:1685] finished
0709 13:09:09.475918 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:09.476050 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":35443,"threads_started":1,"wal-append.queue_time_us":425804}
I20260709 13:09:09.479593 21228 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:09.481590 21181 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.482195 21181 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.493098 13789 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 23.
I20260709 13:09:09.410725 13707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02"
I20260709 13:09:09.277858 14367 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:09.353520 13710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b9d194f45e044e0988d5de1a99e5cd02" is_pre_election: true
I20260709 13:09:09.278825 21173 consensus_queue.cc:260] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.415577 21208 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:09.416258 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:09.416375 21051 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:09.416833 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:09.419728 21243 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 13:09:09.422241 21259 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:09.422950 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 170250us
I20260709 13:09:09.362128 20897 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:09.494645 13707 raft_consensus.cc:3060] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:09.495563 13783 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:09.494302 13710 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 23.
W20260709 13:09:09.496097 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 218379us
I20260709 13:09:09.503165 20887 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:09.503780 14367 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:09.505483 20888 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:09.506110 20888 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.506950 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:09.507774 14393 raft_consensus.cc:2393] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 23: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:09.508865 20888 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:09.509639 21051 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:09.510066 21051 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.510437 21051 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:09.510668 13783 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 20.
I20260709 13:09:09.511075 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:09.511772 14393 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:09:09.515044 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:09.515658 14393 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:09.504700 20887 consensus_queue.cc:1048] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.012s
I20260709 13:09:09.521916 14399 raft_consensus.cc:1275] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:09:09.467900 20998 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:09.525025 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:09.525734 14399 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 23.
I20260709 13:09:09.528343 13783 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:09:09.528502 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:09:09.496949 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 80936.8us
I20260709 13:09:09.483582 21169 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:09.498376 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 122077us
I20260709 13:09:09.532153 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:09.532770 13790 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:09:09.533172 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:09.538456 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:09.541616 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:09.535037 21233 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.544354 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:09.544271 21233 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.545933 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:09.546583 21233 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:09.547288 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:09.548074 21206 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:09.548532 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:09.546574 13857 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 20.
I20260709 13:09:09.551038 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:09.522918 21213 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:09.549070 13791 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 24.
I20260709 13:09:09.553570 13789 raft_consensus.cc:1275] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:09:09.561203 13707 raft_consensus.cc:2468] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 23.
W20260709 13:09:09.587028 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 55005.9us
I20260709 13:09:09.588348 14366 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:09.530234 20881 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.540202 20888 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:09.597301 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:09.594419 14366 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:09.598726 13755 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:09.594800 13865 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:09.599398 14366 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:09.600765 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:09.601465 13865 raft_consensus.cc:3060] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:09.595736 14393 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
I20260709 13:09:09.596216 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:09.603601 13857 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 23.
I20260709 13:09:09.604472 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:09.604921 20897 raft_consensus.cc:2804] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:09.605448 20897 raft_consensus.cc:697] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 23 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:09.606438 20897 consensus_queue.cc:237] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.604166 20888 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.609184 20888 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:09.556288 21213 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.612614 21213 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:09.500010 21208 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.592736 13680 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:09.596527 14368 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:09.540071 20849 consensus_queue.cc:1059] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:09:09.623522 13755 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:09.602535 21122 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:09.530176 20998 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.549821 21169 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:09.623095 21033 consensus_meta.cc:287] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.669s	user 0.009s	sys 0.002s
I20260709 13:09:09.617702 20902 raft_consensus.cc:2804] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:09.619169 21064 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:09.636776 13755 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:09.637436 13865 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 20.
I20260709 13:09:09.637991 14368 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:09.652243 13861 raft_consensus.cc:1275] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:09:09.656294 13755 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:09.658656 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:09.661579 21122 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:09.662463 20902 raft_consensus.cc:697] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 20 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:09.663740 20902 consensus_queue.cc:237] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.668697 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:09.626746 20888 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:09.631887 20887 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.613289 20881 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.635962 21257 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:09:09.676406 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.639958 20950 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:09.639662 21181 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:09.677942 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 55715.5us
I20260709 13:09:09.640681 21064 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:09.623770 21128 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:09:09.696298 13680 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:09.674947 21175 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:09.673795 21234 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:09:09.705542 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 43759.8us
I20260709 13:09:09.706557 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:09.710567 14368 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:09.711714 20919 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:09.714115 14368 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:09.716552 14368 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:09.717800 20897 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:09.719535 20897 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:09.720618 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:09.720618 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:09.721299 14396 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:09.721750 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:09.722400 14397 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 24.
I20260709 13:09:09.724742 14366 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:09.725711 20897 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:09:09.726114 20897 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.726498 20897 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:09:09.726770 21230 log.cc:927] Time spent T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.855s	user 0.001s	sys 0.000s
I20260709 13:09:09.728585 20998 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:09.729961 14396 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:09:09.730656 20881 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:09.682355 20887 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:09.733364 20887 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:09.733826 14396 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:09:09.735124 21206 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.735699 21206 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:09.692780 21257 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.743759 13862 raft_consensus.cc:1275] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:09:09.739035 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:09.744549 14395 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:09.737663 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:09.747745 13865 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
W20260709 13:09:09.739141 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.739848 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:09.749070 14393 raft_consensus.cc:2410] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 22 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:09:09.695395 21247 raft_consensus.cc:3055] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:09:09.752285 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.753499 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:09.750098 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:09.754969 13862 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:09:09.750715 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:09.751154 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:09.696442 20849 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:09.670729 21259 consensus_queue.cc:1048] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:09:09.702023 21064 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:09.767657 14368 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:09.761338 14395 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:09:09.762879 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:09.763823 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:09.719012 21172 consensus_queue.cc:1048] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
W20260709 13:09:09.775669 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 75144.1us
I20260709 13:09:09.775266 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:09.789490 13757 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:09.807286 20849 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.809762 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:09.811643 21261 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:09.769799 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:09.812238 20849 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:09.811595 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:09.770171 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:09.813869 13856 raft_consensus.cc:2393] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 22: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:09.814064 13862 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:09:09.815150 13757 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:09.816756 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 49178us
I20260709 13:09:09.817400 13757 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:09.708532 21234 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:09.744060 21175 raft_consensus.cc:697] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:09.824425 13860 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:09.706403 21248 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.102s
I20260709 13:09:09.752189 21257 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:09.708071 21051 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.751890 21247 raft_consensus.cc:740] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:09.828783 21277 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:09.827015 13757 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:09.758364 20919 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:09.786877 13858 raft_consensus.cc:1275] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:09:09.822470 21261 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:09.758242 20950 consensus_queue.cc:1048] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.072s
I20260709 13:09:09.823982 20902 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:09.824499 21234 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:09.823159 21233 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:09.838833 21277 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:09.865087 21271 log.cc:927] Time spent T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:09:09.840235 13757 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:09:09.936089 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 95931.7us
I20260709 13:09:09.866247 21175 consensus_queue.cc:237] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.867405 20992 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:09.870249 21208 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:09.841671 21019 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:09.844646 20774 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:09.893249 21206 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:09.893810 21014 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.894783 20731 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:09.896543 21169 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:09.897326 21247 consensus_queue.cc:260] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:09.825296 21172 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.929082 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:09.901181 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:09.934327 21233 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.939565 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:09.928252 20902 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:09.949155 13860 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
W20260709 13:09:09.943852 21283 log.cc:927] Time spent T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.081s	user 0.005s	sys 0.017s
I20260709 13:09:09.944453 20887 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:09.938643 21277 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:09.954825 13862 raft_consensus.cc:2410] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 25 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 13:09:09.954054 13680 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:09.944679 21258 consensus_queue.cc:1048] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
I20260709 13:09:09.943610 21064 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.955905 21233 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:09.959436 20887 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.972045 20887 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:09.972353 21014 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:09.939934 21213 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.956830 20902 raft_consensus.cc:3060] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:09.980430 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:09:09.939706 20897 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:09.979650 21247 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:09.985707 21208 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:09:08.539489 13713 rpcz_store.cc:276] 0709 13:09:07.272436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.344184 (+ 71748us) service_pool.cc:224] Handling call
0709 13:09:07.344430 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.344595 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:09:08.014977 (+670382us) log.cc:844] Serialized 14 byte log entry
0709 13:09:08.404549 (+389572us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:08.404904 (+   355us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:08.404968 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.405159 (+   191us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.405372 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":199200,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":26,"raft.queue_time_us":22405,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":48,"thread_start_us":1048015,"threads_started":2,"wal-append.queue_time_us":509736}
I20260709 13:09:09.955704 21172 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:10.019814 20897 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:10.020571 21286 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:09.997349 21206 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:10.022574 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:10.024470 13790 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:10.027769 21286 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:10.031360 14400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 2128) took 2294 ms (client timeout 2565 ms). Trace:
W20260709 13:09:10.032030 14400 rpcz_store.cc:269] 0709 13:09:07.736946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.872900 (+135954us) service_pool.cc:224] Handling call
0709 13:09:10.031180 (+2158280us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b5400943ed4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:10.031287 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":695124352}
I20260709 13:09:09.996299 21285 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 13:09:10.039847 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:10.040482 13783 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:09.992714 21014 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:10.043919 13756 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:10.045116 13756 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:10.020784 21213 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:10.055509 13783 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 25.
W20260709 13:09:10.050318 13756 leader_election.cc:336] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:10.057083 13756 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:10.060686 13756 consensus_peers.cc:597] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:10.061305 21019 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:10.058684 21014 raft_consensus.cc:697] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:10.063841 21014 consensus_queue.cc:237] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:10.076889 13756 consensus_peers.cc:597] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:10.049212 21236 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:10.043269 21206 raft_consensus.cc:697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:10.051920 21259 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:10.072507 21019 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:10.082034 21129 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.313s	user 0.004s	sys 0.020s
W20260709 13:09:10.094740 13864 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 3324) took 2378 ms (client timeout 1735 ms). Trace:
W20260709 13:09:10.095194 13864 rpcz_store.cc:269] 0709 13:09:07.716057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.957744 (+241687us) service_pool.cc:224] Handling call
0709 13:09:10.094524 (+2136780us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b5400235354. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:10.094673 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2201215744}
W20260709 13:09:10.101121 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.110339 13864 raft_consensus.cc:1275] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 27 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 14. (term mismatch)
I20260709 13:09:10.110903 13864 pending_rounds.cc:85] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 13
I20260709 13:09:10.111225 13864 pending_rounds.cc:107] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 26.14
I20260709 13:09:10.112161 13864 raft_consensus.cc:2889] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:10.114773 14367 leader_election.cc:336] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:10.095518 21129 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.326s	user 0.004s	sys 0.021s
I20260709 13:09:10.106204 21019 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.118891 21019 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:10.122603 21206 consensus_queue.cc:237] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:10.124964 13783 raft_consensus.cc:1275] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:09:10.126564 21215 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:10.090752 21257 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:10.127219 21215 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:10.129940 13789 raft_consensus.cc:2393] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 18: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:10.143352 21172 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:10.145649 21234 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:10.147807 13791 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:10.148106 21215 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:10.140196 20992 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:10.149544 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:10.149364 20992 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:10.150169 13783 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:09:10.154364 21234 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:10.159662 21064 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:10.129719 21286 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:10.123219 21284 log.cc:927] Time spent T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:09:10.184628 14366 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:10.184863 20897 consensus_queue.cc:1048] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:09:10.186272 21292 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:10.187347 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:10.189597 14394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 1645) took 1735 ms. Trace:
I20260709 13:09:10.189982 14394 rpcz_store.cc:276] 0709 13:09:08.453899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.541181 (+ 87282us) service_pool.cc:224] Handling call
0709 13:09:08.541492 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.364859 (+823367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.189332 (+824473us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b5400596854. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:10.189538 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1624001408}
I20260709 13:09:10.191393 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:10.192744 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:10.192852 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:10.192922 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:10.193869 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:10.194564 13786 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:09:10.194693 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:10.195335 14393 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 21.
I20260709 13:09:10.196223 21178 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:10.197013 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:10.198292 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:10.199075 14397 raft_consensus.cc:2393] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 13: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:10.202276 20992 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:10.199081 14367 leader_election.cc:336] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:10.207968 14367 leader_election.cc:336] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:10.208642 14367 leader_election.cc:336] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:10.210973 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:10.211760 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:10.213608 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:10.214149 13858 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:10.215723 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:10.216061 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:10.216522 14395 raft_consensus.cc:2393] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 21: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:10.216657 14401 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:09:10.217824 13856 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:09:10.186758 21292 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:10.218736 21292 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:10.222400 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:10.223179 13864 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:09:10.193674 14400 raft_consensus.cc:2393] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 20: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:09:10.223656 13756 consensus_peers.cc:597] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:10.218847 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:10.225648 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:10.226150 13829 connection.cc:256] RPC call timeout handler was delayed by -1.3562025280000398s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
W20260709 13:09:10.227348 13829 connection.cc:256] RPC call timeout handler was delayed by -1.0214025279999532s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
I20260709 13:09:10.224387 14398 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
W20260709 13:09:10.230207 13829 connection.cc:256] RPC call timeout handler was delayed by -1.0169025280000596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
I20260709 13:09:10.231504 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:10.232973 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:10.233417 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:10.233958 13858 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 21.
I20260709 13:09:10.232126 13856 raft_consensus.cc:2376] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18. Re-sending same reply.
I20260709 13:09:10.236990 14397 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:09:10.238925 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:10.238322 21064 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:10.240571 21064 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:10.241092 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:10.241739 13858 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:09:10.242667 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:10.245031 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:10.245764 13865 raft_consensus.cc:2393] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 19: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:10.213270 21215 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.247938 13682 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:10.239898 21014 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:10.251226 21014 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:10.251562 21178 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.252117 21178 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:10.253207 21014 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:10.254492 21178 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:10.259924 21215 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:10.260497 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:10.261698 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:10.262202 21215 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:10.263681 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:10.263471 21064 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:10.258455 13864 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 25.
I20260709 13:09:10.265532 13859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 4031) took 2112 ms. Trace:
I20260709 13:09:10.269953 13682 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:10.218009 20887 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:10.271924 21064 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:10.266067 13859 rpcz_store.cc:276] 0709 13:09:08.153074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.427134 (+274060us) service_pool.cc:224] Handling call
0709 13:09:08.427374 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.396812 (+969438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.265244 (+868432us) spinlock_profiling.cc:243] Waited 823 ms on lock 0x7b540035af54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:10.265471 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1892888832}
I20260709 13:09:10.273478 20887 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:10.277305 13756 consensus_peers.cc:597] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:10.283792 21064 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:10.290397 21287 log.cc:927] Time spent T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.313s	user 0.001s	sys 0.000s
W20260709 13:09:10.292234 13782 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 3446) took 2395 ms (client timeout 1795 ms). Trace:
W20260709 13:09:10.292748 13782 rpcz_store.cc:269] 0709 13:09:07.896649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.896860 (+   211us) service_pool.cc:224] Handling call
0709 13:09:10.291970 (+2395110us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54003dfc54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:10.292143 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1009942784}
I20260709 13:09:10.293996 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:10.295023 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:10.296423 13785 raft_consensus.cc:1240] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 23 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 22. Current term is 23. Ops: []
I20260709 13:09:10.297699 13785 raft_consensus.cc:1275] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:09:10.299085 13785 raft_consensus.cc:1275] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:09:10.301321 13782 raft_consensus.cc:2393] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 16: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:10.303135 13785 raft_consensus.cc:1275] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:09:10.278872 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:09:10.304383 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:10.303264 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 238127us
I20260709 13:09:10.339169 13782 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:09:10.342868 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 61720.7us
I20260709 13:09:10.345753 13682 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:09:10.366892 13756 consensus_peers.cc:597] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:10.369103 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:10.264230 21292 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:10.367933 13756 leader_election.cc:336] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:10.387512 13756 leader_election.cc:336] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:10.342108 20858 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:10.348625 20902 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:10.389186 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 43541.1us
I20260709 13:09:10.303697 20849 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:10.388182 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 68939.5us
I20260709 13:09:10.361302 21181 consensus_queue.cc:1048] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:09:10.361018 21033 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.038s
I20260709 13:09:10.363245 21064 consensus_queue.cc:1048] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:09:10.420249 14399 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:09:10.420920 13682 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:10.390107 13756 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:10.382118 21215 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:09:10.362934 21014 consensus_queue.cc:1048] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:09:10.432809 13680 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:10.393181 21286 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:10.349606 20976 consensus_queue.cc:1059] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.089s
I20260709 13:09:10.443552 20881 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:10.445967 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 58495.5us
W20260709 13:09:10.447008 13756 consensus_peers.cc:597] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:10.447939 13756 leader_election.cc:336] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:10.440882 21285 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:10.419768 20858 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:10.444324 21195 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:09:10.460682 13790 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 21.
I20260709 13:09:10.448333 13756 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:10.467970 13756 leader_election.cc:336] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:10.468715 13756 leader_election.cc:336] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:10.469153 13756 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:10.470613 13756 leader_election.cc:336] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:10.473130 13756 consensus_peers.cc:597] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:10.512010 13756 leader_election.cc:336] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:10.513247 21259 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:10.433094 20849 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:10.442394 21286 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:10.522998 20902 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:10.512023 21175 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.017s	sys 0.069s
I20260709 13:09:10.463466 20858 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:10.519809 12594 thread.cc:527] Waited for 1000ms trying to join with rpc worker (tid 13717)
I20260709 13:09:10.512507 13756 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:10.510334 20881 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:10.541872 13756 leader_election.cc:336] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:10.522506 21286 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:09:10.526315 21233 consensus_meta.cc:287] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.000s
I20260709 13:09:10.526173 21249 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:10.516793 21285 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.032s
I20260709 13:09:10.555001 21170 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:10.542625 21078 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:10.569825 21249 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:10.569319 21233 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:10.614705 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:48902 (request call id 99) took 1230 ms. Trace:
W20260709 13:09:10.542889 21175 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.018s	sys 0.069s
W20260709 13:09:10.570003 21276 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.026s	sys 0.033s
W20260709 13:09:10.545183 13756 leader_election.cc:336] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:10.573545 21181 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.615504 13788 rpcz_store.cc:276] 0709 13:09:09.366843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.372571 (+  5728us) service_pool.cc:224] Handling call
0709 13:09:10.584689 (+1212118us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54001b6cd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e4735 00007f52324dc9fa 00007f52374a44c9 00007f5230a20c54 00007f5230a20be2 00007f5230a20b11 00007f5230a20a8c 00007f5230a1fd42 00007f523081948c 00007f52308188c6
0709 13:09:10.593719 (+  9030us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334460160}
I20260709 13:09:10.600185 21249 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:10.623766 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 78612.9us
W20260709 13:09:10.626581 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 403539us
W20260709 13:09:10.627326 13756 consensus_peers.cc:597] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:10.625785 21276 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.027s	sys 0.033s
I20260709 13:09:10.631068 13791 raft_consensus.cc:2368] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 20. Current term is 21.
I20260709 13:09:10.627342 14368 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:10.639608 20897 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:10.637044 14368 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:10.629959 21181 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:10.668941 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 236186us
W20260709 13:09:10.647557 13756 leader_election.cc:336] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:10.680908 20992 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:09:10.684203 21297 log.cc:927] Time spent T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:09:10.685321 21181 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:10.668221 21175 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:10.687752 21175 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:10.690039 21175 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:10.675580 21277 consensus_meta.cc:287] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.711s	user 0.012s	sys 0.000s
I20260709 13:09:10.691817 21277 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:10.693905 21277 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:10.697871 14368 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:10.706070 14368 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:10.696473 21137 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.612s	user 0.005s	sys 0.023s
W20260709 13:09:10.710101 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 272153us
W20260709 13:09:10.714709 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 366164us
I20260709 13:09:10.720969 13829 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:10.722747 13829 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:10.708455 21137 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.641s	user 0.005s	sys 0.023s
I20260709 13:09:10.724383 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:09:10.709743 20849 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:10.710680 20902 raft_consensus.cc:2804] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:10.705657 21195 consensus_queue.cc:1048] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:09:10.719087 21234 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.726169 21181 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:10.725046 21029 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:10.719050 21215 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:09:10.737684 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 491169us
I20260709 13:09:10.727358 21137 raft_consensus.cc:697] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 27 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:10.730660 21033 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:09:10.738368 21300 log.cc:927] Time spent T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:09:10.755569 13829 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:10.796674 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:10.796643 13680 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:10.739941 21181 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:10.805030 21181 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:10.805912 21029 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:10.806475 21029 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.806859 21029 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:10.809232 21286 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:10.813702 20897 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.814453 20897 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:10.817256 21303 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.818007 21303 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:10.824801 21170 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:10.756713 20849 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:10.825960 21278 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.760773 21233 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:10.841694 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:10.763435 21033 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:10.765318 21215 raft_consensus.cc:697] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 25 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:09:10.860496 13785 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.013s	sys 0.032s
W20260709 13:09:10.861404 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 102148us
W20260709 13:09:10.861420 13785 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.013s	sys 0.032s
I20260709 13:09:10.739507 21234 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:10.858994 13756 consensus_peers.cc:597] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:10.902912 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 45608.9us
W20260709 13:09:10.865193 13862 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.009s	sys 0.007s
W20260709 13:09:10.904556 13862 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.010s	sys 0.009s
I20260709 13:09:10.909080 13859 raft_consensus.cc:2468] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
W20260709 13:09:10.903813 13756 leader_election.cc:336] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:10.860325 21033 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:10.831996 21306 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:10.826357 20849 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:10.912781 21169 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.826751 21278 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:10.969053 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 172442us
I20260709 13:09:10.972338 13682 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:09:10.895388 21314 consensus_queue.cc:1059] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.093s
W20260709 13:09:10.954953 21298 log.cc:927] Time spent T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
W20260709 13:09:10.922664 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.977685 13682 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:10.982232 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:10.982265 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:10.982863 13782 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:09:10.984915 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:10.987967 14395 raft_consensus.cc:1240] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:10.989151 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:10.989673 14395 raft_consensus.cc:2468] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:09:10.990466 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:10.968655 20976 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.949465 20858 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:10.975783 20897 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:11.002471 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:10.971554 21313 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:10.980938 20992 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.009905 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:11.012283 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:11.013616 14394 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:10.986443 21233 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.015285 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:10.918073 21137 consensus_queue.cc:237] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.018260 14368 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:11.018519 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:11.020144 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:11.020517 13859 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:09:11.013075 14400 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 14.
I20260709 13:09:10.993626 21315 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:11.025367 13863 raft_consensus.cc:1240] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:11.032212 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:11.034505 13790 raft_consensus.cc:2468] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:09:11.027926 14368 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:10.976085 21169 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:11.013206 21313 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:11.019622 21053 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:11.019919 20902 raft_consensus.cc:697] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 21 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:09:11.038077 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 280336us
I20260709 13:09:11.071461 14395 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:09:10.956331 21306 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.096602 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:11.098945 14400 raft_consensus.cc:2468] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:09:11.010836 20976 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:11.103902 13790 raft_consensus.cc:1275] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:09:11.042003 21315 raft_consensus.cc:697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 18 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:11.109876 14400 raft_consensus.cc:1240] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:11.097231 21303 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:11.021107 20992 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.111580 13755 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:11.112398 21305 log.cc:927] Time spent T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:09:11.121119 21234 leader_election.cc:290] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:11.072824 21313 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:11.026357 21233 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:11.111658 21308 log.cc:927] Time spent T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:09:11.117290 20858 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:11.140166 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:11.005322 21215 consensus_queue.cc:237] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:11.148236 13789 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1695) took 1431 ms (client timeout 1778 ms). Trace:
W20260709 13:09:11.148747 13789 rpcz_store.cc:269] 0709 13:09:09.706055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.706243 (+   188us) service_pool.cc:224] Handling call
0709 13:09:11.136980 (+1430737us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b540026ded4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:11.137141 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":967881600}
I20260709 13:09:11.149928 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:11.143507 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 171172us
I20260709 13:09:11.144237 14400 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:09:11.145254 13856 raft_consensus.cc:1275] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:09:11.146037 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 168431us
I20260709 13:09:11.152691 13682 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:11.153000 14396 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
I20260709 13:09:11.155157 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:11.157624 13789 raft_consensus.cc:2368] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 24. Current term is 25.
I20260709 13:09:11.158876 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:11.165050 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:11.165778 13859 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:11.167635 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:11.167930 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:11.168198 13790 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:11.171708 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:11.134987 21286 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:11.174942 13857 raft_consensus.cc:2393] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 21: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:11.145416 20881 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:11.152503 21307 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:11.128008 21170 consensus_queue.cc:1059] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:09:11.152774 20897 raft_consensus.cc:2804] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:11.164157 21303 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:11.200366 13859 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 23.
I20260709 13:09:11.192524 21329 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:09:11.207688 13830 leader_election.cc:336] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:11.189896 21324 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.188300 20858 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:11.209862 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 182028us
W20260709 13:09:11.213019 13830 consensus_peers.cc:597] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:11.194826 21303 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.229796 13784 raft_consensus.cc:1240] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:09:11.170975 21320 consensus_queue.cc:1059] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
W20260709 13:09:11.221338 13830 leader_election.cc:336] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:11.196650 21314 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.143288 20902 consensus_queue.cc:237] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.240880 21334 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:11.208068 20849 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:11.241557 21334 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:11.241876 20849 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.242056 21334 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.242483 20849 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:11.243799 21311 log.cc:927] Time spent T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:09:11.207664 21278 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:11.246483 20992 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:11.216965 21315 consensus_queue.cc:237] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:11.247547 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:11.248392 13859 raft_consensus.cc:2410] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 21 because replica has last-logged OpId of term: 19 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 16.
W20260709 13:09:11.249596 21317 log.cc:927] Time spent T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.225s	user 0.001s	sys 0.001s
I20260709 13:09:11.240311 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:11.250878 13864 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:09:11.245319 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1835) took 1036 ms. Trace:
W20260709 13:09:11.251665 21290 log.cc:927] Time spent T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 1.267s	user 0.007s	sys 0.002s
I20260709 13:09:11.252111 21314 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:11.254016 21314 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:11.257200 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:11.258608 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:11.260361 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:11.245131 20849 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:11.264400 14394 raft_consensus.cc:2468] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 24.
I20260709 13:09:11.265084 14400 raft_consensus.cc:1240] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:11.266512 14394 raft_consensus.cc:1275] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:11.268987 14394 raft_consensus.cc:1275] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:11.269027 21172 raft_consensus.cc:3055] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:09:11.272550 21323 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:09:11.273319 21292 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:11.273731 14401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 2156) took 1058 ms. Trace:
I20260709 13:09:11.274098 14401 rpcz_store.cc:276] 0709 13:09:10.215213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.217265 (+  2052us) service_pool.cc:224] Handling call
0709 13:09:10.217499 (+   234us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:10.635831 (+418332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:10.635863 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:10.641055 (+  5192us) log.cc:844] Serialized 26 byte log entry
0709 13:09:11.000642 (+359587us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:09:11.000691 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.001541 (+   850us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:11.273534 (+271993us) raft_consensus.cc:1685] finished
0709 13:09:11.273553 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.273682 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":509,"raft.queue_time_us":38616,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":738265,"threads_started":2,"wal-append.queue_time_us":464755}
I20260709 13:09:11.277777 21051 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:11.212142 21329 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.270538 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 4033) took 3116 ms. Trace:
I20260709 13:09:11.280900 13790 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 23.
I20260709 13:09:11.208827 20897 raft_consensus.cc:697] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 19 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:11.209987 21170 raft_consensus.cc:3055] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:11.283138 13755 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:11.269598 21172 raft_consensus.cc:740] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:11.298444 13861 rpcz_store.cc:276] 0709 13:09:08.153759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.981829 (+828070us) service_pool.cc:224] Handling call
0709 13:09:08.982232 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.652773 (+670541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.270297 (+1617524us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b54003016d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:11.270453 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1539947776}
I20260709 13:09:11.251966 13862 rpcz_store.cc:276] 0709 13:09:10.208971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.211955 (+  2984us) service_pool.cc:224] Handling call
0709 13:09:10.212235 (+   280us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:10.212645 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:10.212673 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:10.213192 (+   519us) log.cc:844] Serialized 52 byte log entry
0709 13:09:10.297551 (+ 84359us) spinlock_profiling.cc:243] Waited 8.84 ms on lock 0x7b18004a48e0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e0d1 00007f5232499a0f
0709 13:09:10.906426 (+608875us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:10.906485 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.906582 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:11.245010 (+338428us) raft_consensus.cc:1685] finished
0709 13:09:11.245028 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.245258 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2050,"raft.queue_time_us":8774,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":3061,"spinlock_wait_cycles":20326272,"thread_start_us":608629,"threads_started":1,"wal-append.queue_time_us":821869}
I20260709 13:09:11.287997 13830 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:11.232394 21303 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:11.209888 21316 consensus_queue.cc:1048] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.079s
W20260709 13:09:11.325927 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 106036us
I20260709 13:09:11.304123 21259 raft_consensus.cc:3055] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:11.226086 20858 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:11.355839 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 72786.4us
W20260709 13:09:11.354183 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 202894us
I20260709 13:09:11.360158 21136 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:09:11.330451 21029 consensus_meta.cc:287] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.523s	user 0.011s	sys 0.000s
I20260709 13:09:11.365028 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:11.300269 21170 raft_consensus.cc:740] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:11.300361 21329 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:11.366364 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:11.366823 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:11.366231 21033 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.369432 13680 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:11.197099 21307 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:11.370271 21181 consensus_meta.cc:287] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.565s	user 0.011s	sys 0.001s
I20260709 13:09:11.357723 21259 raft_consensus.cc:740] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:11.226292 21324 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.364841 21169 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:11.399060 13680 leader_election.cc:400] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 24. Current term is 25.
W20260709 13:09:11.379277 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 226637us
I20260709 13:09:11.399616 13680 leader_election.cc:403] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:09:11.401889 13861 raft_consensus.cc:1240] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:11.402153 14401 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 20.
I20260709 13:09:11.408352 13680 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:09:11.371366 21029 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.413261 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:11.381137 20976 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:11.414201 14402 raft_consensus.cc:2468] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:09:11.414790 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:11.385993 21214 raft_consensus.cc:2804] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:11.416477 13680 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:11.418624 13864 raft_consensus.cc:2368] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 24. Current term is 25.
I20260709 13:09:11.399134 21306 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:11.427742 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.409221 21315 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:11.424738 13680 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:11.428661 13860 raft_consensus.cc:1240] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260709 13:09:11.429227 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:11.453402 21222 log.cc:927] Time spent T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 2.591s	user 0.011s	sys 0.004s
I20260709 13:09:11.453560 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:09:11.421233 21128 raft_consensus.cc:2804] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:09:11.455724 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 92299.4us
I20260709 13:09:11.430197 21337 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.398654 21181 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.402931 20849 consensus_queue.cc:1048] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:09:11.416556 21233 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:11.458649 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:11.421382 21214 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:11.428553 20976 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:11.464165 13712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49488 (request call id 3576) took 3204 ms. Trace:
I20260709 13:09:11.422443 21334 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:11.457360 21249 consensus_meta.cc:287] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.826s	user 0.013s	sys 0.000s
I20260709 13:09:11.399593 21172 consensus_queue.cc:260] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.469277 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:11.471889 13712 rpcz_store.cc:276] 0709 13:09:08.256078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.256188 (+   110us) service_pool.cc:224] Handling call
0709 13:09:08.278638 (+ 22450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:08.296529 (+ 17891us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:08.296575 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:08.331882 (+ 35307us) log.cc:844] Serialized 26 byte log entry
0709 13:09:08.612834 (+280952us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:08.612892 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.642392 (+ 29500us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:11.420753 (+2778361us) spinlock_profiling.cc:243] Waited 7.26 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:09:11.455344 (+ 34591us) raft_consensus.cc:1685] finished
0709 13:09:11.455373 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.460493 (+  5120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23122,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":10470,"spinlock_wait_cycles":16688512,"thread_start_us":254672,"threads_started":1,"wal-append.queue_time_us":401888}
I20260709 13:09:11.454892 21319 raft_consensus.cc:2804] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:09:11.472064 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 61345.1us
I20260709 13:09:11.460675 21128 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.407279 20897 consensus_queue.cc:237] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.478539 14393 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:09:11.462280 21339 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.479753 13829 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:11.480999 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:11.502641 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:11.471853 20976 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:11.472724 21332 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:11.427925 21170 consensus_queue.cc:260] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.471371 21214 raft_consensus.cc:3060] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:11.489984 21128 raft_consensus.cc:3060] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:11.528085 21315 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 24. Current term is 25.
I20260709 13:09:11.528232 21170 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:11.529054 12594 thread.cc:527] Waited for 2000ms trying to join with rpc worker (tid 13717)
W20260709 13:09:11.531067 21321 log.cc:927] Time spent T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 13:09:11.524806 20976 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:11.532541 21333 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:09:11.534883 21307 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:11.535518 21347 consensus_queue.cc:1059] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.071s
I20260709 13:09:11.536602 21315 raft_consensus.cc:3055] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:11.537029 21315 raft_consensus.cc:740] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:09:11.537305 21344 log.cc:927] Time spent T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:09:11.537779 21315 consensus_queue.cc:260] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.488497 21029 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:11.538980 21324 leader_election.cc:290] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:11.539929 21331 log.cc:927] Time spent T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:09:11.497164 21335 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.488730 21306 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:09:11.597647 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 142870us
I20260709 13:09:11.508042 21172 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:11.483263 21346 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:11.487543 21282 raft_consensus.cc:2804] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:11.519080 21051 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:11.599776 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 150721us
I20260709 13:09:11.489837 21181 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:11.450279 21259 consensus_queue.cc:260] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.606299 13682 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:09:11.606525 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 126883us
I20260709 13:09:11.468098 21337 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.618521 13682 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:11.547220 21214 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:11.598973 21033 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:11.480571 21249 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.599375 21170 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:11.626938 13783 raft_consensus.cc:1240] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:11.632690 13682 leader_election.cc:400] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for earlier term 24. Current term is 25.
I20260709 13:09:11.633955 13829 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:11.605746 21282 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.637151 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:11.637687 21019 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:11.638283 21170 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:11.639761 21243 consensus_queue.cc:1048] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:11.645658 13788 raft_consensus.cc:1275] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:11.607976 21136 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 13:09:11.611053 21051 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.647071 21325 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:11.647643 21325 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.648530 21051 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:11.648798 21345 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:11.649168 21181 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:09:11.649448 21354 log.cc:927] Time spent T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:09:11.649339 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:11.649361 20858 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:11.613499 21346 raft_consensus.cc:697] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:09:11.655201 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.523828 21339 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.607630 21334 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:09:11.641518 21259 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:11.642922 21282 raft_consensus.cc:3060] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:11.606403 21335 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.653714 20849 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:11.605325 21306 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.654733 21319 raft_consensus.cc:697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 24 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:11.657284 21181 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:11.673942 21019 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.659086 21136 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.665531 21029 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:11.677892 21019 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.671903 21356 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:11.674005 21364 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.678458 21181 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:11.783393 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 148962us
I20260709 13:09:11.681372 20849 raft_consensus.cc:697] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:11.795974 21213 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:11.780246 21243 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:11.806682 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 157409us
I20260709 13:09:11.807425 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:11.761139 21359 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:11.809435 14396 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:11.827565 21346 consensus_queue.cc:237] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.832442 21335 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:11.807745 21213 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.837730 21329 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:11.842278 21306 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:11.843467 21214 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:11.801879 21292 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:11.844723 21292 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:11.814888 13791 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 2872) took 1625 ms (client timeout 2164 ms). Trace:
I20260709 13:09:11.781435 21303 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:11.806041 21313 consensus_meta.cc:287] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.654s	user 0.009s	sys 0.002s
W20260709 13:09:11.846782 13791 rpcz_store.cc:269] 0709 13:09:10.189384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.263462 (+ 74078us) service_pool.cc:224] Handling call
0709 13:09:11.808153 (+1544691us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54003bd654. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:11.814824 (+  6671us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":842608896}
I20260709 13:09:11.857570 14394 raft_consensus.cc:2393] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 20: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:11.816989 20976 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.820869 21019 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:11.821394 21319 consensus_queue.cc:237] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.795487 21364 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:11.823863 20849 consensus_queue.cc:237] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:11.824304 21339 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:11.824898 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:11.856551 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 46206.1us
I20260709 13:09:11.816198 21128 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.691992 21136 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.853924 21303 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:11.881008 21349 log.cc:927] Time spent T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 13:09:11.847357 21292 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:11.782214 21356 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.893085 13829 leader_election.cc:400] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 20. Current term is 21.
W20260709 13:09:11.904403 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 291421us
I20260709 13:09:11.901343 21162 consensus_queue.cc:1048] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:09:11.855206 21313 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:11.851603 21243 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:11.890916 21019 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:11.908159 14396 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 21.
I20260709 13:09:11.909446 13829 leader_election.cc:403] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:11.915226 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:11.917831 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:11.927986 13791 raft_consensus.cc:2468] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:09:11.919030 13861 raft_consensus.cc:1240] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:11.920847 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:11.916107 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:11.919322 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:11.934257 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:11.929706 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:11.877799 21335 consensus_queue.cc:1059] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:09:11.936470 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:11.911481 21029 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.943647 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:11.915393 21337 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:11.917954 21348 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:11.942322 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 49438.2us
I20260709 13:09:11.926450 21249 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:11.945614 13680 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:11.948830 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:11.964865 13680 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:11.922785 21019 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:11.980886 21361 log.cc:927] Time spent T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
W20260709 13:09:11.981693 21371 log.cc:927] Time spent T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:09:11.981936 21357 log.cc:927] Time spent T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 13:09:11.982610 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:11.966755 21359 raft_consensus.cc:3055] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:11.992213 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:11.992466 21249 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:12.020825 14393 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
I20260709 13:09:11.944525 21374 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:09:12.025028 21370 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.026130 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:12.027518 13755 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:12.023383 21335 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.027573 13680 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:11.972435 21233 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.972117 21339 raft_consensus.cc:2804] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:12.028329 21335 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:12.025775 21370 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:11.948490 21375 consensus_queue.cc:1059] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.082s
I20260709 13:09:12.029918 20976 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:12.029757 21334 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:12.114667 14393 raft_consensus.cc:1240] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:12.115443 21356 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:11.966799 21348 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:12.020313 21359 raft_consensus.cc:740] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:12.026142 21376 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.157738 21376 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:12.108984 21339 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.160490 21339 raft_consensus.cc:3060] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:12.160624 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.164352 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:11.951916 21029 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:12.032367 21128 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:12.156355 21335 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:12.110354 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:12.291751 14395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 2160) took 1302 ms. Trace:
I20260709 13:09:12.292337 14395 rpcz_store.cc:276] 0709 13:09:10.989529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.080115 (+ 90586us) service_pool.cc:224] Handling call
0709 13:09:11.080481 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.363034 (+282553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.373020 (+  9986us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:11.373780 (+   760us) log.cc:844] Serialized 26 byte log entry
0709 13:09:11.604209 (+230429us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:11.604243 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.604304 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:12.291471 (+687167us) raft_consensus.cc:1685] finished
0709 13:09:12.291501 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.291674 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81469,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":4150,"thread_start_us":474197,"threads_started":2,"wal-append.queue_time_us":266722}
I20260709 13:09:12.117908 21337 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:12.318531 13864 raft_consensus.cc:1240] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:12.033978 21181 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:12.331336 13859 raft_consensus.cc:2468] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:09:12.113409 21233 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:12.203701 20897 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:12.432063 13865 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:09:12.376937 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:12.332547 14395 raft_consensus.cc:1275] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 13:09:12.843134 14395 pending_rounds.cc:85] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 15
I20260709 13:09:12.843514 14395 pending_rounds.cc:107] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 13:09:12.843812 14395 raft_consensus.cc:2889] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:12.850059 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:12.851310 13755 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.005s	sys 0.017s
W20260709 13:09:12.851666 13755 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.006s	sys 0.017s
W20260709 13:09:12.851940 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 706812us
I20260709 13:09:12.297204 21334 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
W20260709 13:09:12.857980 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:12.778301 21259 consensus_meta.cc:287] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 1.103s	user 0.012s	sys 0.000s
W20260709 13:09:12.543386 20849 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.007s	sys 0.016s
W20260709 13:09:12.664888 21172 consensus_meta.cc:287] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 1.059s	user 0.010s	sys 0.002s
I20260709 13:09:12.803128 21214 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.545444 21243 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:12.639585 21364 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:12.747861 21019 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:12.773018 21306 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:12.878418 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:12.885265 13864 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:09:12.850811 21370 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:12.546151 21313 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:12.858918 21332 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.007s	sys 0.025s
I20260709 13:09:12.870198 21334 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:12.857985 21376 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:12.871896 20849 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.009s	sys 0.016s
W20260709 13:09:12.884713 13829 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.011s	sys 0.010s
W20260709 13:09:12.891532 13829 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.011s	sys 0.010s
I20260709 13:09:12.895784 13864 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 27 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:09:12.855557 20897 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:12.865686 21345 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.007s	sys 0.021s
I20260709 13:09:12.337185 21337 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:12.905486 21337 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:12.905735 14400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 2163) took 1915 ms. Trace:
W20260709 13:09:12.889796 21332 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.007s	sys 0.025s
I20260709 13:09:12.880038 21259 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:12.906654 14400 rpcz_store.cc:276] 0709 13:09:10.991427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.172949 (+181522us) service_pool.cc:224] Handling call
0709 13:09:11.264895 (+ 91946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.265451 (+   556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.905489 (+1640038us) spinlock_profiling.cc:243] Waited 91.6 ms on lock 0x7b54009169d0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:12.905666 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210639232}
W20260709 13:09:12.898406 21282 consensus_meta.cc:287] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 1.218s	user 0.010s	sys 0.003s
I20260709 13:09:12.880646 21214 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:12.903002 21345 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.952s	user 0.008s	sys 0.021s
I20260709 13:09:12.917886 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:12.921478 13754 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.011s	sys 0.020s
W20260709 13:09:12.921877 13754 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.011s	sys 0.020s
I20260709 13:09:12.919821 21332 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:12.922698 21332 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:12.889325 21306 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:12.907832 21364 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:12.928246 14400 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:09:12.889449 21019 consensus_queue.cc:1048] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:09:12.933255 14400 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 20. Current term is 21. Ops: []
W20260709 13:09:12.925393 21319 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.010s	sys 0.004s
W20260709 13:09:12.938467 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 405225us
W20260709 13:09:12.935786 21339 consensus_meta.cc:287] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.775s	user 0.009s	sys 0.003s
W20260709 13:09:12.939168 21319 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.010s	sys 0.005s
I20260709 13:09:12.920229 21282 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:12.979729 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.933558 21364 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:12.980288 21206 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.007982 21214 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:12.984409 21384 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:13.011227 21384 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:13.013425 21384 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:13.020874 21387 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:09:13.021291 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.021471 21387 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:13.022383 21386 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:13.023787 21337 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.024358 21019 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.023885 21175 consensus_queue.cc:1048] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:13.024575 21337 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:13.024880 21019 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:13.026645 21337 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:13.026779 21019 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:13.027535 20919 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.027984 20919 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:13.028878 21364 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:12.937625 21259 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:13.029984 20919 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:13.023805 21206 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:13.032101 12594 thread.cc:527] Waited for 1000ms trying to join with rpc worker (tid 13697)
I20260709 13:09:13.032682 21282 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:13.032863 21206 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:13.030779 21259 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:13.023730 21387 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:13.035073 21122 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:13.035681 21122 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:13.038023 21122 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:13.038373 20897 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:13.039000 20897 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:13.039119 20919 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:13.039515 20897 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:13.039613 20919 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:13.041530 20897 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:13.042743 21332 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:13.038452 21122 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.044042 21122 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:13.153446 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 171714us
I20260709 13:09:13.022913 21386 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:13.167558 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 57633.6us
W20260709 13:09:13.154879 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 104408us
I20260709 13:09:12.979143 21339 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:13.170619 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:13.192909 14400 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 27.
I20260709 13:09:13.194463 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:13.195222 14400 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:13.041494 20919 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:09:13.166720 21390 log.cc:927] Time spent T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260709 13:09:13.166221 21388 log.cc:927] Time spent T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 13:09:13.350970 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 305158us
W20260709 13:09:13.314116 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 116714us
W20260709 13:09:13.357893 14367 leader_election.cc:336] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Timed out: RequestConsensusVote RPC to 127.12.76.129:37533 timed out after 1.731s (SENT)
I20260709 13:09:13.200371 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:13.358637 14367 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:13.360054 14399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 1654) took 3167 ms (client timeout 1794 ms). Trace:
I20260709 13:09:13.359992 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:13.360736 14399 rpcz_store.cc:269] 0709 13:09:10.192591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.192703 (+   112us) service_pool.cc:224] Handling call
0709 13:09:13.359834 (+3167131us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54003f07d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:13.359971 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519314688}
W20260709 13:09:13.170997 21383 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 13:09:13.363574 13682 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:13.370077 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:09:12.997818 21257 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:13.170822 21382 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
W20260709 13:09:13.364591 13783 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.025s	user 0.005s	sys 0.005s
W20260709 13:09:13.400175 13783 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.069s	user 0.005s	sys 0.005s
I20260709 13:09:13.400633 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:13.365664 13864 raft_consensus.cc:2410] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:09:13.376318 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:13.406000 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:13.450076 14399 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:09:13.287851 21391 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.452942 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:13.458323 14399 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:13.450250 13861 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:13.200296 21233 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:13.355823 21258 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:13.355804 21386 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:13.404228 21214 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:09:13.256367 13599 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 536b1fc131984687bf3b13417507e21d with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 35ecb005831740438d7537dd4b840e03 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 24 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:09:13.488125 21374 consensus_meta.cc:287] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 1.377s	user 0.005s	sys 0.007s
I20260709 13:09:13.492362 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:13.374506 21247 consensus_queue.cc:1059] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.121s
I20260709 13:09:13.495735 14396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 2405) took 1834 ms. Trace:
I20260709 13:09:13.401360 20919 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:13.500345 13861 raft_consensus.cc:2410] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:09:13.325284 21376 consensus_queue.cc:1048] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.151s
I20260709 13:09:13.407722 21384 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:13.453543 21356 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:09:13.474191 21381 log.cc:927] Time spent T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.553s	user 0.001s	sys 0.000s
I20260709 13:09:13.452070 21334 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:13.403124 21392 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:09:13.580811 13599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 324685us
I20260709 13:09:13.583477 14396 rpcz_store.cc:276] 0709 13:09:11.661632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.262449 (+600817us) service_pool.cc:224] Handling call
0709 13:09:12.262766 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:12.349211 (+ 86445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.349261 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:12.349851 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 13:09:12.949520 (+599669us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:12.949577 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.949671 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:13.495496 (+545825us) raft_consensus.cc:1685] finished
0709 13:09:13.495517 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.495664 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":80333,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":48912,"thread_start_us":92463,"threads_started":1,"wal-append.queue_time_us":522064}
I20260709 13:09:13.607055 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:13.588778 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:13.592770 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:09:13.597050 14367 leader_election.cc:336] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Timed out: RequestConsensusVote RPC to 127.12.76.129:37533 timed out after 1.834s (SENT)
W20260709 13:09:13.609150 14367 leader_election.cc:336] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Timed out: RequestConsensusVote RPC to 127.12.76.129:37533 timed out after 1.848s (SENT)
W20260709 13:09:13.610378 14367 leader_election.cc:336] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Timed out: RequestConsensusVote RPC to 127.12.76.129:37533 timed out after 1.999s (SENT)
I20260709 13:09:13.612336 14399 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:09:13.587865 21374 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 20. Current term is 21.
I20260709 13:09:13.613348 14396 raft_consensus.cc:2393] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 20: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:13.613787 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:13.618734 14400 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:09:13.453706 21397 consensus_queue.cc:1059] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.192s
I20260709 13:09:13.586053 21214 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.451710 21395 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.198s
I20260709 13:09:13.403754 21345 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.198s
I20260709 13:09:13.634922 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:13.637249 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 234268us
I20260709 13:09:13.630721 13864 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
W20260709 13:09:13.631219 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 433052us
W20260709 13:09:13.640415 14366 leader_election.cc:336] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Timed out: RequestConsensusVote RPC to 127.12.76.130:36047 timed out after 1.778s (SENT)
I20260709 13:09:13.640925 14366 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:13.605793 21306 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:13.647183 13757 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:13.648353 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:13.649557 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:13.604839 21384 raft_consensus.cc:697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 21 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:13.605597 21386 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:13.653725 14399 raft_consensus.cc:1240] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:13.594754 21364 consensus_queue.cc:1059] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:09:13.656997 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:13.638911 21214 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:13.659170 13861 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
I20260709 13:09:13.664676 13864 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:09:13.497423 21258 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:13.657920 21374 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:13.665294 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 86329us
I20260709 13:09:13.484472 21391 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:13.669351 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:13.670004 13864 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 23.
I20260709 13:09:13.663008 21122 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:13.629580 21392 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:13.661840 21397 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:13.663372 21306 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:13.670174 13755 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:13.663539 21401 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:09:13.716344 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 46297.5us
I20260709 13:09:13.700165 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:13.668048 21339 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:13.659859 21386 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:13.681340 21402 raft_consensus.cc:3055] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:13.717092 21401 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:13.732249 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:13.733860 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:13.720036 21233 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:13.726540 21402 raft_consensus.cc:740] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:13.738240 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:13.672897 21374 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:13.742182 14396 raft_consensus.cc:1275] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:09:13.742877 21391 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:13.720069 21384 consensus_queue.cc:237] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:13.745162 14401 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 1659) took 2378 ms (client timeout 2039 ms). Trace:
W20260709 13:09:13.750288 14401 rpcz_store.cc:269] 0709 13:09:11.366488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.366622 (+   134us) service_pool.cc:224] Handling call
0709 13:09:13.744955 (+2378333us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b54000fa854. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:13.745084 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67235072}
I20260709 13:09:13.752214 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 33 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:13.753026 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 3497) took 1642 ms. Trace:
I20260709 13:09:13.753345 13791 rpcz_store.cc:276] 0709 13:09:12.110539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.751939 (+1641400us) service_pool.cc:224] Handling call
0709 13:09:13.752967 (+  1028us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:13.754030 21170 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:13.754424 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:13.755292 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:13.756443 13788 raft_consensus.cc:2410] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:09:13.756820 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48928 (request call id 3492) took 1822 ms. Trace:
I20260709 13:09:13.757117 13788 rpcz_store.cc:276] 0709 13:09:11.934454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.755056 (+1820602us) service_pool.cc:224] Handling call
0709 13:09:13.756768 (+  1712us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:13.757959 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:13.741590 21233 raft_consensus.cc:697] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:13.759402 21233 consensus_queue.cc:237] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:13.759907 21285 raft_consensus.cc:3055] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:13.760085 21258 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:13.760331 21285 raft_consensus.cc:740] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:09:13.761109 13830 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 80 similar messages]
I20260709 13:09:13.761221 21285 consensus_queue.cc:260] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:13.762670 21285 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:13.762367 21402 consensus_queue.cc:260] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:13.763607 21402 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:13.764873 21401 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:13.765153 21181 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:13.770516 21374 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:13.748060 13864 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
W20260709 13:09:13.740908 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 93801.3us
I20260709 13:09:13.748574 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 3375) took 1585 ms. Trace:
I20260709 13:09:13.772751 13865 rpcz_store.cc:276] 0709 13:09:12.163498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.163672 (+   174us) service_pool.cc:224] Handling call
0709 13:09:12.164037 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:12.850081 (+686044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.748319 (+898238us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54002d7dd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:13.748514 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615503104}
I20260709 13:09:13.749580 21345 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.774797 13757 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:13.772785 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:13.779714 13864 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 23.
I20260709 13:09:13.781308 21345 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:13.781976 13865 raft_consensus.cc:1275] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:09:13.784118 21345 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:13.785213 14393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 1665) took 2168 ms. Trace:
I20260709 13:09:13.785598 14393 rpcz_store.cc:276] 0709 13:09:11.616977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.260204 (+643227us) service_pool.cc:224] Handling call
0709 13:09:12.840487 (+580283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.911940 (+ 71453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.911987 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:12.912042 (+    55us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:12.912093 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.785000 (+872907us) spinlock_profiling.cc:243] Waited 71.2 ms on lock 0x7b5400595bd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:13.785045 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.785160 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163691904}
I20260709 13:09:13.786824 21392 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:13.794852 21386 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:13.798041 13757 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:13.809859 13865 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 21 LEADER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 20. Current term is 21. Ops: []
W20260709 13:09:13.812920 14367 leader_election.cc:336] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Timed out: RequestConsensusVote RPC to 127.12.76.129:37533 timed out after 2.157s (SENT)
I20260709 13:09:13.818512 13864 raft_consensus.cc:1275] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:09:13.819736 21408 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:13.805946 21391 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:13.821957 21078 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:13.822482 21078 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:13.819219 21214 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:13.794852 21325 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:09:13.842703 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:13.833206 14402 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 2402) took 2606 ms (client timeout 2111 ms). Trace:
W20260709 13:09:13.853868 14402 rpcz_store.cc:269] 0709 13:09:11.227068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.259966 (+ 32898us) service_pool.cc:224] Handling call
0709 13:09:13.832959 (+2572993us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b5400383954. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:13.833115 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352494848}
I20260709 13:09:13.828341 21410 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:13.864675 21410 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.865015 21410 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:13.865634 21214 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:13.868291 21329 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:13.822058 21408 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:13.870872 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.871186 20881 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.826999 21078 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:13.864166 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:13.845886 21399 raft_consensus.cc:3055] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:13.872877 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:13.881896 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:13.882679 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:13.883277 14402 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
I20260709 13:09:13.883541 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:13.884222 14396 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:09:13.879767 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:13.842300 21213 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:09:13.877949 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 239805us
I20260709 13:09:13.871802 20881 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:13.882869 21401 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:13.894068 21401 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:13.878394 21051 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.889986 13755 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:09:14.032547 12594 thread.cc:527] Waited for 2000ms trying to join with rpc worker (tid 13697)
I20260709 13:09:13.896214 21051 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:14.376608 21391 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:14.377085 21391 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.377465 21391 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:14.123253 21395 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:14.378216 21395 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:14.378852 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:14.237670 20776 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:14.380496 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:14.380582 14399 raft_consensus.cc:1240] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:09:14.381754 14396 raft_consensus.cc:2410] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 22 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:09:14.382019 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:14.382570 14399 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:09:14.382943 14396 raft_consensus.cc:1240] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:14.382645 20776 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:14.384029 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.384641 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:13.930356 21414 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.385001 21391 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:14.295136 13830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.900755 14395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 2408) took 2027 ms. Trace:
W20260709 13:09:13.923166 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.387694 14395 rpcz_store.cc:276] 0709 13:09:11.873437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.863239 (+989802us) service_pool.cc:224] Handling call
0709 13:09:13.746755 (+883516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.746934 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.746957 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:13.746996 (+    39us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:13.747033 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.747080 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.900592 (+153512us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b54000fa850. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:13.900695 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2031040256}
I20260709 13:09:14.385753 21414 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:14.386708 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 485049us
I20260709 13:09:13.896284 21401 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:14.394906 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 504952us
I20260709 13:09:13.871703 20965 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:14.396093 13829 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:14.403479 14399 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:14.404052 21356 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:14.404567 21356 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:14.406345 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:14.407095 14399 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:14.362192 21233 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:14.411819 21233 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:14.412348 13755 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:14.413883 21233 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:14.414417 21233 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:14.414785 21233 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:14.415154 21233 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:14.417892 13757 leader_election.cc:304] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:14.418781 13757 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:13.882020 21399 raft_consensus.cc:740] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:14.420471 14399 raft_consensus.cc:2468] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 22.
W20260709 13:09:14.420080 21338 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.029s	sys 0.025s
I20260709 13:09:13.877761 21078 consensus_queue.cc:1048] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.546s
I20260709 13:09:14.387447 21391 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:14.428355 21338 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.029s	sys 0.026s
I20260709 13:09:14.438091 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:14.432794 21414 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:14.441471 20991 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:14.443081 21277 raft_consensus.cc:3055] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:09:14.445107 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2881) took 3075 ms. Trace:
I20260709 13:09:14.449131 13785 rpcz_store.cc:276] 0709 13:09:11.369395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.369503 (+   108us) service_pool.cc:224] Handling call
0709 13:09:11.369778 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.370180 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.370218 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:13.757891 (+2387673us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b18001b96a0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3bf2a6 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5230dd7a11 00007f5230de7372 00007f5232519a01 00007f52324de43a
0709 13:09:13.758326 (+   435us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b2c000108d8. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5230dd7a11 00007f5230de7372 00007f5232519a01 00007f52324de43a 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2
0709 13:09:13.758768 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 13:09:13.927341 (+168573us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:09:13.927378 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.957481 (+ 30103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:14.444847 (+487366us) raft_consensus.cc:1685] finished
0709 13:09:14.444872 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.445026 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12606,"raft.queue_time_us":1974,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":4634,"spinlock_wait_cycles":11526144,"thread_start_us":168267,"threads_started":1,"wal-append.queue_time_us":674127}
I20260709 13:09:14.428966 20881 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:14.453353 21051 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:14.448681 20991 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.456494 14399 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 27 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:09:14.400549 20965 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:14.458037 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:14.439869 21391 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:14.459777 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:14.464288 14402 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:14.468325 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42104 (request call id 1843) took 3450 ms. Trace:
I20260709 13:09:14.468799 13863 rpcz_store.cc:276] 0709 13:09:11.017755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.017879 (+   124us) service_pool.cc:224] Handling call
0709 13:09:11.020361 (+  2482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.034242 (+ 13881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.468040 (+3433798us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b540004a454. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:14.468255 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11036928}
I20260709 13:09:14.459322 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:14.458660 20991 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:14.448909 21277 raft_consensus.cc:740] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:09:14.455963 21341 log.cc:927] Time spent T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 3.061s	user 0.009s	sys 0.037s
I20260709 13:09:14.463537 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1709) took 1458 ms. Trace:
I20260709 13:09:14.479346 13785 rpcz_store.cc:276] 0709 13:09:13.005433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.457819 (+1452386us) service_pool.cc:224] Handling call
0709 13:09:14.463480 (+  5661us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:14.486187 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:14.489773 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:14.490464 13785 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:14.491612 14399 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:14.474301 21053 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.498822 14400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56558 (request call id 1671) took 1327 ms. Trace:
I20260709 13:09:14.499233 14400 rpcz_store.cc:276] 0709 13:09:13.171285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.634156 (+462871us) service_pool.cc:224] Handling call
0709 13:09:13.836896 (+202740us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:13.837343 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.837384 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:13.838137 (+   753us) log.cc:844] Serialized 52 byte log entry
0709 13:09:13.861204 (+ 23067us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:09:13.861898 (+   694us) log.cc:844] Serialized 14 byte log entry
0709 13:09:13.863286 (+  1388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.863371 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:13.863564 (+   193us) raft_consensus.cc:1685] finished
0709 13:09:13.863578 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.498650 (+635072us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b5400383950. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:14.498763 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":153,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":3838,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":188,"spinlock_wait_cycles":465170176,"thread_start_us":22633,"threads_started":1,"wal-append.queue_time_us":23014}
I20260709 13:09:14.501507 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:14.502602 14402 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:09:14.513129 21335 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:09:14.513585 21335 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.513908 21335 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:09:14.519402 13785 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 20.
I20260709 13:09:14.455693 21399 consensus_queue.cc:260] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:14.520908 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1708) took 1515 ms. Trace:
I20260709 13:09:14.522003 14399 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:09:14.525364 21399 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:14.525091 13785 rpcz_store.cc:276] 0709 13:09:13.005093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.489466 (+1484373us) service_pool.cc:224] Handling call
0709 13:09:14.520851 (+ 31385us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:14.507725 21053 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:14.543567 21356 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:14.526252 21395 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:14.547092 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:14.545094 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56582 (request call id 2395) took 3554 ms. Trace:
I20260709 13:09:14.558475 14397 rpcz_store.cc:276] 0709 13:09:10.986397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.986596 (+   199us) service_pool.cc:224] Handling call
0709 13:09:10.993056 (+  6460us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:10.993378 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:10.993401 (+    23us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:11.007100 (+ 13699us) log.cc:844] Serialized 52 byte log entry
0709 13:09:11.229143 (+222043us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:11.598222 (+369079us) log.cc:844] Serialized 14 byte log entry
0709 13:09:11.603891 (+  5669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.604008 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:14.450847 (+2846839us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:09:14.532484 (+ 81637us) raft_consensus.cc:1685] finished
0709 13:09:14.540228 (+  7744us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.540398 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6497,"prepare.queue_time_us":422449,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":135531,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":16877,"spinlock_wait_cycles":8639360,"thread_start_us":562139,"threads_started":2,"wal-append.queue_time_us":334570}
I20260709 13:09:14.515674 21277 consensus_queue.cc:260] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:14.556311 21401 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.585038 13860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 3359) took 3443 ms. Trace:
I20260709 13:09:14.585649 13860 rpcz_store.cc:276] 0709 13:09:11.141121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.141447 (+   326us) service_pool.cc:224] Handling call
0709 13:09:11.141819 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.443453 (+301634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.584681 (+3141228us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b5400387054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:14.584955 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659115392}
W20260709 13:09:14.618664 21410 consensus_meta.cc:287] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03: Time spent flushing consensus metadata: real 0.753s	user 0.010s	sys 0.003s
I20260709 13:09:14.592146 21401 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:14.618943 21277 raft_consensus.cc:3060] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:14.626204 21410 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:14.672117 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 258399us
W20260709 13:09:14.674217 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 255321us
I20260709 13:09:14.683364 13757 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:14.685393 13757 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:14.686817 13755 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:14.698241 21019 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:14.699733 21019 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:14.636438 21356 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:14.703159 21356 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:14.703696 21356 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:14.704247 21356 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:09:14.705462 21420 log.cc:927] Time spent T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:09:14.706496 21320 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:14.706611 21053 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:14.633450 20965 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:14.707727 21320 raft_consensus.cc:2804] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:14.713843 13784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 1688) took 6000 ms. Trace:
I20260709 13:09:14.718075 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:14.721844 13788 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1713) took 1554 ms (client timeout 1778 ms). Trace:
W20260709 13:09:14.722388 13788 rpcz_store.cc:269] 0709 13:09:13.167116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.757731 (+590615us) service_pool.cc:224] Handling call
0709 13:09:14.721332 (+963601us) spinlock_profiling.cc:243] Waited 48.9 ms on lock 0x7b540026ded4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:14.721605 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112498560}
I20260709 13:09:14.724738 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3471) took 3738 ms. Trace:
I20260709 13:09:14.725848 21410 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:14.727321 21413 log.cc:927] Time spent T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:09:14.725327 13782 rpcz_store.cc:276] 0709 13:09:10.986262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.991231 (+  4969us) service_pool.cc:224] Handling call
0709 13:09:10.991680 (+   449us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:10.992261 (+   581us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:09:14.417043 (+3424782us) spinlock_profiling.cc:243] Waited 9.74 ms on lock 0x7b1800324a60. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f52320864bc 00007f522f3d448b 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3ee455 00007f5235ed63c7 00007f52324e89a7 00007f52324f80bf
0709 13:09:14.417182 (+   139us) log.cc:844] Serialized 14 byte log entry
0709 13:09:14.679489 (+262307us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:14.680979 (+  1490us) log.cc:844] Serialized 52 byte log entry
0709 13:09:14.681239 (+   260us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:14.681701 (+   462us) log.cc:844] Serialized 14 byte log entry
0709 13:09:14.681915 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.682074 (+   159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:14.724278 (+ 42204us) raft_consensus.cc:1685] finished
0709 13:09:14.724300 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.724513 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":124927,"prepare.run_cpu_time_us":161,"prepare.run_wall_time_us":4220,"raft.queue_time_us":31118,"raft.run_cpu_time_us":595,"raft.run_wall_time_us":24705,"spinlock_wait_cycles":22393088,"thread_start_us":397359,"threads_started":2,"wal-append.queue_time_us":224786}
I20260709 13:09:14.729593 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 4070) took 1090 ms. Trace:
I20260709 13:09:14.730593 13858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 3358) took 3589 ms. Trace:
W20260709 13:09:14.715075 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.731003 13858 rpcz_store.cc:276] 0709 13:09:11.140870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.141449 (+   579us) service_pool.cc:224] Handling call
0709 13:09:11.141884 (+   435us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:11.187584 (+ 45700us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:09:11.207056 (+ 19472us) log.cc:844] Serialized 14 byte log entry
0709 13:09:13.774796 (+2567740us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b18004bbf80. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f522f3d3e07 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b 00007f523207dd23 00007f523207e23a 00007f52324e8a2a
0709 13:09:13.860535 (+ 85739us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:13.861313 (+   778us) log.cc:844] Serialized 52 byte log entry
0709 13:09:13.861529 (+   216us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:13.861577 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.861676 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:14.729943 (+868267us) raft_consensus.cc:1685] finished
0709 13:09:14.730062 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.730307 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12207,"prepare.queue_time_us":19295,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":46527,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":16989,"spinlock_wait_cycles":82526592,"thread_start_us":85329,"threads_started":1,"wal-append.queue_time_us":3304818}
I20260709 13:09:14.733628 21424 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.730054 13864 rpcz_store.cc:276] 0709 13:09:13.638584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.856304 (+217720us) service_pool.cc:224] Handling call
0709 13:09:13.873190 (+ 16886us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:13.873525 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:09:14.164120 (+290595us) log.cc:844] Serialized 14 byte log entry
0709 13:09:14.555677 (+391557us) log.cc:844] Serialized 14 byte log entry
0709 13:09:14.555814 (+   137us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:14.556496 (+   682us) log.cc:844] Serialized 26 byte log entry
0709 13:09:14.556717 (+   221us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:14.556747 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.556810 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:14.729106 (+172296us) raft_consensus.cc:1685] finished
0709 13:09:14.729140 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.729348 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":556476,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":75,"raft.queue_time_us":45690,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":1427,"thread_start_us":670307,"threads_started":2,"wal-append.queue_time_us":463140}
I20260709 13:09:14.734840 13757 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:14.708649 21320 raft_consensus.cc:697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 22 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:14.687144 13787 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:09:14.714504 13784 rpcz_store.cc:276] 0709 13:09:08.712783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.773090 (+ 60307us) service_pool.cc:224] Handling call
0709 13:09:08.773713 (+   623us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.230245 (+2456532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.712976 (+3482731us) spinlock_profiling.cc:243] Waited 2.46 s on lock 0x7b540033ac54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:14.713552 (+   576us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5647701248}
I20260709 13:09:14.721760 21401 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:14.734472 21424 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:14.750998 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.752455 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3467) took 3771 ms. Trace:
I20260709 13:09:14.753475 13787 rpcz_store.cc:276] 0709 13:09:10.981595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.981761 (+   166us) service_pool.cc:224] Handling call
0709 13:09:14.685773 (+3704012us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b580001c598. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f3b9b71 00007f522f3b9a22 00007f52382d2c09 00007f523742cee0 00007f52374f60ab 00007f52374f6131 00007f52374b7fc0 00007f52374a2929 00007f52374a23d2 00007f5230a19bd4
0709 13:09:14.686389 (+   616us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:14.746814 (+ 60425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.752392 (+  5578us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4409600}
I20260709 13:09:14.764304 13863 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: []
W20260709 13:09:14.766546 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.767644 21029 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:14.768052 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:14.769034 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 2898) took 1286 ms. Trace:
I20260709 13:09:14.769469 13788 rpcz_store.cc:276] 0709 13:09:13.483021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.767606 (+1284585us) service_pool.cc:224] Handling call
0709 13:09:14.768946 (+  1340us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:14.769972 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:14.771881 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:14.766372 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:14.769068 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:14.779991 20785 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:14.781241 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:14.782159 13857 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 25.
I20260709 13:09:14.776050 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:14.759202 20776 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:14.787870 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:14.771132 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:14.783290 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:14.793759 13863 raft_consensus.cc:2393] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 20: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:14.775403 21424 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:14.775920 21136 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:14.804258 13857 raft_consensus.cc:2410] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:09:14.805544 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:14.804843 21320 consensus_queue.cc:237] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:14.806392 13857 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:09:14.809909 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 121360us
I20260709 13:09:14.793736 21356 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:14.815627 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:14.822849 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:14.821025 13858 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:14.824779 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1721) took 1334 ms. Trace:
I20260709 13:09:14.826180 13788 rpcz_store.cc:276] 0709 13:09:13.489848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.819686 (+1329838us) service_pool.cc:224] Handling call
0709 13:09:14.824689 (+  5003us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:14.837167 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 104539us
I20260709 13:09:14.839500 13757 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:14.848150 21348 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:14.853601 13757 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:14.854691 21355 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:14.854293 21359 consensus_queue.cc:260] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:14.855237 21355 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:14.855909 21355 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:09:14.861135 13830 consensus_peers.cc:597] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:14.862521 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:14.863713 13788 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 25.
I20260709 13:09:14.864362 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 2893) took 1505 ms. Trace:
I20260709 13:09:14.864737 13788 rpcz_store.cc:276] 0709 13:09:13.359452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.844675 (+1485223us) service_pool.cc:224] Handling call
0709 13:09:14.864271 (+ 19596us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:14.866051 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:14.866474 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:14.866983 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 2899) took 1380 ms. Trace:
W20260709 13:09:14.877049 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 480905us
I20260709 13:09:14.877285 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:14.878512 13791 raft_consensus.cc:2410] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:09:14.879047 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1718) took 1390 ms. Trace:
I20260709 13:09:14.879643 21356 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:14.880867 13861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 4063) took 1375 ms. Trace:
I20260709 13:09:14.881392 13861 rpcz_store.cc:276] 0709 13:09:13.505117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.592540 (+ 87423us) service_pool.cc:224] Handling call
0709 13:09:14.880357 (+1287817us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b54000d0cd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:14.880602 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61954816}
W20260709 13:09:14.884464 14398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56570 (request call id 2165) took 3883 ms (client timeout 2565 ms). Trace:
W20260709 13:09:14.884969 14398 rpcz_store.cc:269] 0709 13:09:11.001168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.015058 (+ 13890us) service_pool.cc:224] Handling call
0709 13:09:14.883900 (+3868842us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b5400943ed4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:14.884206 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1366768384}
W20260709 13:09:14.886914 14394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56558 (request call id 1658) took 3521 ms (client timeout 3442 ms). Trace:
W20260709 13:09:14.887428 14394 rpcz_store.cc:269] 0709 13:09:11.365638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.366128 (+   490us) service_pool.cc:224] Handling call
0709 13:09:14.886462 (+3520334us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b540059a454. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:14.886712 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1114218368}
W20260709 13:09:14.888235 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.867336 13790 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:09:14.868573 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:14.878230 13829 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:14.893555 13829 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:14.894373 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:14.895720 21348 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:14.896075 21328 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:14.883220 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:14.888954 13791 rpcz_store.cc:276] 0709 13:09:13.488970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.876783 (+1387813us) service_pool.cc:224] Handling call
0709 13:09:14.878967 (+  2184us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:14.896275 21379 log.cc:927] Time spent T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 1.906s	user 0.005s	sys 0.000s
I20260709 13:09:14.898152 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:14.904605 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 26 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:14.900736 21233 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:14.911590 21348 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.889278 13790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1722) took 1399 ms. Trace:
I20260709 13:09:14.901889 21173 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:14.914204 13790 rpcz_store.cc:276] 0709 13:09:13.490137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.866002 (+1375865us) service_pool.cc:224] Handling call
0709 13:09:14.889225 (+ 23223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:14.870327 13788 rpcz_store.cc:276] 0709 13:09:13.486338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.865586 (+1379248us) service_pool.cc:224] Handling call
0709 13:09:14.866885 (+  1299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:14.913877 21348 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:14.918097 21424 consensus_queue.cc:1059] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:14.918602 21233 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:14.915804 21328 raft_consensus.cc:697] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:14.920337 21328 consensus_queue.cc:237] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:14.921386 21315 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:14.921908 13785 raft_consensus.cc:2393] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 19: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
W20260709 13:09:14.924515 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.932394 14366 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:14.933480 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:14.934387 14398 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:09:14.934530 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:14.936702 21051 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:14.937202 21051 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:14.937628 21051 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:14.938194 13784 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1717) took 1449 ms (client timeout 1786 ms). Trace:
W20260709 13:09:14.938721 13784 rpcz_store.cc:269] 0709 13:09:13.488605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.893828 (+1405223us) service_pool.cc:224] Handling call
0709 13:09:14.938125 (+ 44297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:14.939981 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:14.949072 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:14.949875 13790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1728) took 1032 ms. Trace:
I20260709 13:09:14.950263 13790 rpcz_store.cc:276] 0709 13:09:13.917766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.948689 (+1030923us) service_pool.cc:224] Handling call
0709 13:09:14.949822 (+  1133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:14.950629 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:14.951138 21408 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:14.954120 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:14.955974 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 33 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:14.956269 21019 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:14.957844 13787 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1720) took 1458 ms (client timeout 1933 ms). Trace:
W20260709 13:09:14.958324 13787 rpcz_store.cc:269] 0709 13:09:13.489563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.897698 (+1408135us) service_pool.cc:224] Handling call
0709 13:09:14.947994 (+ 50296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:14.958942 21216 consensus_queue.cc:1059] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:09:14.960152 13859 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59792 (request call id 3370) took 3041 ms (client timeout 2847 ms). Trace:
W20260709 13:09:14.960857 13859 rpcz_store.cc:269] 0709 13:09:11.918789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.919105 (+   316us) service_pool.cc:224] Handling call
0709 13:09:14.959744 (+3040639us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b540024f754. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:14.959931 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":921722752}
I20260709 13:09:14.962191 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:14.962560 21335 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:14.946223 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:14.932683 21350 log.cc:927] Time spent T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 3.445s	user 0.007s	sys 0.027s
I20260709 13:09:14.960191 21303 raft_consensus.cc:3055] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:09:14.964395 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 138526us
I20260709 13:09:14.964877 21136 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.966427 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:14.945073 13783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3488) took 3019 ms. Trace:
I20260709 13:09:14.969060 13865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 4061) took 1464 ms. Trace:
I20260709 13:09:14.963128 13859 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 12.
I20260709 13:09:14.940562 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:14.941466 13863 raft_consensus.cc:2393] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 22: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:14.969901 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:14.976166 13857 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 22.
I20260709 13:09:14.971576 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:14.978763 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 125347us
I20260709 13:09:14.987568 13784 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 20.
W20260709 13:09:14.990015 13785 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1712) took 1823 ms (client timeout 2008 ms). Trace:
I20260709 13:09:14.990199 14398 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:14.987538 21136 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:14.990540 13785 rpcz_store.cc:269] 0709 13:09:13.166780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.540042 (+1373262us) service_pool.cc:224] Handling call
0709 13:09:14.987669 (+447627us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54000df554. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:14.989940 (+  2271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":769271168}
I20260709 13:09:14.991812 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:14.992400 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 50892.2us
I20260709 13:09:14.992511 13785 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:09:14.979183 13783 rpcz_store.cc:276] 0709 13:09:11.925111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.925252 (+   141us) service_pool.cc:224] Handling call
0709 13:09:11.940036 (+ 14784us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.940405 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:09:11.952989 (+ 12584us) log.cc:844] Serialized 14 byte log entry
0709 13:09:13.400553 (+1447564us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:13.409399 (+  8846us) log.cc:844] Serialized 26 byte log entry
0709 13:09:13.409580 (+   181us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:09:13.409633 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.409744 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:14.859123 (+1449379us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:09:14.944506 (+ 85383us) raft_consensus.cc:1685] finished
0709 13:09:14.944651 (+   145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.944869 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10656,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":552333,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":7765,"spinlock_wait_cycles":6241536,"thread_start_us":1416002,"threads_started":2,"wal-append.queue_time_us":950588}
I20260709 13:09:14.993456 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:14.994167 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:14.994458 13755 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:14.994614 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:14.995344 13864 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:14.996917 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:15.001345 13787 raft_consensus.cc:2410] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:09:15.001803 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 2896) took 1599 ms. Trace:
I20260709 13:09:15.002154 13787 rpcz_store.cc:276] 0709 13:09:13.402049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.996556 (+1594507us) service_pool.cc:224] Handling call
0709 13:09:15.001722 (+  5166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:14.998136 21315 consensus_queue.cc:1059] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:09:15.003907 21315 raft_consensus.cc:3055] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:15.004334 21315 raft_consensus.cc:740] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:15.005419 21315 consensus_queue.cc:260] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:15.006923 21315 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:14.979696 13865 rpcz_store.cc:276] 0709 13:09:13.504578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.782709 (+278131us) service_pool.cc:224] Handling call
0709 13:09:13.782972 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.810400 (+ 27428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.959204 (+1148804us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b54002fadd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:14.968808 (+  9604us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61382912}
I20260709 13:09:14.998449 21333 consensus_queue.cc:1059] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.010s
I20260709 13:09:15.008610 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:15.008630 21333 raft_consensus.cc:3055] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:15.009192 21333 raft_consensus.cc:740] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:15.009466 13865 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:09:15.010524 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:15.010228 21333 consensus_queue.cc:260] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:14.978479 21303 raft_consensus.cc:740] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:14.996914 21234 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:15.012266 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:15.012816 21234 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:15.013396 21234 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:14.999462 21249 consensus_queue.cc:1059] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:09:15.015923 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:15.016836 14393 raft_consensus.cc:2393] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 21: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:15.018029 21347 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.018299 21333 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:15.018657 21347 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:15.019722 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 121042us
I20260709 13:09:15.021106 21347 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:15.021234 13829 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:15.021775 13856 raft_consensus.cc:2393] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 28: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:15.023756 21335 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 28 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:15.024350 21136 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:15.024534 21236 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:15.025035 21236 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.025455 21236 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:15.026480 13861 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 20: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:09:14.988117 13830 leader_election.cc:336] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:15.028689 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 99802.1us
I20260709 13:09:15.029265 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:15.012136 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1727) took 1122 ms. Trace:
I20260709 13:09:15.030468 13791 rpcz_store.cc:276] 0709 13:09:13.889600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.927921 (+1038321us) service_pool.cc:224] Handling call
0709 13:09:15.012041 (+ 84120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:15.032845 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:15.020852 21359 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:15.012437 21303 consensus_queue.cc:260] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:15.035894 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:14.942873 20991 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:15.033417 13790 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 21.
I20260709 13:09:14.988530 13784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 2900) took 1087 ms. Trace:
I20260709 13:09:15.030027 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1724) took 1371 ms. Trace:
I20260709 13:09:15.043959 13784 rpcz_store.cc:276] 0709 13:09:13.901302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.961380 (+1060078us) service_pool.cc:224] Handling call
0709 13:09:14.988456 (+ 27076us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:15.044054 13782 rpcz_store.cc:276] 0709 13:09:13.658661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.028935 (+1370274us) service_pool.cc:224] Handling call
0709 13:09:15.029976 (+  1041us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:15.049876 13864 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:09:15.011693 13785 raft_consensus.cc:2376] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 20. Re-sending same reply.
I20260709 13:09:15.024497 21335 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:15.062048 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:15.062994 14398 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:09:15.064697 13791 raft_consensus.cc:2410] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 20 because replica has last-logged OpId of term: 19 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 13:09:15.065636 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:15.066082 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:15.068383 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1715) took 1702 ms. Trace:
I20260709 13:09:15.068877 13791 rpcz_store.cc:276] 0709 13:09:13.366492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.031156 (+1664664us) service_pool.cc:224] Handling call
0709 13:09:15.068311 (+ 37155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:15.070269 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:15.061220 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:15.071746 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:15.079663 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:15.080703 13784 raft_consensus.cc:2410] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 20 because replica has last-logged OpId of term: 19 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 13:09:15.081948 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:15.078877 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:15.085119 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:15.058346 21335 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:15.091756 13789 raft_consensus.cc:2393] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 19: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:15.095994 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:15.092216 14393 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
I20260709 13:09:15.097203 13790 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 21.
I20260709 13:09:15.101733 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:15.103528 13787 raft_consensus.cc:1240] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 22 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:15.091264 21335 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:15.110484 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 26 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:15.111264 13856 raft_consensus.cc:2410] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 26 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 13:09:15.112119 13755 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:15.114379 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3491) took 3177 ms. Trace:
I20260709 13:09:15.114802 13787 rpcz_store.cc:276] 0709 13:09:11.929499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.061104 (+3131605us) service_pool.cc:224] Handling call
0709 13:09:15.098213 (+ 37109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.107007 (+  8794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.107207 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:15.115720 14368 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:15.116894 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:15.117684 13860 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
I20260709 13:09:15.119637 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:15.120436 13788 raft_consensus.cc:2393] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 21: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:15.120800 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1711) took 1954 ms. Trace:
I20260709 13:09:15.121076 13788 rpcz_store.cc:276] 0709 13:09:13.166414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.058508 (+1892094us) service_pool.cc:224] Handling call
0709 13:09:15.120746 (+ 62238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:15.123639 21303 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:15.119339 21234 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:15.134310 13863 raft_consensus.cc:1275] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:09:15.137149 13785 raft_consensus.cc:1240] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:15.141149 13863 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:09:15.145787 13789 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 2895) took 1773 ms (client timeout 1830 ms). Trace:
W20260709 13:09:15.146234 13789 rpcz_store.cc:269] 0709 13:09:13.372205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.717246 (+1345041us) service_pool.cc:224] Handling call
0709 13:09:15.145617 (+428371us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b540033bb54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:15.145737 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841151360}
I20260709 13:09:15.153309 13783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3498) took 1956 ms. Trace:
I20260709 13:09:15.153759 13783 rpcz_store.cc:276] 0709 13:09:13.196590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.152356 (+1955766us) service_pool.cc:224] Handling call
0709 13:09:15.152703 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.152922 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:15.152962 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:15.153023 (+    61us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:15.153072 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.153133 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.153239 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:15.155094 20991 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:15.153774 14366 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:15.161708 13859 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 28 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 27. Current term is 28. Ops: [27.16-27.16]
I20260709 13:09:15.165598 13863 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:09:15.166719 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:15.168180 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3493) took 3230 ms. Trace:
I20260709 13:09:15.168663 13857 raft_consensus.cc:2410] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:09:15.168604 13785 rpcz_store.cc:276] 0709 13:09:11.938079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.060548 (+3122469us) service_pool.cc:224] Handling call
0709 13:09:15.102172 (+ 41624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.137680 (+ 35508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.167933 (+ 30253us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b54001b71d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:15.168101 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79969024}
W20260709 13:09:15.186123 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 207816us
I20260709 13:09:15.186547 14366 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:15.187070 14368 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:15.187629 21337 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:15.187983 21401 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:15.188407 21401 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:15.188714 21195 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:15.188853 21401 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:15.190623 14366 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:15.191596 21195 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:15.192018 21195 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:15.192427 21195 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:09:15.194103 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:15.196828 21277 consensus_meta.cc:287] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.569s	user 0.007s	sys 0.011s
I20260709 13:09:15.197799 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:15.199014 21393 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:15.199450 21393 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:15.199831 21393 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:15.200225 14398 raft_consensus.cc:1240] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:15.202759 14398 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:15.203738 21175 consensus_queue.cc:1048] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:09:15.163314 13859 raft_consensus.cc:1275] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:15.203048 13757 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:15.216523 13858 raft_consensus.cc:2468] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 20.
I20260709 13:09:15.219509 13784 raft_consensus.cc:1240] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:15.224879 13791 raft_consensus.cc:1240] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:09:15.241014 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2894) took 1876 ms. Trace:
I20260709 13:09:15.229832 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:15.241529 13791 rpcz_store.cc:276] 0709 13:09:13.364266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.207810 (+1843544us) service_pool.cc:224] Handling call
0709 13:09:15.208258 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:15.229392 (+ 21134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.240946 (+ 11554us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:15.244527 13784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3494) took 3287 ms. Trace:
I20260709 13:09:15.245429 13784 rpcz_store.cc:276] 0709 13:09:11.943778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.088808 (+3145030us) service_pool.cc:224] Handling call
0709 13:09:15.209010 (+120202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.230511 (+ 21501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.230753 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:15.183748 21236 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:15.253126 13790 raft_consensus.cc:2393] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 17: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:15.254112 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:15.251984 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 193481us
I20260709 13:09:15.167186 21348 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:15.261309 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:15.265362 13755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.151314 21051 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:15.275311 13785 raft_consensus.cc:1240] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:15.273269 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:15.278951 21236 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:15.220356 21320 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:09:15.262321 21408 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:15.287588 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:15.287676 21277 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:15.295234 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 92304.7us
I20260709 13:09:15.241092 21355 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:15.259310 21029 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.300873 13785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2897) took 1893 ms. Trace:
I20260709 13:09:15.310631 13785 rpcz_store.cc:276] 0709 13:09:13.407790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.250935 (+1843145us) service_pool.cc:224] Handling call
0709 13:09:15.275106 (+ 24171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.284803 (+  9697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.300802 (+ 15999us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:15.307603 13861 raft_consensus.cc:2393] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 16: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:15.263638 21337 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:15.318696 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 1725) took 1436 ms. Trace:
I20260709 13:09:15.314179 14395 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:09:15.322989 13784 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:09:15.319209 13791 rpcz_store.cc:276] 0709 13:09:13.882494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.253918 (+1371424us) service_pool.cc:224] Handling call
0709 13:09:15.299670 (+ 45752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.318279 (+ 18609us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:09:15.318319 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:15.318376 (+    57us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:15.318421 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.318499 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.318627 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:15.329960 13784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 1716) took 1860 ms. Trace:
I20260709 13:09:15.330893 14368 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:15.330449 13784 rpcz_store.cc:276] 0709 13:09:13.469243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.263766 (+1794523us) service_pool.cc:224] Handling call
0709 13:09:15.305594 (+ 41828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.323519 (+ 17925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.329877 (+  6358us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:15.335727 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.337486 21315 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.338287 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:15.338059 21315 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:15.339761 21355 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:15.340725 13829 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:15.341179 21315 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:15.341928 13789 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:15.344179 13790 raft_consensus.cc:1275] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:09:15.344985 13790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 1731) took 1090 ms. Trace:
I20260709 13:09:15.345386 13790 rpcz_store.cc:276] 0709 13:09:14.254360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.265090 (+1010730us) service_pool.cc:224] Handling call
0709 13:09:15.343756 (+ 78666us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.344676 (+   920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.344919 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:15.348807 21358 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:15.349822 21358 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:15.350237 21358 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.350302 21051 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:15.350719 21358 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:15.352420 21348 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:15.354605 21234 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:15.315928 21333 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:15.365016 21333 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:15.366329 13787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2891) took 3413 ms. Trace:
I20260709 13:09:15.326216 21408 raft_consensus.cc:697] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:15.377825 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:15.378896 14366 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:15.383402 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.399303 13789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 1710) took 2393 ms. Trace:
I20260709 13:09:15.446363 13860 raft_consensus.cc:1240] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:09:15.446766 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:15.446712 13789 rpcz_store.cc:276] 0709 13:09:13.005961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.147008 (+2141047us) service_pool.cc:224] Handling call
0709 13:09:15.147292 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.342343 (+195051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.399046 (+ 56703us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b540026e3d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:15.399245 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":447175552}
I20260709 13:09:15.397550 14395 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:09:15.370590 13757 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:15.449616 14393 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:09:15.453780 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:15.458079 13791 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:15.366734 13787 rpcz_store.cc:276] 0709 13:09:11.952734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.115803 (+3163069us) service_pool.cc:224] Handling call
0709 13:09:15.116373 (+   570us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:15.200594 (+ 84221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:15.200623 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:15.201190 (+   567us) log.cc:844] Serialized 52 byte log entry
0709 13:09:15.282401 (+ 81211us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:15.290874 (+  8473us) log.cc:844] Serialized 14 byte log entry
0709 13:09:15.291133 (+   259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.291216 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:15.366100 (+ 74884us) raft_consensus.cc:1685] finished
0709 13:09:15.366122 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.366271 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81928,"prepare.queue_time_us":10308,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":84174,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":191,"thread_start_us":80451,"threads_started":1,"wal-append.queue_time_us":162272}
W20260709 13:09:15.460722 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 129951us
I20260709 13:09:15.461076 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:15.461675 13789 raft_consensus.cc:2468] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 25.
I20260709 13:09:15.462663 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:15.464354 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:15.463789 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:15.465893 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:15.466261 13789 raft_consensus.cc:2468] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:09:15.466780 13790 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:09:15.467185 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:15.469995 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:15.470991 13784 raft_consensus.cc:2393] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 17: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:15.475278 13784 raft_consensus.cc:1240] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:15.461833 14368 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:15.373546 21441 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:15.458076 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 28 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:15.373406 13680 connection.cc:256] RPC call timeout handler was delayed by -1.8638741299999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2565s for a response
W20260709 13:09:15.484402 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 114000us
I20260709 13:09:15.367367 21333 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:15.452854 21051 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:15.446079 21315 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.503054 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:15.501837 13859 raft_consensus.cc:2410] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 28 because replica has last-logged OpId of term: 27 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 13:09:15.375175 21335 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:15.367544 21277 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:15.518577 13829 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:15.519876 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:15.510203 13680 connection.cc:256] RPC call timeout handler was delayed by -1.5630495389999624s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
W20260709 13:09:15.521130 13680 connection.cc:256] RPC call timeout handler was delayed by -1.388857322999911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1569s for a response
I20260709 13:09:15.335630 21029 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:15.521523 13680 connection.cc:256] RPC call timeout handler was delayed by -1.36562473399988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
W20260709 13:09:15.524827 13680 connection.cc:256] RPC call timeout handler was delayed by -1.289449538999861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
W20260709 13:09:15.525262 13680 connection.cc:256] RPC call timeout handler was delayed by -1.264231685000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17600000000000002s for a response
W20260709 13:09:15.525671 13680 connection.cc:256] RPC call timeout handler was delayed by -1.2169573229999742s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17600000000000002s for a response
I20260709 13:09:15.517238 13784 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:09:15.521576 13757 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:15.499884 21303 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:09:15.527693 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.528312 13829 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:15.506402 21249 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:15.509948 21216 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:15.509791 21233 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:15.532646 13857 raft_consensus.cc:1240] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: []
W20260709 13:09:15.537698 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 158944us
I20260709 13:09:15.531817 13786 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 13.
I20260709 13:09:15.536053 21433 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:15.379767 21408 consensus_queue.cc:237] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:15.541762 21173 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:09:15.533905 21303 raft_consensus.cc:697] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 20 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:15.555529 13829 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:15.542006 21216 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:15.500680 21441 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:15.532336 21424 consensus_queue.cc:1059] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 13:09:15.545672 21233 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:15.560940 14366 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:15.565590 13829 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:15.533216 21315 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:15.567111 20887 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.567516 21425 consensus_queue.cc:1059] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 13:09:15.565013 21216 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:15.561508 21359 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:15.545066 21249 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:15.571079 21233 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:15.581892 13788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48914 (request call id 2892) took 3485 ms. Trace:
I20260709 13:09:15.569284 21393 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:15.561856 21433 consensus_queue.cc:1059] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
I20260709 13:09:15.601632 21393 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:15.607333 21424 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:15.586346 13680 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:15.609910 14368 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:09:15.585711 21359 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.590569 21314 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.640702 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:15.641551 13858 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
I20260709 13:09:15.609163 21414 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.612691 21051 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:15.655632 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:15.580051 20887 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:15.657135 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:15.658013 13859 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
I20260709 13:09:15.614929 21359 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:15.655611 21332 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:15.662618 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:15.678684 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:15.682343 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:15.662577 21332 raft_consensus.cc:3055] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:15.653798 21051 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.686811 13858 raft_consensus.cc:2393] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 17: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:09:15.653983 21414 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:15.688774 13862 raft_consensus.cc:2410] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:09:15.664354 21277 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:15.673523 21335 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:15.697293 13865 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.009s	sys 0.033s
I20260709 13:09:15.654078 21401 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:15.697700 13865 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.009s	sys 0.033s
I20260709 13:09:15.698340 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:15.693176 13783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45134 (request call id 1723) took 2047 ms. Trace:
I20260709 13:09:15.700217 21249 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:15.684918 21332 raft_consensus.cc:740] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:09:15.708474 21195 consensus_meta.cc:287] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.003s
I20260709 13:09:15.709698 14393 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:09:15.679916 21303 consensus_queue.cc:237] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:15.710379 21292 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:09:15.712210 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:15.714679 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:15.715332 21064 raft_consensus.cc:3055] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:09:15.716279 21459 log.cc:927] Time spent T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:09:15.724290 21029 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:15.697911 21277 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:15.699582 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 140676us
I20260709 13:09:15.689364 21051 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:15.735340 13859 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:15.745155 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:09:15.743945 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 154598us
I20260709 13:09:15.748076 13757 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:15.735904 13783 rpcz_store.cc:276] 0709 13:09:13.645672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.256261 (+1610589us) service_pool.cc:224] Handling call
0709 13:09:15.309618 (+ 53357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.416611 (+106993us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:09:15.507247 (+ 90636us) log.cc:844] Serialized 14 byte log entry
0709 13:09:15.678272 (+171025us) log.cc:844] Serialized 14 byte log entry
0709 13:09:15.685332 (+  7060us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:15.686916 (+  1584us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:09:15.687216 (+   300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.692748 (+  5532us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.693083 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27801,"prepare.queue_time_us":27331,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":40109,"raft.run_wall_time_us":11004,"spinlock_wait_cycles":32901504,"thread_start_us":104314,"threads_started":1}
W20260709 13:09:15.761557 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.676126 21314 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:15.738989 21330 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:15.746652 21064 raft_consensus.cc:740] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:15.773685 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:15.781697 21472 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:15.782183 21472 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.782481 21472 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:15.749341 21195 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:15.785079 21195 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:15.789518 21332 consensus_queue.cc:260] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:15.790788 21332 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:15.791538 21064 consensus_queue.cc:260] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:15.792810 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 198367us
I20260709 13:09:15.792546 21064 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:15.791002 13791 raft_consensus.cc:2468] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:09:15.771592 21393 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:09:15.799307 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 51343.2us
I20260709 13:09:15.804441 14401 raft_consensus.cc:1275] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:09:15.805223 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:15.800905 13757 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:15.805968 14400 raft_consensus.cc:2393] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 22: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:15.810463 13757 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:15.812227 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:15.813565 20991 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:15.803908 21393 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:15.818924 20991 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:15.802700 21315 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:15.806742 21441 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:15.824016 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:15.826699 13865 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:15.825230 14368 leader_election.cc:304] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:09:15.826314 21458 log.cc:927] Time spent T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:09:15.833295 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:15.830420 13783 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 21.
I20260709 13:09:15.824546 21393 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:15.847538 21358 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:15.851505 13863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 4080) took 1021 ms. Trace:
I20260709 13:09:15.851892 13863 rpcz_store.cc:276] 0709 13:09:14.829859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.173289 (+343430us) service_pool.cc:224] Handling call
0709 13:09:15.176858 (+  3569us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:15.182597 (+  5739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:15.182921 (+   324us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:15.205354 (+ 22433us) log.cc:844] Serialized 26 byte log entry
0709 13:09:15.302538 (+ 97184us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:15.574510 (+271972us) log.cc:844] Serialized 14 byte log entry
0709 13:09:15.697100 (+122590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.697171 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:15.851263 (+154092us) raft_consensus.cc:1685] finished
0709 13:09:15.851283 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.851439 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6187,"prepare.queue_time_us":65456,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":34133,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":205,"thread_start_us":422405,"threads_started":3,"wal-append.queue_time_us":252519}
I20260709 13:09:15.822183 21175 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:09:15.843788 13782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48928 (request call id 3489) took 3906 ms. Trace:
I20260709 13:09:15.860730 13782 rpcz_store.cc:276] 0709 13:09:11.927498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.060458 (+3132960us) service_pool.cc:224] Handling call
0709 13:09:15.103023 (+ 42565us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:15.199028 (+ 96005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:15.199086 (+    58us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:15.219397 (+ 20311us) log.cc:844] Serialized 52 byte log entry
0709 13:09:15.334156 (+114759us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:15.336121 (+  1965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.336628 (+   507us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:15.833820 (+497192us) raft_consensus.cc:1685] finished
0709 13:09:15.833845 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.834028 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47066,"raft.queue_time_us":49062,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":61,"thread_start_us":71285,"threads_started":1,"wal-append.queue_time_us":274303}
I20260709 13:09:15.862799 21469 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:15.809336 21195 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:09:15.863327 21469 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.863718 21469 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:15.863948 13863 raft_consensus.cc:1240] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 21. Current term is 22. Ops: [19.12-21.13]
I20260709 13:09:15.839483 21433 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.867902 21433 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:15.869974 21433 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:15.870612 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 303893us
I20260709 13:09:15.870721 21393 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:15.872015 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:15.873845 21314 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:15.874074 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:15.875891 21292 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:15.876777 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 51659.7us
I20260709 13:09:15.878027 13865 raft_consensus.cc:2468] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 24.
I20260709 13:09:15.879545 21337 consensus_queue.cc:1048] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:15.880954 21337 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:15.882747 21277 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:15.883455 21277 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:15.884060 21216 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:15.885141 14394 raft_consensus.cc:1240] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:15.886165 21216 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:15.887190 21424 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:15.887465 14368 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:15.888434 21358 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:15.889137 21401 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:15.889238 21292 raft_consensus.cc:2804] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:15.890020 21292 raft_consensus.cc:697] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 20 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:15.890626 21401 consensus_queue.cc:1048] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:15.891608 21468 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.059s
W20260709 13:09:15.893297 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:15.894812 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 62500.7us
I20260709 13:09:15.901700 13859 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:09:15.904145 14395 raft_consensus.cc:2468] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 28.
I20260709 13:09:15.905692 14366 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:09:15.911787 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 101394us
W20260709 13:09:15.919034 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 107300us
I20260709 13:09:15.924902 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:15.935976 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:09:15.945277 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 49550.8us
I20260709 13:09:15.891224 21292 consensus_queue.cc:237] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:15.946846 14366 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:09:15.947731 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 54979us
I20260709 13:09:15.948864 21470 consensus_queue.cc:1059] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.055s
I20260709 13:09:15.950771 21393 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:15.951644 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 77685.8us
I20260709 13:09:15.951829 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:15.953410 13680 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:15.957072 21472 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:15.924525 21216 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:15.960217 21441 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:09:15.961995 21441 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:15.962462 21441 raft_consensus.cc:697] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:15.944244 14397 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:09:15.962960 21359 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:15.964013 13857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 4077) took 1153 ms. Trace:
I20260709 13:09:15.971540 13857 rpcz_store.cc:276] 0709 13:09:14.814240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.169506 (+355266us) service_pool.cc:224] Handling call
0709 13:09:15.169801 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.543487 (+373686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.963779 (+420292us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b540006e854. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:15.963955 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":833912704}
I20260709 13:09:15.959123 21472 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:15.993783 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:15.992290 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:15.994311 14397 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 20.
I20260709 13:09:15.998487 14393 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:16.004626 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:15.978003 21359 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:15.978379 21303 raft_consensus.cc:2804] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:16.007658 13680 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:15.969439 21051 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:16.017057 14395 raft_consensus.cc:1240] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 20 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: []
W20260709 13:09:16.018131 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.018725 21315 raft_consensus.cc:3060] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:16.019457 21470 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:16.015451 21303 raft_consensus.cc:697] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 19 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:16.020812 14399 raft_consensus.cc:1240] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:16.023806 21470 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:16.027984 21303 consensus_queue.cc:237] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:16.031392 14396 raft_consensus.cc:1240] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:15.995644 21233 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:15.963371 21441 consensus_queue.cc:237] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:16.039932 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 47192.9us
I20260709 13:09:16.039081 21315 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:15.590332 13788 rpcz_store.cc:276] 0709 13:09:12.093041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.121719 (+3028678us) service_pool.cc:224] Handling call
0709 13:09:15.122044 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.122317 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:09:15.123351 (+  1034us) log.cc:844] Serialized 14 byte log entry
0709 13:09:15.577765 (+454414us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:15.577815 (+    50us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:15.577862 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.577922 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.578038 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3847,"prepare.queue_time_us":152,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":10968,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":7209,"thread_start_us":427899,"threads_started":1}
I20260709 13:09:16.047606 14400 raft_consensus.cc:1240] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:16.048779 13680 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:16.054292 21315 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:16.055466 21233 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:16.055088 21315 raft_consensus.cc:697] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:16.056624 21315 consensus_queue.cc:237] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:16.060777 20887 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:16.072547 21051 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:16.073220 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:16.079735 14399 raft_consensus.cc:2393] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 21: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:16.031844 21470 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:16.091594 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:16.082243 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:16.092929 14399 raft_consensus.cc:2393] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 14: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:16.092834 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:16.093475 13788 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:16.085723 14367 leader_election.cc:336] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Timed out: RequestConsensusVote RPC to 127.12.76.129:37533 timed out after 1.786s (SENT)
I20260709 13:09:16.094736 14367 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:16.095506 21470 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:16.096055 14367 leader_election.cc:336] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Timed out: RequestConsensusVote RPC to 127.12.76.129:37533 timed out after 1.836s (SENT)
I20260709 13:09:16.096519 14367 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:16.088476 21469 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:16.098172 14393 raft_consensus.cc:2410] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:09:16.098637 13857 raft_consensus.cc:1240] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 21. Ops: []
I20260709 13:09:16.098717 13861 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:16.099876 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:16.104225 21453 log.cc:927] Time spent T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.364s	user 0.002s	sys 0.000s
I20260709 13:09:16.106201 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:16.107033 21216 raft_consensus.cc:3055] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:09:16.111726 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 63090.8us
I20260709 13:09:16.113953 13788 raft_consensus.cc:2468] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 21.
W20260709 13:09:16.109997 13786 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48914 (request call id 2875) took 5919 ms (client timeout 1905 ms). Trace:
I20260709 13:09:16.118211 14398 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:16.116278 13829 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:09:16.117249 13786 rpcz_store.cc:269] 0709 13:09:10.190126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.195250 (+  5124us) service_pool.cc:224] Handling call
0709 13:09:16.109764 (+5914514us) spinlock_profiling.cc:243] Waited 5.26 s on lock 0x7b54002f9c54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:16.109896 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12090319744}
I20260709 13:09:16.122587 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:16.123358 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:16.107265 21470 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:16.118248 21234 consensus_queue.cc:1048] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 13:09:16.126888 21328 raft_consensus.cc:3055] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:16.107897 21348 raft_consensus.cc:3055] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:16.114632 21216 raft_consensus.cc:740] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:16.139817 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:16.140413 13859 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:09:16.147110 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:16.124461 21425 raft_consensus.cc:2804] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:16.155622 13680 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:16.159531 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:16.137617 21328 raft_consensus.cc:740] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:16.139204 21348 raft_consensus.cc:740] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:09:16.162408 13830 leader_election.cc:336] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.168152 13830 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:16.169081 21473 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:16.169718 21473 raft_consensus.cc:697] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:16.169613 21328 consensus_queue.cc:260] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:16.170948 21328 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:16.170680 21473 consensus_queue.cc:237] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:16.171932 21348 consensus_queue.cc:260] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:16.175200 21470 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:16.163017 21408 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.010s	sys 0.010s
W20260709 13:09:16.185855 21408 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.011s	sys 0.011s
I20260709 13:09:16.162256 21425 raft_consensus.cc:697] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 21 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:16.202770 13680 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:16.186498 21348 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:16.211599 21216 consensus_queue.cc:260] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:16.217552 14398 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:09:16.186807 21467 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:09:16.225564 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.226182 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.226631 13828 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.231244 21408 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:09:16.233852 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:16.234570 13856 raft_consensus.cc:2393] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 16: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:16.235257 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:16.235859 13858 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:16.236322 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 78112.7us
W20260709 13:09:16.237030 13830 consensus_peers.cc:597] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.248165 21277 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:16.249869 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:16.251780 21425 consensus_queue.cc:237] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:16.252370 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:09:16.255750 13830 leader_election.cc:336] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:16.257737 13830 leader_election.cc:336] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.258416 13830 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:16.263362 21029 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:09:16.282267 21469 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:16.278785 21315 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:16.292026 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 89327.5us
I20260709 13:09:16.263693 21236 consensus_queue.cc:1059] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:09:16.304767 13680 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
W20260709 13:09:16.303979 13830 leader_election.cc:336] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.305534 13830 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:16.305508 13858 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:09:16.311347 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:16.313383 21236 raft_consensus.cc:3055] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:16.313782 21236 raft_consensus.cc:740] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:16.317291 21314 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:16.317728 21314 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.318094 21314 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:16.302987 21315 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:16.319581 21277 consensus_queue.cc:1059] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:09:16.320734 21333 raft_consensus.cc:3055] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:16.321254 21333 raft_consensus.cc:740] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:16.322114 21333 consensus_queue.cc:260] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:16.324234 13830 leader_election.cc:336] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:16.325186 13830 consensus_peers.cc:597] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.325687 13830 consensus_peers.cc:597] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.326217 13830 leader_election.cc:336] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.326591 13830 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:16.314646 21236 consensus_queue.cc:260] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:16.327721 21236 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:16.327864 13680 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:16.328759 21366 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:16.329276 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:16.330569 13680 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:16.320793 21315 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:16.343917 21469 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:16.344730 21469 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:16.345667 13757 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:16.347965 13757 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:16.348721 21438 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:16.350549 21441 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 13:09:16.350641 21438 consensus_queue.cc:1059] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:16.351397 21441 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:16.351575 21320 raft_consensus.cc:2804] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:09:16.352105 21320 raft_consensus.cc:697] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 24 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:16.353010 21320 consensus_queue.cc:237] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:16.356101 13757 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:09:16.357152 13862 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59780 (request call id 4056) took 3201 ms (client timeout 1974 ms). Trace:
I20260709 13:09:16.357663 21315 consensus_queue.cc:1059] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:09:16.357724 13862 rpcz_store.cc:269] 0709 13:09:13.155625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.400185 (+244560us) service_pool.cc:224] Handling call
0709 13:09:16.356810 (+2956625us) spinlock_profiling.cc:243] Waited 2.24 s on lock 0x7b54003dbdd4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:16.357067 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5148387200}
I20260709 13:09:16.358840 21408 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:16.359516 21408 raft_consensus.cc:697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 19 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:16.359640 13864 raft_consensus.cc:1275] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:09:16.360145 13864 pending_rounds.cc:85] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 13
I20260709 13:09:16.360441 13864 pending_rounds.cc:107] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:09:16.360744 13864 raft_consensus.cc:2889] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:16.361485 21366 consensus_queue.cc:1059] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:16.362170 21366 consensus_queue.cc:1243] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer 35ecb005831740438d7537dd4b840e03 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:09:16.360452 21408 consensus_queue.cc:237] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:16.365309 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:16.358948 21064 raft_consensus.cc:3055] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:16.368017 14368 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:09:16.371309 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 214960us
I20260709 13:09:16.362613 13864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 4082) took 1531 ms. Trace:
I20260709 13:09:16.381673 13864 rpcz_store.cc:276] 0709 13:09:14.830755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.177527 (+346772us) service_pool.cc:224] Handling call
0709 13:09:16.359161 (+1181634us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:16.361290 (+  2129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.362372 (+  1082us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54003dbdd0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dd8ad 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:16.362545 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2715872000}
I20260709 13:09:16.338793 21314 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:16.391361 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 71972.5us
I20260709 13:09:16.357154 21441 consensus_queue.cc:1059] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:09:16.402066 21441 consensus_queue.cc:1243] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Peer 35ecb005831740438d7537dd4b840e03 log is divergent from this leader: its last log entry 22.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:09:16.309151 21414 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:16.376397 21064 raft_consensus.cc:740] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:16.394459 21303 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:16.405025 21303 raft_consensus.cc:697] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:16.406145 21303 consensus_queue.cc:237] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:16.407742 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 81563.1us
W20260709 13:09:16.409251 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.410449 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:16.411231 13859 raft_consensus.cc:2393] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 14: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:16.413280 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:16.417065 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:16.417791 14393 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:16.414086 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:16.418967 14402 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:16.414749 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:16.415601 21064 consensus_queue.cc:260] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:16.416970 13830 leader_election.cc:336] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.422236 13861 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:09:16.423715 13830 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:16.423959 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 53387.6us
I20260709 13:09:16.421906 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:16.426203 14398 raft_consensus.cc:1240] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:16.427639 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:16.428355 14395 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 21.
I20260709 13:09:16.391846 21315 raft_consensus.cc:3055] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:16.432039 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:16.444458 13757 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:16.452848 13756 leader_election.cc:336] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.453359 13756 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:16.455149 13829 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:16.464810 14393 raft_consensus.cc:2468] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 21.
I20260709 13:09:16.437603 21330 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:16.432416 21315 raft_consensus.cc:740] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:16.446023 21441 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.473778 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:09:16.508379 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 91445us
W20260709 13:09:16.509413 13830 leader_election.cc:336] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.517124 13830 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:16.446089 21233 consensus_queue.cc:1048] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:09:16.472287 21173 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:16.474052 21469 raft_consensus.cc:2804] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 28 FOLLOWER]: Leader election won for term 28
W20260709 13:09:16.535607 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 175722us
W20260709 13:09:16.537536 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 84716.7us
I20260709 13:09:16.520555 21330 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:16.532066 21425 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:16.543540 13680 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:16.537320 14367 consensus_peers.cc:597] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.519767 21473 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:16.547804 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 77621.4us
I20260709 13:09:16.548784 21332 consensus_queue.cc:1059] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:16.549432 13829 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:16.550189 21332 raft_consensus.cc:3055] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:16.550665 21332 raft_consensus.cc:740] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:16.550781 21348 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:16.550885 13829 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:16.551555 21348 consensus_queue.cc:1059] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:09:16.552013 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 90161.6us
W20260709 13:09:16.538261 13756 leader_election.cc:336] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.557555 13756 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:16.552888 13680 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:16.559752 13829 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:09:16.561700 14367 consensus_peers.cc:597] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.537340 21064 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:16.551496 21478 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:16.536777 21469 raft_consensus.cc:697] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 28 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:16.552081 20887 raft_consensus.cc:3055] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:16.570436 13859 raft_consensus.cc:1275] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:09:16.572520 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 63159.7us
W20260709 13:09:16.574584 13830 leader_election.cc:336] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.547492 21330 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:16.551684 21332 consensus_queue.cc:260] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:16.530440 21441 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:16.572221 14367 consensus_peers.cc:597] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.580742 13756 leader_election.cc:336] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.565198 21393 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:16.571144 21414 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:16.571522 21348 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:16.586815 21348 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.587387 21348 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:16.587554 21508 raft_consensus.cc:2804] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:09:16.588105 21508 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.588426 21508 raft_consensus.cc:3060] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:09:16.584858 13830 leader_election.cc:336] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.590489 13830 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:16.586897 21472 consensus_queue.cc:1048] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.005s
W20260709 13:09:16.593022 13830 leader_election.cc:336] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:16.585501 14367 consensus_peers.cc:597] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.573590 20887 raft_consensus.cc:740] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
W20260709 13:09:16.596521 13756 leader_election.cc:336] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.596957 13756 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:16.591547 21029 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:16.577805 21330 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:16.562341 21473 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:16.606789 21358 raft_consensus.cc:3055] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:16.607295 21358 raft_consensus.cc:740] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:16.608206 21358 consensus_queue.cc:260] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:16.609561 21358 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:16.612604 21469 consensus_queue.cc:237] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:16.616104 21441 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:16.616653 21441 raft_consensus.cc:2804] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:16.616971 21441 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:16.617324 21441 raft_consensus.cc:3060] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:16.623126 21498 log.cc:927] Time spent T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:09:16.623886 20887 consensus_queue.cc:260] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:16.625181 20887 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:16.603611 21314 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:16.552676 21315 consensus_queue.cc:260] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:16.604446 13829 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:16.634435 21359 raft_consensus.cc:2804] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:16.634963 21359 raft_consensus.cc:697] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 21 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:16.635900 21359 consensus_queue.cc:237] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:16.642839 14366 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.646130 13862 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
W20260709 13:09:16.644321 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 51346.3us
W20260709 13:09:16.649466 13830 leader_election.cc:336] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.651894 13830 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:16.668655 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 72143.8us
W20260709 13:09:16.669534 13756 leader_election.cc:336] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:16.670487 13756 leader_election.cc:336] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.671494 21029 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:09:16.672010 21333 raft_consensus.cc:3060] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:16.672554 21236 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:09:16.674598 14367 leader_election.cc:336] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:16.671365 13756 leader_election.cc:336] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.675915 13756 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:16.676394 14402 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:09:16.677978 13757 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:16.680152 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:09:16.672024 21315 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:16.607152 13613 catalog_manager.cc:5697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 17 to 19, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 19 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:09:16.694556 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 141769us
I20260709 13:09:16.710530 21366 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.711110 21366 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:16.713398 21366 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:16.695545 21473 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:16.694401 21029 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:16.714567 21029 raft_consensus.cc:697] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:16.715648 21029 consensus_queue.cc:237] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:16.716566 21478 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:16.722762 21332 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:16.726528 13613 catalog_manager.cc:5697] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 16 to 19, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 19 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
W20260709 13:09:16.727900 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 50003.8us
W20260709 13:09:16.729615 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 49803.8us
W20260709 13:09:16.730369 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 80953.5us
W20260709 13:09:16.732340 13830 leader_election.cc:336] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.732774 13830 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:16.735951 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:16.736574 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 62012.3us
I20260709 13:09:16.729347 21233 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:16.743697 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 72349.2us
W20260709 13:09:16.747520 13756 leader_election.cc:336] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:16.744237 14367 leader_election.cc:336] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.748638 14367 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:16.734997 21478 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:16.719249 21441 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:16.740338 21425 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:16.769001 13682 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:09:16.749480 21473 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:16.777220 13783 raft_consensus.cc:1240] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:16.773231 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:16.741556 21315 consensus_queue.cc:1059] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:09:16.778435 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:16.818006 14398 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:09:16.820603 14393 raft_consensus.cc:1240] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:16.821725 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 28 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:16.780362 13756 leader_election.cc:336] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.822503 13756 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:16.820493 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:16.820022 21366 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:16.749763 21330 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:16.825855 21330 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:16.828472 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.830104 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:09:16.835955 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 67063.3us
I20260709 13:09:16.837812 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:16.838213 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:16.838691 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 98019.2us
I20260709 13:09:16.841359 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:16.821266 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:16.766860 21216 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:16.842736 13786 raft_consensus.cc:2468] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
I20260709 13:09:16.774861 21292 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:09:16.848829 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:16.768754 21478 raft_consensus.cc:697] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:16.860890 13613 catalog_manager.cc:5697] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 5 to 12. New cstate: current_term: 12 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.856184 21277 consensus_queue.cc:1059] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:16.856943 21366 raft_consensus.cc:697] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:16.862864 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:16.863430 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:16.879347 13783 raft_consensus.cc:1275] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260709 13:09:16.884819 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 48155.5us
W20260709 13:09:16.889129 14367 leader_election.cc:336] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.889631 14367 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:16.890806 14367 leader_election.cc:336] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.892072 14396 raft_consensus.cc:1240] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:16.891206 14367 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:16.892656 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 112311us
I20260709 13:09:16.888469 13682 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:09:16.893575 13756 leader_election.cc:336] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.894848 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:16.897308 13783 raft_consensus.cc:1240] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:16.906965 14401 raft_consensus.cc:1240] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 28 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 27. Current term is 28. Ops: [27.16-27.16]
W20260709 13:09:16.904866 13830 leader_election.cc:336] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.919054 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:16.919350 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:09:16.920464 14367 leader_election.cc:336] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.920882 14367 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:16.921643 13783 raft_consensus.cc:1240] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:16.922456 21441 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:16.897708 21328 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:16.923755 21328 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:16.925812 21328 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:16.898311 21348 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:16.926539 21366 consensus_queue.cc:237] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:16.898512 21425 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:16.927762 21425 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:16.929677 21425 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:16.923310 21359 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:16.930495 21359 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:16.932591 21359 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:16.933421 13863 raft_consensus.cc:2393] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 22: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:09:16.933881 13890 heartbeater.cc:646] Failed to heartbeat to 127.12.76.190:43389 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.12.76.190:43389 timed out after 15.000s (SENT)
I20260709 13:09:16.934569 21348 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:16.935454 21512 log.cc:927] Time spent T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:09:16.937016 13864 raft_consensus.cc:1275] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:09:16.937983 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:16.939081 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:16.941625 13613 catalog_manager.cc:5697] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:16.945310 21478 consensus_queue.cc:237] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:16.946364 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:16.948982 21473 raft_consensus.cc:3055] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:09:16.949398 21473 raft_consensus.cc:740] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:16.950299 21473 consensus_queue.cc:260] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:16.954856 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:16.888165 21277 consensus_queue.cc:1243] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer ceb06175847b428ea8bd77055fcddf58 log is divergent from this leader: its last log entry 20.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 13:09:16.962702 21513 log.cc:927] Time spent T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:09:16.894387 21480 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:16.965072 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 60247.8us
W20260709 13:09:16.965771 13830 leader_election.cc:336] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.898712 21472 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:16.972798 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:16.988294 13783 raft_consensus.cc:2393] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 22: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:16.966805 13613 catalog_manager.cc:5697] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 12 to 17, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 17 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.985554 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:09:16.961236 21502 log.cc:927] Time spent T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:09:16.918946 21292 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:16.995636 14394 raft_consensus.cc:1240] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 19 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:16.997448 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:16.987334 21510 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:09:16.998224 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 77785.8us
W20260709 13:09:17.039379 14367 leader_election.cc:336] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.039883 14367 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:17.041388 14367 leader_election.cc:336] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.041766 14367 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:17.042807 14367 leader_election.cc:336] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.999688 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:17.043488 13830 leader_election.cc:336] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.989679 21473 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:09:17.002503 21515 log.cc:927] Time spent T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:09:17.043915 13830 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:17.044759 21292 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:09:17.044966 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 50121.3us
W20260709 13:09:17.045670 13830 leader_election.cc:336] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.046013 13860 raft_consensus.cc:1240] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:17.046212 21467 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:17.003145 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:09:17.033764 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 147719us
I20260709 13:09:17.047654 13784 raft_consensus.cc:2393] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 15: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:17.048792 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:17.049500 21277 consensus_queue.cc:1059] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:09:17.004372 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:17.006865 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:17.051028 21277 raft_consensus.cc:3055] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:09:17.043853 13787 raft_consensus.cc:2393] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 21: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:17.051192 14396 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:17.051481 21277 raft_consensus.cc:740] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:09:17.052841 14367 leader_election.cc:336] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.053349 14367 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:17.054112 21401 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:17.054800 21401 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:17.003808 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:17.056715 13786 raft_consensus.cc:1275] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:09:17.057910 13786 raft_consensus.cc:1275] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:09:17.058118 14396 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 22.
I20260709 13:09:17.008005 21441 consensus_queue.cc:1059] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:17.060248 21441 raft_consensus.cc:3055] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:17.060690 21441 raft_consensus.cc:740] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:17.061623 21314 raft_consensus.cc:3055] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:17.062156 21401 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:17.009732 13785 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:17.061692 21441 consensus_queue.cc:260] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:17.043869 14366 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:17.010020 13857 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:09:17.008996 13783 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 24 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 23. Current term is 24. Ops: []
I20260709 13:09:17.011175 14397 raft_consensus.cc:1275] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:09:17.012291 14395 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:09:17.012976 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:17.007491 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:17.010670 13613 catalog_manager.cc:5697] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 12 to 15, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 15 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:17.013784 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:16.952124 21508 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:17.048867 13682 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:17.062234 21314 raft_consensus.cc:740] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:17.084852 13863 raft_consensus.cc:1275] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:09:17.015023 14399 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:09:17.072583 13789 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 14.
I20260709 13:09:17.046042 13830 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:17.078219 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:17.087530 13783 raft_consensus.cc:2393] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 21: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:17.019351 13790 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
W20260709 13:09:17.034982 13612 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49444 (request call id 348) took 45400 ms (client timeout 15000 ms). Trace:
I20260709 13:09:17.090845 14400 raft_consensus.cc:2393] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 21: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
W20260709 13:09:17.090981 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 83568.9us
W20260709 13:09:17.092828 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 44033.1us
I20260709 13:09:16.966951 21303 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:17.103443 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:17.104907 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:17.094498 13682 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:17.107024 13785 raft_consensus.cc:2393] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 24: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:17.125348 13857 raft_consensus.cc:1240] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:17.131124 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:09:17.114348 13756 consensus_peers.cc:597] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.135288 14398 raft_consensus.cc:2468] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
W20260709 13:09:17.137471 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 91827.2us
W20260709 13:09:17.138258 13830 leader_election.cc:336] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.139281 14401 raft_consensus.cc:2393] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 22: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:09:17.141191 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:17.091168 21441 raft_consensus.cc:3060] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:17.084605 21470 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:17.140287 13613 catalog_manager.cc:5697] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 15 to 19, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 19 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:09:17.052366 21277 consensus_queue.cc:260] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.16, Last appended by leader: 16, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:17.148212 13830 leader_election.cc:336] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.124706 21510 raft_consensus.cc:2804] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:17.130594 21029 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:17.095203 21518 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:09:17.145556 13756 leader_election.cc:336] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.129483 21292 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:17.130795 21333 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:09:17.152181 21425 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:17.141865 21505 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:17.170674 14397 raft_consensus.cc:1275] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:09:17.130483 21064 consensus_queue.cc:1059] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:09:17.150862 21510 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:17.182067 13754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.175017 13830 leader_election.cc:336] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.133867 21358 consensus_queue.cc:1048] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:09:17.133219 21233 consensus_queue.cc:1048] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
W20260709 13:09:17.184309 13830 leader_election.cc:336] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.143671 21366 consensus_queue.cc:1059] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:09:17.190202 13830 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:17.189224 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 46783.2us
W20260709 13:09:17.203560 13756 consensus_peers.cc:597] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.214995 13830 consensus_peers.cc:597] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.214461 13613 catalog_manager.cc:5697] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 10 to 12, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 12 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:09:17.223342 13830 leader_election.cc:336] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.183898 21510 raft_consensus.cc:3060] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:17.174541 21315 consensus_queue.cc:1059] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:09:17.176440 21277 raft_consensus.cc:3060] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:09:17.226059 13830 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:17.234371 13830 leader_election.cc:336] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:17.238915 13830 leader_election.cc:336] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.183588 21408 consensus_queue.cc:1059] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
W20260709 13:09:17.241429 13830 leader_election.cc:336] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:17.233521 13756 leader_election.cc:336] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.163954 21314 consensus_queue.cc:260] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:17.169699 21518 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:17.261912 13613 catalog_manager.cc:5697] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 13 to 17, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 17 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:17.260200 14367 leader_election.cc:336] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.264082 14367 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:17.233377 21522 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:17.238432 21425 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:17.264751 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 125853us
W20260709 13:09:17.266028 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 159078us
W20260709 13:09:17.088138 13612 rpcz_store.cc:269] 0709 13:08:31.634797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.635506 (+   709us) service_pool.cc:224] Handling call
0709 13:09:17.034721 (+45399215us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:09.440487 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:09.466606 (+ 26119us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:09.472631 (+  6025us) write_op.cc:435] Acquired schema lock
0709 13:09:09.472661 (+    30us) tablet.cc:662] Decoding operations
0709 13:09:09.474140 (+  1479us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:09.474261 (+   121us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:09.474300 (+    39us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:09:09.613351 (+139051us) tablet.cc:701] Row locks acquired
0709 13:09:09.622880 (+  9529us) write_op.cc:260] PREPARE: finished
0709 13:09:09.653079 (+ 30199us) write_op.cc:270] Start()
0709 13:09:09.692597 (+ 39518us) write_op.cc:276] Timestamp: P: 1783602549631968 usec, L: 0
0709 13:09:09.697433 (+  4836us) op_driver.cc:348] REPLICATION: starting
0709 13:09:09.711850 (+ 14417us) log.cc:844] Serialized 5179 byte log entry
0709 13:09:10.902694 (+1190844us) op_driver.cc:464] REPLICATION: finished
0709 13:09:11.260007 (+357313us) write_op.cc:301] APPLY: starting
0709 13:09:11.260108 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:13.644734 (+2384626us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b18003f2ce0. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f52382b9de1 00007f52382c65b1 00007f523221d0ec 00007f5232269c0a 00007f52322694f7 00007f5232269490 00007f5232220f48 00007f5235f351bb 00007f5235f35532 00007f5235f7cb93 00007f5235e29de3
0709 13:09:13.774160 (+129426us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:13.781215 (+  7055us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:13.871474 (+ 90259us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:13.871826 (+   352us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:09:13.871873 (+    47us) write_op.cc:312] APPLY: finished
0709 13:09:13.877606 (+  5733us) log.cc:844] Serialized 121 byte log entry
0709 13:09:14.451382 (+573776us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:14.456187 (+  4805us) write_op.cc:454] Released schema lock
0709 13:09:14.461571 (+  5384us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:14.492040 (+ 30469us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:14.493015 (+   975us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2075234,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":346450,"apply.run_cpu_time_us":93140,"apply.run_wall_time_us":3218486,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58467,"num_ops":13,"prepare.queue_time_us":192126,"prepare.run_cpu_time_us":86200,"prepare.run_wall_time_us":530887,"raft.queue_time_us":562930,"raft.run_cpu_time_us":19662,"raft.run_wall_time_us":376612,"replication_time_us":1129947,"spinlock_wait_cycles":5987584,"thread_start_us":1351711,"threads_started":5,"wal-append.queue_time_us":978101,"wal-append.run_cpu_time_us":59332,"wal-append.run_wall_time_us":2715968}]]}
W20260709 13:09:17.265336 13756 leader_election.cc:336] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.266625 13858 raft_consensus.cc:1275] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:17.328579 13682 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:09:17.333153 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 67839.7us
W20260709 13:09:17.333971 13756 leader_election.cc:336] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:17.320046 21501 log.cc:927] Time spent T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:09:17.316226 21472 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:09:17.339764 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 80822.3us
W20260709 13:09:17.346735 14367 leader_election.cc:336] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.347246 14367 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:17.350729 13756 leader_election.cc:336] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.351222 13756 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:17.351593 12594 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 13741)
W20260709 13:09:17.352634 21523 log.cc:927] Time spent T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:09:17.355505 21533 consensus_queue.cc:1059] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:09:17.355796 21535 consensus_queue.cc:1059] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:17.356631 21535 consensus_queue.cc:1243] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer 35ecb005831740438d7537dd4b840e03 log is divergent from this leader: its last log entry 24.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:09:17.357964 21535 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:17.335386 21315 consensus_queue.cc:1059] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.025s
I20260709 13:09:17.360698 21315 raft_consensus.cc:3055] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:17.361063 21315 raft_consensus.cc:740] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:17.361924 21315 consensus_queue.cc:260] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:17.320031 21359 consensus_queue.cc:1048] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:09:17.337922 21314 raft_consensus.cc:3060] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:17.364312 13613 catalog_manager.cc:5697] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:17.363186 21315 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:17.368794 13613 catalog_manager.cc:5697] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 12 to 14, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 14 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
W20260709 13:09:17.387573 13756 leader_election.cc:336] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:17.393216 13756 leader_election.cc:336] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.391848 20887 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:17.394788 13613 catalog_manager.cc:5697] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:09:17.414813 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 114087us
W20260709 13:09:17.433295 13756 leader_election.cc:336] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.433763 13756 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:17.435843 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 107399us
I20260709 13:09:17.394579 21472 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:17.442260 13613 catalog_manager.cc:5697] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 14 to 17, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 17 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:09:17.444276 21518 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:17.447892 13756 leader_election.cc:336] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.448377 13756 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:17.431180 21508 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 26 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:17.452538 21175 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:17.452061 13756 leader_election.cc:336] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.456633 13756 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:17.461275 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.432363 21216 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:09:17.445261 20887 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:09:17.470912 13756 leader_election.cc:336] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:17.472775 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 126048us
W20260709 13:09:17.473703 14367 leader_election.cc:336] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:17.474735 14367 leader_election.cc:336] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.471527 13756 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:17.475209 14367 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:17.479625 21401 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 13:09:17.479813 21541 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:09:17.481519 14367 leader_election.cc:336] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:17.484305 14367 consensus_peers.cc:597] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.485028 14367 consensus_peers.cc:597] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.485656 14367 consensus_peers.cc:597] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.486299 14367 leader_election.cc:336] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.489746 14367 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:17.491564 21401 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:17.492951 14367 leader_election.cc:336] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.494560 14367 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:17.496752 14367 leader_election.cc:336] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:17.497774 14367 leader_election.cc:336] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.498270 14367 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:17.502571 21530 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:17.503507 21530 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:09:17.505089 14367 leader_election.cc:336] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:17.506286 14367 leader_election.cc:336] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.510651 21064 raft_consensus.cc:3055] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:09:17.511076 21064 raft_consensus.cc:740] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:09:17.514750 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.515947 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 45071.9us
W20260709 13:09:17.516858 13756 leader_election.cc:336] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:17.517890 13756 leader_election.cc:336] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.470657 13682 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:09:17.518759 13756 leader_election.cc:336] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.519660 20887 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:09:17.502784 21510 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:17.528061 21510 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:17.519389 13756 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:17.529404 21175 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:09:17.530887 13756 leader_election.cc:336] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:17.532009 13756 consensus_peers.cc:597] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.532814 13756 leader_election.cc:336] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.533344 13756 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:17.534312 21175 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:09:17.535697 13756 consensus_peers.cc:597] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.536569 13756 leader_election.cc:336] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.541517 14393 raft_consensus.cc:1275] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:09:17.545089 13787 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:09:17.547766 21333 raft_consensus.cc:3055] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:17.548172 21333 raft_consensus.cc:740] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:17.549007 21333 consensus_queue.cc:260] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:17.549997 21333 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:17.555212 13787 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:17.537147 13756 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:17.558722 21480 raft_consensus.cc:3055] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:17.559106 21480 raft_consensus.cc:740] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:17.559904 21480 consensus_queue.cc:260] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:17.561132 21480 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:17.561158 21535 raft_consensus.cc:3055] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:17.561832 21535 raft_consensus.cc:740] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:09:17.567723 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 97139.6us
I20260709 13:09:17.568492 13682 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:09:17.572408 14367 consensus_peers.cc:597] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.580060 13680 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:17.585649 14367 consensus_peers.cc:597] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.586848 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:17.586416 14367 consensus_peers.cc:597] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.593161 13682 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:09:17.595448 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.596168 13679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.581984 21277 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:17.600224 21277 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.600579 21277 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:17.604693 21505 raft_consensus.cc:3055] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:17.605090 21505 raft_consensus.cc:740] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:17.605865 21505 consensus_queue.cc:260] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:17.606822 21505 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:17.618628 14400 raft_consensus.cc:2368] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18.
I20260709 13:09:17.619367 21473 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:17.621526 14398 raft_consensus.cc:1275] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:09:17.562793 21535 consensus_queue.cc:260] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:17.644731 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 64762.7us
I20260709 13:09:17.645861 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:17.636816 21314 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:17.652336 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 104114us
I20260709 13:09:17.660689 13755 leader_election.cc:400] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18.
I20260709 13:09:17.661098 13755 leader_election.cc:403] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:09:17.664798 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 128234us
I20260709 13:09:17.665778 14366 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:17.666177 13680 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:17.673503 14366 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:17.653736 21473 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:17.688305 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:17.632349 21533 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:09:17.637959 21366 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:09:17.652870 21332 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:17.659636 21478 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.037s	sys 0.043s
W20260709 13:09:17.712061 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 52625.9us
I20260709 13:09:17.713332 13680 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:17.705926 14401 raft_consensus.cc:1275] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 28 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 13:09:17.674356 21393 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:17.675391 21510 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.688104 21303 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:17.687147 21441 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:17.725196 13680 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:17.687551 21315 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:09:17.710748 21478 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.038s	sys 0.043s
I20260709 13:09:17.706846 21530 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:17.703297 21548 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:17.660969 21467 consensus_queue.cc:1048] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.054s
I20260709 13:09:17.718909 21314 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:17.733039 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:17.738099 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:17.744825 13860 raft_consensus.cc:2376] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17. Re-sending same reply.
I20260709 13:09:17.739035 13859 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
W20260709 13:09:17.746965 21534 log.cc:927] Time spent T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.389s	user 0.003s	sys 0.000s
I20260709 13:09:17.739607 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:17.734162 21414 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
W20260709 13:09:17.756259 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 112861us
W20260709 13:09:17.740136 13830 leader_election.cc:336] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.740587 13862 raft_consensus.cc:1275] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:09:17.741456 13856 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:09:17.758373 13830 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:17.712785 21472 consensus_queue.cc:1048] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.024s
I20260709 13:09:17.765633 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:17.715652 21332 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:17.766801 21478 consensus_queue.cc:1048] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:17.767019 21547 consensus_queue.cc:1048] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:09:17.768438 21332 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:17.727962 21473 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:09:17.758836 21355 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 17. Current term is 18.
I20260709 13:09:17.775564 21544 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 13:09:17.776162 21549 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:17.776841 21549 raft_consensus.cc:697] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:17.777771 21549 consensus_queue.cc:237] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:17.778604 21522 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:17.779336 21540 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:17.779727 13864 raft_consensus.cc:1240] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:09:17.780063 21540 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:17.736115 21315 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:17.781543 21527 log.cc:927] Time spent T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.452s	user 0.002s	sys 0.000s
I20260709 13:09:17.782491 21540 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:17.782613 21315 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:17.783284 21548 raft_consensus.cc:3060] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:17.786705 21558 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.787266 21558 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:17.778617 13830 leader_election.cc:336] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.788436 13830 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:17.789588 13830 leader_election.cc:336] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.790864 21469 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:17.723817 21508 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:09:17.726593 21510 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:17.799391 21510 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:17.759526 21441 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.800343 21441 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:17.802433 21441 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:17.789995 13830 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:17.809518 13830 leader_election.cc:336] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.810039 13830 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:17.751056 21277 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:17.789615 21558 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:17.827646 13830 consensus_peers.cc:597] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.828277 13830 consensus_peers.cc:597] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.841207 21535 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:17.815689 21029 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:17.843488 13682 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:09:17.826713 21469 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:17.859233 13784 raft_consensus.cc:1275] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:17.868646 13682 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:09:17.869897 21531 log.cc:927] Time spent T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.481s	user 0.003s	sys 0.000s
I20260709 13:09:17.871028 21508 consensus_queue.cc:1059] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:17.872444 21508 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:17.873298 21508 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:17.879598 21558 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:17.880803 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:17.880484 21558 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:17.881405 13863 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:09:17.843672 21359 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:17.883882 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:17.885115 13830 consensus_peers.cc:597] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.885440 21546 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:17.887993 13682 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:17.888738 21558 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:17.892879 21508 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:09:17.896000 21546 raft_consensus.cc:697] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:17.898201 21277 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:17.898423 13865 raft_consensus.cc:1240] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:17.898058 21546 consensus_queue.cc:237] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:17.900430 21538 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.900915 21538 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:17.895649 21558 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.901856 21558 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:17.905674 21558 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:17.903264 21538 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:17.902999 21548 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:09:17.907457 13830 leader_election.cc:336] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:17.938023 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 235630us
I20260709 13:09:17.944352 14366 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:17.912945 21029 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:17.963984 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:17.966346 13861 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 21.
W20260709 13:09:17.987783 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 43512.7us
I20260709 13:09:17.992695 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:17.993618 13857 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:17.999388 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 43574.9us
I20260709 13:09:17.930382 21548 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:17.998121 20887 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.999873 21472 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:09:18.011601 13830 leader_election.cc:336] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:18.009336 14368 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:18.019200 13857 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
W20260709 13:09:18.017936 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 292831us
I20260709 13:09:18.022226 13680 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:18.022415 13682 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:18.003744 21548 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.030256 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:18.033021 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:18.035430 13783 raft_consensus.cc:1275] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 13:09:18.040588 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:18.013657 21518 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:18.045271 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:18.041996 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:18.035778 13783 pending_rounds.cc:85] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 11
I20260709 13:09:18.047842 13783 pending_rounds.cc:107] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:09:18.046627 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:18.048276 13783 raft_consensus.cc:2889] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:18.048563 13791 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 22.
I20260709 13:09:18.048715 13783 pending_rounds.cc:107] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 13:09:18.049724 13783 raft_consensus.cc:2889] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:18.060364 13787 raft_consensus.cc:1240] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 24 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:09:18.027630 21548 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:18.062166 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:18.029768 21508 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:18.014561 20887 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.067704 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:18.066031 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:18.057838 21292 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:18.063549 21277 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.070393 21277 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.072533 21562 raft_consensus.cc:2804] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:18.073014 21562 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.073520 21562 raft_consensus.cc:3060] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:18.072576 21277 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:18.061780 21546 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.085283 21216 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:18.085839 21216 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.085807 21546 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.088377 21292 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.088723 21546 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:18.088894 21292 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:18.034657 21064 consensus_queue.cc:260] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:18.090142 21064 raft_consensus.cc:3060] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:18.091650 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:18.092248 13857 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 22.
I20260709 13:09:18.094118 20887 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:18.094465 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:18.095304 13788 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:09:18.097375 13786 raft_consensus.cc:2393] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 22: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:18.030066 21558 consensus_queue.cc:1048] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 13:09:18.126732 13680 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:18.133152 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:18.135742 13859 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:09:18.139113 13680 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:09:18.140156 13756 consensus_peers.cc:597] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:18.063860 21530 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:18.145936 13860 raft_consensus.cc:1275] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:09:18.055650 21518 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.121229 21508 raft_consensus.cc:697] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:18.154546 13757 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:18.094760 21542 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.100s
I20260709 13:09:18.143900 21277 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:09:18.159636 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 150425us
I20260709 13:09:18.163951 21567 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.141709 21546 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:09:18.172622 14397 raft_consensus.cc:1275] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:18.174185 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:18.177452 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:18.178040 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:18.184270 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:18.184870 14395 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:18.158605 21366 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.184337 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:18.190445 14402 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 22.
I20260709 13:09:18.191316 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:18.188066 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:18.188299 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:18.188699 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:18.188867 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:18.188920 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:18.192327 14399 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 21.
I20260709 13:09:18.192668 14398 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 18.
I20260709 13:09:18.197273 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:18.144166 21549 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:09:18.200798 13680 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:18.169102 21234 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.213388 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:18.218391 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:18.180034 21472 raft_consensus.cc:697] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:18.185190 21567 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:18.235828 13756 consensus_peers.cc:597] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:18.198585 21480 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:18.213063 21535 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:18.216655 21315 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:18.300177 13680 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:18.260951 21348 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.318892 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:18.326388 13861 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
W20260709 13:09:18.320652 21571 log.cc:927] Time spent T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:09:18.167274 21292 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.227602 21216 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:18.323091 13829 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:18.272149 21480 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.215761 21555 consensus_queue.cc:1048] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.096s
I20260709 13:09:18.214731 21366 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.324793 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:18.325513 21277 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:18.302870 21315 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.338943 13829 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:18.223090 21234 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:18.328387 14395 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:09:18.346680 14393 raft_consensus.cc:2368] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 22. Current term is 23.
I20260709 13:09:18.348639 21567 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:18.314251 21508 consensus_queue.cc:237] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.354398 21472 consensus_queue.cc:237] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:18.354988 12594 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 13741)
I20260709 13:09:18.359889 14368 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:09:18.339792 21480 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:18.331725 21348 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.346935 21535 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:18.344360 21556 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:18.381276 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:18.379930 21315 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:18.379709 21505 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.384399 21029 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:18.393282 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:18.432654 14395 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 15.
I20260709 13:09:18.434192 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:18.434551 13680 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:18.396230 21563 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:18.454133 21555 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:18.466990 21414 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.409170 21518 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:18.390452 21562 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.467451 21064 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.453111 21575 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.476701 21549 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:18.500964 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:18.520183 13858 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 22.
I20260709 13:09:18.457506 21029 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:18.505647 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:18.500705 21555 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.489233 21563 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:18.453531 21505 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.492378 21535 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.527630 13788 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:18.538430 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:18.539033 13858 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:09:18.519838 21549 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.529213 21029 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:18.532822 21555 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:18.533480 21563 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:18.509714 21414 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:18.519230 21064 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.558053 13788 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 23.
I20260709 13:09:18.543326 21549 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:18.527510 21575 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.561368 14366 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:18.566124 13859 raft_consensus.cc:1275] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:09:18.537622 21535 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.549875 21548 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:18.576260 21562 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:18.576680 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:18.576990 21548 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:18.580403 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:18.581192 13864 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:18.583948 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:18.588368 13858 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 23.
I20260709 13:09:18.585258 21064 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:18.573390 21542 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:09:18.602154 21580 log.cc:927] Time spent T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.466s	user 0.005s	sys 0.006s
I20260709 13:09:18.603914 21505 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:18.609270 21064 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.609880 21064 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.612879 21292 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:18.612978 21064 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:18.615067 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:18.617228 21593 log.cc:927] Time spent T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7: Append to log took a long time: real 0.076s	user 0.002s	sys 0.000s
I20260709 13:09:18.618902 21542 raft_consensus.cc:697] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 23 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:18.609751 21359 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.627995 21542 consensus_queue.cc:237] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.628690 21359 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.633960 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:18.636221 14400 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:09:18.636910 21575 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:18.639305 21562 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:09:18.640131 21414 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:18.641933 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:18.631212 21359 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:18.622536 21535 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:18.655655 21556 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:18.625550 21234 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:18.655387 13864 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 20.
W20260709 13:09:18.674266 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 576925us
I20260709 13:09:18.662437 21556 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.678298 21556 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:18.681169 21315 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.680150 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:18.700418 13682 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:18.701395 21535 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:18.710135 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:18.710875 13858 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:18.682889 21563 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.712787 13682 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:18.721920 14395 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:09:18.728510 21549 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.728878 21029 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.731897 13861 raft_consensus.cc:1240] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:18.718526 21548 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:18.730911 21549 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:18.738425 21611 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:09:18.721496 21315 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:18.717017 21480 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.749418 13858 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 23.
I20260709 13:09:18.752187 13682 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:09:18.758466 21579 log.cc:927] Time spent T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.621s	user 0.002s	sys 0.000s
I20260709 13:09:18.759553 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:18.748383 21548 raft_consensus.cc:697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 20 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:18.755402 21549 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.753875 21029 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:18.764839 21535 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:18.767479 21480 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:18.754350 21555 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.775832 21505 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.790380 21548 consensus_queue.cc:237] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:18.798386 21555 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:18.799580 21505 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.800158 21366 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:18.801909 21505 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:18.802567 21563 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:18.773943 21549 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:18.805238 21599 log.cc:927] Time spent T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
W20260709 13:09:18.811022 21602 log.cc:927] Time spent T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 13:09:18.807283 21549 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:18.814018 21549 consensus_queue.cc:1048] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:18.820262 13829 leader_election.cc:400] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 22. Current term is 23.
I20260709 13:09:18.820650 13829 leader_election.cc:403] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:18.820925 21557 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:18.821949 21029 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039) with higher term. Message: Invalid argument: T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for earlier term 22. Current term is 23.
I20260709 13:09:18.823931 21348 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:18.828276 21173 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:18.828861 21173 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.831565 21541 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.832122 21541 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.834506 21541 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:18.779261 21535 raft_consensus.cc:697] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:18.960987 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:18.951011 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:18.867333 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:18.866374 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:18.971200 13791 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 21.
I20260709 13:09:18.839969 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:18.955382 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:18.954571 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:18.835032 21541 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.913344 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:18.859887 21546 consensus_queue.cc:1059] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.117s
I20260709 13:09:18.978466 21601 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.978765 21366 raft_consensus.cc:3055] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:18.964185 21173 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:18.979238 21366 raft_consensus.cc:740] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:18.979113 21601 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:18.880857 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:18.866756 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:18.981130 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:18.972494 13786 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 17.
I20260709 13:09:18.844851 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:18.929553 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:18.867074 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:18.974478 13782 raft_consensus.cc:2393] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 20: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:18.864308 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:18.844314 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:18.975122 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:19.001809 13790 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:09:19.003768 13861 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 24.
I20260709 13:09:18.983841 21366 consensus_queue.cc:260] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.997871 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:19.011096 14394 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 22.
I20260709 13:09:19.006278 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:19.012388 14393 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:18.951596 21064 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.953666 21236 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:19.024775 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:19.025789 14394 raft_consensus.cc:2393] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 22: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:19.028486 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:18.846742 21549 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.030715 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:19.031095 13791 raft_consensus.cc:1275] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:09:19.030773 21549 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:18.821578 21557 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:19.032037 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:19.033074 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:19.033215 21549 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:19.033576 13791 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:18.843858 13830 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 146 similar messages]
I20260709 13:09:18.997004 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:19.016817 13859 raft_consensus.cc:2368] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20.
I20260709 13:09:19.029502 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:18.866240 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:19.038283 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:19.036461 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:18.835819 21408 consensus_queue.cc:1048] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.188s
I20260709 13:09:19.038546 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:19.046240 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:19.046643 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:19.034148 21557 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:19.041638 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:19.040894 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:19.049002 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 221135us
I20260709 13:09:19.051191 14394 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:19.054322 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:19.054826 13788 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 24.
I20260709 13:09:18.982643 21541 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:19.066751 13680 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:19.043053 21556 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:19.065989 14393 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 23.
I20260709 13:09:19.070020 13791 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:09:19.045645 21366 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:19.064280 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:19.066718 13757 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:19.071365 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:19.076134 13680 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:19.034739 21236 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:19.081930 13680 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:19.089852 21315 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:19.090451 21315 raft_consensus.cc:697] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:19.091326 21315 consensus_queue.cc:237] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:19.028626 21064 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:19.107138 21064 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:19.107708 21064 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:19.112901 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:19.113765 13788 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 22.
I20260709 13:09:19.044059 21549 consensus_queue.cc:1048] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
W20260709 13:09:19.117141 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 50504us
I20260709 13:09:19.114845 13680 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:09:19.128419 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 284581us
I20260709 13:09:19.123708 14394 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
W20260709 13:09:19.172430 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.072535 21556 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.073942 21505 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:09:19.196117 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 63198.1us
I20260709 13:09:19.245893 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:19.193532 21064 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:19.132669 21480 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:19.249321 13859 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 13:09:19.252204 13859 pending_rounds.cc:85] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 15
I20260709 13:09:19.252513 13859 pending_rounds.cc:107] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 13:09:19.252803 13859 raft_consensus.cc:2889] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:19.201752 21556 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:19.194494 21508 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.238257 21505 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:19.388635 12594 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 13741)
I20260709 13:09:19.241240 21277 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:19.251052 21546 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.254323 21064 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.253958 21480 raft_consensus.cc:493] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:19.466899 13829 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:19.303005 21505 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:19.509943 21029 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:19.550122 21595 log.cc:927] Time spent T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
W20260709 13:09:19.550531 21620 log.cc:927] Time spent T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.654s	user 0.004s	sys 0.007s
W20260709 13:09:19.563663 21632 log.cc:927] Time spent T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:09:19.563896 21624 log.cc:927] Time spent T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:09:19.550238 21589 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.071700 21535 consensus_queue.cc:237] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:19.650579 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:19.656454 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 189643us
I20260709 13:09:19.675872 21589 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:19.676702 13829 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:19.668089 21541 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:19.672632 21348 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.677856 21348 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:19.653551 21064 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:19.680354 21348 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:19.680528 14395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56582 (request call id 2508) took 1290 ms. Trace:
I20260709 13:09:19.680989 14395 rpcz_store.cc:276] 0709 13:09:18.390248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.433848 (+ 43600us) service_pool.cc:224] Handling call
0709 13:09:19.680313 (+1246465us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54005c1054. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:19.680443 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659917056}
I20260709 13:09:19.653157 21277 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:19.682292 21348 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:19.682834 21348 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:19.672979 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:19.683526 21277 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:19.683888 13782 raft_consensus.cc:2376] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16. Re-sending same reply.
I20260709 13:09:19.654095 21546 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:19.683290 21348 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:19.686676 21546 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:19.653900 21480 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:19.688971 21029 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:19.691349 21029 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:19.660234 21559 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:19.718684 21277 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.714851 21546 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.723598 21236 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:19.735056 14402 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.008s	sys 0.007s
W20260709 13:09:19.738795 14402 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.008s	sys 0.008s
I20260709 13:09:19.709491 21173 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:19.649163 21508 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:19.741315 21546 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:19.829106 13682 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.003s	sys 0.020s
W20260709 13:09:19.830502 13682 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.003s	sys 0.020s
I20260709 13:09:19.752945 21277 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:19.790709 21548 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.039s	sys 0.116s
I20260709 13:09:19.804359 21408 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:19.782356 21173 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:19.840411 13756 leader_election.cc:336] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:19.830643 21470 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:09:19.869586 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 192931us
I20260709 13:09:19.874402 13829 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:19.835207 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 586974us
I20260709 13:09:19.873710 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:19.875568 13865 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
W20260709 13:09:19.869993 21548 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.046s	sys 0.131s
I20260709 13:09:19.878180 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:19.879818 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:19.879880 13757 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:19.907524 21636 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:09:19.869815 21545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.004s	sys 0.017s
I20260709 13:09:19.910210 13757 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:19.973866 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 63752.9us
W20260709 13:09:19.846010 21366 consensus_meta.cc:287] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02: Time spent flushing consensus metadata: real 0.746s	user 0.010s	sys 0.001s
I20260709 13:09:19.834483 21051 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.908141 21636 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:19.838038 21638 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.834946 21547 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:09:19.981926 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 102181us
I20260709 13:09:19.896095 21559 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:19.985960 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:19.977264 13756 leader_election.cc:336] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:19.999361 13756 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:19.988528 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:19.989105 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:19.984968 21051 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:19.994661 21636 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:19.995581 21627 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:09:19.977604 21545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.005s	sys 0.018s
I20260709 13:09:19.998294 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:20.002498 13786 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 21.
I20260709 13:09:20.002640 13783 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 21.
I20260709 13:09:19.999328 13863 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
I20260709 13:09:19.873479 21348 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:19.983949 21277 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:19.976562 21621 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:20.000552 21557 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:20.055836 21051 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:20.056038 13860 raft_consensus.cc:1240] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 19. Current term is 20. Ops: [16.11-19.12]
I20260709 13:09:20.056980 21637 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:20.057619 13757 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:19.976215 21549 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.070s
I20260709 13:09:19.976498 21541 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:20.065392 21480 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.082603 21173 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:20.070139 21556 consensus_meta.cc:287] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7: Time spent flushing consensus metadata: real 0.669s	user 0.008s	sys 0.000s
I20260709 13:09:19.995405 21638 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:20.000921 21547 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.052085 21642 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:09:19.874472 21408 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:20.046586 13756 leader_election.cc:336] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:20.120139 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 73601.3us
I20260709 13:09:20.000684 21559 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:20.109097 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 51570us
W20260709 13:09:20.077343 21542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.091s	user 0.035s	sys 0.099s
I20260709 13:09:19.883282 21470 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.083158 21508 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:20.074170 21546 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:20.095153 21467 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:20.088783 21064 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:20.116230 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 1.04961e+06us
I20260709 13:09:20.130577 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 2227) took 1275 ms. Trace:
I20260709 13:09:20.116904 14397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 2225) took 1257 ms. Trace:
W20260709 13:09:20.136489 13756 leader_election.cc:336] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:20.111279 21627 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:09:20.134074 21542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.148s	user 0.035s	sys 0.099s
I20260709 13:09:20.117871 21545 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:20.109040 21557 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.134399 21559 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:20.113205 21541 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:20.146600 14397 rpcz_store.cc:276] 0709 13:09:18.854571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.052468 (+197897us) service_pool.cc:224] Handling call
0709 13:09:19.052758 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:19.052980 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:09:19.200493 (+147513us) log.cc:844] Serialized 14 byte log entry
0709 13:09:20.111379 (+910886us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:20.111448 (+    69us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:20.111493 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.111551 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.111673 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":622364,"prepare.queue_time_us":512474,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":784508,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":49883,"thread_start_us":417487,"threads_started":2}
I20260709 13:09:20.146377 14402 rpcz_store.cc:276] 0709 13:09:18.855212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.057246 (+202034us) service_pool.cc:224] Handling call
0709 13:09:19.073296 (+ 16050us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:19.073693 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:09:19.781050 (+707357us) log.cc:844] Serialized 14 byte log entry
0709 13:09:20.130153 (+349103us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:20.130217 (+    64us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:09:20.130286 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.130372 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.130511 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":491975,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":27,"raft.queue_time_us":324,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":5747,"thread_start_us":978241,"threads_started":2}
I20260709 13:09:20.158488 14366 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:20.161070 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:20.118667 21556 raft_consensus.cc:515] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.168370 14395 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:09:20.162338 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:20.153851 21627 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.169992 14401 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 22.
I20260709 13:09:20.162740 21545 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.175077 21401 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.142401 21467 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.161454 21292 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:20.227581 21645 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:20.228237 21646 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:20.221990 21642 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:20.229975 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:20.166560 21472 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:20.234401 13865 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:09:20.205139 21627 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:20.235481 13860 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:09:20.237998 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:20.200709 21064 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:20.202221 21557 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:20.199837 21480 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:20.197149 21556 leader_election.cc:290] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:20.198598 21638 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:20.201602 21408 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:20.218779 21029 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.275635 21029 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.203428 21470 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:20.200505 21348 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:20.197553 21547 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:20.249325 13860 raft_consensus.cc:1275] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:09:20.280347 21467 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:20.183365 21545 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:20.250005 21601 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:20.254769 21653 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:20.259877 21643 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:09:20.284322 21029 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:20.297318 13829 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:20.240823 21654 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:20.237097 21529 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:20.343144 13857 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:09:20.261521 21651 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:20.263716 21644 log.cc:927] Time spent T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:09:20.238900 21472 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.200791 21505 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:20.241092 21642 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.241252 21646 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.421578 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:20.268821 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:20.422367 13791 raft_consensus.cc:2393] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 21: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:20.422487 13790 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:09:20.237764 21645 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.235759 21292 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.272651 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:20.424991 13783 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:09:20.195959 21401 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.276079 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:20.252202 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:20.300242 21541 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:20.300582 21623 log.cc:927] Time spent T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.833s	user 0.008s	sys 0.011s
I20260709 13:09:20.304946 21414 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.305675 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:20.306655 21558 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:20.306687 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:20.307711 21556 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.260078 21589 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:20.317408 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.420122 21029 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:20.324229 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:20.325815 13782 raft_consensus.cc:3055] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:20.473774 13782 raft_consensus.cc:740] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:20.325946 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:20.327322 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 33 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:20.331293 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:09:20.478097 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 146872us
I20260709 13:09:20.360109 14368 leader_election.cc:400] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20.
I20260709 13:09:20.368079 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:20.354692 13756 consensus_peers.cc:597] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:20.417032 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:20.419853 21557 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:20.429725 21277 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.339713 21508 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:09:20.438051 13830 leader_election.cc:336] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:20.450944 21535 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:09:20.502085 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 85170.1us
I20260709 13:09:20.434298 21546 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.433735 21648 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.419936 21064 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.424276 21467 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:20.465296 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:20.446506 13682 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:09:20.518404 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 71998.2us
I20260709 13:09:20.475850 21366 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.323956 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:20.423928 21638 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.472874 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:20.433331 21562 raft_consensus.cc:493] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.426991 21601 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.481587 14368 leader_election.cc:403] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:09:20.482415 13864 raft_consensus.cc:1240] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:20.501041 21359 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:09:20.482590 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 127950us
W20260709 13:09:20.502076 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 64048.4us
W20260709 13:09:20.530038 13830 leader_election.cc:336] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:20.531195 13830 leader_election.cc:336] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:20.531697 13830 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:20.503145 13680 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:20.474762 13782 consensus_queue.cc:260] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:20.417853 21651 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.533713 13782 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:20.470801 21548 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.416783 21559 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.509291 21636 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:20.355262 21654 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.524780 13791 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:20.471341 21558 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.355716 21348 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:20.469787 21627 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.467779 21414 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.540674 14396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 2211) took 2357 ms. Trace:
I20260709 13:09:20.511195 21557 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:20.528357 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 168539us
I20260709 13:09:20.536526 21656 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:20.520545 21648 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.545848 21636 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.528709 21366 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.516085 21546 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.478617 21029 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.535949 21562 raft_consensus.cc:515] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.524609 21315 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:09:20.558698 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 417896us
I20260709 13:09:20.570336 13857 raft_consensus.cc:1240] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 16. Current term is 17. Ops: []
W20260709 13:09:20.558099 13756 leader_election.cc:336] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:20.574398 13791 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 23.
I20260709 13:09:20.534632 21359 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.476061 21556 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.368932 21529 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.513162 21277 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.532920 21640 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:20.513633 21508 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.576088 14396 rpcz_store.cc:276] 0709 13:09:18.177672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.178106 (+   434us) service_pool.cc:224] Handling call
0709 13:09:18.178361 (+   255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:18.178649 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:18.178672 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:18.838740 (+660068us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b2c00012878. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5230dd7a11 00007f5230de7372 00007f5232519a01 00007f52324de43a 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2
0709 13:09:18.839127 (+   387us) log.cc:844] Serialized 26 byte log entry
0709 13:09:19.026955 (+187828us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:09:19.026987 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:19.027058 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:20.299933 (+1272875us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f523207986e 00007f5232078bb6 00007f52320787d8 00007f5232082221 00007f52320821d9 00007f5232082169
0709 13:09:20.534783 (+234850us) raft_consensus.cc:1685] finished
0709 13:09:20.534816 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.534977 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99605,"raft.queue_time_us":40684,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":2357,"spinlock_wait_cycles":25679488,"thread_start_us":187486,"threads_started":1,"wal-append.queue_time_us":400450}
I20260709 13:09:20.700143 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:20.535948 21236 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:20.580940 13858 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 21.
W20260709 13:09:20.578997 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 406506us
I20260709 13:09:20.585748 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:20.709066 14401 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 21.
I20260709 13:09:20.586650 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:20.711233 14397 raft_consensus.cc:2410] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:09:20.591655 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:20.711995 14399 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:20.521366 21064 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.524760 21467 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.536346 21544 consensus_queue.cc:1048] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.047s
W20260709 13:09:20.624192 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 82355.3us
I20260709 13:09:20.563031 21348 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.639539 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 33 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:20.756176 14402 raft_consensus.cc:2468] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 31.
I20260709 13:09:20.641613 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:09:20.643164 12594 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 13741)
I20260709 13:09:20.562777 21589 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:20.535732 21638 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:20.674384 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:20.675459 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:20.538265 21601 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:20.540544 21548 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:20.688292 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:20.689270 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 64606.7us
W20260709 13:09:20.699079 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 196031us
I20260709 13:09:20.622017 21315 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.637544 21359 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:20.592363 21542 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:20.621491 21563 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.085s
I20260709 13:09:20.637486 21234 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:09:20.717299 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 186127us
W20260709 13:09:20.777654 13830 leader_election.cc:336] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:20.778084 13830 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:20.677448 21587 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:20.721927 13865 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:09:20.754333 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:20.781672 14395 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
I20260709 13:09:20.679231 21470 raft_consensus.cc:493] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:20.758903 14393 raft_consensus.cc:2393] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 22: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:20.760947 13788 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:09:20.763234 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 44487.7us
I20260709 13:09:20.762379 13757 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:20.789196 13757 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:20.761860 14394 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
I20260709 13:09:20.762933 13680 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:20.765928 21589 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.767016 21277 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:20.620244 21636 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.696452 21621 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:20.803606 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:20.808020 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:20.773728 13856 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:09:20.714501 21535 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:20.713248 21582 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:20.764114 21348 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:09:20.752287 13756 consensus_peers.cc:597] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:20.818114 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 65910.9us
W20260709 13:09:20.785003 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 113468us
I20260709 13:09:20.757584 21505 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:20.760564 21472 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:20.773875 21315 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:20.796453 21355 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:20.843684 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:20.844339 14393 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 18.
I20260709 13:09:20.806267 13788 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 23.
I20260709 13:09:20.718650 21236 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.821244 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:20.781589 21575 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:20.805446 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:20.831877 21556 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:20.832331 21173 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:20.832893 21401 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:20.834734 21414 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:20.837141 21589 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:20.838093 21557 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:20.840049 21366 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:20.811604 21480 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
W20260709 13:09:20.829041 13756 leader_election.cc:336] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:20.799249 21560 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:20.682691 21640 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.811244 21277 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.809646 21545 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:20.812598 21642 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:20.807080 21547 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:20.782896 21542 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.860342 13860 raft_consensus.cc:2368] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 22. Current term is 23.
I20260709 13:09:20.784837 21234 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.790741 21587 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.850773 21355 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.795517 21470 raft_consensus.cc:515] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:20.888952 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 59968.4us
I20260709 13:09:20.845835 21582 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.855880 21645 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:20.853663 21535 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:20.867892 21556 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:20.952386 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:20.859635 21575 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:20.955493 13613 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49436 (request call id 351) took 32493 ms (client timeout 15000 ms). Trace:
I20260709 13:09:20.888227 21401 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:09:20.919843 21674 log.cc:927] Time spent T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:09:20.957237 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:20.905567 21559 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:20.852938 21505 raft_consensus.cc:493] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.816056 21621 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:20.964562 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:21.000991 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:21.001439 14393 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 20.
I20260709 13:09:20.953298 21664 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:20.958575 21355 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:20.867998 21173 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.977874 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5171bcd42ea14ad3af7399ab8c6a7e35" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:09:20.983212 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 205570us
I20260709 13:09:20.983372 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:21.028999 14396 raft_consensus.cc:3060] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:21.029300 13857 raft_consensus.cc:2393] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 17: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:20.983877 13755 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:20.985764 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:21.029947 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 267099us
I20260709 13:09:20.988003 13782 raft_consensus.cc:1275] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:09:21.030606 13782 pending_rounds.cc:85] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03: Aborting all ops after (but not including) 10
I20260709 13:09:21.030848 13782 pending_rounds.cc:107] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:09:21.030833 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.031280 13782 raft_consensus.cc:2889] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:21.030170 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 46391.4us
I20260709 13:09:21.031673 13782 pending_rounds.cc:107] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:09:21.031945 13782 raft_consensus.cc:2889] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:20.992589 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:20.952105 21558 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.002315 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:20.921298 21529 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:21.034019 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:20.956387 21673 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:09:21.004513 21662 log.cc:927] Time spent T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:09:21.006014 13777 tablet_service.cc:1558] Processing DeleteTablet for tablet c9e22f0634b34971aed9c5b948f3275e with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 7 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:48902
I20260709 13:09:21.006151 13757 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:21.007699 13681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.007381 21505 raft_consensus.cc:515] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:21.008850 21648 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:20.943073 21545 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.968793 21508 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.016647 21470 leader_election.cc:290] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:21.018143 21234 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.020985 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:21.068105 13861 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:09:20.958841 21408 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:20.958796 21660 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:20.966638 21651 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:20.937362 21277 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:21.082906 21505 leader_election.cc:290] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:21.085328 21277 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:21.087332 21173 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.049113 21646 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:20.986362 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:20.969483 21654 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:20.957687 21627 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.030015 13864 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 21.
I20260709 13:09:21.032122 13755 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:09:21.093395 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 61344.5us
I20260709 13:09:21.060652 21548 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:20.948833 21547 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:20.989681 21562 leader_election.cc:290] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:20.989830 21029 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.038339 13859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59780 (request call id 4144) took 1035 ms. Trace:
I20260709 13:09:21.039263 14399 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 23.
W20260709 13:09:21.040037 14367 leader_election.cc:336] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:21.116176 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 81883us
W20260709 13:09:21.116261 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 120368us
I20260709 13:09:21.116533 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:21.116807 14367 leader_election.cc:336] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.040850 14401 raft_consensus.cc:2410] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:09:21.117789 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:21.118840 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:20.989569 21652 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:21.122200 21652 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.051950 13680 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.052872 14396 raft_consensus.cc:2468] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 23.
I20260709 13:09:21.124061 21348 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:20.993383 21401 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.087280 21359 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:21.062839 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 56769.6us
I20260709 13:09:21.131098 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:21.072496 21661 consensus_queue.cc:1059] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:09:21.077605 21621 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:21.079743 21470 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:21.138422 21051 raft_consensus.cc:3055] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:21.138881 21051 raft_consensus.cc:740] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:21.138651 21470 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.139834 21051 consensus_queue.cc:260] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.141094 21051 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:21.081864 21640 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.082858 21636 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.083127 21582 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:20.911332 21480 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.144088 21480 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.056171 21535 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:21.027511 21664 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.146704 21664 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:21.059937 21541 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:09:20.967103 13613 rpcz_store.cc:269] 0709 13:08:48.455122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.468335 (+ 13213us) service_pool.cc:224] Handling call
0709 13:09:20.942768 (+32474433us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:18.075809 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:18.076641 (+   832us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:18.076708 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:09:18.076734 (+    26us) tablet.cc:662] Decoding operations
0709 13:09:18.078376 (+  1642us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:18.078509 (+   133us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:18.078538 (+    29us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:09:18.225900 (+147362us) tablet.cc:701] Row locks acquired
0709 13:09:18.225960 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:09:18.226170 (+   210us) write_op.cc:270] Start()
0709 13:09:18.226354 (+   184us) write_op.cc:276] Timestamp: P: 1783602558226097 usec, L: 0
0709 13:09:18.226383 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:09:18.227295 (+   912us) log.cc:844] Serialized 5158 byte log entry
0709 13:09:18.351459 (+124164us) spinlock_profiling.cc:243] Waited 7.01 ms on lock 0x7b4400022b4c. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f522f279db1 00007f522f317c85 00007f522f3186a2 00007f523208a1db 00007f5232085aaf 00007f522f3d40ac 00007f523822eab9 00007f522f3f069b 00007f522f3ee93f 00007f522f3f0c02 00007f523207820b
0709 13:09:18.715505 (+364046us) op_driver.cc:464] REPLICATION: finished
0709 13:09:18.807888 (+ 92383us) write_op.cc:301] APPLY: starting
0709 13:09:18.808022 (+   134us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:18.952414 (+144392us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:18.952457 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:19.033325 (+ 80868us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:19.033648 (+   323us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:09:19.033692 (+    44us) write_op.cc:312] APPLY: finished
0709 13:09:19.034153 (+   461us) log.cc:844] Serialized 121 byte log entry
0709 13:09:19.050356 (+ 16203us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:19.067992 (+ 17636us) write_op.cc:454] Released schema lock
0709 13:09:19.081769 (+ 13777us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:19.104699 (+ 22930us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:19.104732 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2639191,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":90504,"apply.run_cpu_time_us":21795,"apply.run_wall_time_us":296745,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58467,"num_ops":13,"prepare.queue_time_us":323796,"prepare.run_cpu_time_us":71442,"prepare.run_wall_time_us":449243,"raft.queue_time_us":52165,"raft.run_cpu_time_us":21740,"raft.run_wall_time_us":98099,"replication_time_us":480481,"spinlock_wait_cycles":16120576,"thread_start_us":374430,"threads_started":4,"wal-append.queue_time_us":297207,"wal-append.run_cpu_time_us":26695,"wal-append.run_wall_time_us":1520853}]]}
I20260709 13:09:21.100314 21575 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:21.100708 21545 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:21.100811 21656 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20.
I20260709 13:09:21.089157 21660 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.151010 21557 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.151603 21557 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.153793 21557 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.154335 21557 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:21.104995 21234 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:21.154860 21234 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:21.155294 21234 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:21.157522 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:21.158140 13858 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 22.
I20260709 13:09:21.159847 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:21.160454 13864 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:09:21.106089 21665 log.cc:927] Time spent T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 13:09:21.114295 13859 rpcz_store.cc:276] 0709 13:09:20.003153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.003276 (+   123us) service_pool.cc:224] Handling call
0709 13:09:20.003570 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:20.003779 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:09:20.439757 (+435978us) log.cc:844] Serialized 14 byte log entry
0709 13:09:21.038050 (+598293us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:21.038095 (+    45us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:09:21.038137 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.038198 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.038289 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":586437,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":32006,"raft.queue_time_us":160800,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":5046,"spinlock_wait_cycles":18592384,"thread_start_us":974781,"threads_started":3,"wal-append.queue_time_us":515420}
I20260709 13:09:21.121565 21547 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:21.025909 21677 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:21.174655 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:09:21.125095 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 74141.3us
I20260709 13:09:21.125617 21682 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:09:21.129518 14367 leader_election.cc:336] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.130640 21064 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.132232 13757 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:21.175072 21677 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.132555 13860 raft_consensus.cc:2368] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 21. Current term is 22.
I20260709 13:09:21.180649 21601 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:21.080772 14398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56570 (request call id 2228) took 2209 ms. Trace:
I20260709 13:09:21.182399 14398 rpcz_store.cc:276] 0709 13:09:18.871757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.069444 (+197687us) service_pool.cc:224] Handling call
0709 13:09:19.069748 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:20.164889 (+1095141us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:09:20.180446 (+ 15557us) log.cc:844] Serialized 14 byte log entry
0709 13:09:20.571861 (+391415us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:20.590690 (+ 18829us) log.cc:844] Serialized 26 byte log entry
0709 13:09:20.590887 (+   197us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:20.590935 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.591045 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:21.080571 (+489526us) raft_consensus.cc:1685] finished
0709 13:09:21.080592 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.080717 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":808778,"prepare.queue_time_us":15058,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":907704,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":17846,"thread_start_us":732517,"threads_started":2,"wal-append.queue_time_us":594681}
I20260709 13:09:21.184638 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:21.088999 21408 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.187003 21408 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.105965 21236 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.190179 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:21.162137 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.162545 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:21.168017 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.191929 13783 raft_consensus.cc:2393] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 17: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:21.168831 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:21.192426 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 60284.4us
I20260709 13:09:21.192921 14402 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 15.
I20260709 13:09:21.193243 13757 leader_election.cc:400] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 22. Current term is 23.
I20260709 13:09:21.172672 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:21.193765 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 59810.8us
I20260709 13:09:21.193931 13785 raft_consensus.cc:2468] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 21.
I20260709 13:09:21.194051 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 24 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:21.160605 21557 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:21.195019 14399 raft_consensus.cc:2410] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 24 because replica has last-logged OpId of term: 21 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 16.
I20260709 13:09:21.195308 21236 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:21.196314 21557 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:21.196774 14368 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:21.197024 21638 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:21.197651 14368 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:09:21.198807 21676 log.cc:927] Time spent T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.113s	user 0.001s	sys 0.001s
I20260709 13:09:21.199071 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:21.173990 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.198446 14368 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:21.200060 13787 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 14.
I20260709 13:09:21.175959 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:21.176656 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 57547.9us
I20260709 13:09:21.073128 21658 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:21.189641 21315 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:21.193523 13757 leader_election.cc:403] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:09:21.160575 21660 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:21.214773 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 44382.5us
W20260709 13:09:21.162089 13830 leader_election.cc:336] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:21.217737 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 55664.5us
I20260709 13:09:21.218156 13680 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.223559 21472 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:21.224059 21472 raft_consensus.cc:493] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:21.224445 21472 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:21.226421 21355 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.228469 13791 raft_consensus.cc:2393] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 22: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:21.228102 14368 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:21.230242 13757 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.234965 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.238802 13864 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 25.
I20260709 13:09:21.239720 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:21.239212 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:21.243973 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:21.244705 13859 raft_consensus.cc:2393] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 22: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:21.249096 13757 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.247406 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:21.251588 14368 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:21.251827 14367 leader_election.cc:336] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.249637 13829 leader_election.cc:304] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:09:21.256788 13830 leader_election.cc:336] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.257426 13830 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:21.262192 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:21.262800 13856 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 14.
I20260709 13:09:21.216233 21658 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:21.252990 14367 leader_election.cc:336] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.266528 14368 leader_election.cc:400] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 21. Current term is 22.
I20260709 13:09:21.269717 14368 leader_election.cc:403] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:21.229156 21638 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:21.228480 21064 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:09:21.239804 21656 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:21.263223 13680 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:09:21.272632 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.239534 21359 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.246636 21538 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:09:21.270049 14367 leader_election.cc:336] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.297284 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:09:21.300282 14367 leader_election.cc:336] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.246400 21408 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:21.246004 21621 raft_consensus.cc:2749] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 22. Current term is 23.
W20260709 13:09:21.301602 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 52942.3us
I20260709 13:09:21.300630 13680 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:09:21.307137 13830 leader_election.cc:336] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.307614 13830 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.311023 13829 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:21.265386 21681 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:21.264091 21637 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:21.264612 21645 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:21.268893 21556 raft_consensus.cc:2804] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:21.271631 21658 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:09:21.314498 13830 leader_election.cc:336] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.295082 21545 raft_consensus.cc:3060] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:09:21.270648 21562 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.270679 21660 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:21.299667 21656 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.331326 21315 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:21.331643 21656 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:21.324452 21638 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:21.332980 21234 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.335047 21234 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.335632 21660 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.337473 21562 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.236016 21682 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.082s
I20260709 13:09:21.305087 21548 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:21.340674 21548 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.341048 21548 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:21.341449 21562 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.299525 21538 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:21.343532 21558 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:21.343688 21538 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:21.343991 21558 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:21.344435 21558 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:21.346686 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:21.329356 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:21.336076 21660 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:21.309283 21673 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:21.309686 21601 raft_consensus.cc:2804] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 13:09:21.273229 21687 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:21.353663 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:21.321363 21680 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:21.354665 21556 raft_consensus.cc:697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 23 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:21.371078 21556 consensus_queue.cc:237] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.372418 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:21.372578 21472 raft_consensus.cc:515] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.373669 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:21.375037 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:21.375815 21355 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.376139 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:21.376374 21505 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:21.376943 21505 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.376971 21638 raft_consensus.cc:697] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:21.378916 21505 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.379333 21638 consensus_queue.cc:237] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.388273 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:21.389503 13864 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 16.
I20260709 13:09:21.382228 21508 consensus_queue.cc:1059] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:09:21.273084 13599 catalog_manager.cc:5028] TS 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): tablet c9e22f0634b34971aed9c5b948f3275e (table test-workload [id=b02e35b5ed4b44a99a40fb3ded6c439a]) successfully deleted
I20260709 13:09:21.353775 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:21.391989 13599 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 126539us
W20260709 13:09:21.352957 14367 leader_election.cc:336] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:21.391316 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 62762.2us
I20260709 13:09:21.329936 21645 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.397464 21467 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.398140 21677 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:21.399608 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.400219 13787 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 20.
I20260709 13:09:21.400607 21542 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:21.381436 13682 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:09:21.401968 14367 leader_election.cc:336] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.402732 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:21.405402 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 28 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:21.351769 21408 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.406420 13680 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:21.408320 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:21.403988 14367 leader_election.cc:336] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.411026 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:21.411080 14367 leader_election.cc:336] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.408095 13682 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:09:21.411816 14367 leader_election.cc:336] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.404912 13829 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.327711 21348 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:21.414808 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:21.414882 13680 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:21.407097 21408 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:21.400892 21548 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.414073 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:21.454041 13756 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.412439 14367 leader_election.cc:336] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.413522 21562 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:21.382349 21315 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.041s
I20260709 13:09:21.411950 21636 raft_consensus.cc:3055] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:21.465122 21636 raft_consensus.cc:740] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:21.465728 13782 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:09:21.465911 21636 consensus_queue.cc:260] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:21.426270 21545 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 21. Current term is 22.
I20260709 13:09:21.426636 21508 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:09:21.427023 21648 raft_consensus.cc:3060] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:21.427343 21684 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:21.428318 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:21.478523 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:21.479538 21636 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:21.416492 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:21.480978 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 64574.3us
I20260709 13:09:21.481206 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:21.482141 13829 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.484768 21348 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:21.485493 21348 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:21.485826 21348 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:21.486177 21348 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:21.487442 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:21.488523 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:21.432852 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.417622 21538 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:21.491981 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 59193.1us
I20260709 13:09:21.492707 13680 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:21.493510 21538 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:21.494225 13680 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:21.433398 21535 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:21.495932 21535 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:21.496398 21472 leader_election.cc:290] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:21.496577 21535 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:21.497219 21535 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:21.498308 14394 raft_consensus.cc:2468] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 22.
I20260709 13:09:21.433772 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:21.434520 21660 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.501101 21660 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:21.436188 21292 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:21.391330 21601 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.501891 21601 raft_consensus.cc:3060] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 32 FOLLOWER]: Advancing to term 33
I20260709 13:09:21.504107 21652 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:21.437201 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:21.506110 21470 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:21.417271 21558 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.438181 21546 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.517510 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:21.517859 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:21.518597 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:21.518981 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:21.437935 21658 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.439078 21587 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:21.440605 13682 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:21.354548 21656 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.444180 13862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59792 (request call id 3455) took 1014 ms. Trace:
I20260709 13:09:21.483268 13829 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:09:21.455271 14367 leader_election.cc:336] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.459303 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.461570 13791 raft_consensus.cc:1240] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:21.461683 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.455790 21562 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:21.463328 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 52826.1us
I20260709 13:09:21.463501 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.463687 21548 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.464408 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.469802 21508 raft_consensus.cc:697] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 25 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:21.432448 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:21.495153 21408 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:21.507934 14395 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 22: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:21.508677 13757 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.510254 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:21.513080 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:21.514845 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:21.516381 21558 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.516736 21401 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:21.519972 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:21.519275 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:21.519637 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:09:21.586272 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 145733us
I20260709 13:09:21.587077 13861 raft_consensus.cc:2393] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 22: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:21.587359 13786 raft_consensus.cc:3060] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:09:21.589744 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 106551us
I20260709 13:09:21.523173 14368 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:21.591741 14397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:21.592309 14397 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:21.587500 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 132261us
W20260709 13:09:21.593477 14367 leader_election.cc:336] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:21.594055 14367 consensus_peers.cc:597] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:21.595194 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:21.597510 13829 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:21.603264 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 94628.4us
W20260709 13:09:21.604452 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 81355.8us
I20260709 13:09:21.523794 14398 raft_consensus.cc:2410] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:09:21.605654 21518 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:21.606112 21518 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:21.606956 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:21.607219 14368 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:21.605080 13830 leader_election.cc:336] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:21.609138 13830 leader_election.cc:336] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.609732 13830 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.606490 21518 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:21.610910 13861 raft_consensus.cc:2393] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 25: Already voted for candidate b9d194f45e044e0988d5de1a99e5cd02 in this term.
I20260709 13:09:21.549448 13862 rpcz_store.cc:276] 0709 13:09:20.429490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.480946 (+ 51456us) service_pool.cc:224] Handling call
0709 13:09:20.481263 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:20.774928 (+293665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.774959 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:20.779054 (+  4095us) log.cc:844] Serialized 26 byte log entry
0709 13:09:20.921785 (+142731us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:09:20.921832 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.443769 (+521937us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54000d11d4. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324dee01 00007f52324dd83e 00007f52374a2419 00007f5230a19bd4 00007f5230a19b62 00007f5230a19a91 00007f5230a19a0c 00007f5230a18cc2 00007f523081948c 00007f52308188c6
0709 13:09:21.443820 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:21.443874 (+    54us) raft_consensus.cc:1685] finished
0709 13:09:21.443890 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.444104 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":283600,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":45154,"spinlock_wait_cycles":321737600,"thread_start_us":249318,"threads_started":2,"wal-append.queue_time_us":207914}
I20260709 13:09:21.612869 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.613521 13791 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 23.
I20260709 13:09:21.614410 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:09:21.614563 13830 leader_election.cc:336] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.615006 13830 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.616506 14368 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:21.618031 13787 raft_consensus.cc:2393] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 22: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:21.554215 21648 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:21.590631 21562 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:21.602322 21546 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:21.598939 21645 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.602069 21556 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:21.589318 21681 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:21.606770 21467 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:09:21.618929 13830 leader_election.cc:336] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.623975 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1367b7b65234b7fbaacfcd765b3a6e5" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.642798 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:21.633109 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.643796 13782 raft_consensus.cc:2410] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 24 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:09:21.616562 21029 raft_consensus.cc:2749] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:21.644397 13785 raft_consensus.cc:2368] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 21. Current term is 22.
I20260709 13:09:21.636817 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.625499 14368 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:21.615712 21401 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:21.648921 13787 raft_consensus.cc:2393] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 22: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:21.642071 13830 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.645473 13784 raft_consensus.cc:2410] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:09:21.634070 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.625988 13757 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.638824 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.646050 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.657953 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.633491 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.646626 13755 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.659624 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:21.639110 13783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:21.660393 13783 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:21.660782 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e689999f416446c9bf87d759da2844ae" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.661130 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:21.658772 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.662878 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:21.663792 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.664767 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.666085 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 28 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.550894 21505 consensus_queue.cc:1048] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:09:21.668663 13680 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:21.669216 14400 raft_consensus.cc:1240] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 21. Current term is 22. Ops: []
I20260709 13:09:21.670652 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:21.671659 13790 raft_consensus.cc:1240] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:09:21.621150 21587 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:09:21.673381 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 47473.7us
I20260709 13:09:21.674288 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de09d01498e547e591ce4ebe62e59488" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:21.626475 21652 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:21.679071 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07097a615d345468e43de064c67057d" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.683185 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:21.680133 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:21.676378 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 57547.6us
W20260709 13:09:21.685519 13830 leader_election.cc:336] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.685927 13830 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.686815 13757 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.621920 21558 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:21.619462 21684 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:21.624436 21546 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.675343 13680 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:21.672947 21508 consensus_queue.cc:237] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:21.640375 21467 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:21.711880 13680 leader_election.cc:304] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:21.640110 21681 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.714502 21320 consensus_queue.cc:1059] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:09:21.714975 21681 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.715790 21627 raft_consensus.cc:3055] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:21.716144 21627 raft_consensus.cc:740] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:21.716921 21627 consensus_queue.cc:260] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.639833 21556 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:21.708319 21234 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:09:21.718560 21467 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:21.703480 13786 raft_consensus.cc:2468] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 22.
I20260709 13:09:21.705541 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:21.709502 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:21.721580 14394 raft_consensus.cc:2393] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 17: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:21.722762 13680 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:21.724582 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.673105 21480 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:09:21.677773 21355 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:21.683439 21051 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.727662 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:21.652645 21348 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.737576 13680 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:21.745231 14395 raft_consensus.cc:1240] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:09:21.683257 21673 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:21.679069 21648 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:21.733194 14367 leader_election.cc:336] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.746162 14367 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:21.706954 21029 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:21.719614 21556 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:21.708590 21640 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.711018 21546 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:21.747462 14367 consensus_peers.cc:597] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:21.750511 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:21.758865 12594 thread.cc:527] Waited for 5000ms trying to join with heartbeat (tid 13741)
I20260709 13:09:21.730106 21638 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:21.727634 21548 raft_consensus.cc:2749] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:21.773056 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:21.779563 14367 consensus_peers.cc:597] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:21.741024 21064 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:21.783547 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:21.784042 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:21.787603 14367 leader_election.cc:336] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.708267 21601 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 33 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.786342 13858 raft_consensus.cc:1240] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:21.748660 21672 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:09:21.797344 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:21.842660 14398 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:21.797501 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.843870 21064 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:09:21.845809 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 48394.3us
I20260709 13:09:21.847534 13680 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:21.799319 14368 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.849189 14368 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:21.809505 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.810202 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d32f086650d45b7b7ae3e0d858e360b" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:21.811472 13788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.850042 14397 raft_consensus.cc:2468] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:09:21.811792 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:21.850663 14399 raft_consensus.cc:1240] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:21.810946 21652 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.003s
I20260709 13:09:21.811964 13787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.780510 21645 consensus_queue.cc:1059] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 13:09:21.825907 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.826813 21518 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.828449 21658 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.830799 21348 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.748396 21051 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.832201 21656 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:21.834762 21601 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 33 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:21.835287 21401 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:21.781399 21640 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:21.847719 14366 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:21.884370 13786 raft_consensus.cc:1240] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 14. Current term is 15. Ops: []
W20260709 13:09:21.851840 14367 consensus_peers.cc:597] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:21.854460 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 142383us
I20260709 13:09:21.854633 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:21.854202 13756 consensus_peers.cc:597] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:21.855871 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 143539us
I20260709 13:09:21.870122 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 33 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:21.855371 21470 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:21.867614 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:21.888873 13858 raft_consensus.cc:3060] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:21.853184 21655 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:21.889827 13680 leader_election.cc:304] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:21.885612 14367 leader_election.cc:336] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.886608 13829 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:21.894172 14401 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 22.
I20260709 13:09:21.892696 14393 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:09:21.891813 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:21.857820 21064 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:21.897529 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.900656 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:21.902084 14398 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 22.
I20260709 13:09:21.904170 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:21.908751 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 61103.1us
I20260709 13:09:21.920446 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:21.920941 14366 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:21.921132 13680 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.921765 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:21.910511 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:21.925217 13861 raft_consensus.cc:1240] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:21.890434 21646 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:21.926728 13785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 33 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:21.927582 13787 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:09:21.928762 13829 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:09:21.934309 13830 leader_election.cc:336] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.931015 13858 raft_consensus.cc:2468] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:09:21.931663 14366 leader_election.cc:400] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 21. Current term is 22.
I20260709 13:09:21.929447 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.934890 13830 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.935472 14368 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:21.936767 14366 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:21.942494 13829 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:21.946110 13830 leader_election.cc:336] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.948900 13830 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.949460 13680 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:21.895334 21636 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:21.908080 21680 raft_consensus.cc:2804] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:21.908258 21601 raft_consensus.cc:493] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.907836 21548 raft_consensus.cc:2749] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:21.924765 21505 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:21.919849 21563 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:21.882020 21538 consensus_queue.cc:1059] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:09:21.953647 21681 raft_consensus.cc:2749] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:21.953444 21678 raft_consensus.cc:2804] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:21.924860 21683 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:21.919601 21315 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.931841 21648 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:09:21.932020 21556 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:21.942250 21673 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:09:21.954705 21690 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:09:21.970228 13830 leader_election.cc:336] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.949837 21292 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:21.957350 21544 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:22.011253 21678 raft_consensus.cc:697] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 22 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:21.974300 14366 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:21.962599 21401 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:21.963104 21545 raft_consensus.cc:2804] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:21.986766 13783 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 25.
I20260709 13:09:21.941927 21535 consensus_queue.cc:1059] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 13:09:21.963958 21064 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:22.002135 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 115585us
W20260709 13:09:22.011551 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 44330.5us
I20260709 13:09:21.998864 21547 raft_consensus.cc:3055] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:09:22.027652 13830 leader_election.cc:336] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:21.968324 21680 raft_consensus.cc:697] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 22 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:22.016714 21558 raft_consensus.cc:3055] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:09:22.020721 14366 leader_election.cc:304] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:22.020879 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:09:22.023469 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 73990.7us
W20260709 13:09:22.021404 14367 consensus_peers.cc:597] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:22.037125 13858 raft_consensus.cc:2393] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 15: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:22.039754 13680 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:09:21.972285 21601 raft_consensus.cc:515] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:22.042377 14366 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:22.049346 14401 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:09:22.025875 21563 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:22.032332 21547 raft_consensus.cc:740] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:22.057068 14366 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:22.035211 21558 raft_consensus.cc:740] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:22.009059 21315 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:22.039764 21545 raft_consensus.cc:697] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:09:22.068845 14367 leader_election.cc:336] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:22.069132 14366 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:22.058435 21683 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:22.075896 21627 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:09:22.079690 21694 log.cc:927] Time spent T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:09:22.080214 21518 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:22.080596 21696 log.cc:927] Time spent T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:09:22.082638 21601 leader_election.cc:290] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:22.061224 21563 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:22.086473 21546 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:22.060819 21562 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:22.089177 21545 consensus_queue.cc:237] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:22.090276 21467 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:22.091437 21562 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:22.092579 21640 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:22.093891 21051 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:22.094533 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:22.094360 21680 consensus_queue.cc:237] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:22.094822 21558 consensus_queue.cc:260] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:22.095741 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:22.096066 21558 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:22.049793 21401 raft_consensus.cc:2749] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:22.073632 21712 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:09:22.102049 21315 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:22.102547 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.057037 21064 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:22.109469 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:22.109862 14367 consensus_peers.cc:597] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:22.072330 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 145194us
I20260709 13:09:22.013113 21556 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:22.110693 13858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:22.112498 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:22.113011 14401 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:22.104202 13829 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:22.039072 21648 consensus_queue.cc:1059] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:09:22.068794 21678 consensus_queue.cc:237] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:22.108474 13861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:22.116276 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:22.114735 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:22.115027 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:22.116882 14368 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:22.117309 13856 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:09:22.118659 14367 consensus_peers.cc:597] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:22.118822 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:22.121865 21029 raft_consensus.cc:2804] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:22.122411 21029 raft_consensus.cc:697] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:22.123231 21029 consensus_queue.cc:237] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:22.124939 21467 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:22.126526 21051 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:22.083321 21687 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:22.127879 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:22.130349 13829 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:22.133719 13680 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:22.138463 14402 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Rejecting Update request from peer 35ecb005831740438d7537dd4b840e03 for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:22.138501 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7aeef8df5a945efb8666f30fe979ab7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:22.138509 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:22.141001 13782 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:22.148730 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
W20260709 13:09:22.129742 21707 log.cc:927] Time spent T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:09:22.157104 13789 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:09:22.159545 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:22.163319 14402 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
I20260709 13:09:22.169889 13782 raft_consensus.cc:2468] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 21.
I20260709 13:09:22.136845 21467 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:22.137177 21673 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:09:22.184864 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 48400.8us
I20260709 13:09:22.137683 21684 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:22.189702 13755 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:22.190887 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:22.145385 21544 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
W20260709 13:09:22.219723 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 59195.2us
I20260709 13:09:22.219547 14401 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 23.
I20260709 13:09:22.182672 21064 raft_consensus.cc:697] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:22.222381 13829 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:22.187304 21648 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:22.228832 13755 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:22.234743 13680 leader_election.cc:304] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:22.245651 21546 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:22.223153 21355 raft_consensus.cc:2749] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:22.187628 21638 consensus_queue.cc:1059] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 13:09:22.263206 13856 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 23.
I20260709 13:09:22.230545 21505 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
W20260709 13:09:22.255707 21711 log.cc:927] Time spent T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:09:22.265965 21467 raft_consensus.cc:2804] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:22.241776 21640 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:22.211405 21658 consensus_queue.cc:1059] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 13:09:22.263798 21712 raft_consensus.cc:2749] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:22.294827 21640 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.218492 21549 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:09:22.274773 21467 raft_consensus.cc:697] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 21 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:22.286358 21064 consensus_queue.cc:237] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:22.287619 21562 raft_consensus.cc:3055] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:22.263276 21029 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.227453 21544 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:22.307657 14401 raft_consensus.cc:1275] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:09:22.308738 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:22.324460 21029 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:22.326777 21029 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:22.320156 21562 raft_consensus.cc:740] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:22.328008 21547 consensus_queue.cc:260] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:22.328253 21467 consensus_queue.cc:237] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:22.329070 21547 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:22.306139 21640 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:22.334946 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:22.340562 14394 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 20.
I20260709 13:09:22.309361 21658 raft_consensus.cc:3055] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:22.345194 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:09:22.331887 21718 log.cc:927] Time spent T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:09:22.347373 21658 raft_consensus.cc:740] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:22.372766 21544 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:22.373322 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:22.343181 21029 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 13:09:22.388211 21712 raft_consensus.cc:3055] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:09:22.357395 21673 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:22.388670 21712 raft_consensus.cc:740] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:22.398730 21646 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:22.400854 21684 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:22.406484 13599 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f09ef105d67b41dba510b44a6567d790 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 35ecb005831740438d7537dd4b840e03 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:09:22.389351 21710 log.cc:927] Time spent T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:09:22.364769 21562 consensus_queue.cc:260] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:22.413412 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 381541us
I20260709 13:09:22.396358 21673 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.436661 21673 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:22.414479 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:22.438621 13756 leader_election.cc:336] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:22.415436 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:22.439230 13756 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:22.414885 21658 consensus_queue.cc:260] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:22.452525 21658 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:22.447345 21320 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:22.443821 21701 consensus_queue.cc:1048] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.005s
I20260709 13:09:22.449481 21712 consensus_queue.cc:260] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:22.431224 21646 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:22.458947 14366 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:22.461319 13830 consensus_peers.cc:597] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:22.486078 14366 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:22.487380 14366 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:22.490906 13830 leader_election.cc:336] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:22.451261 21562 raft_consensus.cc:3060] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:22.492146 13791 raft_consensus.cc:2468] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 22.
W20260709 13:09:22.461928 21355 consensus_queue.cc:1175] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b5029654a4384e43a68eb67b794949b7" responder_term: 15 status { last_received { term: 15 index: 13 } last_committed_idx: 13 last_received_current_leader { term: 15 index: 13 } }
I20260709 13:09:22.492089 21654 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:22.516309 14366 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
W20260709 13:09:22.526233 13829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.490296 21687 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:22.517655 21292 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 13:09:22.530190 14366 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:22.533298 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 304894us
W20260709 13:09:22.535346 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.536664 13682 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:22.543155 13861 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:09:22.544073 13860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:09:22.547751 13830 leader_election.cc:336] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:22.548616 13863 raft_consensus.cc:1240] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:22.549113 13860 raft_consensus.cc:2393] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 17: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:22.548254 13830 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:22.532318 21292 raft_consensus.cc:2749] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:09:22.533258 21687 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:22.511307 21640 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:22.558358 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:22.560076 21640 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:22.560547 21505 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:09:22.565395 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:22.571499 13782 raft_consensus.cc:2393] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 21: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:22.572330 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:09:22.575119 14365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.576766 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:22.577527 14399 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:22.579468 21646 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:22.581574 21646 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:22.584127 21673 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:22.585345 13856 raft_consensus.cc:2393] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 21: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:22.586269 21673 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:22.589762 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:22.591837 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:22.591969 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:09:22.593777 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 57187.5us
I20260709 13:09:22.608719 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:09:22.610692 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 52472.8us
I20260709 13:09:22.611038 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:22.651916 13830 leader_election.cc:336] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:22.653981 13830 leader_election.cc:336] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:22.573801 21678 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:22.666180 21729 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:22.666986 21729 raft_consensus.cc:697] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 23 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
W20260709 13:09:22.668030 21728 log.cc:927] Time spent T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 13:09:22.676885 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 65905.1us
I20260709 13:09:22.678452 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:22.679755 21701 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:09:22.681071 21701 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:09:22.643846 13680 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:22.624048 13682 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:22.654374 13830 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:22.691313 14399 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 21.
W20260709 13:09:22.689139 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 65182.3us
W20260709 13:09:22.697772 13830 consensus_peers.cc:597] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:22.701731 13682 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:22.705024 13830 consensus_peers.cc:597] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:22.707628 21601 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:22.711499 21546 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:22.700814 21700 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:22.713733 21729 consensus_queue.cc:237] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:22.692018 21535 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:22.688383 21505 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:22.692220 21508 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.725944 21508 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:22.742444 21508 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:22.750734 13782 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:09:22.757786 21712 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:22.762806 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:22.764971 14396 raft_consensus.cc:1275] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:09:22.767652 13782 raft_consensus.cc:1275] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:09:22.768093 13783 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:09:22.770728 13830 consensus_peers.cc:597] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:22.772025 13864 raft_consensus.cc:1240] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 21 LEADER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:22.773164 13755 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:22.775869 21638 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:22.779907 12594 thread.cc:527] Waited for 6000ms trying to join with heartbeat (tid 13741)
I20260709 13:09:22.784998 21505 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:22.786700 21638 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:22.788949 21638 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:22.777792 21659 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:22.805968 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:22.775892 21646 consensus_queue.cc:1048] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 13:09:22.623366 13608 catalog_manager.cc:5697] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:22.776684 21678 consensus_queue.cc:1048] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:09:22.777763 21558 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 13:09:22.814745 13783 raft_consensus.cc:1240] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Rejecting Update request from peer b9d194f45e044e0988d5de1a99e5cd02 for earlier term 20. Current term is 21. Ops: []
I20260709 13:09:22.781054 21508 consensus_queue.cc:1059] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:09:22.811964 21659 raft_consensus.cc:697] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:22.833297 21659 consensus_queue.cc:237] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:22.840633 14393 raft_consensus.cc:1275] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:09:22.843588 21700 consensus_queue.cc:1048] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:09:22.845459 13791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45134 (request call id 1795) took 1036 ms. Trace:
I20260709 13:09:22.845844 13791 rpcz_store.cc:276] 0709 13:09:21.809446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.809984 (+   538us) service_pool.cc:224] Handling call
0709 13:09:22.845313 (+1035329us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54003bd654. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324e22fa 00007f52374a3b17 00007f5230a1e6d4 00007f5230a1e662 00007f5230a1e591 00007f5230a1e50c 00007f5230a1d7c2 00007f523081948c 00007f52308188c6 00007f523081826f
0709 13:09:22.845404 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1339298176}
I20260709 13:09:22.847566 21508 consensus_queue.cc:1243] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer b5029654a4384e43a68eb67b794949b7 log is divergent from this leader: its last log entry 21.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:09:22.848095 21672 consensus_queue.cc:1059] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:22.839599 13608 catalog_manager.cc:5697] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 21 to 25, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 25 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:22.911443 13756 consensus_peers.cc:597] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:22.911917 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 298393us
W20260709 13:09:22.913918 13756 leader_election.cc:336] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:22.914366 13756 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:22.927032 13608 catalog_manager.cc:5697] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:22.928578 13608 catalog_manager.cc:5697] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 29 to 31. New cstate: current_term: 31 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:22.930022 13608 catalog_manager.cc:5697] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 18 to 21, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 21 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:22.889004 21556 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:22.936715 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 199615us
I20260709 13:09:22.937575 13791 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:09:22.940539 13862 raft_consensus.cc:1240] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 23. Current term is 24. Ops: []
W20260709 13:09:22.950147 14367 consensus_peers.cc:597] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:22.952641 21401 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.953157 21401 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:22.958797 21548 raft_consensus.cc:3055] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:09:22.959262 21548 raft_consensus.cc:740] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:22.960165 21548 consensus_queue.cc:260] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:22.961388 21548 raft_consensus.cc:3060] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:22.964818 21638 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:09:22.968806 13830 consensus_peers.cc:597] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:22.972518 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:22.972921 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 59040.4us
W20260709 13:09:22.973562 13756 leader_election.cc:336] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:22.973973 13756 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:22.974745 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:22.974974 13756 leader_election.cc:336] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:22.975559 21355 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:22.976276 21355 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:22.977871 13680 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:22.980338 13863 raft_consensus.cc:1275] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:09:22.979385 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:22.984778 13756 leader_election.cc:336] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:22.999007 13756 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:22.981866 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:23.012295 13756 leader_election.cc:336] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:23.013365 13756 leader_election.cc:336] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:23.013767 13756 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:23.000204 13859 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
W20260709 13:09:23.016127 14367 consensus_peers.cc:597] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:22.955219 21401 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:23.033732 13830 consensus_peers.cc:597] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:23.035790 14367 consensus_peers.cc:597] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:23.032967 13756 leader_election.cc:336] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:23.036509 13756 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:22.980482 21508 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:23.040783 13756 leader_election.cc:336] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:23.034816 21505 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:23.020227 21541 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:23.043533 13756 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:23.062561 14366 leader_election.cc:304] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7
I20260709 13:09:23.036651 21320 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:23.042508 21621 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:23.039438 21716 consensus_queue.cc:1059] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.031s
I20260709 13:09:23.063962 21682 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.097486 21508 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.936071 13608 catalog_manager.cc:5697] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 17 to 19, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 19 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:23.098129 21508 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:23.098883 13608 catalog_manager.cc:5697] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:23.100309 13608 catalog_manager.cc:5697] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:23.101850 13608 catalog_manager.cc:5697] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 9 to 22, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 22 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:23.103539 21636 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.104005 21636 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:23.109818 21682 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:23.120749 13791 raft_consensus.cc:1275] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:09:23.124521 21682 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:23.126798 21701 consensus_queue.cc:1048] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:23.144526 21638 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.145316 21638 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:23.149309 21638 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:23.103267 13608 catalog_manager.cc:5697] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 16 to 20, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 20 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:23.156102 13608 catalog_manager.cc:5697] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:23.157564 13608 catalog_manager.cc:5697] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 15 to 21. New cstate: current_term: 21 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:09:23.160857 21744 log.cc:927] Time spent T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.064s	user 0.002s	sys 0.000s
I20260709 13:09:23.168000 21636 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:23.172248 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:23.173821 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:23.180404 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 134964us
I20260709 13:09:23.181044 14368 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:23.182065 21508 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:23.182785 21677 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:23.183209 21677 raft_consensus.cc:493] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.183557 21677 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:23.183590 21292 consensus_queue.cc:1048] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:23.186908 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:23.188572 21545 raft_consensus.cc:2804] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:09:23.188668 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 126200us
I20260709 13:09:23.188916 14401 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:09:23.189103 21545 raft_consensus.cc:697] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 22 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:23.190037 21545 consensus_queue.cc:237] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:23.191309 21587 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:23.191839 21587 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:23.192407 21716 raft_consensus.cc:3055] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:09:23.192798 21716 raft_consensus.cc:740] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:23.193900 21587 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:23.195544 21658 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:23.196027 21658 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:23.197925 21658 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:23.202682 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:23.203282 13791 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:09:23.204865 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:23.205715 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:23.208204 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:23.208726 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:23.208808 13856 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:09:23.212325 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:23.215898 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 74578.6us
I20260709 13:09:23.217852 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:23.219367 13791 raft_consensus.cc:2393] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 in current term 19: Already voted for candidate 35ecb005831740438d7537dd4b840e03 in this term.
I20260709 13:09:23.224962 14368 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:23.227980 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:23.240193 13830 consensus_peers.cc:597] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:23.242491 13682 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:23.243672 21548 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:23.249697 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:23.159029 13608 catalog_manager.cc:5697] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 14 to 19, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 19 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:23.253392 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:23.257519 13680 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:23.258358 13830 consensus_peers.cc:597] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:23.257856 13756 consensus_peers.cc:597] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:23.250478 21672 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:23.254904 21401 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:23.268070 21355 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:09:23.246642 21535 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.018s
I20260709 13:09:23.264722 21682 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.277441 21682 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:23.277878 21677 raft_consensus.cc:515] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:23.265048 21729 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:09:23.263458 21712 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:23.268157 21064 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:23.320899 13756 consensus_peers.cc:597] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:23.271492 21401 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:23.330487 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:23.331429 13786 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:23.333489 14394 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:09:23.339839 13864 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:09:23.344096 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:23.344655 13859 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 18.
I20260709 13:09:23.328521 21401 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:23.346134 13682 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
W20260709 13:09:23.360551 13756 consensus_peers.cc:597] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:23.368983 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:23.372299 14367 consensus_peers.cc:597] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:23.375073 13756 leader_election.cc:336] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:23.378086 13830 consensus_peers.cc:597] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:23.333307 21682 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:23.382531 13859 raft_consensus.cc:2393] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 in current term 18: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:23.328624 21064 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:23.388171 13757 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:23.390566 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:23.391175 13784 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 17.
I20260709 13:09:23.392750 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14765cc3066247a49b29adae5e893ab8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:23.393329 13859 raft_consensus.cc:3060] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:23.365119 21687 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.369781 21729 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:23.365532 21505 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 13:09:23.395208 13786 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:09:23.396215 21677 leader_election.cc:290] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:23.402412 21518 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:23.403385 21729 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.416973 14366 leader_election.cc:304] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:09:23.429939 21753 log.cc:927] Time spent T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:09:23.451259 13859 raft_consensus.cc:2468] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
I20260709 13:09:23.457576 21712 raft_consensus.cc:493] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.423687 21716 consensus_queue.cc:260] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:23.459227 21716 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:23.421515 21638 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.044s
I20260709 13:09:23.458083 21712 raft_consensus.cc:515] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:23.425607 21729 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:23.487432 13856 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:09:23.403452 13608 catalog_manager.cc:5697] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 7 to 15. New cstate: current_term: 15 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:23.449843 21545 raft_consensus.cc:2804] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:23.406239 21687 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:23.522797 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 98757.8us
I20260709 13:09:23.490314 13608 catalog_manager.cc:5697] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 16 to 21, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 21 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:23.554064 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:23.554709 13856 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:09:23.537159 21761 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.507252 21234 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 13:09:23.541821 21064 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:23.542078 21682 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:23.515793 21601 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.544222 21687 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:23.557708 14368 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:23.516239 21545 raft_consensus.cc:697] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:23.569764 21401 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:23.572363 21545 consensus_queue.cc:237] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:23.561318 21761 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:23.575984 21761 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:23.577031 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:23.577836 14393 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 19.
I20260709 13:09:23.579161 13755 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:23.582015 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:23.587361 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:23.577454 21660 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:23.562328 21518 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:23.583698 21401 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:23.583843 21480 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:23.596328 21480 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.596706 21480 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:23.596745 21548 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:23.597332 21548 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:23.599530 13856 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
I20260709 13:09:23.612950 14368 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:23.561599 21682 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:23.622264 21682 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:23.600502 21660 raft_consensus.cc:493] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.623199 21660 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:23.562976 21601 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:23.599292 21548 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:23.632579 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:23.641625 21729 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:23.653170 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:23.631911 21401 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:23.654251 21401 raft_consensus.cc:697] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 19 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:23.654582 21729 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:23.655104 21401 consensus_queue.cc:237] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:23.660727 13862 raft_consensus.cc:3060] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:23.651052 13608 catalog_manager.cc:5697] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 14 to 21, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 21 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:23.668200 13862 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260709 13:09:23.659152 21601 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:23.673275 13862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:23.679003 13862 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:23.662566 13608 catalog_manager.cc:5697] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 12 to 20. New cstate: current_term: 20 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:23.690248 21480 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:23.691655 13862 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:09:23.695482 14393 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:09:23.700390 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 245828us
I20260709 13:09:23.680327 21470 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.025s
I20260709 13:09:23.680503 21548 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.705003 21548 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:23.707073 21548 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:23.725766 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:23.726421 13864 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:23.734925 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:23.735635 13786 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:09:23.736464 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:23.737613 13791 raft_consensus.cc:1275] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260709 13:09:23.740248 13789 raft_consensus.cc:2368] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20.
I20260709 13:09:23.740083 13864 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 20.
I20260709 13:09:23.742651 13682 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02; no voters: 
I20260709 13:09:23.743952 13757 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:23.762676 21655 consensus_queue.cc:1048] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:09:23.775189 14366 leader_election.cc:400] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Vote denied by peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047) with higher term. Message: Invalid argument: T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20.
W20260709 13:09:23.781771 12594 thread.cc:527] Waited for 7000ms trying to join with heartbeat (tid 13741)
I20260709 13:09:23.749488 21636 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:23.750707 21764 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:23.792923 21636 raft_consensus.cc:697] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Becoming Leader. State: Replica: b9d194f45e044e0988d5de1a99e5cd02, State: Running, Role: LEADER
I20260709 13:09:23.793991 21636 consensus_queue.cc:237] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:23.740479 21627 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.044s
I20260709 13:09:23.805850 21712 leader_election.cc:290] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:23.806471 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:23.803265 21764 raft_consensus.cc:697] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 20 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:23.808365 21480 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:23.808917 21764 consensus_queue.cc:237] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:23.809437 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:23.811352 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:23.815711 14398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:23.787177 13830 consensus_peers.cc:597] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:23.747037 21505 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.819242 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c307c37029c4b5596bad2e08bda02bf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:23.819586 13830 consensus_peers.cc:597] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:23.825661 14393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:23.830685 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:23.832717 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:23.837215 13756 consensus_peers.cc:597] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:23.837941 13756 consensus_peers.cc:597] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:23.843442 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c254367a594ceb8d4a3db25a715ae1" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:23.853008 14367 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 194 similar messages]
I20260709 13:09:23.853890 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:23.854542 13789 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:23.858764 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5150c5d9c445549ec6d199f2cd70e0" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:23.867317 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aefa8c282f4143b3c3d55f5a4d0bcf" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:23.868525 21660 raft_consensus.cc:515] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:23.822932 21505 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:23.882085 13789 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 19.
I20260709 13:09:23.911211 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:23.912088 13789 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:23.922205 21757 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:23.922982 21757 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:23.925516 21757 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:23.895766 13682 leader_election.cc:304] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:23.936340 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:23.937498 14394 raft_consensus.cc:2393] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 16: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:23.940969 13789 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:09:23.947863 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:23.883035 21562 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:23.953349 13756 consensus_peers.cc:597] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:23.949838 13791 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:09:23.942586 14366 leader_election.cc:304] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:23.958700 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:23.950702 13682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 55068.7us
I20260709 13:09:23.959370 13680 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:23.964386 13680 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:23.966763 21638 raft_consensus.cc:493] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.956955 21766 raft_consensus.cc:2749] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:23.971627 13680 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:23.963778 21470 raft_consensus.cc:2804] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:23.964490 21660 leader_election.cc:290] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:23.869524 13608 catalog_manager.cc:5697] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:24.005944 13680 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:23.955467 21562 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:23.972978 21601 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:23.971199 21723 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:24.007198 13680 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:24.007313 21064 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:24.001049 21772 log.cc:927] Time spent T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:09:23.973080 21636 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:23.974599 21654 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.976576 21638 raft_consensus.cc:515] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } attrs { replace: true } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:23.999445 21672 raft_consensus.cc:493] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:24.006412 21470 raft_consensus.cc:697] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:24.017194 21508 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.017701 21723 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:24.052081 13608 catalog_manager.cc:5697] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:24.063305 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2aec8e942e44d9b699829a1e6de4b3" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:24.085518 13857 raft_consensus.cc:3060] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:24.016248 21779 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:24.067853 21064 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:09:24.067981 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 60850.7us
I20260709 13:09:24.091830 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:24.096359 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 154711us
I20260709 13:09:24.094213 21562 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:24.085038 21723 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:24.099701 21774 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:09:24.107707 21505 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:24.120081 21775 log.cc:927] Time spent T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:09:24.119817 21470 consensus_queue.cc:237] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:24.125123 21638 leader_election.cc:290] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:24.088413 21654 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:24.128067 21654 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:24.128208 21776 log.cc:927] Time spent T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.271s	user 0.004s	sys 0.000s
I20260709 13:09:24.089700 21508 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:24.087554 21672 raft_consensus.cc:515] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:24.133586 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 54615.4us
I20260709 13:09:24.145004 13857 raft_consensus.cc:2468] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:09:24.151948 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:24.217607 21638 raft_consensus.cc:493] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:24.260641 14367 leader_election.cc:336] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:24.140920 13608 catalog_manager.cc:5697] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 10 to 20, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 20 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:24.277846 13608 catalog_manager.cc:5697] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 19 to 24, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 24 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:24.279325 13608 catalog_manager.cc:5697] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:24.286978 13608 catalog_manager.cc:5697] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 12 to 20. New cstate: current_term: 20 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:09:24.287949 21787 log.cc:927] Time spent T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:09:24.289048 13608 catalog_manager.cc:5697] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 17 to 19, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 19 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:24.291246 13608 catalog_manager.cc:5697] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 17 to 19, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 19 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:24.292323 21672 leader_election.cc:290] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:24.296429 21672 raft_consensus.cc:493] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.297050 21672 raft_consensus.cc:515] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:24.298697 21508 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:24.299831 21672 leader_election.cc:290] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:24.301776 13784 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:24.263876 21638 raft_consensus.cc:515] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:24.310137 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:24.314386 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 217830us
I20260709 13:09:24.316761 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:24.320933 13789 raft_consensus.cc:1275] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:09:24.334529 21638 leader_election.cc:290] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:24.338335 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:24.329061 21601 consensus_queue.cc:1048] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:09:24.342471 21723 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:24.355206 21723 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:24.356946 21785 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.361326 21785 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:24.357744 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:24.363874 14402 raft_consensus.cc:2393] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 16: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
I20260709 13:09:24.365538 21785 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:24.367303 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:24.368048 14402 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 22.
W20260709 13:09:24.369268 21773 log.cc:927] Time spent T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.495s	user 0.003s	sys 0.008s
I20260709 13:09:24.370085 13789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:24.392760 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:24.394976 13859 raft_consensus.cc:2410] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb06175847b428ea8bd77055fcddf58 for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:09:24.396098 13856 raft_consensus.cc:1240] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20. Ops: []
I20260709 13:09:24.401971 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:24.403746 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:24.404419 13859 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 22.
I20260709 13:09:24.407860 13857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19de5233e495495dbff7c520c86d37c7" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:24.401968 13856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:24.392700 13829 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:24.410434 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:24.411983 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536b1fc131984687bf3b13417507e21d" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:24.415180 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:24.415256 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3fcea1abf04503bc26d451a56ed222" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:24.410682 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:24.419966 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e22f0634b34971aed9c5b948f3275e" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:24.420401 13789 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 16.
I20260709 13:09:24.422262 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:24.416090 14402 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d194f45e044e0988d5de1a99e5cd02 in term 22.
I20260709 13:09:24.424418 13856 raft_consensus.cc:1275] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:24.431303 13682 leader_election.cc:304] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:24.432601 13829 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:24.433545 13680 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:24.439121 13682 leader_election.cc:304] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:24.440455 21508 raft_consensus.cc:2749] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:09:24.440843 14396 raft_consensus.cc:3055] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:09:24.441134 21508 raft_consensus.cc:2749] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:24.441417 14396 raft_consensus.cc:740] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:24.442545 14396 consensus_queue.cc:260] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:24.443152 13682 leader_election.cc:304] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:24.443837 14396 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:24.444471 21783 raft_consensus.cc:2749] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:24.446720 13680 leader_election.cc:304] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:24.394840 21414 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.458663 13680 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:24.431453 21757 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:24.436264 21562 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:24.449893 21712 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:24.453023 21723 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:24.469532 21601 raft_consensus.cc:2749] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:24.487006 21712 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.489108 21712 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:24.483570 21535 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:24.436836 21660 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:09:24.477303 21757 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.499698 21757 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:24.459124 21414 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:24.508055 21723 raft_consensus.cc:697] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
W20260709 13:09:24.508198 13830 leader_election.cc:336] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:24.509073 21723 consensus_queue.cc:237] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:24.509684 13856 raft_consensus.cc:1275] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Refusing update from remote peer b9d194f45e044e0988d5de1a99e5cd02: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:09:24.519516 21764 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.012s	sys 0.034s
W20260709 13:09:24.523007 21764 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.012s	sys 0.034s
I20260709 13:09:24.523569 13784 raft_consensus.cc:1240] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 20 LEADER]: Rejecting Update request from peer ceb06175847b428ea8bd77055fcddf58 for earlier term 19. Current term is 20. Ops: []
W20260709 13:09:24.527143 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 77522.5us
I20260709 13:09:24.546521 21763 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.547204 21763 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:24.555722 21672 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:24.556308 21672 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:24.559084 21672 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:24.559571 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 51402.6us
I20260709 13:09:24.565577 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:24.573082 21414 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:24.574223 21672 consensus_queue.cc:1048] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:09:24.599627 13756 consensus_peers.cc:597] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:24.602566 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:24.607542 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 152104us
I20260709 13:09:24.608261 14368 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:24.620010 14367 consensus_peers.cc:597] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:24.621347 14396 pending_rounds.cc:85] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58: Aborting all ops after (but not including) 15
I20260709 13:09:24.621721 14396 pending_rounds.cc:107] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 13:09:24.622145 14396 raft_consensus.cc:2889] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:24.621397 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6fb0872745419da9cb9e1228d021aa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:24.628705 13863 raft_consensus.cc:1275] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:24.637838 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:24.638381 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:24.641610 21508 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.641475 21401 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:24.642132 21508 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:24.638471 14401 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 24.
I20260709 13:09:24.620157 21538 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:24.670523 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:09:24.675143 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:24.673638 13682 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:24.635035 21687 consensus_queue.cc:1048] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:09:24.652391 21655 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.678828 13682 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:24.691937 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:24.674192 21763 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:24.693499 21315 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:24.678529 21678 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:09:24.706168 21678 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.706549 21678 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:24.711796 21757 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:24.713963 21757 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:24.687521 21729 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:24.714692 21678 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:24.718318 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:24.718879 14396 raft_consensus.cc:3060] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:24.691434 21655 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:24.725282 21655 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:24.726557 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:24.727165 13782 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:09:24.728442 13790 raft_consensus.cc:1275] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:24.730266 14366 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:24.731380 21797 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:24.731568 21655 consensus_queue.cc:1048] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:24.731842 21797 raft_consensus.cc:493] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.732355 21797 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:24.733523 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 97944.7us
I20260709 13:09:24.739823 21541 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:24.740384 21541 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:24.742429 21541 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:24.744095 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:24.749467 14400 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 24.
I20260709 13:09:24.750576 13755 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:24.747567 21638 raft_consensus.cc:493] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.750896 14396 raft_consensus.cc:2468] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 23.
I20260709 13:09:24.759486 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f358793c54a8fa2409a5d4c5505f8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:24.759757 14367 consensus_peers.cc:597] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:24.758817 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 62979.7us
I20260709 13:09:24.768224 13829 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
W20260709 13:09:24.761662 13756 consensus_peers.cc:597] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.782368 12594 thread.cc:527] Waited for 8000ms trying to join with heartbeat (tid 13741)
I20260709 13:09:24.770288 13680 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:24.794998 21797 raft_consensus.cc:515] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:24.793159 21320 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:24.806733 21064 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:24.794045 21548 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:24.816190 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 43892.8us
I20260709 13:09:24.796849 21784 raft_consensus.cc:2804] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:24.820639 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:24.755612 21508 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:24.753809 21638 raft_consensus.cc:515] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:24.743345 21712 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:24.842432 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:24.843801 13864 raft_consensus.cc:2368] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 24. Current term is 25.
W20260709 13:09:24.850991 21796 log.cc:927] Time spent T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:09:24.813062 21320 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting leader election (detected failure of leader ceb06175847b428ea8bd77055fcddf58)
I20260709 13:09:24.853071 21320 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:24.834367 21548 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:24.858875 21548 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:24.862160 21638 leader_election.cc:290] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:24.862792 13756 consensus_peers.cc:597] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:24.870368 13830 leader_election.cc:336] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:24.875702 13830 consensus_peers.cc:597] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:24.877089 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:24.879238 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:24.879348 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd386d71cc264abca3dbfa88ffd4e951" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:24.872282 14367 consensus_peers.cc:597] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:24.881187 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:24.879238 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:24.901587 21797 leader_election.cc:290] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:24.907672 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:24.908294 13786 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:24.867084 21784 raft_consensus.cc:697] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 23 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:24.909296 21784 consensus_queue.cc:237] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:24.915463 13786 raft_consensus.cc:2468] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 17.
I20260709 13:09:24.920768 14366 leader_election.cc:304] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:24.915750 21782 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.915515 21712 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:24.922581 21655 raft_consensus.cc:2804] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:24.921732 21782 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:24.923105 21655 raft_consensus.cc:697] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:24.924235 21655 consensus_queue.cc:237] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:24.927207 13680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 49239.8us
I20260709 13:09:24.932192 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:24.938408 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:24.939162 14396 raft_consensus.cc:2393] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b9d194f45e044e0988d5de1a99e5cd02 in current term 23: Already voted for candidate b5029654a4384e43a68eb67b794949b7 in this term.
I20260709 13:09:24.924723 21782 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:24.960348 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 71156.5us
I20260709 13:09:24.954332 13680 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:24.970170 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:24.979379 13757 leader_election.cc:400] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 24. Current term is 25.
I20260709 13:09:24.986138 13680 leader_election.cc:304] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:24.988404 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:24.989202 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cc0929e3a64836993d9ee880b12800" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:24.991317 21064 raft_consensus.cc:2749] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:24.992257 13682 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:24.993975 13680 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:24.989533 21712 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:25.005288 21636 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:09:25.009040 21712 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:25.031906 21808 log.cc:927] Time spent T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:09:25.087399 21320 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:25.091126 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:25.092567 14400 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:25.028019 21678 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 25 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:25.115440 21712 raft_consensus.cc:493] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.116832 21712 raft_consensus.cc:515] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:25.143890 21712 leader_election.cc:290] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:25.155225 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:25.156338 13864 raft_consensus.cc:2368] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 24. Current term is 25.
I20260709 13:09:25.130075 21320 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 election: Requested vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:25.183817 21712 raft_consensus.cc:493] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.184875 21712 raft_consensus.cc:515] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:25.187274 21508 raft_consensus.cc:493] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.189478 21712 leader_election.cc:290] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:25.196030 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:25.212291 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:25.213009 13791 raft_consensus.cc:3060] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:09:25.224572 13757 leader_election.cc:400] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 election: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 24. Current term is 25.
I20260709 13:09:25.225042 13757 leader_election.cc:403] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:09:25.225920 14395 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:25.188830 21508 raft_consensus.cc:515] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:25.228860 21508 leader_election.cc:290] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:25.230083 14367 consensus_peers.cc:597] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:25.239151 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79adc3f3cf6a48518016b2d56c531dbd" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:25.270803 14400 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 25.
I20260709 13:09:25.283186 14396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:25.290535 21785 consensus_queue.cc:1059] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:09:25.295814 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0eeb1582143a09acf311171812faa" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:25.300139 21785 consensus_queue.cc:1243] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Peer ceb06175847b428ea8bd77055fcddf58 log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:09:25.306418 13790 raft_consensus.cc:1240] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Rejecting Update request from peer b5029654a4384e43a68eb67b794949b7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:25.318976 13829 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:25.320458 21784 raft_consensus.cc:2804] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:09:25.321125 21784 raft_consensus.cc:697] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 25 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:25.329100 21784 consensus_queue.cc:237] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:25.345621 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:25.350030 21757 raft_consensus.cc:3055] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:25.350525 21757 raft_consensus.cc:740] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:25.357520 21757 consensus_queue.cc:260] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:25.359406 21757 raft_consensus.cc:3060] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:25.369642 21780 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.370427 21780 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:25.372900 21780 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:25.375720 21780 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.376325 21780 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:25.378459 21780 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:25.381451 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60899523d3d145f58ccff5bb3438cb90" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:25.389909 13786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3618fd55609843fca70082d3565b459b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:25.343233 13791 raft_consensus.cc:2468] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 25.
I20260709 13:09:25.405435 21764 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015) with higher term. Message: Invalid argument: T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ecb005831740438d7537dd4b840e03 for earlier term 24. Current term is 25.
I20260709 13:09:25.417800 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:25.421695 13680 leader_election.cc:304] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:25.423281 21636 raft_consensus.cc:2749] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:25.416198 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:25.446557 14367 consensus_peers.cc:597] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:25.461879 21780 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.462776 21780 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:25.465482 21780 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:25.462807 14367 consensus_peers.cc:597] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:25.466619 14367 consensus_peers.cc:597] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:25.476126 13864 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 13:09:25.476560 13864 pending_rounds.cc:85] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: Aborting all ops after (but not including) 13
I20260709 13:09:25.481597 13864 pending_rounds.cc:107] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:09:25.481945 13864 raft_consensus.cc:2889] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:25.482692 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:25.481619 14395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbcfa22d8b54ed5997bc6453bdf0fd3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:25.480402 14367 consensus_peers.cc:597] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.491884 13859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc19cb1c68943cba711cd721c8caa91" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:25.506004 13680 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:25.511195 21547 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:25.516588 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2185b760234a0280587d4ea3f18b8a" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:25.517764 14400 raft_consensus.cc:1275] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:09:25.521644 13682 leader_election.cc:304] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:25.523324 21508 raft_consensus.cc:2749] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:25.525995 13682 leader_election.cc:304] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:25.528265 21638 raft_consensus.cc:2749] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:25.544394 21780 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:25.602133 21558 consensus_queue.cc:1048] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.018s
W20260709 13:09:25.612174 13830 consensus_peers.cc:597] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:25.618355 13756 consensus_peers.cc:597] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:25.617486 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 65016.3us
W20260709 13:09:25.620909 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 58048.1us
I20260709 13:09:25.632566 13790 raft_consensus.cc:1275] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:09:25.647140 21716 consensus_queue.cc:1048] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:09:25.649587 21712 raft_consensus.cc:493] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.650285 21712 raft_consensus.cc:515] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:25.654922 21712 leader_election.cc:290] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:25.656998 13682 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:25.657943 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:25.658403 21712 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:25.659714 13682 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:25.660781 21712 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:09:25.671322 13756 consensus_peers.cc:597] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:25.676460 13782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb0e4fb02d3a45d4a6cc322c544fbf80" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:25.689567 13830 consensus_peers.cc:597] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:25.702378 13680 leader_election.cc:304] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
W20260709 13:09:25.703665 13830 consensus_peers.cc:597] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.717836 21508 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.718482 21508 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:25.721869 14367 consensus_peers.cc:597] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:25.712680 21636 raft_consensus.cc:2749] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:25.748471 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 28 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:25.740267 13830 consensus_peers.cc:597] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:25.770488 21508 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:25.771950 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d8b741328f1468cb4ac726ffe62e9e8" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 28 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:25.773972 13682 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:25.775589 21508 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:09:25.786005 13756 consensus_peers.cc:597] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:25.793517 21508 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:25.793774 12594 thread.cc:527] Waited for 9000ms trying to join with heartbeat (tid 13741)
I20260709 13:09:25.794880 21508 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:25.797613 21508 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:25.798645 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 34 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:25.798959 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9ba3c4f4a14a57b28d5cf2b9cf5afd" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 34 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:25.801033 13680 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:25.802060 21636 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 13:09:25.835824 14401 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:09:25.840042 21784 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:09:25.877197 13756 consensus_peers.cc:597] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:25.893054 13790 raft_consensus.cc:1275] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:09:25.895881 21757 consensus_queue.cc:1048] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:09:25.899621 13756 consensus_peers.cc:597] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:25.902105 13611 catalog_manager.cc:5697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 12 to 15, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 15 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:25.941619 13611 catalog_manager.cc:5697] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:25.961740 13608 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57116 (request call id 258) took 8630 ms. Trace:
I20260709 13:09:25.964217 13611 catalog_manager.cc:5697] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 16 to 18, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 18 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:09:25.966058 13611 catalog_manager.cc:5697] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
W20260709 13:09:25.972915 13830 consensus_peers.cc:597] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:25.988505 21508 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:25.989228 21508 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:25.974253 13608 rpcz_store.cc:276] 0709 13:09:17.331734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.344649 (+ 12915us) service_pool.cc:224] Handling call
0709 13:09:25.961489 (+8616840us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:24.724556 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:24.725056 (+   500us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:24.725094 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:09:24.725110 (+    16us) tablet.cc:662] Decoding operations
0709 13:09:24.726790 (+  1680us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:24.726846 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:24.726870 (+    24us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:09:24.812065 (+ 85195us) tablet.cc:701] Row locks acquired
0709 13:09:24.812079 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:09:24.812219 (+   140us) write_op.cc:270] Start()
0709 13:09:24.812331 (+   112us) write_op.cc:276] Timestamp: P: 1783602564812175 usec, L: 0
0709 13:09:24.812354 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:09:24.866109 (+ 53755us) log.cc:844] Serialized 9914 byte log entry
0709 13:09:25.160158 (+294049us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b54003edd54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232447571 00007f52324d9e28 00007f5235f14581 00007f5235f13d58 00007f5235f189f1 00007f5235f189a9 00007f5235f18939 00007f5235f18901 00007f5235f17b2d 000000000038f354 000000000038f199
0709 13:09:25.308114 (+147956us) op_driver.cc:464] REPLICATION: finished
0709 13:09:25.440058 (+131944us) write_op.cc:301] APPLY: starting
0709 13:09:25.440198 (+   140us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:25.717170 (+276972us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:25.717212 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:25.821051 (+103839us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:25.821585 (+   534us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 13:09:25.821639 (+    54us) write_op.cc:312] APPLY: finished
0709 13:09:25.822262 (+   623us) log.cc:844] Serialized 220 byte log entry
0709 13:09:25.822465 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:25.823026 (+   561us) write_op.cc:454] Released schema lock
0709 13:09:25.823102 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:25.861752 (+ 38650us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:25.861792 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2793,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":131530,"apply.run_cpu_time_us":37743,"apply.run_wall_time_us":421734,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108627,"num_ops":25,"prepare.queue_time_us":222780,"prepare.run_cpu_time_us":50247,"prepare.run_wall_time_us":435871,"raft.queue_time_us":275643,"raft.run_cpu_time_us":14958,"raft.run_wall_time_us":111242,"replication_time_us":495513,"spinlock_wait_cycles":5105408,"thread_start_us":583173,"threads_started":4,"wal-append.queue_time_us":162840}]]}
I20260709 13:09:25.996039 21508 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:26.014444 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:26.016429 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b0054f48c4947acaea83521993a8f01" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:26.017045 14367 consensus_peers.cc:597] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.017683 14367 consensus_peers.cc:597] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:26.052136 13680 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:26.052973 21508 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:26.076637 13830 consensus_peers.cc:597] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:26.077433 13830 consensus_peers.cc:597] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:26.087080 21508 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.087769 21508 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:26.090242 21508 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:26.097573 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:26.099346 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fb07fff88a4dcf97841a29f2641f66" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:26.108225 13680 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:26.109319 21508 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:26.125923 13830 consensus_peers.cc:597] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:26.200443 13608 catalog_manager.cc:5697] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:26.202075 13608 catalog_manager.cc:5697] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 11 to 18, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 18 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.204221 13608 catalog_manager.cc:5697] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 14 to 20, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 20 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:26.206151 13608 catalog_manager.cc:5697] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 14 to 23, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 23 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:26.222143 13608 catalog_manager.cc:5697] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 18 to 25, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 25 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:26.223991 13608 catalog_manager.cc:5697] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 18 to 21, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 21 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:26.226589 13608 catalog_manager.cc:5697] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:09:26.221668 13611 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49428 (request call id 357) took 36913 ms (client timeout 15000 ms). Trace:
W20260709 13:09:26.229354 13611 rpcz_store.cc:269] 0709 13:08:49.307940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.308186 (+   246us) service_pool.cc:224] Handling call
0709 13:09:26.221556 (+36913370us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:26.011725 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:26.013597 (+  1872us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:26.013644 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:09:26.013664 (+    20us) tablet.cc:662] Decoding operations
0709 13:09:26.014398 (+   734us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:26.014512 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:26.014543 (+    31us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:09:26.015080 (+   537us) tablet.cc:701] Row locks acquired
0709 13:09:26.015137 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:09:26.015313 (+   176us) write_op.cc:270] Start()
0709 13:09:26.015480 (+   167us) write_op.cc:276] Timestamp: P: 1783602566015231 usec, L: 0
0709 13:09:26.015501 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:09:26.017047 (+  1546us) log.cc:844] Serialized 1701 byte log entry
0709 13:09:26.135063 (+118016us) op_driver.cc:464] REPLICATION: finished
0709 13:09:26.135498 (+   435us) write_op.cc:301] APPLY: starting
0709 13:09:26.135595 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:26.138267 (+  2672us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:26.138373 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:26.152169 (+ 13796us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:26.152374 (+   205us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:09:26.152433 (+    59us) write_op.cc:312] APPLY: finished
0709 13:09:26.152699 (+   266us) log.cc:844] Serialized 49 byte log entry
0709 13:09:26.153586 (+   887us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:26.153710 (+   124us) write_op.cc:454] Released schema lock
0709 13:09:26.154346 (+   636us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:26.154749 (+   403us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:26.154778 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1373158,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":107,"apply.run_cpu_time_us":7185,"apply.run_wall_time_us":19242,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16720,"num_ops":4,"prepare.queue_time_us":35196,"prepare.run_cpu_time_us":3830,"prepare.run_wall_time_us":5689,"replication_time_us":119382,"thread_start_us":18805,"threads_started":1}]]}
I20260709 13:09:26.227954 13608 catalog_manager.cc:5697] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:26.238179 13608 catalog_manager.cc:5697] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 7 to 17. New cstate: current_term: 17 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.248153 13608 catalog_manager.cc:5697] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 15 to 21, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 21 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:26.251099 13608 catalog_manager.cc:5697] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:26.253441 13608 catalog_manager.cc:5697] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 15 to 17, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 17 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.255378 13608 catalog_manager.cc:5697] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 16 to 22, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 22 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.264518 13608 catalog_manager.cc:5697] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 16 to 22. New cstate: current_term: 22 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:26.266331 13608 catalog_manager.cc:5697] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 11 to 19, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 19 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.268451 13608 catalog_manager.cc:5697] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 16 to 21. New cstate: current_term: 21 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:26.269925 13608 catalog_manager.cc:5697] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 13 to 18, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 18 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:26.276074 13608 catalog_manager.cc:5697] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 10 to 16, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 16 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.277906 13608 catalog_manager.cc:5697] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 11 to 18. New cstate: current_term: 18 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:26.288131 13608 catalog_manager.cc:5697] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 16 to 23. New cstate: current_term: 23 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:26.289613 13608 catalog_manager.cc:5697] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:26.290956 13608 catalog_manager.cc:5697] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 20 to 22, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 22 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:26.292449 13608 catalog_manager.cc:5697] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 19 to 23, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 23 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:26.293967 13608 catalog_manager.cc:5697] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 24 to 28, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 28 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:09:26.301170 13756 consensus_peers.cc:597] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:26.299623 13608 catalog_manager.cc:5697] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 17 to 23, leader changed from ceb06175847b428ea8bd77055fcddf58 (127.12.76.132) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 23 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
W20260709 13:09:26.362208 13830 consensus_peers.cc:597] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.401346 13756 consensus_peers.cc:597] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.440133 13830 consensus_peers.cc:597] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.443965 13756 consensus_peers.cc:597] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:26.506398 21508 raft_consensus.cc:493] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.507088 21508 raft_consensus.cc:515] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:26.509236 21508 leader_election.cc:290] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:26.511235 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:26.514259 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3cfef71353344f180965689d6ec9166" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:26.515760 13680 leader_election.cc:304] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:26.521308 21508 raft_consensus.cc:2749] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:26.534663 13613 catalog_manager.cc:5697] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 14 to 22, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 22 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:09:26.543924 13613 catalog_manager.cc:5697] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 14 to 20, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 20 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:09:26.538283 21508 raft_consensus.cc:493] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.554325 13613 catalog_manager.cc:5697] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 20 to 27, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 27 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:09:26.555482 21508 raft_consensus.cc:515] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:26.557940 13613 catalog_manager.cc:5697] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 18 to 24, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 24 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:09:26.560247 21548 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.575904 21548 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:26.565605 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:26.573434 21636 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.578162 21548 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:26.578510 21636 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:26.580078 13613 catalog_manager.cc:5697] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 16 to 21. New cstate: current_term: 21 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:09:26.580642 21636 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:26.581199 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:26.581727 13613 catalog_manager.cc:5697] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 17 to 21, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 21 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.583664 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68418f30a686438bba0d6ab02efa0986" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:26.561640 13791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "106d35c470db4341b591e5268b81a3f3" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:26.585666 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:26.586598 13680 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:26.587688 21636 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:26.583875 13613 catalog_manager.cc:5697] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 14 to 18, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 18 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.592536 13613 catalog_manager.cc:5697] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.593138 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8591822f3dc3430e935360afdb260fce" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:26.604460 13613 catalog_manager.cc:5697] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 18 to 24. New cstate: current_term: 24 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.597048 13680 leader_election.cc:304] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:26.606225 21636 raft_consensus.cc:2749] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:26.606386 13613 catalog_manager.cc:5697] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.607797 21508 leader_election.cc:290] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:26.606758 13680 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:26.609236 13613 catalog_manager.cc:5697] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 19 to 23, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 23 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:09:26.610399 21508 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:26.651196 21636 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.653311 21636 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:26.656493 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:26.662279 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43b4c4d63f407c90aa0154dfcc1063" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:26.664145 21636 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:26.673843 13680 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:26.679164 21548 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.679715 21548 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:26.682723 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:26.683772 21548 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:26.684441 21636 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:26.690789 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e4bec6398d84f67ad839268ec8d2a12" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:26.692591 13680 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:26.693583 21548 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:26.777904 13613 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49444 (request call id 350) took 4958 ms. Trace:
I20260709 13:09:26.778673 13609 catalog_manager.cc:5697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:26.795111 12594 thread.cc:527] Waited for 10000ms trying to join with heartbeat (tid 13741)
I20260709 13:09:26.799082 13609 catalog_manager.cc:5697] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.801990 13613 rpcz_store.cc:276] 0709 13:09:21.819882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.820057 (+   175us) service_pool.cc:224] Handling call
0709 13:09:26.777809 (+4957752us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:26.629655 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:26.630210 (+   555us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:26.630250 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:09:26.630268 (+    18us) tablet.cc:662] Decoding operations
0709 13:09:26.631382 (+  1114us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:26.631454 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:26.631482 (+    28us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:09:26.632416 (+   934us) tablet.cc:701] Row locks acquired
0709 13:09:26.632432 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:09:26.632585 (+   153us) write_op.cc:270] Start()
0709 13:09:26.632700 (+   115us) write_op.cc:276] Timestamp: P: 1783602566632531 usec, L: 0
0709 13:09:26.632718 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:09:26.633455 (+   737us) log.cc:844] Serialized 4422 byte log entry
0709 13:09:26.635627 (+  2172us) op_driver.cc:464] REPLICATION: finished
0709 13:09:26.637018 (+  1391us) write_op.cc:301] APPLY: starting
0709 13:09:26.637108 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:26.704479 (+ 67371us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:26.704568 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:26.716495 (+ 11927us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:26.716708 (+   213us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:09:26.716752 (+    44us) write_op.cc:312] APPLY: finished
0709 13:09:26.717043 (+   291us) log.cc:844] Serialized 105 byte log entry
0709 13:09:26.717199 (+   156us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:26.717345 (+   146us) write_op.cc:454] Released schema lock
0709 13:09:26.717390 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:26.755684 (+ 38294us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:26.755721 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3614,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":1141,"apply.run_cpu_time_us":13998,"apply.run_wall_time_us":118610,"cfile_cache_hit":44,"cfile_cache_hit_bytes":45980,"num_ops":11,"prepare.queue_time_us":112,"prepare.run_cpu_time_us":3986,"prepare.run_wall_time_us":4082,"replication_time_us":2772}]]}
I20260709 13:09:26.808158 13609 catalog_manager.cc:5697] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 reported cstate change: term changed from 15 to 20, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 20 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:26.864634 13756 consensus_peers.cc:597] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:26.886049 13609 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49428 (request call id 358) took 10562 ms. Trace:
W20260709 13:09:26.893663 14367 consensus_peers.cc:597] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:26.900177 21636 raft_consensus.cc:493] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.900967 21636 raft_consensus.cc:515] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:26.891060 13609 rpcz_store.cc:276] 0709 13:09:16.323560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.323797 (+   237us) service_pool.cc:224] Handling call
0709 13:09:26.885990 (+10562193us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:26.814387 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:26.814917 (+   530us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:26.814946 (+    29us) write_op.cc:435] Acquired schema lock
0709 13:09:26.814962 (+    16us) tablet.cc:662] Decoding operations
0709 13:09:26.815522 (+   560us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:26.815569 (+    47us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:26.815596 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:09:26.815905 (+   309us) tablet.cc:701] Row locks acquired
0709 13:09:26.815922 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:09:26.816046 (+   124us) write_op.cc:270] Start()
0709 13:09:26.816139 (+    93us) write_op.cc:276] Timestamp: P: 1783602566816006 usec, L: 0
0709 13:09:26.816158 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:09:26.819946 (+  3788us) log.cc:844] Serialized 1317 byte log entry
0709 13:09:26.825895 (+  5949us) op_driver.cc:464] REPLICATION: finished
0709 13:09:26.826319 (+   424us) write_op.cc:301] APPLY: starting
0709 13:09:26.826412 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:26.828257 (+  1845us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:26.828365 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:26.830166 (+  1801us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:26.830322 (+   156us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:09:26.830386 (+    64us) write_op.cc:312] APPLY: finished
0709 13:09:26.830580 (+   194us) log.cc:844] Serialized 41 byte log entry
0709 13:09:26.830727 (+   147us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:26.830818 (+    91us) write_op.cc:454] Released schema lock
0709 13:09:26.830867 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:26.831191 (+   324us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:26.831216 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":61417,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":193,"apply.run_cpu_time_us":4838,"apply.run_wall_time_us":4836,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12540,"num_ops":3,"prepare.queue_time_us":125,"prepare.run_cpu_time_us":2632,"prepare.run_wall_time_us":5832,"replication_time_us":9565}]]}
I20260709 13:09:26.910125 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:26.921023 21548 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:26.921723 21548 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:26.921983 13614 catalog_manager.cc:5697] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 9 to 15, leader changed from b5029654a4384e43a68eb67b794949b7 (127.12.76.131) to b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129). New cstate: current_term: 15 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:09:26.924080 21548 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:26.927281 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:26.930437 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:26.933115 12594 tablet_replica.cc:333] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:26.934963 12594 raft_consensus.cc:2243] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:26.935899 12594 raft_consensus.cc:2272] T 9a3fcea1abf04503bc26d451a56ed222 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:26.939205 12594 tablet_replica.cc:333] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:26.940492 12594 raft_consensus.cc:2243] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:26.947821 12594 pending_rounds.cc:70] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02: Trying to abort 1 pending ops.
I20260709 13:09:26.948196 12594 pending_rounds.cc:77] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02: Aborting op as it isn't in flight: id { term: 21 index: 15 } timestamp: 7305636045312180224 op_type: NO_OP noop_request { }
I20260709 13:09:26.948659 12594 raft_consensus.cc:2889] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:26.949069 12594 raft_consensus.cc:2272] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:26.943073 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7de615f578424d8bafe69fe6bea9f9" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:26.953349 13610 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49436 (request call id 352) took 10636 ms. Trace:
I20260709 13:09:26.953820 13610 rpcz_store.cc:276] 0709 13:09:16.316749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.317046 (+   297us) service_pool.cc:224] Handling call
0709 13:09:26.953158 (+10636112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":186989,"reported_tablets":46}
I20260709 13:09:26.956023 12594 tablet_replica.cc:333] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:26.958642 12594 raft_consensus.cc:2243] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:26.969182 12594 pending_rounds.cc:70] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02: Trying to abort 1 pending ops.
I20260709 13:09:26.965657 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8446dab661a64f9b8075d7586f1197f4" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:26.977253 13680 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:26.984556 12594 pending_rounds.cc:77] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02: Aborting op as it isn't in flight: id { term: 23 index: 14 } timestamp: 7305636034196402176 op_type: NO_OP noop_request { }
I20260709 13:09:26.985206 12594 raft_consensus.cc:2889] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:26.985657 12594 raft_consensus.cc:2272] T 0e6fb0872745419da9cb9e1228d021aa P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:26.985737 21508 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:26.954295 21636 leader_election.cc:290] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:26.988363 13680 leader_election.cc:304] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:26.989531 21636 raft_consensus.cc:2749] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:26.990358 12594 tablet_replica.cc:333] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:26.997315 12594 raft_consensus.cc:2243] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:26.998009 12594 raft_consensus.cc:2272] T b7aeef8df5a945efb8666f30fe979ab7 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:26.995613 13613 catalog_manager.cc:5697] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:09:27.000804 13613 catalog_manager.cc:5697] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 20 to 21, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 21 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.005059 13613 catalog_manager.cc:5697] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 20 to 22, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 22 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.009244 12594 tablet_replica.cc:333] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.017227 12594 raft_consensus.cc:2243] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.018066 12594 raft_consensus.cc:2272] T fe5150c5d9c445549ec6d199f2cd70e0 P b9d194f45e044e0988d5de1a99e5cd02 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.020946 12594 tablet_replica.cc:333] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.029309 12594 raft_consensus.cc:2243] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.024592 21548 raft_consensus.cc:493] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.029940 21548 raft_consensus.cc:515] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } attrs { replace: true } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:27.033385 21548 leader_election.cc:290] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:27.022589 13613 catalog_manager.cc:5697] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:09:27.034657 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:27.035162 12594 raft_consensus.cc:2272] T 4c6f358793c54a8fa2409a5d4c5505f8 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.038473 12594 tablet_replica.cc:333] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.039428 13613 catalog_manager.cc:5697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "b9d194f45e044e0988d5de1a99e5cd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } }
I20260709 13:09:27.044148 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:27.041296 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ef105d67b41dba510b44a6567d790" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:27.045388 13830 consensus_peers.cc:597] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:27.046211 13682 leader_election.cc:304] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:27.047145 21548 raft_consensus.cc:2749] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:27.056102 12594 raft_consensus.cc:2243] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.056782 12594 raft_consensus.cc:2272] T 3e4bec6398d84f67ad839268ec8d2a12 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:27.042656 13614 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49444 (request call id 349) took 26295 ms (client timeout 15000 ms). Trace:
W20260709 13:09:27.059624 13614 rpcz_store.cc:269] 0709 13:09:00.747006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.749290 (+  2284us) service_pool.cc:224] Handling call
0709 13:09:02.665734 (+1916444us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54003edd54. stack: 00007f522f3bf343 00007f522f3bf240 00007f522ed4e1d4 00007f5238a8c304 00007f5238a8c299 00007f5232448090 00007f52324e6f3a 00007f523829d1cc 00007f523839b37e 00007f523685c2a4 00007f523685c232 00007f523685c161 00007f523685c0dc 00007f523685b392 00007f523081948c 00007f52308188c6
0709 13:09:26.966562 (+24300828us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:26.966585 (+    23us) write_op.cc:454] Released schema lock
0709 13:09:27.042567 (+ 75982us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:26.959128 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:26.959660 (+   532us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:26.959690 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:09:26.959713 (+    23us) tablet.cc:662] Decoding operations
0709 13:09:26.960010 (+   297us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:26.960060 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:26.960084 (+    24us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:09:26.960248 (+   164us) tablet.cc:701] Row locks acquired
0709 13:09:26.960264 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:09:26.960389 (+   125us) write_op.cc:270] Start()
0709 13:09:26.960479 (+    90us) write_op.cc:276] Timestamp: P: 1783602566960350 usec, L: 0
0709 13:09:26.960498 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:09:26.961005 (+   507us) log.cc:844] Serialized 541 byte log entry
0709 13:09:26.962756 (+  1751us) op_driver.cc:464] REPLICATION: finished
0709 13:09:26.963183 (+   427us) write_op.cc:301] APPLY: starting
0709 13:09:26.963261 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:26.964126 (+   865us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:26.964226 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:26.964987 (+   761us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:26.965141 (+   154us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:09:26.965189 (+    48us) write_op.cc:312] APPLY: finished
0709 13:09:26.965371 (+   182us) log.cc:844] Serialized 25 byte log entry
0709 13:09:26.965525 (+   154us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:26.965595 (+    70us) write_op.cc:454] Released schema lock
0709 13:09:26.965638 (+    43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":2908,"reported_tablets":45,"spinlock_wait_cycles":464853888,"child_traces":[["op",{"apply.queue_time_us":253,"apply.run_cpu_time_us":2714,"apply.run_wall_time_us":2714,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4180,"num_ops":1,"prepare.queue_time_us":1586,"prepare.run_cpu_time_us":2106,"prepare.run_wall_time_us":2116,"replication_time_us":2155}]]}
I20260709 13:09:27.064167 12594 tablet_replica.cc:333] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
W20260709 13:09:27.064914 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 61793.7us
I20260709 13:09:27.065312 12594 raft_consensus.cc:2243] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:09:27.071468 12594 raft_consensus.cc:2272] T 4648ad5742bd4fe09563b72eb2dfc059 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.079604 12594 tablet_replica.cc:333] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.080852 12594 raft_consensus.cc:2243] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.083917 12594 raft_consensus.cc:2272] T e689999f416446c9bf87d759da2844ae P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.105798 12594 tablet_replica.cc:333] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.107043 12594 raft_consensus.cc:2243] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.107978 12594 pending_rounds.cc:70] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02: Trying to abort 1 pending ops.
I20260709 13:09:27.110699 12594 pending_rounds.cc:77] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02: Aborting op as it isn't in flight: id { term: 19 index: 12 } timestamp: 7305636029490814976 op_type: NO_OP noop_request { }
I20260709 13:09:27.111127 12594 raft_consensus.cc:2889] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:27.111598 12594 raft_consensus.cc:2272] T 60899523d3d145f58ccff5bb3438cb90 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.114560 12594 tablet_replica.cc:333] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.185812 12594 raft_consensus.cc:2243] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.195250 12594 pending_rounds.cc:70] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: Trying to abort 1 pending ops.
I20260709 13:09:27.195676 12594 pending_rounds.cc:77] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02: Aborting op as it isn't in flight: id { term: 27 index: 16 } timestamp: 7305636049880424448 op_type: NO_OP noop_request { }
I20260709 13:09:27.196154 12594 raft_consensus.cc:2889] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:27.196614 12594 raft_consensus.cc:2272] T ff2185b760234a0280587d4ea3f18b8a P b9d194f45e044e0988d5de1a99e5cd02 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.201807 12594 tablet_replica.cc:333] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.203229 12594 raft_consensus.cc:2243] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.203895 12594 raft_consensus.cc:2272] T 68418f30a686438bba0d6ab02efa0986 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.216799 12594 tablet_replica.cc:333] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.217929 12594 raft_consensus.cc:2243] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 LEADER]: Raft consensus shutting down.
W20260709 13:09:27.218494 13682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.219650 12594 raft_consensus.cc:2272] T b022fc3eb21246ff9f62e8a747bac6c4 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.222644 12594 tablet_replica.cc:333] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.223978 21548 raft_consensus.cc:493] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.224532 21548 raft_consensus.cc:515] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:27.226547 21548 leader_election.cc:290] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:27.227093 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:27.227479 12594 raft_consensus.cc:2243] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:27.230779 12594 raft_consensus.cc:2272] T ca5b6ba16dba4c529324c949c6b9ac85 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.240913 12594 tablet_replica.cc:333] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.241781 12594 raft_consensus.cc:2243] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:27.242969 12594 raft_consensus.cc:2272] T ac05b1933cb74e488759c38bd76d8d00 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.248662 12594 tablet_replica.cc:333] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.254468 12594 raft_consensus.cc:2243] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.255139 12594 pending_rounds.cc:70] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02: Trying to abort 1 pending ops.
I20260709 13:09:27.255474 12594 pending_rounds.cc:77] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02: Aborting op as it isn't in flight: id { term: 21 index: 16 } timestamp: 7305636034321874944 op_type: NO_OP noop_request { }
I20260709 13:09:27.255896 12594 raft_consensus.cc:2889] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:27.256313 12594 raft_consensus.cc:2272] T 6f7de615f578424d8bafe69fe6bea9f9 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.258930 12594 tablet_replica.cc:333] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.259812 12594 raft_consensus.cc:2243] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 33 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.260568 12594 pending_rounds.cc:70] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: Trying to abort 1 pending ops.
I20260709 13:09:27.260872 12594 pending_rounds.cc:77] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02: Aborting op as it isn't in flight: id { term: 31 index: 21 } timestamp: 7305636022864154624 op_type: NO_OP noop_request { }
I20260709 13:09:27.261284 12594 raft_consensus.cc:2889] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 33 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:27.262770 12594 raft_consensus.cc:2272] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P b9d194f45e044e0988d5de1a99e5cd02 [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.266841 12594 tablet_replica.cc:333] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.267829 12594 raft_consensus.cc:2243] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.268613 12594 raft_consensus.cc:2272] T 7c307c37029c4b5596bad2e08bda02bf P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.277921 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca53eab03a80405b9ebe6f6a25d8e30b" candidate_uuid: "b9d194f45e044e0988d5de1a99e5cd02" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:27.280421 12594 tablet_replica.cc:333] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.281538 12594 raft_consensus.cc:2243] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.282445 12594 raft_consensus.cc:2272] T e7c254367a594ceb8d4a3db25a715ae1 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.285280 12594 tablet_replica.cc:333] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.286194 12594 raft_consensus.cc:2243] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:27.287279 12594 raft_consensus.cc:2272] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.290218 12594 tablet_replica.cc:333] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.291152 12594 raft_consensus.cc:2243] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.291849 12594 pending_rounds.cc:70] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02: Trying to abort 1 pending ops.
I20260709 13:09:27.292131 12594 pending_rounds.cc:77] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02: Aborting op as it isn't in flight: id { term: 23 index: 15 } timestamp: 7305636021234737152 op_type: NO_OP noop_request { }
I20260709 13:09:27.292539 12594 raft_consensus.cc:2889] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:27.292949 12594 raft_consensus.cc:2272] T 536b1fc131984687bf3b13417507e21d P b9d194f45e044e0988d5de1a99e5cd02 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.296037 12594 tablet_replica.cc:333] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.297056 12594 raft_consensus.cc:2243] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.297603 12594 raft_consensus.cc:2272] T 44fb07fff88a4dcf97841a29f2641f66 P b9d194f45e044e0988d5de1a99e5cd02 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.300498 12594 tablet_replica.cc:333] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.301308 12594 raft_consensus.cc:2243] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.302003 12594 pending_rounds.cc:70] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02: Trying to abort 1 pending ops.
I20260709 13:09:27.302284 12594 pending_rounds.cc:77] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02: Aborting op as it isn't in flight: id { term: 19 index: 15 } timestamp: 7305636052298059776 op_type: NO_OP noop_request { }
I20260709 13:09:27.302753 12594 raft_consensus.cc:2889] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:27.303122 12594 raft_consensus.cc:2272] T 82e0eeb1582143a09acf311171812faa P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.306371 12594 tablet_replica.cc:333] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.307242 12594 raft_consensus.cc:2243] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.307885 12594 raft_consensus.cc:2272] T 8d8b741328f1468cb4ac726ffe62e9e8 P b9d194f45e044e0988d5de1a99e5cd02 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:27.308224 14367 consensus_peers.cc:597] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:27.310858 12594 tablet_replica.cc:333] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.311910 12594 raft_consensus.cc:2243] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.312593 12594 pending_rounds.cc:70] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02: Trying to abort 1 pending ops.
I20260709 13:09:27.312879 12594 pending_rounds.cc:77] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02: Aborting op as it isn't in flight: id { term: 17 index: 14 } timestamp: 7305636042522796032 op_type: NO_OP noop_request { }
I20260709 13:09:27.313277 12594 raft_consensus.cc:2889] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:27.313649 12594 raft_consensus.cc:2272] T ebc19cb1c68943cba711cd721c8caa91 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.316576 12594 tablet_replica.cc:333] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.317358 12594 raft_consensus.cc:2243] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.317998 12594 pending_rounds.cc:70] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02: Trying to abort 1 pending ops.
I20260709 13:09:27.318305 12594 pending_rounds.cc:77] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02: Aborting op as it isn't in flight: id { term: 21 index: 17 } timestamp: 7305636033032466432 op_type: NO_OP noop_request { }
I20260709 13:09:27.318714 12594 raft_consensus.cc:2889] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:27.319097 12594 raft_consensus.cc:2272] T 0b0054f48c4947acaea83521993a8f01 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.322757 12594 tablet_replica.cc:333] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.323662 12594 raft_consensus.cc:2243] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:27.324631 12594 raft_consensus.cc:2272] T 397ec99b74c24481a69c1f4a7c294a73 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.327567 12594 tablet_replica.cc:333] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.328500 12594 raft_consensus.cc:2243] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.329051 12594 raft_consensus.cc:2272] T f3cfef71353344f180965689d6ec9166 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.331910 12594 tablet_replica.cc:333] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.332919 12594 raft_consensus.cc:2243] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.333611 12594 raft_consensus.cc:2272] T de09d01498e547e591ce4ebe62e59488 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.336779 12594 tablet_replica.cc:333] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.337581 12594 raft_consensus.cc:2243] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:27.338616 12594 raft_consensus.cc:2272] T 03391a24625846c6997759d9b34dc4b4 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.341269 12594 tablet_replica.cc:333] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.342053 12594 raft_consensus.cc:2243] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:09:27.342515 13682 leader_election.cc:304] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9d194f45e044e0988d5de1a99e5cd02; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:27.343240 12594 raft_consensus.cc:2272] T 49638a262b1d4ba9b26cde1d408bf7ac P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.343667 21548 raft_consensus.cc:2749] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:27.346100 12594 tablet_replica.cc:333] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.347080 12594 raft_consensus.cc:2243] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.347702 12594 pending_rounds.cc:70] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02: Trying to abort 1 pending ops.
I20260709 13:09:27.347998 12594 pending_rounds.cc:77] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02: Aborting op as it isn't in flight: id { term: 21 index: 15 } timestamp: 7305636006811107328 op_type: NO_OP noop_request { }
I20260709 13:09:27.348382 12594 raft_consensus.cc:2889] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:27.348774 12594 raft_consensus.cc:2272] T 3618fd55609843fca70082d3565b459b P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.351585 12594 tablet_replica.cc:333] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.352478 12594 raft_consensus.cc:2243] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 25 LEADER]: Raft consensus shutting down.
W20260709 13:09:27.352905 14367 consensus_peers.cc:597] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:27.353442 12594 raft_consensus.cc:2272] T d82f3ff70ad54875bc615804bb1a2da7 P b9d194f45e044e0988d5de1a99e5cd02 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.356196 12594 tablet_replica.cc:333] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.357059 12594 raft_consensus.cc:2243] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.357683 12594 raft_consensus.cc:2272] T 82aefa8c282f4143b3c3d55f5a4d0bcf P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.360396 12594 tablet_replica.cc:333] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.361217 12594 raft_consensus.cc:2243] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.361730 12594 raft_consensus.cc:2272] T f09ef105d67b41dba510b44a6567d790 P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.364476 12594 tablet_replica.cc:333] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.365314 12594 raft_consensus.cc:2243] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.365823 12594 pending_rounds.cc:70] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02: Trying to abort 1 pending ops.
I20260709 13:09:27.366078 12594 pending_rounds.cc:77] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02: Aborting op as it isn't in flight: id { term: 23 index: 14 } timestamp: 7305636052961288192 op_type: NO_OP noop_request { }
I20260709 13:09:27.366485 12594 raft_consensus.cc:2889] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:27.366835 12594 raft_consensus.cc:2272] T aa43b4c4d63f407c90aa0154dfcc1063 P b9d194f45e044e0988d5de1a99e5cd02 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.369858 12594 tablet_replica.cc:333] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.370673 12594 raft_consensus.cc:2243] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.371469 12594 raft_consensus.cc:2272] T 8446dab661a64f9b8075d7586f1197f4 P b9d194f45e044e0988d5de1a99e5cd02 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.374336 12594 tablet_replica.cc:333] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.375237 12594 raft_consensus.cc:2243] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.376101 12594 pending_rounds.cc:70] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02: Trying to abort 1 pending ops.
I20260709 13:09:27.376379 12594 pending_rounds.cc:77] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02: Aborting op as it isn't in flight: id { term: 17 index: 13 } timestamp: 7305635959076880384 op_type: NO_OP noop_request { }
I20260709 13:09:27.376816 12594 raft_consensus.cc:2889] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:27.377203 12594 raft_consensus.cc:2272] T c9e22f0634b34971aed9c5b948f3275e P b9d194f45e044e0988d5de1a99e5cd02 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.380304 12594 tablet_replica.cc:333] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.388049 12594 raft_consensus.cc:2243] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.388635 12594 raft_consensus.cc:2272] T ca53eab03a80405b9ebe6f6a25d8e30b P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.391659 12594 tablet_replica.cc:333] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.400107 12594 raft_consensus.cc:2243] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.400868 12594 raft_consensus.cc:2272] T 106d35c470db4341b591e5268b81a3f3 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.408475 12594 tablet_replica.cc:333] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.409327 12594 raft_consensus.cc:2243] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.409934 12594 raft_consensus.cc:2272] T eb0e4fb02d3a45d4a6cc322c544fbf80 P b9d194f45e044e0988d5de1a99e5cd02 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.424232 12594 tablet_replica.cc:333] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.432116 12594 raft_consensus.cc:2243] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:27.433471 12594 raft_consensus.cc:2272] T cff75d4a417e4aeab081acad01b03c36 P b9d194f45e044e0988d5de1a99e5cd02 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.436420 12594 tablet_replica.cc:333] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.437284 12594 raft_consensus.cc:2243] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.440487 12594 raft_consensus.cc:2272] T 8591822f3dc3430e935360afdb260fce P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.450182 12594 tablet_replica.cc:333] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.460065 12594 raft_consensus.cc:2243] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.460803 12594 raft_consensus.cc:2272] T cd386d71cc264abca3dbfa88ffd4e951 P b9d194f45e044e0988d5de1a99e5cd02 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.463647 12594 tablet_replica.cc:333] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
W20260709 13:09:27.466920 13756 consensus_peers.cc:597] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:27.472504 12594 raft_consensus.cc:2243] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:09:27.473685 12594 raft_consensus.cc:2272] T ab01257d4e56488eba41a0ce5c5e9954 P b9d194f45e044e0988d5de1a99e5cd02 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.476699 12594 tablet_replica.cc:333] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02: stopping tablet replica
I20260709 13:09:27.479403 12594 raft_consensus.cc:2243] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.491856 12594 raft_consensus.cc:2272] T 19de5233e495495dbff7c520c86d37c7 P b9d194f45e044e0988d5de1a99e5cd02 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:27.630000 14367 consensus_peers.cc:597] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:27.639730 14367 consensus_peers.cc:597] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:27.640535 14367 consensus_peers.cc:597] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:27.641304 13756 consensus_peers.cc:597] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:27.642176 13756 consensus_peers.cc:597] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:27.667212 14367 consensus_peers.cc:597] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:27.667971 13830 consensus_peers.cc:597] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:27.696859 13830 connection.cc:573] client connection to 127.12.76.129:37533 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:09:27.954910 13756 consensus_peers.cc:597] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:27.967142 13756 consensus_peers.cc:597] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:27.980234 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 78591.7us
W20260709 13:09:28.116612 13830 consensus_peers.cc:597] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:28.148264 21830 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.148866 21830 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:28.151090 21830 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:09:28.155759 14367 leader_election.cc:336] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:28.164032 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
W20260709 13:09:28.179296 13830 consensus_peers.cc:597] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:28.187852 14366 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:28.189590 14367 consensus_peers.cc:597] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:28.191015 21837 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:28.217077 21830 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.217603 21830 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:28.224748 14367 leader_election.cc:336] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:28.226589 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:28.228504 14368 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:28.229256 21837 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:28.231352 21830 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:28.242297 21831 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.242858 21831 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:28.249339 21831 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:28.250414 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:28.256059 14399 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 23.
W20260709 13:09:28.255389 13830 leader_election.cc:336] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:28.257474 13829 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:28.258705 21831 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:28.262243 21831 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.265188 21831 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:09:28.264731 13830 consensus_peers.cc:597] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:28.292436 13830 consensus_peers.cc:597] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:28.302471 21831 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:28.316304 13830 leader_election.cc:336] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:28.329926 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4648ad5742bd4fe09563b72eb2dfc059" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:28.330528 14399 raft_consensus.cc:3060] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:28.342958 14399 raft_consensus.cc:2468] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 24.
W20260709 13:09:28.353652 13830 consensus_peers.cc:597] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:28.353863 13829 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:28.355100 21829 raft_consensus.cc:2804] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:09:28.360240 21829 raft_consensus.cc:697] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 24 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:28.355962 21836 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.361562 21829 consensus_queue.cc:237] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:28.365768 21621 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.366290 21621 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:28.371304 21621 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:28.390573 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:28.397351 13756 leader_election.cc:336] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:28.397993 13756 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:28.399928 21764 raft_consensus.cc:2749] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:09:28.410683 14367 consensus_peers.cc:597] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:28.361270 21836 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:28.432667 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:28.433280 14401 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 16.
I20260709 13:09:28.434451 13755 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:28.435663 21836 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:28.436133 21621 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:28.463907 21621 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.464485 21621 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:28.352675 21831 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:28.483572 21836 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.484408 21836 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:28.458735 13756 leader_election.cc:336] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:28.509771 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 51062.9us
I20260709 13:09:28.491331 21836 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:28.525372 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:28.534731 21841 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.535694 21841 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:28.538724 21830 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.539467 21830 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:28.542361 21830 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:28.555120 21841 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:28.557469 21838 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.559314 21838 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:28.561970 21838 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:28.555744 21764 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.563861 21764 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:28.565843 21764 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:28.567217 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:28.568027 13830 leader_election.cc:336] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:28.558166 13756 leader_election.cc:336] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:28.569312 13756 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:28.571081 21836 raft_consensus.cc:2749] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:09:28.573287 13830 leader_election.cc:336] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:28.585331 13756 leader_election.cc:336] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:28.587919 13756 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:28.589239 21621 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:28.591655 21830 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.592195 21830 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:28.594177 21830 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:09:28.594472 14367 leader_election.cc:336] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:28.595103 14367 consensus_peers.cc:597] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:28.595651 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b022fc3eb21246ff9f62e8a747bac6c4" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:28.596204 14399 raft_consensus.cc:3060] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:28.596418 13756 consensus_peers.cc:597] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:28.599834 13756 leader_election.cc:336] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:28.602097 21480 raft_consensus.cc:2749] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:28.591347 21621 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:28.605748 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:28.608291 13613 catalog_manager.cc:5697] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 23 to 24, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 24 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:28.615337 14399 raft_consensus.cc:2468] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 17.
I20260709 13:09:28.618356 13755 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:28.619603 21480 raft_consensus.cc:2804] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:28.620067 21480 raft_consensus.cc:697] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:28.620894 21480 consensus_queue.cc:237] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:28.621363 21836 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.621872 21836 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:28.625115 14401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:28.625661 14401 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 23.
I20260709 13:09:28.627071 13755 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:28.627846 21836 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:28.628958 21836 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:28.629329 21836 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.629722 21836 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:09:28.635145 13830 consensus_peers.cc:597] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:28.636672 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 282886us
I20260709 13:09:28.637600 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
W20260709 13:09:28.609273 14367 leader_election.cc:336] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:28.639674 14366 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:28.641549 21837 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:28.647261 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:28.647939 13790 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 20.
W20260709 13:09:28.651191 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 49089.8us
W20260709 13:09:28.648995 13756 consensus_peers.cc:597] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:28.655881 14368 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:28.656710 14367 consensus_peers.cc:597] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:28.656976 21837 raft_consensus.cc:2749] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:09:28.661917 13756 leader_election.cc:336] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:28.663931 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:28.662976 21836 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:28.673157 13830 consensus_peers.cc:597] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:28.674233 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab01257d4e56488eba41a0ce5c5e9954" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:28.674860 14399 raft_consensus.cc:3060] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:28.680385 21836 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:28.683599 13756 leader_election.cc:336] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:28.686901 13756 consensus_peers.cc:597] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:28.689878 13756 consensus_peers.cc:597] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:28.694267 13614 catalog_manager.cc:5697] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 16 to 17, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 17 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:28.700600 13829 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:28.701701 21843 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:28.702296 21843 raft_consensus.cc:493] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.702751 21843 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:28.716073 21830 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.716665 21830 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:28.717203 12594 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 13737)
I20260709 13:09:28.719797 21830 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:28.719936 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:28.720631 13863 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 22.
I20260709 13:09:28.721975 14368 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:28.724119 21830 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:28.724581 21830 raft_consensus.cc:493] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.725430 21830 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:09:28.737360 14367 leader_election.cc:336] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:28.744701 13829 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:28.745685 21829 raft_consensus.cc:2749] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:28.748948 14399 raft_consensus.cc:2468] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ecb005831740438d7537dd4b840e03 in term 24.
I20260709 13:09:28.740201 21843 raft_consensus.cc:515] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:28.763087 21480 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.763696 21480 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:28.764945 21830 raft_consensus.cc:515] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:28.765954 21480 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:28.768328 13755 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:28.768808 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac05b1933cb74e488759c38bd76d8d00" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
W20260709 13:09:28.771385 13756 leader_election.cc:336] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:28.775214 13863 raft_consensus.cc:3060] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:28.773164 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a31d8aefe71401dadd16c2c0a9e9ecf" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:28.776849 13784 raft_consensus.cc:3060] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:28.773736 21830 leader_election.cc:290] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:28.780819 21829 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.781454 21829 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:28.782152 21844 raft_consensus.cc:2804] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:09:28.782714 21844 raft_consensus.cc:697] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 24 LEADER]: Becoming Leader. State: Replica: 35ecb005831740438d7537dd4b840e03, State: Running, Role: LEADER
I20260709 13:09:28.783651 21844 consensus_queue.cc:237] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:28.786051 21829 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:28.790213 13756 consensus_peers.cc:597] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:28.793865 21830 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.794521 21830 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:28.797933 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:28.798576 13865 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 15.
I20260709 13:09:28.799748 21843 leader_election.cc:290] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:28.799894 14368 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:28.800890 21837 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:28.801383 21837 raft_consensus.cc:493] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.801838 21837 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:28.801950 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
W20260709 13:09:28.808686 13830 leader_election.cc:336] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:28.805579 21830 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:28.808934 13755 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:28.820955 21764 raft_consensus.cc:2749] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:28.821141 21480 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.809986 13863 raft_consensus.cc:2468] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 23.
I20260709 13:09:28.810213 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:28.821704 21480 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:28.827338 21830 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
W20260709 13:09:28.827452 13830 leader_election.cc:336] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:28.828114 21830 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:28.830789 21480 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:28.805066 13784 raft_consensus.cc:2468] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 21.
W20260709 13:09:28.812688 14367 leader_election.cc:336] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:28.810806 21843 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.814447 21829 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.834597 14368 leader_election.cc:304] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:28.834666 21829 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:28.835628 21538 raft_consensus.cc:2804] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:28.835793 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:28.836591 13790 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 22.
I20260709 13:09:28.837142 21829 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:28.837570 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "35ecb005831740438d7537dd4b840e03" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:28.837852 21843 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:28.839751 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:28.840363 13790 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 22.
I20260709 13:09:28.842732 14366 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:28.844278 13829 leader_election.cc:304] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:28.845538 21829 raft_consensus.cc:2804] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:28.846086 21843 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:28.815124 21838 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.848300 21538 raft_consensus.cc:697] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 23 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:28.848084 21838 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:28.849454 21852 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:28.850483 21838 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:28.832304 21830 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:28.849460 21538 consensus_queue.cc:237] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:28.846144 21829 raft_consensus.cc:697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 21 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:28.852974 21829 consensus_queue.cc:237] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:28.849913 21852 raft_consensus.cc:493] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.855130 21852 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:09:28.847080 13756 leader_election.cc:336] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:28.847366 13829 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:28.814693 21837 raft_consensus.cc:515] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:28.857496 14367 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111) [suppressed 340 similar messages]
I20260709 13:09:28.858127 14399 raft_consensus.cc:2393] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5029654a4384e43a68eb67b794949b7 in current term 16: Already voted for candidate ceb06175847b428ea8bd77055fcddf58 in this term.
W20260709 13:09:28.858210 14367 leader_election.cc:336] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:28.859715 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:28.860399 13790 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 19.
I20260709 13:09:28.861094 13756 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ecb005831740438d7537dd4b840e03; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:28.862561 13829 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:28.865567 21838 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:28.865988 21838 raft_consensus.cc:493] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.866343 21838 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:28.867236 21844 raft_consensus.cc:2749] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:09:28.863111 21843 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:28.864285 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff75d4a417e4aeab081acad01b03c36" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:28.875810 13863 raft_consensus.cc:3060] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:28.875540 21843 raft_consensus.cc:493] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.877568 21843 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:28.879442 21838 raft_consensus.cc:515] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:28.882733 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03391a24625846c6997759d9b34dc4b4" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
W20260709 13:09:28.864578 14367 leader_election.cc:336] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:28.883314 13790 raft_consensus.cc:3060] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:28.871542 21837 leader_election.cc:290] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:28.889012 14367 leader_election.cc:336] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:28.873608 13614 catalog_manager.cc:5697] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 reported cstate change: term changed from 23 to 24, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to 35ecb005831740438d7537dd4b840e03 (127.12.76.130). New cstate: current_term: 24 leader_uuid: "35ecb005831740438d7537dd4b840e03" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:28.891737 13863 raft_consensus.cc:2468] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 16.
I20260709 13:09:28.893038 14368 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:28.893939 13790 raft_consensus.cc:2468] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 20.
I20260709 13:09:28.894100 21830 raft_consensus.cc:2804] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:28.899945 21830 raft_consensus.cc:697] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:28.900828 21830 consensus_queue.cc:237] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:28.902680 13829 leader_election.cc:304] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:09:28.902987 13830 consensus_peers.cc:597] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:28.904958 21838 leader_election.cc:290] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:28.905403 21829 raft_consensus.cc:2804] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:28.906657 21829 raft_consensus.cc:697] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 20 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:28.908285 21829 consensus_queue.cc:237] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:28.912739 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 70113us
I20260709 13:09:28.913763 13829 leader_election.cc:304] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:28.914916 21838 raft_consensus.cc:2749] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:28.916905 13614 catalog_manager.cc:5697] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 20 to 21, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 21 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:28.912127 21841 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.919936 21841 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:28.922178 21841 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:28.924108 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03" is_pre_election: true
I20260709 13:09:28.924849 13790 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 25.
I20260709 13:09:28.928297 13613 catalog_manager.cc:5697] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 22 to 23, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 23 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:28.932542 13829 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
W20260709 13:09:28.933491 13830 leader_election.cc:336] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:28.948315 13830 leader_election.cc:336] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:28.923903 21843 raft_consensus.cc:515] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:28.956195 21843 leader_election.cc:290] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:28.958133 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca5b6ba16dba4c529324c949c6b9ac85" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:28.958768 13790 raft_consensus.cc:3060] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:28.946190 21841 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:09:28.962297 21841 raft_consensus.cc:493] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:28.962651 21841 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:09:28.950012 13830 leader_election.cc:336] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:28.967442 21852 raft_consensus.cc:515] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:28.969687 21852 leader_election.cc:290] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:28.970785 13790 raft_consensus.cc:2468] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 23.
I20260709 13:09:28.971859 13829 leader_election.cc:304] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: 
I20260709 13:09:28.972599 21838 raft_consensus.cc:2804] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:28.973060 21838 raft_consensus.cc:697] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 23 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:28.973881 21838 consensus_queue.cc:237] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:28.977836 14367 leader_election.cc:336] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:28.979141 14399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:28.979754 14399 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 23.
I20260709 13:09:28.980494 13784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec99b74c24481a69c1f4a7c294a73" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:28.981033 13784 raft_consensus.cc:3060] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:28.980821 13829 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:28.988762 13784 raft_consensus.cc:2468] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 23.
I20260709 13:09:28.990000 14366 leader_election.cc:304] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:28.995255 21852 raft_consensus.cc:2804] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:28.995016 21843 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:09:29.001312 21852 raft_consensus.cc:697] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 23 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:29.001785 21843 raft_consensus.cc:493] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting leader election (detected failure of leader b9d194f45e044e0988d5de1a99e5cd02)
I20260709 13:09:29.002230 21843 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:29.005697 21852 consensus_queue.cc:237] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:29.007754 13613 catalog_manager.cc:5697] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 15 to 16, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 16 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.013639 14401 raft_consensus.cc:1275] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:09:29.029950 21841 raft_consensus.cc:515] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:29.044732 13830 leader_election.cc:336] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:29.045369 21840 consensus_queue.cc:1048] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.005s
I20260709 13:09:29.047566 21843 raft_consensus.cc:515] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:29.061003 21841 leader_election.cc:290] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 26 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:29.062031 21843 leader_election.cc:290] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 election: Requested vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:29.091361 13830 leader_election.cc:336] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:29.092249 13830 leader_election.cc:336] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:29.093225 13830 consensus_peers.cc:597] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:29.097405 13756 consensus_peers.cc:597] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:29.097918 13756 consensus_peers.cc:597] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:29.101687 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 54704.2us
I20260709 13:09:29.116550 13790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82f3ff70ad54875bc615804bb1a2da7" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "35ecb005831740438d7537dd4b840e03"
I20260709 13:09:29.117170 13790 raft_consensus.cc:3060] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:09:29.116869 13613 catalog_manager.cc:5697] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 19 to 20, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 20 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.118610 13613 catalog_manager.cc:5697] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 22 to 23, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 23 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:29.119848 13830 leader_election.cc:336] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:29.120466 13830 leader_election.cc:336] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:29.121023 13830 consensus_peers.cc:597] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:29.121160 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49638a262b1d4ba9b26cde1d408bf7ac" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:29.121691 14400 raft_consensus.cc:3060] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:09:29.130982 13790 raft_consensus.cc:2468] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 26.
I20260709 13:09:29.136476 14395 raft_consensus.cc:1275] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:09:29.138134 21480 consensus_queue.cc:1048] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:09:29.142011 14400 raft_consensus.cc:2468] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 24.
I20260709 13:09:29.155346 13614 catalog_manager.cc:5697] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 22 to 23, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 23 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.170367 14399 raft_consensus.cc:1275] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Refusing update from remote peer 35ecb005831740438d7537dd4b840e03: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:09:29.172034 21844 consensus_queue.cc:1048] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:09:29.222056 13829 leader_election.cc:304] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: b9d194f45e044e0988d5de1a99e5cd02
W20260709 13:09:29.412002 14367 consensus_peers.cc:597] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:29.416320 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 194354us
I20260709 13:09:29.417516 21831 raft_consensus.cc:2804] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:09:29.418040 21831 raft_consensus.cc:697] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 24 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:29.418918 21831 consensus_queue.cc:237] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:29.419786 13829 leader_election.cc:304] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7; no voters: b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:29.423498 21842 raft_consensus.cc:2804] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:09:29.424091 21842 raft_consensus.cc:697] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 26 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:29.425220 21842 consensus_queue.cc:237] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:29.453274 13863 raft_consensus.cc:1275] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
W20260709 13:09:29.454119 14367 consensus_peers.cc:597] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:29.461992 13830 consensus_peers.cc:597] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:29.462810 13830 consensus_peers.cc:597] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:29.471012 21538 consensus_queue.cc:1048] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
W20260709 13:09:29.532703 13830 consensus_peers.cc:597] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:29.536211 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 116490us
I20260709 13:09:29.549728 13791 raft_consensus.cc:1275] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:09:29.562943 13786 raft_consensus.cc:1275] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:09:29.568060 13791 raft_consensus.cc:1275] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:09:29.575939 13791 raft_consensus.cc:1275] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 13:09:29.577670 13862 raft_consensus.cc:1275] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:09:29.592876 21879 consensus_queue.cc:1048] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.002s
I20260709 13:09:29.611968 21876 consensus_queue.cc:1048] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.015s
W20260709 13:09:29.632983 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 76837.5us
I20260709 13:09:29.645347 21867 consensus_queue.cc:1048] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:29.647562 21868 consensus_queue.cc:1048] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:29.648957 21868 consensus_queue.cc:1048] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:09:29.666704 14367 consensus_peers.cc:597] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:29.667369 14367 consensus_peers.cc:597] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:29.677471 14399 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.011s	sys 0.007s
W20260709 13:09:29.677906 14399 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.012s	sys 0.008s
W20260709 13:09:29.695952 13830 consensus_peers.cc:597] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:29.697098 13830 consensus_peers.cc:597] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:29.706923 13756 consensus_peers.cc:597] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:29.708578 13756 consensus_peers.cc:597] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:29.711596 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 105204us
W20260709 13:09:29.717662 12594 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 13737)
W20260709 13:09:29.731971 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 84635.2us
W20260709 13:09:29.829918 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 71589.2us
W20260709 13:09:29.846872 13755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 109556us
I20260709 13:09:29.876860 13614 catalog_manager.cc:5697] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 23 to 24, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 24 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:29.881925 14367 consensus_peers.cc:597] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:29.896819 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 50051.1us
W20260709 13:09:29.908330 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 161792us
W20260709 13:09:29.926306 21882 log.cc:927] Time spent T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:09:29.955974 13791 raft_consensus.cc:1275] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 26 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
W20260709 13:09:29.960671 21885 log.cc:927] Time spent T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:09:30.014778 21894 consensus_queue.cc:1048] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:09:30.050688 13830 consensus_peers.cc:597] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:30.054065 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 47072.5us
W20260709 13:09:30.067175 14367 consensus_peers.cc:597] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:30.074127 14367 consensus_peers.cc:597] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:30.073494 13830 consensus_peers.cc:597] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:09:30.070376 14395 raft_consensus.cc:1275] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Refusing update from remote peer b5029654a4384e43a68eb67b794949b7: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:09:30.120339 21892 consensus_queue.cc:1048] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.024s
W20260709 13:09:30.160105 21896 log.cc:927] Time spent T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:09:30.167198 13830 consensus_peers.cc:597] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:30.196348 14367 consensus_peers.cc:597] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:30.196867 14367 consensus_peers.cc:597] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:09:30.263404 13613 catalog_manager.cc:5697] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 25 to 26, leader changed from b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 26 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:30.270732 13756 consensus_peers.cc:597] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:30.271674 13756 consensus_peers.cc:597] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:30.395339 13756 consensus_peers.cc:597] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:30.400645 14367 consensus_peers.cc:597] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:30.466703 13830 consensus_peers.cc:597] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:30.506042 13756 consensus_peers.cc:597] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:30.528309 14423 debug-util.cc:398] Leaking SignalData structure 0x7b080034c7c0 after lost signal to thread 12597
W20260709 13:09:30.529556 14423 debug-util.cc:398] Leaking SignalData structure 0x7b0800361720 after lost signal to thread 13648
W20260709 13:09:30.531009 14423 debug-util.cc:398] Leaking SignalData structure 0x7b08003a9940 after lost signal to thread 13815
W20260709 13:09:30.534497 14423 debug-util.cc:398] Leaking SignalData structure 0x7b0800363ae0 after lost signal to thread 13889
W20260709 13:09:30.536556 14423 debug-util.cc:398] Leaking SignalData structure 0x7b080039d200 after lost signal to thread 14426
W20260709 13:09:30.578969 13830 consensus_peers.cc:597] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:30.619930 13756 consensus_peers.cc:597] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:30.718639 12594 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 13737)
W20260709 13:09:30.755671 13830 consensus_peers.cc:597] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:30.825340 13830 consensus_peers.cc:597] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:30.859764 13830 consensus_peers.cc:597] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:31.000331 14367 consensus_peers.cc:597] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:31.074098 13756 consensus_peers.cc:597] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:31.109966 14367 consensus_peers.cc:597] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:31.150841 13830 consensus_peers.cc:597] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:31.173694 13756 consensus_peers.cc:597] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:31.194639 13830 consensus_peers.cc:597] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:31.210050 13756 consensus_peers.cc:597] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:31.243736 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 48387.5us
W20260709 13:09:31.318262 13830 consensus_peers.cc:597] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:31.318872 14367 consensus_peers.cc:597] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:31.357230 14367 consensus_peers.cc:597] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:31.375860 13756 consensus_peers.cc:597] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:31.433495 13756 consensus_peers.cc:597] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:31.508477 13756 consensus_peers.cc:597] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:31.577606 13756 consensus_peers.cc:597] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:31.597836 13830 consensus_peers.cc:597] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:31.719172 12594 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 13737)
W20260709 13:09:31.869709 13830 consensus_peers.cc:597] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:31.908677 14367 consensus_peers.cc:597] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:31.914525 13756 consensus_peers.cc:597] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:31.940464 13830 consensus_peers.cc:597] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:32.008292 14367 consensus_peers.cc:597] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:32.070115 14367 consensus_peers.cc:597] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:32.071619 13830 consensus_peers.cc:597] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:32.081410 13830 consensus_peers.cc:597] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:32.157567 13756 consensus_peers.cc:597] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:32.216513 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 58986.9us
W20260709 13:09:32.300540 13830 consensus_peers.cc:597] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:32.320515 14367 consensus_peers.cc:597] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:32.408845 13830 consensus_peers.cc:597] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:32.489931 13830 consensus_peers.cc:597] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:32.493507 14367 consensus_peers.cc:597] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:32.597751 13756 consensus_peers.cc:597] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:32.634332 13756 consensus_peers.cc:597] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:32.688192 14367 consensus_peers.cc:597] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:32.719749 12594 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 13737)
W20260709 13:09:32.738807 13756 consensus_peers.cc:597] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:32.753535 14367 consensus_peers.cc:597] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:32.762789 14367 consensus_peers.cc:597] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:32.836014 13830 consensus_peers.cc:597] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:32.894292 13830 consensus_peers.cc:597] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:32.908567 14367 consensus_peers.cc:597] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:32.956526 14367 consensus_peers.cc:597] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:33.042265 13756 consensus_peers.cc:597] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:33.203115 13830 consensus_peers.cc:597] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:33.259297 13830 consensus_peers.cc:597] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:33.386641 13830 consensus_peers.cc:597] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:33.404966 13830 consensus_peers.cc:597] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:33.475685 13756 consensus_peers.cc:597] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:33.500917 13830 consensus_peers.cc:597] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:33.521306 14367 consensus_peers.cc:597] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:33.542265 13756 consensus_peers.cc:597] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:33.569823 13830 consensus_peers.cc:597] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:33.603982 13757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46015, user_credentials={real_user=slave}} blocked reactor thread for 43988.4us
W20260709 13:09:33.680683 13830 consensus_peers.cc:597] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:33.699302 13756 consensus_peers.cc:597] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:33.715561 14367 consensus_peers.cc:597] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:33.720286 12594 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 13737)
W20260709 13:09:33.750267 14367 consensus_peers.cc:597] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:33.858438 13830 consensus_peers.cc:597] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:33.860028 13756 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111) [suppressed 446 similar messages]
W20260709 13:09:33.904134 13756 consensus_peers.cc:597] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:33.907008 13830 consensus_peers.cc:597] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:33.913360 13756 consensus_peers.cc:597] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:34.040567 14367 consensus_peers.cc:597] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:34.105614 13756 consensus_peers.cc:597] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:34.302532 13830 consensus_peers.cc:597] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:34.336331 13756 consensus_peers.cc:597] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:34.348487 13756 consensus_peers.cc:597] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:34.390542 13830 consensus_peers.cc:597] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:34.435599 13830 consensus_peers.cc:597] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:34.443957 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 66470us
W20260709 13:09:34.479760 13756 consensus_peers.cc:597] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:34.491487 14367 consensus_peers.cc:597] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:34.511088 14367 consensus_peers.cc:597] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:34.610996 14367 consensus_peers.cc:597] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:34.645057 13830 consensus_peers.cc:597] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:34.720811 12594 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 13737)
W20260709 13:09:34.731776 13756 consensus_peers.cc:597] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:34.829190 13830 consensus_peers.cc:597] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:34.864485 14367 consensus_peers.cc:597] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:34.836757 13756 consensus_peers.cc:597] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:34.938838 13830 consensus_peers.cc:597] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:34.989125 13830 consensus_peers.cc:597] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:35.004601 14367 consensus_peers.cc:597] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:35.035708 14367 consensus_peers.cc:597] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:35.202349 13830 consensus_peers.cc:597] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:35.369695 13756 consensus_peers.cc:597] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:35.441437 14367 consensus_peers.cc:597] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:35.459611 13756 consensus_peers.cc:597] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:35.463999 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 88945.4us
W20260709 13:09:35.467924 13830 consensus_peers.cc:597] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:35.500886 14367 consensus_peers.cc:597] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:35.521245 13830 consensus_peers.cc:597] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:35.546557 14367 consensus_peers.cc:597] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:35.562287 13756 consensus_peers.cc:597] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:35.641019 13830 consensus_peers.cc:597] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:35.701532 14367 consensus_peers.cc:597] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:35.721777 12594 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 13737)
W20260709 13:09:35.731068 13756 consensus_peers.cc:597] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:35.778260 13830 consensus_peers.cc:597] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:35.835521 13830 consensus_peers.cc:597] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:36.520344 13756 consensus_peers.cc:597] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:36.527124 13756 consensus_peers.cc:597] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:36.608633 14367 consensus_peers.cc:597] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:36.627982 13830 consensus_peers.cc:597] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:36.649441 13830 consensus_peers.cc:597] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:36.650213 13830 consensus_peers.cc:597] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:36.655699 13756 consensus_peers.cc:597] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:36.722249 12594 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 13737)
I20260709 13:09:36.750833 13603 maintenance_manager.cc:419] P a8849f59e7a642f3b694e3e403857ae7: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033337
W20260709 13:09:36.823261 13756 consensus_peers.cc:597] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:36.886957 13830 consensus_peers.cc:597] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:36.903553 13645 debug-util.cc:398] Leaking SignalData structure 0x7b08003687e0 after lost signal to thread 12597
W20260709 13:09:36.904733 13645 debug-util.cc:398] Leaking SignalData structure 0x7b080034b7e0 after lost signal to thread 13648
W20260709 13:09:36.906107 13645 debug-util.cc:398] Leaking SignalData structure 0x7b080022e360 after lost signal to thread 13815
W20260709 13:09:36.907218 13645 debug-util.cc:398] Leaking SignalData structure 0x7b080038a700 after lost signal to thread 13889
W20260709 13:09:36.908403 13645 debug-util.cc:398] Leaking SignalData structure 0x7b08003a2740 after lost signal to thread 14426
W20260709 13:09:37.004385 14367 consensus_peers.cc:597] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:37.035586 14367 consensus_peers.cc:597] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:37.060863 13830 consensus_peers.cc:597] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:37.062067 13830 consensus_peers.cc:597] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:37.097810 14367 consensus_peers.cc:597] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:37.109227 13756 consensus_peers.cc:597] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:37.096534 13602 maintenance_manager.cc:643] P a8849f59e7a642f3b694e3e403857ae7: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.344s	user 0.049s	sys 0.001s Metrics: {"bytes_written":8308,"delete_count":0,"lbm_write_time_us":1208,"lbm_writes_lt_1ms":7,"reinsert_count":0,"thread_start_us":176655,"threads_started":1,"update_count":327,"wal-append.queue_time_us":176376}
I20260709 13:09:37.134245 13603 maintenance_manager.cc:419] P a8849f59e7a642f3b694e3e403857ae7: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.398256
W20260709 13:09:37.177803 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 46237.2us
W20260709 13:09:37.229586 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 65577.5us
W20260709 13:09:37.266561 13756 consensus_peers.cc:597] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:37.517077 14367 consensus_peers.cc:597] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:37.535974 13756 consensus_peers.cc:597] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:37.547065 13756 consensus_peers.cc:597] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:37.577271 14367 consensus_peers.cc:597] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:37.625833 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 48599.7us
W20260709 13:09:37.656289 13756 consensus_peers.cc:597] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:37.673090 13830 consensus_peers.cc:597] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:37.673686 13830 consensus_peers.cc:597] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:37.717967 14367 consensus_peers.cc:597] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:37.725966 13830 consensus_peers.cc:597] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:37.727480 12594 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 13737)
W20260709 13:09:37.747793 13830 consensus_peers.cc:597] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:37.749311 13830 consensus_peers.cc:597] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:37.763545 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 50349.1us
I20260709 13:09:37.784029 13602 maintenance_manager.cc:643] P a8849f59e7a642f3b694e3e403857ae7: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.649s	user 0.131s	sys 0.012s Metrics: {"cfile_cache_miss":10,"cfile_cache_miss_bytes":29403,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":8891,"dirs.run_cpu_time_us":392,"dirs.run_wall_time_us":1285,"lbm_read_time_us":2203,"lbm_reads_lt_1ms":26,"lbm_write_time_us":1903,"lbm_writes_lt_1ms":12,"peak_mem_usage":584947,"reinsert_count":0,"thread_start_us":12070,"threads_started":1,"update_count":341}
I20260709 13:09:37.789484 13603 maintenance_manager.cc:419] P a8849f59e7a642f3b694e3e403857ae7: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 13:09:37.792752 13602 maintenance_manager.cc:643] P a8849f59e7a642f3b694e3e403857ae7: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
W20260709 13:09:37.826918 14367 consensus_peers.cc:597] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:37.916607 13756 consensus_peers.cc:597] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:37.936975 13756 consensus_peers.cc:597] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:38.022089 13830 consensus_peers.cc:597] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:38.091318 14367 consensus_peers.cc:597] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:38.143592 13830 consensus_peers.cc:597] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:38.145545 14367 consensus_peers.cc:597] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:38.252432 13756 consensus_peers.cc:597] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:38.320091 14367 consensus_peers.cc:597] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:38.392503 13830 consensus_peers.cc:597] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:38.487141 13830 consensus_peers.cc:597] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:38.506440 14367 consensus_peers.cc:597] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:38.534595 14367 consensus_peers.cc:597] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:38.560014 13756 consensus_peers.cc:597] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:38.573671 13830 consensus_peers.cc:597] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:38.590268 13756 consensus_peers.cc:597] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:38.627135 13756 consensus_peers.cc:597] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:38.644914 13830 consensus_peers.cc:597] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:38.667245 14367 consensus_peers.cc:597] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:38.730185 12594 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 13737)
W20260709 13:09:38.776803 13756 consensus_peers.cc:597] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:38.809362 13830 consensus_peers.cc:597] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:38.866541 14367 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111) [suppressed 418 similar messages]
W20260709 13:09:38.970799 13830 consensus_peers.cc:597] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:39.078708 14367 consensus_peers.cc:597] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:39.105327 13830 consensus_peers.cc:597] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:39.149291 13756 consensus_peers.cc:597] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:39.178231 13830 consensus_peers.cc:597] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:39.330281 13830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 152072us
W20260709 13:09:39.345652 14367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 84458us
W20260709 13:09:39.404243 14367 consensus_peers.cc:597] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:39.399240 13756 consensus_peers.cc:597] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:39.436388 13830 consensus_peers.cc:597] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:39.441978 13830 consensus_peers.cc:597] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:39.448513 13830 consensus_peers.cc:597] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:39.452013 14367 consensus_peers.cc:597] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:39.599025 13756 consensus_peers.cc:597] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:39.692233 14367 consensus_peers.cc:597] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:39.710301 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 80210.2us
W20260709 13:09:39.730713 12594 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 13737)
W20260709 13:09:39.778245 13756 consensus_peers.cc:597] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:39.780413 14367 consensus_peers.cc:597] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:39.828531 14367 consensus_peers.cc:597] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:39.959975 13830 consensus_peers.cc:597] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:39.961052 13756 consensus_peers.cc:597] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:40.101027 13830 consensus_peers.cc:597] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:40.109069 13756 consensus_peers.cc:597] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:40.151335 13830 consensus_peers.cc:597] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:40.228434 14367 consensus_peers.cc:597] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:40.265892 13830 consensus_peers.cc:597] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:40.274993 13830 consensus_peers.cc:597] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:40.275564 13756 consensus_peers.cc:597] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:40.392736 13756 consensus_peers.cc:597] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:40.409732 14367 consensus_peers.cc:597] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:40.424553 14367 consensus_peers.cc:597] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:40.574075 13756 consensus_peers.cc:597] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:40.651219 13830 consensus_peers.cc:597] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:40.706379 13756 consensus_peers.cc:597] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:40.731222 12594 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 13737)
W20260709 13:09:40.806820 14367 consensus_peers.cc:597] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:40.840042 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 55761.6us
W20260709 13:09:40.884259 13830 consensus_peers.cc:597] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:40.891798 13830 consensus_peers.cc:597] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:41.000290 14367 consensus_peers.cc:597] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:41.001065 13756 consensus_peers.cc:597] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:41.099095 13756 consensus_peers.cc:597] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:41.131537 14367 consensus_peers.cc:597] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:41.175375 13830 consensus_peers.cc:597] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:41.179179 14367 consensus_peers.cc:597] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:41.204239 13830 consensus_peers.cc:597] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:41.255505 13756 consensus_peers.cc:597] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:41.262681 13830 consensus_peers.cc:597] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:41.273710 14367 consensus_peers.cc:597] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:41.467324 13830 consensus_peers.cc:597] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:41.488721 13830 consensus_peers.cc:597] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:41.568949 13756 consensus_peers.cc:597] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:41.589635 13756 consensus_peers.cc:597] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:41.597682 13830 consensus_peers.cc:597] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:41.661772 13830 consensus_peers.cc:597] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:41.731724 12594 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 13737)
W20260709 13:09:41.768821 14367 consensus_peers.cc:597] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:41.844388 14367 consensus_peers.cc:597] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:41.876006 13830 consensus_peers.cc:597] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:41.891536 14367 consensus_peers.cc:597] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:41.910584 13756 consensus_peers.cc:597] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:41.919632 13830 consensus_peers.cc:597] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:42.094110 14367 consensus_peers.cc:597] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:42.218256 13830 consensus_peers.cc:597] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:42.310542 13756 consensus_peers.cc:597] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:42.341872 13830 consensus_peers.cc:597] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:42.399541 13756 consensus_peers.cc:597] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:42.500584 14367 consensus_peers.cc:597] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:42.588583 14367 consensus_peers.cc:597] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:42.662562 13756 consensus_peers.cc:597] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:42.688798 14367 consensus_peers.cc:597] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:42.717563 13756 consensus_peers.cc:597] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:42.732204 12594 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 13737)
W20260709 13:09:43.030594 14367 consensus_peers.cc:597] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:43.055620 14367 consensus_peers.cc:597] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:43.075434 13756 consensus_peers.cc:597] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:43.079023 13756 consensus_peers.cc:597] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:43.237540 13830 consensus_peers.cc:597] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:43.243350 13830 consensus_peers.cc:597] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:43.244979 13830 consensus_peers.cc:597] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:43.269814 13830 consensus_peers.cc:597] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:43.276764 13756 consensus_peers.cc:597] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:43.284284 13830 consensus_peers.cc:597] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:43.304029 13830 consensus_peers.cc:597] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:43.308440 13756 consensus_peers.cc:597] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:43.432610 14367 consensus_peers.cc:597] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:43.542591 13756 consensus_peers.cc:597] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:43.574010 13830 consensus_peers.cc:597] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:43.574671 13830 consensus_peers.cc:597] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:43.606478 14367 consensus_peers.cc:597] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:43.667517 13756 consensus_peers.cc:597] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:43.732686 12594 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 13737)
W20260709 13:09:43.831071 14367 consensus_peers.cc:597] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:43.844139 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 77970.1us
W20260709 13:09:43.876983 13830 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111) [suppressed 425 similar messages]
W20260709 13:09:43.888041 13830 consensus_peers.cc:597] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:43.889652 13830 consensus_peers.cc:597] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:43.891364 14367 consensus_peers.cc:597] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:43.890489 13830 consensus_peers.cc:597] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:44.022267 14367 consensus_peers.cc:597] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:44.116397 13886 debug-util.cc:398] Leaking SignalData structure 0x7b08000a91e0 after lost signal to thread 12597
W20260709 13:09:44.117509 13886 debug-util.cc:398] Leaking SignalData structure 0x7b08000e4d20 after lost signal to thread 13648
W20260709 13:09:44.118831 13886 debug-util.cc:398] Leaking SignalData structure 0x7b08003e04c0 after lost signal to thread 13815
W20260709 13:09:44.119941 13886 debug-util.cc:398] Leaking SignalData structure 0x7b080018be60 after lost signal to thread 13889
W20260709 13:09:44.121071 13886 debug-util.cc:398] Leaking SignalData structure 0x7b08001aa940 after lost signal to thread 14426
W20260709 13:09:44.126624 13756 consensus_peers.cc:597] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:44.172765 13830 consensus_peers.cc:597] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:44.176838 13756 consensus_peers.cc:597] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:44.212553 13830 consensus_peers.cc:597] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:44.283710 14367 consensus_peers.cc:597] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:44.372080 13830 consensus_peers.cc:597] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:44.407828 14367 consensus_peers.cc:597] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:44.436918 13756 consensus_peers.cc:597] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:44.480623 13830 consensus_peers.cc:597] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:44.586160 14367 consensus_peers.cc:597] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:44.657809 13830 consensus_peers.cc:597] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:44.899156 14367 consensus_peers.cc:597] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:44.990391 14367 consensus_peers.cc:597] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:45.023520 13756 consensus_peers.cc:597] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:45.108117 13830 consensus_peers.cc:597] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:45.166988 13756 consensus_peers.cc:597] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:45.216145 13756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 49207.5us
W20260709 13:09:45.246966 14367 consensus_peers.cc:597] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:45.252593 13756 consensus_peers.cc:597] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:45.285773 13756 consensus_peers.cc:597] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:45.300884 14367 consensus_peers.cc:597] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:45.335661 14367 consensus_peers.cc:597] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:45.436237 13830 consensus_peers.cc:597] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:45.447975 13756 consensus_peers.cc:597] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:45.497769 13756 consensus_peers.cc:597] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:45.511112 13830 consensus_peers.cc:597] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:45.555980 14367 consensus_peers.cc:597] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:45.639065 13830 consensus_peers.cc:597] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:45.674834 12594 tablet_server.cc:196] TabletServer@127.12.76.129:0 shutdown complete.
W20260709 13:09:45.740991 13830 consensus_peers.cc:597] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:45.780829 13830 consensus_peers.cc:597] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:45.836506 13830 consensus_peers.cc:597] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:45.865181 13830 consensus_peers.cc:597] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:45.909960 13756 consensus_peers.cc:597] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:45.918444 13756 consensus_peers.cc:597] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:45.945574 13756 consensus_peers.cc:597] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:09:45.990010 12594 tablet_server.cc:179] TabletServer@127.12.76.130:0 shutting down...
W20260709 13:09:46.002000 13829 consensus_peers.cc:597] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.003397 14366 consensus_peers.cc:597] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.023028 13830 consensus_peers.cc:597] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:46.031826 14366 consensus_peers.cc:597] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.047740 14367 consensus_peers.cc:597] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:46.057444 13756 consensus_peers.cc:597] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:46.061236 14366 consensus_peers.cc:597] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.100284 13756 consensus_peers.cc:597] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:46.127696 13829 consensus_peers.cc:597] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.132723 13830 consensus_peers.cc:597] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:09:46.133044 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:46.134300 12594 tablet_replica.cc:333] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
W20260709 13:09:46.134884 13829 consensus_peers.cc:597] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.135676 12594 raft_consensus.cc:2243] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.137244 12594 raft_consensus.cc:2272] T 2d67d303d4784301a07a1fa014f50b98 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.142195 12594 tablet_replica.cc:333] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.144825 12594 raft_consensus.cc:2243] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:46.146350 13830 consensus_peers.cc:597] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:09:46.148097 12594 raft_consensus.cc:2272] T b7aeef8df5a945efb8666f30fe979ab7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.148944 13829 consensus_peers.cc:597] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.151943 12594 tablet_replica.cc:333] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.152864 12594 raft_consensus.cc:2243] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.154168 12594 raft_consensus.cc:2272] T 0e6fb0872745419da9cb9e1228d021aa P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.157231 12594 tablet_replica.cc:333] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.158097 12594 raft_consensus.cc:2243] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.159216 12594 raft_consensus.cc:2272] T fe5150c5d9c445549ec6d199f2cd70e0 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.162330 12594 tablet_replica.cc:333] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.163791 12594 raft_consensus.cc:2243] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.165112 12594 raft_consensus.cc:2272] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.165123 13829 consensus_peers.cc:597] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.168622 12594 tablet_replica.cc:333] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.169562 12594 raft_consensus.cc:2243] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.170759 12594 raft_consensus.cc:2272] T fa2169d517e24498a35dae28da79c931 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.173641 12594 tablet_replica.cc:333] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.174544 12594 raft_consensus.cc:2243] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.175237 12594 raft_consensus.cc:2272] T 14765cc3066247a49b29adae5e893ab8 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.180694 14366 consensus_peers.cc:597] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.179234 12594 tablet_replica.cc:333] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.182691 12594 raft_consensus.cc:2243] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.183549 12594 raft_consensus.cc:2272] T e689999f416446c9bf87d759da2844ae P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.186479 12594 tablet_replica.cc:333] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.187325 12594 raft_consensus.cc:2243] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.187958 12594 raft_consensus.cc:2272] T 60899523d3d145f58ccff5bb3438cb90 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.191390 12594 tablet_replica.cc:333] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.192273 12594 raft_consensus.cc:2243] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.193427 12594 raft_consensus.cc:2272] T e7c254367a594ceb8d4a3db25a715ae1 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.196097 12594 tablet_replica.cc:333] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.196851 12594 raft_consensus.cc:2243] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:46.197196 13829 consensus_peers.cc:597] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.197708 12594 raft_consensus.cc:2272] T 0a31d8aefe71401dadd16c2c0a9e9ecf P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.199553 13830 consensus_peers.cc:597] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:09:46.202466 12594 tablet_replica.cc:333] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.204747 12594 raft_consensus.cc:2243] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.205430 12594 raft_consensus.cc:2272] T 536b1fc131984687bf3b13417507e21d P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.208148 12594 tablet_replica.cc:333] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.208966 12594 raft_consensus.cc:2243] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.210240 12594 raft_consensus.cc:2272] T 44fb07fff88a4dcf97841a29f2641f66 P 35ecb005831740438d7537dd4b840e03 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.213809 12594 tablet_replica.cc:333] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.214574 12594 raft_consensus.cc:2243] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.215749 12594 raft_consensus.cc:2272] T 6f7de615f578424d8bafe69fe6bea9f9 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.218524 12594 tablet_replica.cc:333] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.219273 12594 raft_consensus.cc:2243] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 31 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.220428 12594 raft_consensus.cc:2272] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P 35ecb005831740438d7537dd4b840e03 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.222965 12594 tablet_replica.cc:333] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.223721 12594 raft_consensus.cc:2243] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.224368 12594 raft_consensus.cc:2272] T d07097a615d345468e43de064c67057d P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.227283 12594 tablet_replica.cc:333] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.228082 12594 raft_consensus.cc:2243] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.228837 12594 raft_consensus.cc:2272] T 7c307c37029c4b5596bad2e08bda02bf P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.231642 12594 tablet_replica.cc:333] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.233042 12594 raft_consensus.cc:2243] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.234267 12594 raft_consensus.cc:2272] T b022fc3eb21246ff9f62e8a747bac6c4 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.237015 12594 tablet_replica.cc:333] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.237836 12594 raft_consensus.cc:2243] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.238938 12594 raft_consensus.cc:2272] T ca5b6ba16dba4c529324c949c6b9ac85 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.247267 12594 tablet_replica.cc:333] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.248118 12594 raft_consensus.cc:2243] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.248842 12594 raft_consensus.cc:2272] T c7cc0929e3a64836993d9ee880b12800 P 35ecb005831740438d7537dd4b840e03 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.251636 12594 tablet_replica.cc:333] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.252425 12594 raft_consensus.cc:2243] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.253808 12594 raft_consensus.cc:2272] T 8d8b741328f1468cb4ac726ffe62e9e8 P 35ecb005831740438d7537dd4b840e03 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.256346 12594 tablet_replica.cc:333] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.257138 12594 raft_consensus.cc:2243] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.257851 12594 raft_consensus.cc:2272] T 2d32f086650d45b7b7ae3e0d858e360b P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.260672 12594 tablet_replica.cc:333] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.261475 12594 raft_consensus.cc:2243] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.262044 12594 raft_consensus.cc:2272] T b1367b7b65234b7fbaacfcd765b3a6e5 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.264662 12594 tablet_replica.cc:333] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.265408 12594 raft_consensus.cc:2243] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.267012 12594 raft_consensus.cc:2272] T 03391a24625846c6997759d9b34dc4b4 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.269726 12594 tablet_replica.cc:333] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.270462 12594 raft_consensus.cc:2243] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.271142 12594 raft_consensus.cc:2272] T cd386d71cc264abca3dbfa88ffd4e951 P 35ecb005831740438d7537dd4b840e03 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.273663 12594 tablet_replica.cc:333] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.274359 12594 raft_consensus.cc:2243] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.275036 12594 raft_consensus.cc:2272] T 79adc3f3cf6a48518016b2d56c531dbd P 35ecb005831740438d7537dd4b840e03 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.277559 12594 tablet_replica.cc:333] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.278290 12594 raft_consensus.cc:2243] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.278849 12594 raft_consensus.cc:2272] T 5171bcd42ea14ad3af7399ab8c6a7e35 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.281450 12594 tablet_replica.cc:333] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.282747 12594 raft_consensus.cc:2243] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.283553 12594 raft_consensus.cc:2272] T 397ec99b74c24481a69c1f4a7c294a73 P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.285921 12594 tablet_replica.cc:333] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.286631 12594 raft_consensus.cc:2243] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.287261 12594 raft_consensus.cc:2272] T f3cfef71353344f180965689d6ec9166 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.289022 13829 consensus_peers.cc:597] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.290427 12594 tablet_replica.cc:333] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.291209 12594 raft_consensus.cc:2243] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.292603 12594 raft_consensus.cc:2272] T 8591822f3dc3430e935360afdb260fce P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.295287 12594 tablet_replica.cc:333] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.296020 12594 raft_consensus.cc:2243] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.296684 12594 raft_consensus.cc:2272] T eb0e4fb02d3a45d4a6cc322c544fbf80 P 35ecb005831740438d7537dd4b840e03 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.299355 12594 tablet_replica.cc:333] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.300158 12594 raft_consensus.cc:2243] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.300875 12594 raft_consensus.cc:2272] T 3618fd55609843fca70082d3565b459b P 35ecb005831740438d7537dd4b840e03 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.303009 14366 consensus_peers.cc:597] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.303488 12594 tablet_replica.cc:333] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.304301 12594 raft_consensus.cc:2243] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.305349 12594 raft_consensus.cc:2272] T d82f3ff70ad54875bc615804bb1a2da7 P 35ecb005831740438d7537dd4b840e03 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.307940 12594 tablet_replica.cc:333] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.308764 12594 raft_consensus.cc:2243] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.310151 12594 raft_consensus.cc:2272] T 82aefa8c282f4143b3c3d55f5a4d0bcf P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.312844 12594 tablet_replica.cc:333] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.313638 12594 raft_consensus.cc:2243] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.314467 12594 raft_consensus.cc:2272] T f09ef105d67b41dba510b44a6567d790 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.314716 13829 consensus_peers.cc:597] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.317153 12594 tablet_replica.cc:333] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.318634 12594 raft_consensus.cc:2243] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:09:46.319763 13829 consensus_peers.cc:597] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.319844 12594 raft_consensus.cc:2272] T 0b0054f48c4947acaea83521993a8f01 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.322245 14366 consensus_peers.cc:597] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.325337 12594 tablet_replica.cc:333] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.326166 12594 raft_consensus.cc:2243] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.327221 12594 raft_consensus.cc:2272] T 0ff0635cc3464389804f1758fde23012 P 35ecb005831740438d7537dd4b840e03 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.330240 12594 tablet_replica.cc:333] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.331012 12594 raft_consensus.cc:2243] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 24 LEADER]: Raft consensus shutting down.
W20260709 13:09:46.331208 14366 consensus_peers.cc:597] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.332376 12594 raft_consensus.cc:2272] T aa43b4c4d63f407c90aa0154dfcc1063 P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.334970 12594 tablet_replica.cc:333] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.335726 12594 raft_consensus.cc:2243] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.336360 12594 raft_consensus.cc:2272] T 19de5233e495495dbff7c520c86d37c7 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.338991 12594 tablet_replica.cc:333] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.339730 12594 raft_consensus.cc:2243] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.340502 12594 raft_consensus.cc:2272] T ca53eab03a80405b9ebe6f6a25d8e30b P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.343076 12594 tablet_replica.cc:333] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.343806 12594 raft_consensus.cc:2243] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.345547 12594 raft_consensus.cc:2272] T ac7aedfecb9c482a9cf59234dff1e9f8 P 35ecb005831740438d7537dd4b840e03 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.347491 13829 consensus_peers.cc:597] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.348102 12594 tablet_replica.cc:333] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.350847 12594 raft_consensus.cc:2243] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.352056 12594 raft_consensus.cc:2272] T 9c37f25da53241cd98c09e4525d9e23c P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.365103 14366 consensus_peers.cc:597] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.354597 12594 tablet_replica.cc:333] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.372494 12594 raft_consensus.cc:2243] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.374809 12594 raft_consensus.cc:2272] T 2e2aec8e942e44d9b699829a1e6de4b3 P 35ecb005831740438d7537dd4b840e03 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.375507 13830 consensus_peers.cc:597] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:46.378387 12594 tablet_replica.cc:333] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.379173 12594 raft_consensus.cc:2243] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.379868 12594 raft_consensus.cc:2272] T 106d35c470db4341b591e5268b81a3f3 P 35ecb005831740438d7537dd4b840e03 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.369553 13829 consensus_peers.cc:597] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.384411 14366 consensus_peers.cc:597] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.398288 12594 tablet_replica.cc:333] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03: stopping tablet replica
I20260709 13:09:46.400782 12594 raft_consensus.cc:2243] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.406275 12594 raft_consensus.cc:2272] T ab01257d4e56488eba41a0ce5c5e9954 P 35ecb005831740438d7537dd4b840e03 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.407939 14366 consensus_peers.cc:597] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.409402 13829 consensus_peers.cc:597] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.417917 13830 consensus_peers.cc:597] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:46.423435 13829 consensus_peers.cc:597] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.436355 13829 consensus_peers.cc:597] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.472402 14366 consensus_peers.cc:597] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.485453 13829 consensus_peers.cc:597] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.512415 14400 consensus_queue.cc:237] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:46.531813 13865 raft_consensus.cc:1275] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:09:46.534869 21966 consensus_queue.cc:1048] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:09:46.552414 14366 consensus_peers.cc:597] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.562356 21966 raft_consensus.cc:2955] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 25 LEADER]: Committing config change with OpId 25.17: config changed from index 10 to 17, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:46.567881 13864 raft_consensus.cc:2955] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Committing config change with OpId 25.17: config changed from index 10 to 17, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } } }
I20260709 13:09:46.582756 13599 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 536b1fc131984687bf3b13417507e21d with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260709 13:09:46.590368 13613 catalog_manager.cc:5697] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 reported cstate change: config changed from index 10 to 17, VOTER b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129) evicted. New cstate: current_term: 25 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:46.641170 13830 consensus_peers.cc:597] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:46.664000 13600 catalog_manager.cc:4755] TS b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 536b1fc131984687bf3b13417507e21d: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:46.790648 13830 consensus_peers.cc:597] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:46.839022 13830 consensus_peers.cc:597] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:47.095923 14367 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.182369 14367 consensus_peers.cc:597] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:47.187078 14367 consensus_peers.cc:597] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:47.195660 14367 consensus_peers.cc:597] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:47.196424 14367 consensus_peers.cc:597] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:09:47.212265 22000 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.212888 22000 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:47.225948 21985 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.226541 21985 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:47.231043 22000 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:47.240942 22000 raft_consensus.cc:493] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.232556 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:47.241422 22000 raft_consensus.cc:515] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:47.243505 22000 leader_election.cc:290] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:47.235364 21985 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:09:47.249694 13829 leader_election.cc:336] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
W20260709 13:09:47.250654 13830 leader_election.cc:336] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:47.258661 13829 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:47.269707 21998 raft_consensus.cc:2749] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:47.259517 14366 leader_election.cc:336] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
W20260709 13:09:47.279939 14367 leader_election.cc:336] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:47.282119 14367 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:47.283739 21985 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:47.284454 21985 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.284914 21985 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:47.286998 21985 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:09:47.292089 13830 consensus_peers.cc:597] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:47.296856 13829 leader_election.cc:336] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:47.297438 13829 leader_election.cc:304] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:47.298254 21986 raft_consensus.cc:2749] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:47.298964 21985 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.299603 21985 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:47.301493 21985 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:09:47.305704 14366 leader_election.cc:336] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
W20260709 13:09:47.310606 14367 leader_election.cc:336] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:47.314491 14367 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:47.316665 21998 raft_consensus.cc:493] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.321712 21998 raft_consensus.cc:515] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:47.323803 21998 leader_election.cc:290] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:47.325359 21985 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:47.328059 14366 leader_election.cc:336] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:47.331380 21998 raft_consensus.cc:493] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.332643 21998 raft_consensus.cc:515] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
W20260709 13:09:47.334045 14367 leader_election.cc:336] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:47.334846 14367 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:47.336292 21966 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:47.337009 13830 leader_election.cc:336] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:47.336031 21998 leader_election.cc:290] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:09:47.349474 13830 leader_election.cc:336] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:47.355726 13829 leader_election.cc:336] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:47.356282 13829 leader_election.cc:304] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:47.360877 21986 raft_consensus.cc:2749] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:09:47.360464 14367 consensus_peers.cc:597] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:09:47.356287 21985 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.363039 21985 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:47.365635 13829 leader_election.cc:336] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:47.366043 13829 leader_election.cc:304] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:47.367367 21986 raft_consensus.cc:2749] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:09:47.370922 21985 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:09:47.375856 14367 leader_election.cc:336] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:47.378221 14366 leader_election.cc:336] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:47.378671 14366 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:47.380046 21985 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:47.389429 21966 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.389922 21966 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:47.398440 14367 leader_election.cc:336] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:47.402536 21966 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:09:47.405273 14366 leader_election.cc:336] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:47.405967 14366 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:47.407255 21966 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 13:09:47.415059 14367 consensus_peers.cc:597] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:09:47.438731 21985 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.439358 21985 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:47.441915 21985 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:47.443686 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:47.444039 21985 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.444375 13865 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 21.
I20260709 13:09:47.445856 14368 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:47.446799 21980 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:47.447197 21980 raft_consensus.cc:493] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.447609 21980 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:47.444603 21985 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:47.457417 21985 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:47.469714 21980 raft_consensus.cc:515] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:47.472940 14366 leader_election.cc:336] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
W20260709 13:09:47.475965 14366 leader_election.cc:336] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:47.486322 21980 leader_election.cc:290] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:47.491089 22001 raft_consensus.cc:493] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.491624 22001 raft_consensus.cc:515] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } }
I20260709 13:09:47.493646 22001 leader_election.cc:290] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:47.496500 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d67d303d4784301a07a1fa014f50b98" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:47.497113 13864 raft_consensus.cc:3060] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:09:47.502449 13830 leader_election.cc:336] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:47.503270 13829 leader_election.cc:336] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:47.503743 13829 leader_election.cc:304] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:47.504940 22001 raft_consensus.cc:2749] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:47.506223 13864 raft_consensus.cc:2468] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 22.
W20260709 13:09:47.487052 14366 leader_election.cc:336] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:47.519016 14368 leader_election.cc:304] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:09:47.520346 22001 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.522085 22001 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:47.527643 22001 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:47.519989 14367 leader_election.cc:336] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:47.528337 14367 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:47.533915 22003 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:47.532392 21980 raft_consensus.cc:2804] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:47.536788 21980 raft_consensus.cc:697] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 22 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:47.538615 21980 consensus_queue.cc:237] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:47.540131 13829 leader_election.cc:336] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:47.540925 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:47.548056 22003 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.552582 22003 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:47.557833 22003 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:47.560814 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:47.562328 13829 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:47.570708 22001 raft_consensus.cc:2749] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:47.584517 14366 leader_election.cc:336] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:47.588933 14366 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:47.593406 22003 raft_consensus.cc:2749] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:47.608932 21980 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.609547 21980 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:47.610399 13613 catalog_manager.cc:5697] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 21 to 22, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 22 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.612102 21980 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:47.621287 22001 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.621785 22001 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:47.623804 22001 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:47.628762 13829 leader_election.cc:336] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
W20260709 13:09:47.630435 14367 leader_election.cc:336] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:47.631589 14400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:47.632179 14400 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 21.
I20260709 13:09:47.635197 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:09:47.636332 22001 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:47.636674 22001 raft_consensus.cc:493] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.636986 22001 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:47.644220 21980 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.649806 22001 raft_consensus.cc:515] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:47.646159 21980 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:47.654281 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:47.656046 21980 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:47.651552 14366 leader_election.cc:336] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:47.656699 14366 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:47.658978 22003 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.659547 22003 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:47.658455 21980 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:47.674295 14367 leader_election.cc:336] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:47.675700 22003 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:47.688372 21998 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.690748 21998 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:47.692782 21998 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:47.689723 13829 leader_election.cc:336] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
W20260709 13:09:47.701031 13829 leader_election.cc:336] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
W20260709 13:09:47.716279 13830 consensus_peers.cc:597] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:09:47.724531 22001 leader_election.cc:290] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:47.727936 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:47.730860 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2169d517e24498a35dae28da79c931" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:47.731389 14394 raft_consensus.cc:3060] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:47.739081 22003 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.739990 22003 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:47.744061 14366 leader_election.cc:336] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
W20260709 13:09:47.748811 14367 leader_election.cc:336] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:47.760049 21980 raft_consensus.cc:493] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.760747 21980 raft_consensus.cc:515] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:47.764271 21980 leader_election.cc:290] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:47.767571 21998 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.768182 21998 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:47.770385 21998 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
W20260709 13:09:47.782021 14367 consensus_peers.cc:597] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:09:47.782634 14367 leader_election.cc:336] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:47.783428 13830 consensus_peers.cc:597] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:47.785889 14366 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:47.788604 21980 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:47.751297 14394 raft_consensus.cc:2468] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 22.
I20260709 13:09:47.792423 22003 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:47.803810 13829 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5029654a4384e43a68eb67b794949b7; no voters: 35ecb005831740438d7537dd4b840e03, ceb06175847b428ea8bd77055fcddf58
I20260709 13:09:47.806720 22002 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.840534 22002 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:47.842517 22002 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:47.812515 21980 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.843631 21980 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:47.845625 21980 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:47.847599 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 43862.1us
I20260709 13:09:47.848163 21998 raft_consensus.cc:2749] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:47.838173 14366 leader_election.cc:336] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:47.873867 14366 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:47.876798 21980 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:47.896414 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:47.897042 13865 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 21.
I20260709 13:09:47.898084 13863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7" is_pre_election: true
I20260709 13:09:47.898839 13863 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 18.
W20260709 13:09:47.909791 13829 leader_election.cc:336] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:47.912838 14368 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:47.926793 14368 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:47.927836 22002 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:09:47.928261 22002 raft_consensus.cc:493] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.928638 22002 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:09:47.933598 21985 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:47.934046 21985 raft_consensus.cc:493] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:47.934466 21985 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:47.946497 22002 raft_consensus.cc:515] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:47.953238 22002 leader_election.cc:290] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:47.921228 13600 catalog_manager.cc:4755] TS b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 536b1fc131984687bf3b13417507e21d: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:47.999279 13600 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.76.129:37533, user_credentials={real_user=slave}} blocked reactor thread for 78084.1us
I20260709 13:09:47.954483 21985 raft_consensus.cc:515] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:47.956981 14394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58" is_pre_election: true
I20260709 13:09:48.000432 14394 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 20.
I20260709 13:09:48.002621 21985 leader_election.cc:290] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:48.008445 13864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c37f25da53241cd98c09e4525d9e23c" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:48.009205 13864 raft_consensus.cc:3060] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:48.009423 12594 tablet_server.cc:196] TabletServer@127.12.76.130:0 shutdown complete.
W20260709 13:09:47.966032 14366 leader_election.cc:336] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:47.982797 13865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7aedfecb9c482a9cf59234dff1e9f8" candidate_uuid: "ceb06175847b428ea8bd77055fcddf58" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b5029654a4384e43a68eb67b794949b7"
I20260709 13:09:48.022153 14366 leader_election.cc:304] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:48.022326 13865 raft_consensus.cc:3060] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:09:48.023102 14366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 61823.1us
I20260709 13:09:48.023571 21966 raft_consensus.cc:2749] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:47.992036 13829 leader_election.cc:304] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
W20260709 13:09:48.029403 14367 consensus_peers.cc:597] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:09:48.035732 13865 raft_consensus.cc:2468] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 22.
I20260709 13:09:48.039016 13864 raft_consensus.cc:2468] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb06175847b428ea8bd77055fcddf58 in term 19.
W20260709 13:09:48.039951 14366 leader_election.cc:336] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:48.040972 14368 leader_election.cc:304] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:48.041764 22001 raft_consensus.cc:2804] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:48.043427 22001 raft_consensus.cc:697] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 22 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:48.040477 14366 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:48.044760 22001 consensus_queue.cc:237] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:48.047384 22003 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:09:48.048171 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 56241.5us
W20260709 13:09:48.048732 14366 leader_election.cc:336] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
W20260709 13:09:48.049515 14366 leader_election.cc:336] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:48.059873 14368 leader_election.cc:304] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:48.061070 22003 raft_consensus.cc:2804] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:09:48.061712 22003 raft_consensus.cc:697] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 22 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
I20260709 13:09:48.062270 22002 raft_consensus.cc:2804] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:48.062719 22003 consensus_queue.cc:237] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:48.065133 13865 raft_consensus.cc:1275] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Refusing update from remote peer ceb06175847b428ea8bd77055fcddf58: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:09:48.067076 22002 raft_consensus.cc:697] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 19 LEADER]: Becoming Leader. State: Replica: ceb06175847b428ea8bd77055fcddf58, State: Running, Role: LEADER
W20260709 13:09:48.075574 14366 leader_election.cc:336] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
W20260709 13:09:48.076640 14366 leader_election.cc:336] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:48.072014 22002 consensus_queue.cc:237] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:48.100610 13613 catalog_manager.cc:5697] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 21 to 22, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 22 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.104116 22003 consensus_queue.cc:1048] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:09:48.108106 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:36047, user_credentials={real_user=slave}} blocked reactor thread for 49194.1us
I20260709 13:09:48.133370 13610 catalog_manager.cc:5697] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 reported cstate change: term changed from 18 to 19, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to ceb06175847b428ea8bd77055fcddf58 (127.12.76.132). New cstate: current_term: 19 leader_uuid: "ceb06175847b428ea8bd77055fcddf58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:48.169351 14366 consensus_peers.cc:597] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:48.178540 13830 consensus_peers.cc:597] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:48.165581 13610 catalog_manager.cc:5697] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 21 to 22, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 22 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:48.193225 14367 consensus_peers.cc:597] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:09:48.199467 14366 consensus_peers.cc:597] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:48.221938 13829 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:43039, user_credentials={real_user=slave}} blocked reactor thread for 68430.1us
I20260709 13:09:48.238665 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03
I20260709 13:09:48.244437 22001 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:48.245482 22001 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:48.246043 22001 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:48.275270 22001 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:48.277779 22001 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: Requested vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039)
I20260709 13:09:48.278769 12594 tablet_server.cc:179] TabletServer@127.12.76.131:0 shutting down...
W20260709 13:09:48.280989 13830 consensus_peers.cc:597] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:48.281499 13830 consensus_peers.cc:597] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:09:48.295120 14402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff0635cc3464389804f1758fde23012" candidate_uuid: "b5029654a4384e43a68eb67b794949b7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ceb06175847b428ea8bd77055fcddf58"
I20260709 13:09:48.295841 14402 raft_consensus.cc:3060] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:09:48.301791 14367 consensus_peers.cc:597] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:48.308030 14402 raft_consensus.cc:2468] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5029654a4384e43a68eb67b794949b7 in term 21.
W20260709 13:09:48.321205 13830 consensus_peers.cc:597] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:48.323367 14368 consensus_peers.cc:597] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 -> Peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Couldn't send request to peer b5029654a4384e43a68eb67b794949b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.331264 13829 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5029654a4384e43a68eb67b794949b7, ceb06175847b428ea8bd77055fcddf58; no voters: 
I20260709 13:09:48.332712 21998 raft_consensus.cc:2804] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:48.333241 21998 raft_consensus.cc:697] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 21 LEADER]: Becoming Leader. State: Replica: b5029654a4384e43a68eb67b794949b7, State: Running, Role: LEADER
I20260709 13:09:48.334146 21998 consensus_queue.cc:237] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:48.372530 13610 catalog_manager.cc:5697] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 reported cstate change: term changed from 20 to 21, leader changed from 35ecb005831740438d7537dd4b840e03 (127.12.76.130) to b5029654a4384e43a68eb67b794949b7 (127.12.76.131). New cstate: current_term: 21 leader_uuid: "b5029654a4384e43a68eb67b794949b7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:48.385816 14368 consensus_peers.cc:597] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 -> Peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Couldn't send request to peer b5029654a4384e43a68eb67b794949b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:48.387604 14367 consensus_peers.cc:597] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:48.390341 13829 leader_election.cc:336] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
W20260709 13:09:48.420044 13830 consensus_peers.cc:597] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:09:48.436939 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:48.438205 12594 tablet_replica.cc:333] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.439662 12594 raft_consensus.cc:2243] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.440316 12594 raft_consensus.cc:2272] T 2d67d303d4784301a07a1fa014f50b98 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:48.442438 13829 consensus_peers.cc:597] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.444171 12594 tablet_replica.cc:333] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.445887 12594 raft_consensus.cc:2243] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.446847 12594 raft_consensus.cc:2272] T 9a3fcea1abf04503bc26d451a56ed222 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.449262 12594 tablet_replica.cc:333] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.449985 12594 raft_consensus.cc:2243] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.450498 12594 raft_consensus.cc:2272] T 0e6fb0872745419da9cb9e1228d021aa P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.452775 12594 tablet_replica.cc:333] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.453433 12594 raft_consensus.cc:2243] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.453955 12594 raft_consensus.cc:2272] T b7aeef8df5a945efb8666f30fe979ab7 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.456532 12594 tablet_replica.cc:333] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.457345 12594 raft_consensus.cc:2243] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.458645 12594 raft_consensus.cc:2272] T 4c6f358793c54a8fa2409a5d4c5505f8 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.462288 12594 tablet_replica.cc:333] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.463200 12594 raft_consensus.cc:2243] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.464295 12594 pending_rounds.cc:70] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7: Trying to abort 1 pending ops.
I20260709 13:09:48.464571 12594 pending_rounds.cc:77] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7: Aborting op as it isn't in flight: id { term: 22 index: 18 } timestamp: 7305636200671215616 op_type: NO_OP noop_request { }
I20260709 13:09:48.465034 12594 raft_consensus.cc:2889] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 22 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:48.465438 12594 raft_consensus.cc:2272] T fa2169d517e24498a35dae28da79c931 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:48.469839 14366 consensus_peers.cc:597] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:48.473917 14368 consensus_peers.cc:597] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 -> Peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Couldn't send request to peer b5029654a4384e43a68eb67b794949b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:48.477614 14368 consensus_peers.cc:597] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 -> Peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Couldn't send request to peer b5029654a4384e43a68eb67b794949b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:48.478561 13830 consensus_peers.cc:597] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:09:48.481426 12594 tablet_replica.cc:333] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.482509 12594 raft_consensus.cc:2243] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.483358 12594 raft_consensus.cc:2272] T 14765cc3066247a49b29adae5e893ab8 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.487165 12594 tablet_replica.cc:333] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.488030 12594 raft_consensus.cc:2243] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.489936 12594 raft_consensus.cc:2272] T e689999f416446c9bf87d759da2844ae P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:48.490391 14366 consensus_peers.cc:597] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:48.491024 14368 consensus_peers.cc:597] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 -> Peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Couldn't send request to peer b5029654a4384e43a68eb67b794949b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.495183 12594 tablet_replica.cc:333] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.496349 12594 raft_consensus.cc:2243] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.497584 12594 raft_consensus.cc:2272] T 4648ad5742bd4fe09563b72eb2dfc059 P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.501677 12594 tablet_replica.cc:333] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
W20260709 13:09:48.502240 13830 consensus_peers.cc:597] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:09:48.502720 12594 raft_consensus.cc:2243] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.503947 12594 raft_consensus.cc:2272] T ff2185b760234a0280587d4ea3f18b8a P b5029654a4384e43a68eb67b794949b7 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:48.511008 14366 consensus_peers.cc:597] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:48.511701 12594 tablet_replica.cc:333] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.514508 12594 raft_consensus.cc:2243] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.518519 12594 raft_consensus.cc:2272] T 68418f30a686438bba0d6ab02efa0986 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.521029 12594 tablet_replica.cc:333] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.521689 12594 raft_consensus.cc:2243] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.522188 12594 raft_consensus.cc:2272] T 6f7de615f578424d8bafe69fe6bea9f9 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.524413 12594 tablet_replica.cc:333] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.525296 12594 raft_consensus.cc:2243] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.526433 12594 raft_consensus.cc:2272] T 60899523d3d145f58ccff5bb3438cb90 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.530426 12594 tablet_replica.cc:333] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.531052 12594 raft_consensus.cc:2243] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.531713 12594 raft_consensus.cc:2272] T c7cc0929e3a64836993d9ee880b12800 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.534103 12594 tablet_replica.cc:333] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.534795 12594 raft_consensus.cc:2243] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.536024 12594 raft_consensus.cc:2272] T ca5b6ba16dba4c529324c949c6b9ac85 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.539819 12594 tablet_replica.cc:333] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
W20260709 13:09:48.540530 14368 consensus_peers.cc:597] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 -> Peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Couldn't send request to peer b5029654a4384e43a68eb67b794949b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.540692 12594 raft_consensus.cc:2243] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.541399 12594 raft_consensus.cc:2272] T ac05b1933cb74e488759c38bd76d8d00 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.544196 12594 tablet_replica.cc:333] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.544979 12594 raft_consensus.cc:2243] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.546026 12594 raft_consensus.cc:2272] T d07097a615d345468e43de064c67057d P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.548861 12594 tablet_replica.cc:333] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.549678 12594 raft_consensus.cc:2243] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.550720 12594 raft_consensus.cc:2272] T 7c307c37029c4b5596bad2e08bda02bf P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.553519 12594 tablet_replica.cc:333] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.554275 12594 raft_consensus.cc:2243] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.555506 12594 raft_consensus.cc:2272] T 0a31d8aefe71401dadd16c2c0a9e9ecf P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.558408 12594 tablet_replica.cc:333] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.559253 12594 raft_consensus.cc:2243] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.560014 12594 raft_consensus.cc:2272] T 536b1fc131984687bf3b13417507e21d P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.563980 12594 tablet_replica.cc:333] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.564884 12594 raft_consensus.cc:2243] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.565783 12594 raft_consensus.cc:2272] T 82e0eeb1582143a09acf311171812faa P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:48.568251 14368 consensus_peers.cc:597] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 -> Peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Couldn't send request to peer b5029654a4384e43a68eb67b794949b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.568769 12594 tablet_replica.cc:333] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.569707 12594 raft_consensus.cc:2243] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.570466 12594 raft_consensus.cc:2272] T 8d8b741328f1468cb4ac726ffe62e9e8 P b5029654a4384e43a68eb67b794949b7 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:48.574036 14368 consensus_peers.cc:597] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 -> Peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Couldn't send request to peer b5029654a4384e43a68eb67b794949b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.574417 12594 tablet_replica.cc:333] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
W20260709 13:09:48.582538 14368 consensus_peers.cc:597] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 -> Peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Couldn't send request to peer b5029654a4384e43a68eb67b794949b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.585485 12594 raft_consensus.cc:2243] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.586375 12594 raft_consensus.cc:2272] T 2d32f086650d45b7b7ae3e0d858e360b P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:48.588856 14368 consensus_peers.cc:597] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 -> Peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Couldn't send request to peer b5029654a4384e43a68eb67b794949b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.589123 12594 tablet_replica.cc:333] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
W20260709 13:09:48.589857 14368 consensus_peers.cc:597] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 -> Peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Couldn't send request to peer b5029654a4384e43a68eb67b794949b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.590078 12594 raft_consensus.cc:2243] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.591478 12594 raft_consensus.cc:2272] T cd386d71cc264abca3dbfa88ffd4e951 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:48.592429 14368 consensus_peers.cc:597] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 -> Peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Couldn't send request to peer b5029654a4384e43a68eb67b794949b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.594349 12594 tablet_replica.cc:333] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.595152 12594 raft_consensus.cc:2243] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.596191 12594 raft_consensus.cc:2272] T 5171bcd42ea14ad3af7399ab8c6a7e35 P b5029654a4384e43a68eb67b794949b7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.598868 12594 tablet_replica.cc:333] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.599628 12594 raft_consensus.cc:2243] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.600755 12594 raft_consensus.cc:2272] T 49638a262b1d4ba9b26cde1d408bf7ac P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.603461 12594 tablet_replica.cc:333] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.604303 12594 raft_consensus.cc:2243] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.604899 12594 raft_consensus.cc:2272] T cff75d4a417e4aeab081acad01b03c36 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.607549 12594 tablet_replica.cc:333] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.608352 12594 raft_consensus.cc:2243] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.609519 12594 raft_consensus.cc:2272] T d82f3ff70ad54875bc615804bb1a2da7 P b5029654a4384e43a68eb67b794949b7 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.612107 12594 tablet_replica.cc:333] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.612766 12594 raft_consensus.cc:2243] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.613354 12594 raft_consensus.cc:2272] T f09ef105d67b41dba510b44a6567d790 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:48.615176 14368 consensus_peers.cc:597] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 -> Peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Couldn't send request to peer b5029654a4384e43a68eb67b794949b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.615875 12594 tablet_replica.cc:333] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.616724 12594 raft_consensus.cc:2243] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.617748 12594 raft_consensus.cc:2272] T 79adc3f3cf6a48518016b2d56c531dbd P b5029654a4384e43a68eb67b794949b7 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.620260 12594 tablet_replica.cc:333] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.620968 12594 raft_consensus.cc:2243] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.621945 12594 raft_consensus.cc:2272] T b1367b7b65234b7fbaacfcd765b3a6e5 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.624542 12594 tablet_replica.cc:333] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.625269 12594 raft_consensus.cc:2243] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.625897 12594 raft_consensus.cc:2272] T de09d01498e547e591ce4ebe62e59488 P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.629207 12594 tablet_replica.cc:333] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.629890 12594 raft_consensus.cc:2243] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.631070 12594 raft_consensus.cc:2272] T 03391a24625846c6997759d9b34dc4b4 P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.634145 12594 tablet_replica.cc:333] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.634892 12594 raft_consensus.cc:2243] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:09:48.636682 13829 consensus_peers.cc:597] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:48.639601 13830 consensus_peers.cc:597] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:48.640684 14366 consensus_peers.cc:597] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.640898 12594 raft_consensus.cc:2272] T ebc19cb1c68943cba711cd721c8caa91 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.643888 12594 tablet_replica.cc:333] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.644672 12594 raft_consensus.cc:2243] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.645723 12594 raft_consensus.cc:2272] T 3e4bec6398d84f67ad839268ec8d2a12 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.648336 12594 tablet_replica.cc:333] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.649121 12594 raft_consensus.cc:2243] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.649914 12594 pending_rounds.cc:70] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7: Trying to abort 1 pending ops.
I20260709 13:09:48.650138 12594 pending_rounds.cc:77] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7: Aborting op as it isn't in flight: id { term: 21 index: 17 } timestamp: 7305636201829199872 op_type: NO_OP noop_request { }
I20260709 13:09:48.650511 12594 raft_consensus.cc:2889] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 21 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:48.650875 12594 raft_consensus.cc:2272] T 0ff0635cc3464389804f1758fde23012 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:48.652201 14368 consensus_peers.cc:597] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 -> Peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Couldn't send request to peer b5029654a4384e43a68eb67b794949b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:48.653995 14368 consensus_peers.cc:597] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 -> Peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Couldn't send request to peer b5029654a4384e43a68eb67b794949b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.654006 12594 tablet_replica.cc:333] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.655673 12594 raft_consensus.cc:2243] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.656419 12594 raft_consensus.cc:2272] T aa43b4c4d63f407c90aa0154dfcc1063 P b5029654a4384e43a68eb67b794949b7 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:48.658663 14368 consensus_peers.cc:597] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 -> Peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Couldn't send request to peer b5029654a4384e43a68eb67b794949b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.659361 12594 tablet_replica.cc:333] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.660279 12594 raft_consensus.cc:2243] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.660878 12594 raft_consensus.cc:2272] T 2e2aec8e942e44d9b699829a1e6de4b3 P b5029654a4384e43a68eb67b794949b7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.663779 12594 tablet_replica.cc:333] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.664551 12594 raft_consensus.cc:2243] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.665359 12594 raft_consensus.cc:2272] T 8446dab661a64f9b8075d7586f1197f4 P b5029654a4384e43a68eb67b794949b7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.668123 12594 tablet_replica.cc:333] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.668694 12594 raft_consensus.cc:2243] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.669589 12594 raft_consensus.cc:2272] T ca53eab03a80405b9ebe6f6a25d8e30b P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.671660 12594 tablet_replica.cc:333] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.672344 12594 raft_consensus.cc:2243] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.673171 12594 raft_consensus.cc:2272] T c9e22f0634b34971aed9c5b948f3275e P b5029654a4384e43a68eb67b794949b7 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.675397 12594 tablet_replica.cc:333] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.675989 12594 raft_consensus.cc:2243] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.676859 12594 raft_consensus.cc:2272] T 106d35c470db4341b591e5268b81a3f3 P b5029654a4384e43a68eb67b794949b7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.678776 12594 tablet_replica.cc:333] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.679301 12594 raft_consensus.cc:2243] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.679800 12594 raft_consensus.cc:2272] T ac7aedfecb9c482a9cf59234dff1e9f8 P b5029654a4384e43a68eb67b794949b7 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.681764 12594 tablet_replica.cc:333] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.682274 12594 raft_consensus.cc:2243] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.682962 12594 raft_consensus.cc:2272] T 9c37f25da53241cd98c09e4525d9e23c P b5029654a4384e43a68eb67b794949b7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.684880 12594 tablet_replica.cc:333] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7: stopping tablet replica
I20260709 13:09:48.685359 12594 raft_consensus.cc:2243] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.686630 12594 raft_consensus.cc:2272] T 19de5233e495495dbff7c520c86d37c7 P b5029654a4384e43a68eb67b794949b7 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:48.731976 14368 consensus_peers.cc:597] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 -> Peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Couldn't send request to peer b5029654a4384e43a68eb67b794949b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:48.774580 14366 consensus_peers.cc:597] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:48.801950 22002 raft_consensus.cc:493] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:48.802733 22002 raft_consensus.cc:515] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:48.810153 14367 leader_election.cc:336] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:48.810676 14366 consensus_peers.cc:597] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:48.811489 22002 leader_election.cc:290] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:09:48.813820 14366 consensus_peers.cc:597] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:48.816915 14366 leader_election.cc:336] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:48.817312 14366 leader_election.cc:304] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:48.819623 22002 raft_consensus.cc:2749] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:48.876659 22002 raft_consensus.cc:493] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:48.877245 22002 raft_consensus.cc:515] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:48.879228 22002 leader_election.cc:290] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:09:48.880781 14367 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111) [suppressed 579 similar messages]
W20260709 13:09:48.884413 14367 leader_election.cc:336] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:48.886626 14366 leader_election.cc:336] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:48.887022 14366 leader_election.cc:304] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:48.887719 22002 raft_consensus.cc:2749] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:48.889313 14366 consensus_peers.cc:597] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:48.966321 14366 consensus_peers.cc:597] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:48.999282 14366 consensus_peers.cc:597] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.061069 14366 consensus_peers.cc:597] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.061772 13600 catalog_manager.cc:4755] TS b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 536b1fc131984687bf3b13417507e21d: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:49.081115 14367 consensus_peers.cc:597] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:09:49.111810 22009 raft_consensus.cc:493] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:49.112341 22009 raft_consensus.cc:515] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:49.114379 22009 leader_election.cc:290] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:09:49.119061 14366 leader_election.cc:336] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
W20260709 13:09:49.120637 14367 leader_election.cc:336] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:49.121037 14367 leader_election.cc:304] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:49.121667 22002 raft_consensus.cc:2749] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 13:09:49.154029 14367 consensus_peers.cc:597] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:49.219770 14367 consensus_peers.cc:597] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:09:49.243649 14366 consensus_peers.cc:597] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 -> Peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Couldn't send request to peer 35ecb005831740438d7537dd4b840e03. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:49.265534 22009 raft_consensus.cc:493] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:49.266113 22009 raft_consensus.cc:515] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:49.267910 22009 leader_election.cc:290] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:09:49.272132 14367 leader_election.cc:336] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:49.272828 14366 leader_election.cc:336] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:49.273339 14366 leader_election.cc:304] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:49.274048 22009 raft_consensus.cc:2749] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:49.333954 22023 raft_consensus.cc:493] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:49.334592 22023 raft_consensus.cc:515] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:49.336580 22023 leader_election.cc:290] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:09:49.340723 14367 leader_election.cc:336] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:49.344105 22023 raft_consensus.cc:493] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:49.344553 22023 raft_consensus.cc:515] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:49.346419 22023 leader_election.cc:290] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:09:49.351670 14367 leader_election.cc:336] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:49.359032 14366 leader_election.cc:336] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:49.359820 14366 leader_election.cc:304] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:49.360920 22023 raft_consensus.cc:2749] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:49.362190 14366 leader_election.cc:336] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
W20260709 13:09:49.362214 14367 consensus_peers.cc:597] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:09:49.362895 14366 leader_election.cc:304] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:49.363732 22023 raft_consensus.cc:2749] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:49.462667 14367 consensus_peers.cc:597] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:09:49.567257 14367 consensus_peers.cc:597] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:09:49.578763 22023 raft_consensus.cc:493] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:49.579218 22023 raft_consensus.cc:515] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:49.581138 22023 leader_election.cc:290] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:09:49.585779 14366 leader_election.cc:336] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
W20260709 13:09:49.587438 14367 leader_election.cc:336] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:49.587869 14367 leader_election.cc:304] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:49.588464 22023 raft_consensus.cc:2749] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:49.615556 22023 raft_consensus.cc:493] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:49.616061 22023 raft_consensus.cc:515] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:49.622627 22023 leader_election.cc:290] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:49.626752 14367 leader_election.cc:336] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:49.627525 14368 leader_election.cc:336] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Network error: Client connection negotiation failed: client connection to 127.12.76.131:46015: connect: Connection refused (error 111)
I20260709 13:09:49.627876 14368 leader_election.cc:304] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:49.628607 22009 raft_consensus.cc:2749] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:09:49.629120 22023 raft_consensus.cc:493] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:49.629575 22023 raft_consensus.cc:515] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
W20260709 13:09:49.635571 14367 leader_election.cc:336] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:49.636089 14366 leader_election.cc:336] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:49.636472 14366 leader_election.cc:304] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:49.637048 22009 raft_consensus.cc:2749] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:49.637298 22023 leader_election.cc:290] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
I20260709 13:09:49.645990 12594 tablet_server.cc:196] TabletServer@127.12.76.131:0 shutdown complete.
I20260709 13:09:49.658975 22023 raft_consensus.cc:493] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 35ecb005831740438d7537dd4b840e03)
I20260709 13:09:49.660267 22023 raft_consensus.cc:515] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:49.662616 22023 leader_election.cc:290] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047)
W20260709 13:09:49.667268 14367 leader_election.cc:336] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:49.667840 14366 leader_election.cc:336] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:49.668300 14366 leader_election.cc:304] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:49.668939 22023 raft_consensus.cc:2749] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:49.696852 14367 consensus_peers.cc:597] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 -> Peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Couldn't send request to peer b9d194f45e044e0988d5de1a99e5cd02. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:09:49.746979 12594 tablet_server.cc:179] TabletServer@127.12.76.132:0 shutting down...
I20260709 13:09:49.785131 22009 raft_consensus.cc:493] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:49.785902 22023 raft_consensus.cc:493] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:49.785975 22009 raft_consensus.cc:515] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:49.788239 22002 raft_consensus.cc:493] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:49.788918 22002 raft_consensus.cc:515] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:49.789659 22009 leader_election.cc:290] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:49.790138 22009 raft_consensus.cc:493] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:49.791000 22002 leader_election.cc:290] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:49.790547 22009 raft_consensus.cc:515] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:49.787000 22023 raft_consensus.cc:515] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:49.801017 22023 leader_election.cc:290] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:49.803506 14367 leader_election.cc:336] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:49.803972 14367 leader_election.cc:336] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:49.807029 14367 leader_election.cc:336] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:49.812496 22009 leader_election.cc:290] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:49.813138 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:09:49.813295 14366 leader_election.cc:336] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:49.814178 12594 tablet_replica.cc:333] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.814980 12594 raft_consensus.cc:2243] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.816213 12594 raft_consensus.cc:2272] T c9e22f0634b34971aed9c5b948f3275e P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.819195 12594 tablet_replica.cc:333] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
W20260709 13:09:49.819300 14368 leader_election.cc:336] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Network error: Client connection negotiation failed: client connection to 127.12.76.131:46015: connect: Connection refused (error 111)
I20260709 13:09:49.819788 14368 leader_election.cc:304] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:49.820015 12594 raft_consensus.cc:2243] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.820654 12594 raft_consensus.cc:2272] T 0b0054f48c4947acaea83521993a8f01 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.821183 22009 raft_consensus.cc:2749] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:49.820626 14368 leader_election.cc:336] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Network error: Client connection negotiation failed: client connection to 127.12.76.131:46015: connect: Connection refused (error 111)
I20260709 13:09:49.823009 14368 leader_election.cc:304] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:49.823449 12594 tablet_replica.cc:333] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.823808 22009 raft_consensus.cc:2749] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:09:49.824319 12594 raft_consensus.cc:2243] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.825549 12594 raft_consensus.cc:2272] T ac05b1933cb74e488759c38bd76d8d00 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:49.826783 14368 leader_election.cc:336] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Network error: Client connection negotiation failed: client connection to 127.12.76.131:46015: connect: Connection refused (error 111)
I20260709 13:09:49.827227 14368 leader_election.cc:304] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:49.827914 22009 raft_consensus.cc:2749] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:49.828145 14368 leader_election.cc:336] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Network error: Client connection negotiation failed: client connection to 127.12.76.131:46015: connect: Connection refused (error 111)
I20260709 13:09:49.828326 12594 tablet_replica.cc:333] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.828614 14368 leader_election.cc:304] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:49.829263 12594 raft_consensus.cc:2243] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.829377 22009 raft_consensus.cc:2749] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:09:49.829962 12594 raft_consensus.cc:2272] T d07097a615d345468e43de064c67057d P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.832047 12594 tablet_replica.cc:333] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.832690 12594 raft_consensus.cc:2243] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.833873 12594 raft_consensus.cc:2272] T f09ef105d67b41dba510b44a6567d790 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.834385 22009 raft_consensus.cc:493] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.834824 22009 raft_consensus.cc:515] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:49.836297 12594 tablet_replica.cc:333] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.836982 22009 leader_election.cc:290] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:49.837141 12594 raft_consensus.cc:2243] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.837966 12594 raft_consensus.cc:2272] T 82aefa8c282f4143b3c3d55f5a4d0bcf P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.840726 12594 tablet_replica.cc:333] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.841598 12594 raft_consensus.cc:2243] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.842203 12594 raft_consensus.cc:2272] T 79adc3f3cf6a48518016b2d56c531dbd P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:49.843302 14368 leader_election.cc:336] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Network error: Client connection negotiation failed: client connection to 127.12.76.131:46015: connect: Connection refused (error 111)
W20260709 13:09:49.843897 14366 leader_election.cc:336] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:49.844307 14366 leader_election.cc:304] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:49.845042 12594 tablet_replica.cc:333] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.844965 22009 raft_consensus.cc:2749] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:49.845631 22028 raft_consensus.cc:493] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:49.845909 12594 raft_consensus.cc:2243] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.846120 22028 raft_consensus.cc:515] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35ecb005831740438d7537dd4b840e03" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36047 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:49.846879 12594 raft_consensus.cc:2272] T 2d32f086650d45b7b7ae3e0d858e360b P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.847043 22009 raft_consensus.cc:493] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:49.847690 22009 raft_consensus.cc:515] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:49.848301 22028 leader_election.cc:290] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:49.849597 12594 tablet_replica.cc:333] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.850450 12594 raft_consensus.cc:2243] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.850759 22009 leader_election.cc:290] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
W20260709 13:09:49.853955 14367 leader_election.cc:336] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:09:49.855046 22028 raft_consensus.cc:670] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
W20260709 13:09:49.855211 14368 leader_election.cc:336] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Network error: Client connection negotiation failed: client connection to 127.12.76.131:46015: connect: Connection refused (error 111)
W20260709 13:09:49.855816 14368 leader_election.cc:336] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Network error: Client connection negotiation failed: client connection to 127.12.76.131:46015: connect: Connection refused (error 111)
I20260709 13:09:49.856189 14368 leader_election.cc:304] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:49.856868 22028 raft_consensus.cc:2749] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:49.856382 12594 raft_consensus.cc:2272] T 5171bcd42ea14ad3af7399ab8c6a7e35 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:49.859244 14366 leader_election.cc:336] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 35ecb005831740438d7537dd4b840e03 (127.12.76.130:36047): Network error: Client connection negotiation failed: client connection to 127.12.76.130:36047: connect: Connection refused (error 111)
I20260709 13:09:49.859670 14366 leader_election.cc:304] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: 35ecb005831740438d7537dd4b840e03, b5029654a4384e43a68eb67b794949b7
I20260709 13:09:49.860363 22009 raft_consensus.cc:2749] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:49.861449 12594 tablet_replica.cc:333] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.862337 12594 raft_consensus.cc:2243] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.863732 12594 raft_consensus.cc:2272] T b7aeef8df5a945efb8666f30fe979ab7 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.866086 12594 tablet_replica.cc:333] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.866701 12594 raft_consensus.cc:2243] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.867276 12594 raft_consensus.cc:2272] T 4648ad5742bd4fe09563b72eb2dfc059 P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.869148 12594 tablet_replica.cc:333] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.869748 12594 raft_consensus.cc:2243] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.870282 12594 raft_consensus.cc:2272] T 4c6f358793c54a8fa2409a5d4c5505f8 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.872226 12594 tablet_replica.cc:333] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.872749 12594 raft_consensus.cc:2243] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.873291 12594 raft_consensus.cc:2272] T ebc19cb1c68943cba711cd721c8caa91 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.875208 12594 tablet_replica.cc:333] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.875751 12594 raft_consensus.cc:2243] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.876688 12594 raft_consensus.cc:2272] T 536b1fc131984687bf3b13417507e21d P ceb06175847b428ea8bd77055fcddf58 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.878489 12594 tablet_replica.cc:333] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.879084 12594 raft_consensus.cc:2243] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.879640 12594 raft_consensus.cc:2272] T 44fb07fff88a4dcf97841a29f2641f66 P ceb06175847b428ea8bd77055fcddf58 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.881383 12594 tablet_replica.cc:333] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.881889 12594 raft_consensus.cc:2243] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.882707 12594 raft_consensus.cc:2272] T c7cc0929e3a64836993d9ee880b12800 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.884519 12594 tablet_replica.cc:333] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.885041 12594 raft_consensus.cc:2243] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.885466 12594 raft_consensus.cc:2272] T ab01257d4e56488eba41a0ce5c5e9954 P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.887209 12594 tablet_replica.cc:333] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.887753 12594 raft_consensus.cc:2243] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.888514 12594 raft_consensus.cc:2272] T 2d67d303d4784301a07a1fa014f50b98 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.890442 12594 tablet_replica.cc:333] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.890960 12594 raft_consensus.cc:2243] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.891829 12594 raft_consensus.cc:2272] T cff75d4a417e4aeab081acad01b03c36 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.893819 12594 tablet_replica.cc:333] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.894317 12594 raft_consensus.cc:2243] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.894799 12594 raft_consensus.cc:2272] T 49638a262b1d4ba9b26cde1d408bf7ac P ceb06175847b428ea8bd77055fcddf58 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.896791 12594 tablet_replica.cc:333] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.896852 22009 raft_consensus.cc:493] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader b5029654a4384e43a68eb67b794949b7)
I20260709 13:09:49.897560 12594 raft_consensus.cc:2243] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.897409 22009 raft_consensus.cc:515] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9d194f45e044e0988d5de1a99e5cd02" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37533 } } peers { permanent_uuid: "b5029654a4384e43a68eb67b794949b7" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46015 } } peers { permanent_uuid: "ceb06175847b428ea8bd77055fcddf58" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 43039 } attrs { promote: false } }
I20260709 13:09:49.898649 12594 raft_consensus.cc:2272] T 3618fd55609843fca70082d3565b459b P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.900309 22009 leader_election.cc:290] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533), b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015)
I20260709 13:09:49.901212 12594 tablet_replica.cc:333] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.903847 12594 raft_consensus.cc:2243] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:49.904052 14367 leader_election.cc:336] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
I20260709 13:09:49.904560 12594 raft_consensus.cc:2272] T 8591822f3dc3430e935360afdb260fce P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:49.906383 14368 leader_election.cc:336] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b5029654a4384e43a68eb67b794949b7 (127.12.76.131:46015): Network error: Client connection negotiation failed: client connection to 127.12.76.131:46015: connect: Connection refused (error 111)
I20260709 13:09:49.906795 14368 leader_election.cc:304] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb06175847b428ea8bd77055fcddf58; no voters: b5029654a4384e43a68eb67b794949b7, b9d194f45e044e0988d5de1a99e5cd02
I20260709 13:09:49.906992 12594 tablet_replica.cc:333] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.907506 22009 raft_consensus.cc:2749] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:09:49.907832 12594 raft_consensus.cc:2243] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.908851 12594 raft_consensus.cc:2272] T eb0e4fb02d3a45d4a6cc322c544fbf80 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.910771 12594 tablet_replica.cc:333] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.911279 12594 raft_consensus.cc:2243] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.911769 12594 raft_consensus.cc:2272] T fe5150c5d9c445549ec6d199f2cd70e0 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.914611 12594 tablet_replica.cc:333] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.915136 12594 raft_consensus.cc:2243] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.915948 12594 raft_consensus.cc:2272] T 82e0eeb1582143a09acf311171812faa P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.917687 12594 tablet_replica.cc:333] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.918207 12594 raft_consensus.cc:2243] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.918696 12594 raft_consensus.cc:2272] T 5fbcfa22d8b54ed5997bc6453bdf0fd3 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.920558 12594 tablet_replica.cc:333] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.921101 12594 raft_consensus.cc:2243] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.921795 12594 pending_rounds.cc:70] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58: Trying to abort 1 pending ops.
I20260709 13:09:49.921943 12594 pending_rounds.cc:77] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58: Aborting op as it isn't in flight: id { term: 19 index: 15 } timestamp: 7305636200865992704 op_type: NO_OP noop_request { }
I20260709 13:09:49.922228 12594 raft_consensus.cc:2889] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 19 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:49.922493 12594 raft_consensus.cc:2272] T 9c37f25da53241cd98c09e4525d9e23c P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.924271 12594 tablet_replica.cc:333] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.924789 12594 raft_consensus.cc:2243] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.925212 12594 raft_consensus.cc:2272] T 0ff0635cc3464389804f1758fde23012 P ceb06175847b428ea8bd77055fcddf58 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.926908 12594 tablet_replica.cc:333] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.927453 12594 raft_consensus.cc:2243] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.928153 12594 pending_rounds.cc:70] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58: Trying to abort 1 pending ops.
I20260709 13:09:49.928339 12594 pending_rounds.cc:77] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58: Aborting op as it isn't in flight: id { term: 22 index: 18 } timestamp: 7305636200716886016 op_type: NO_OP noop_request { }
I20260709 13:09:49.928612 12594 raft_consensus.cc:2889] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 22 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:49.928934 12594 raft_consensus.cc:2272] T ac7aedfecb9c482a9cf59234dff1e9f8 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.930778 12594 tablet_replica.cc:333] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.931324 12594 raft_consensus.cc:2243] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.931900 12594 raft_consensus.cc:2272] T 68418f30a686438bba0d6ab02efa0986 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.933851 12594 tablet_replica.cc:333] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.934338 12594 raft_consensus.cc:2243] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.934823 12594 raft_consensus.cc:2272] T 3e4bec6398d84f67ad839268ec8d2a12 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.936831 12594 tablet_replica.cc:333] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.937378 12594 raft_consensus.cc:2243] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.938135 12594 raft_consensus.cc:2272] T 14765cc3066247a49b29adae5e893ab8 P ceb06175847b428ea8bd77055fcddf58 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.940052 12594 tablet_replica.cc:333] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.940542 12594 raft_consensus.cc:2243] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.941313 12594 raft_consensus.cc:2272] T 9a3fcea1abf04503bc26d451a56ed222 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.943261 12594 tablet_replica.cc:333] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.943782 12594 raft_consensus.cc:2243] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.944339 12594 raft_consensus.cc:2272] T b1367b7b65234b7fbaacfcd765b3a6e5 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.946314 12594 tablet_replica.cc:333] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.946825 12594 raft_consensus.cc:2243] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.947286 12594 raft_consensus.cc:2272] T bb9ba3c4f4a14a57b28d5cf2b9cf5afd P ceb06175847b428ea8bd77055fcddf58 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.949254 12594 tablet_replica.cc:333] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.949751 12594 raft_consensus.cc:2243] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.950224 12594 raft_consensus.cc:2272] T fa2169d517e24498a35dae28da79c931 P ceb06175847b428ea8bd77055fcddf58 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.952023 12594 tablet_replica.cc:333] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.952507 12594 raft_consensus.cc:2243] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.952942 12594 raft_consensus.cc:2272] T ff2185b760234a0280587d4ea3f18b8a P ceb06175847b428ea8bd77055fcddf58 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.954732 12594 tablet_replica.cc:333] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.955233 12594 raft_consensus.cc:2243] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.956163 12594 raft_consensus.cc:2272] T 397ec99b74c24481a69c1f4a7c294a73 P ceb06175847b428ea8bd77055fcddf58 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.957824 12594 tablet_replica.cc:333] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.958303 12594 raft_consensus.cc:2243] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.959192 12594 raft_consensus.cc:2272] T f3cfef71353344f180965689d6ec9166 P ceb06175847b428ea8bd77055fcddf58 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.960896 12594 tablet_replica.cc:333] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.961421 12594 raft_consensus.cc:2243] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.962162 12594 raft_consensus.cc:2272] T 2e2aec8e942e44d9b699829a1e6de4b3 P ceb06175847b428ea8bd77055fcddf58 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.963994 12594 tablet_replica.cc:333] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.964501 12594 raft_consensus.cc:2243] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.965065 12594 raft_consensus.cc:2272] T b022fc3eb21246ff9f62e8a747bac6c4 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.966845 12594 tablet_replica.cc:333] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.967401 12594 raft_consensus.cc:2243] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.968242 12594 raft_consensus.cc:2272] T de09d01498e547e591ce4ebe62e59488 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.970131 12594 tablet_replica.cc:333] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.970669 12594 raft_consensus.cc:2243] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.971402 12594 raft_consensus.cc:2272] T 8446dab661a64f9b8075d7586f1197f4 P ceb06175847b428ea8bd77055fcddf58 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.973245 12594 tablet_replica.cc:333] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58: stopping tablet replica
I20260709 13:09:49.973698 12594 raft_consensus.cc:2243] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.974150 12594 raft_consensus.cc:2272] T e7c254367a594ceb8d4a3db25a715ae1 P ceb06175847b428ea8bd77055fcddf58 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:50.861524 12594 tablet_server.cc:196] TabletServer@127.12.76.132:0 shutdown complete.
I20260709 13:09:50.945298 12594 master.cc:562] Master@127.12.76.190:43389 shutting down...
W20260709 13:09:50.991170 13662 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:09:50.991456 13662 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:09:50.991701 13662 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:09:51.120744 13600 catalog_manager.cc:4755] TS b9d194f45e044e0988d5de1a99e5cd02 (127.12.76.129:37533): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 536b1fc131984687bf3b13417507e21d: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37533: connect: Connection refused (error 111)
W20260709 13:10:22.462987 13599 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.76.132:43039: connect: Connection refused (error 111) [suppressed 121 similar messages]
W20260709 13:10:22.466832 13599 catalog_manager.cc:4755] TS ceb06175847b428ea8bd77055fcddf58 (127.12.76.132:43039): ChangeConfig:REMOVE_PEER RPC failed for tablet f09ef105d67b41dba510b44a6567d790: Network error: Client connection negotiation failed: client connection to 127.12.76.132:43039: connect: Connection refused (error 111)
I20260709 13:10:24.169792 12594 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.170960 12594 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.171407 12594 tablet_replica.cc:333] T 00000000000000000000000000000000 P a8849f59e7a642f3b694e3e403857ae7: stopping tablet replica
I20260709 13:10:24.397771 12594 master.cc:584] Master@127.12.76.190:43389 shutdown complete.
I20260709 13:10:24.449106 12594 test_util.cc:182] -----------------------------------------------
I20260709 13:10:24.449331 12594 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602303087285-12594-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (297378 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:10:24.453008 12594 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.76.190:33127
I20260709 13:10:24.454303 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:24.460343 22036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:24.460409 22037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:24.461313 22039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:24.462512 12594 server_base.cc:1061] running on GCE node
I20260709 13:10:24.466233 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:24.466435 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:24.466550 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602624466540 us; error 0 us; skew 500 ppm
I20260709 13:10:24.467005 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:24.469385 12594 webserver.cc:533] Webserver started at http://127.12.76.190:35495/ using document root <none> and password file <none>
I20260709 13:10:24.469815 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:24.470008 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:24.470232 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:24.471493 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/master-0-root/instance:
uuid: "c24ffb121ed349ad832a6c8110c109ff"
format_stamp: "Formatted at 2026-07-09 13:10:24 on dist-test-slave-th5x"
I20260709 13:10:24.475723 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:10:24.478839 22044 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:24.479624 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:24.479918 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/master-0-root
uuid: "c24ffb121ed349ad832a6c8110c109ff"
format_stamp: "Formatted at 2026-07-09 13:10:24 on dist-test-slave-th5x"
I20260709 13:10:24.480196 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:24.499560 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:24.500756 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:24.539983 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.190:33127
I20260709 13:10:24.540086 22095 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.190:33127 every 8 connection(s)
I20260709 13:10:24.544299 22096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.555699 22096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff: Bootstrap starting.
I20260709 13:10:24.560590 22096 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.564990 22096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff: No bootstrap required, opened a new log
I20260709 13:10:24.567322 22096 raft_consensus.cc:359] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c24ffb121ed349ad832a6c8110c109ff" member_type: VOTER }
I20260709 13:10:24.567896 22096 raft_consensus.cc:385] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.568095 22096 raft_consensus.cc:740] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c24ffb121ed349ad832a6c8110c109ff, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.568743 22096 consensus_queue.cc:260] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c24ffb121ed349ad832a6c8110c109ff" member_type: VOTER }
I20260709 13:10:24.569239 22096 raft_consensus.cc:399] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:24.569456 22096 raft_consensus.cc:493] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:24.569689 22096 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.574352 22096 raft_consensus.cc:515] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c24ffb121ed349ad832a6c8110c109ff" member_type: VOTER }
I20260709 13:10:24.574887 22096 leader_election.cc:304] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c24ffb121ed349ad832a6c8110c109ff; no voters: 
I20260709 13:10:24.576169 22096 leader_election.cc:290] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:24.576582 22099 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:24.577962 22099 raft_consensus.cc:697] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff [term 1 LEADER]: Becoming Leader. State: Replica: c24ffb121ed349ad832a6c8110c109ff, State: Running, Role: LEADER
I20260709 13:10:24.578687 22099 consensus_queue.cc:237] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c24ffb121ed349ad832a6c8110c109ff" member_type: VOTER }
I20260709 13:10:24.579520 22096 sys_catalog.cc:565] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:24.586176 22101 sys_catalog.cc:455] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader c24ffb121ed349ad832a6c8110c109ff. Latest consensus state: current_term: 1 leader_uuid: "c24ffb121ed349ad832a6c8110c109ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c24ffb121ed349ad832a6c8110c109ff" member_type: VOTER } }
I20260709 13:10:24.586360 22100 sys_catalog.cc:455] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c24ffb121ed349ad832a6c8110c109ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c24ffb121ed349ad832a6c8110c109ff" member_type: VOTER } }
I20260709 13:10:24.586917 22100 sys_catalog.cc:458] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:24.586889 22101 sys_catalog.cc:458] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:24.589164 22108 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:24.593923 22108 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:24.597206 12594 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:24.603135 22108 catalog_manager.cc:1383] Generated new cluster ID: 9729ac5936df437eb6c5d0ffe6740e0e
I20260709 13:10:24.603467 22108 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:24.627972 22108 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:24.629205 22108 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:24.642642 22108 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff: Generated new TSK 0
I20260709 13:10:24.643225 22108 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:24.664528 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:24.671303 22117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:24.672348 22118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:24.673664 22120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:24.674963 12594 server_base.cc:1061] running on GCE node
I20260709 13:10:24.677635 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:24.677884 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:24.678119 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602624678096 us; error 0 us; skew 500 ppm
I20260709 13:10:24.678719 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:24.681403 12594 webserver.cc:533] Webserver started at http://127.12.76.129:45899/ using document root <none> and password file <none>
I20260709 13:10:24.682075 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:24.682289 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:24.682612 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:24.684023 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/ts-0-root/instance:
uuid: "5d515385609945e5837e85b77de385e2"
format_stamp: "Formatted at 2026-07-09 13:10:24 on dist-test-slave-th5x"
I20260709 13:10:24.688902 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:24.692495 22125 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:24.693459 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:10:24.693856 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/ts-0-root
uuid: "5d515385609945e5837e85b77de385e2"
format_stamp: "Formatted at 2026-07-09 13:10:24 on dist-test-slave-th5x"
I20260709 13:10:24.694182 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:24.720880 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:24.722021 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:24.723505 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:24.725837 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:24.726004 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:24.726292 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:24.726445 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:24.768661 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.129:33591
I20260709 13:10:24.768894 22187 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.129:33591 every 8 connection(s)
I20260709 13:10:24.774163 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:24.781453 22192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:24.782944 22193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:24.786578 12594 server_base.cc:1061] running on GCE node
W20260709 13:10:24.787177 22195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:24.788203 22188 heartbeater.cc:344] Connected to a master server at 127.12.76.190:33127
I20260709 13:10:24.788586 22188 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:24.789369 22188 heartbeater.cc:507] Master 127.12.76.190:33127 requested a full tablet report, sending...
I20260709 13:10:24.789742 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:24.789979 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:24.790151 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602624790115 us; error 0 us; skew 500 ppm
I20260709 13:10:24.790952 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:24.792124 22061 ts_manager.cc:194] Registered new tserver with Master: 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:24.793658 12594 webserver.cc:533] Webserver started at http://127.12.76.130:33835/ using document root <none> and password file <none>
I20260709 13:10:24.794173 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:24.794390 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:24.794477 22061 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49892
I20260709 13:10:24.794662 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:24.796164 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/ts-1-root/instance:
uuid: "371d38ec3c7f493e9aea62dae121e565"
format_stamp: "Formatted at 2026-07-09 13:10:24 on dist-test-slave-th5x"
I20260709 13:10:24.801446 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:10:24.805065 22200 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:24.806032 12594 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:10:24.806391 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/ts-1-root
uuid: "371d38ec3c7f493e9aea62dae121e565"
format_stamp: "Formatted at 2026-07-09 13:10:24 on dist-test-slave-th5x"
I20260709 13:10:24.806707 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:24.824728 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:24.826079 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:24.827725 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:24.830215 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:24.830473 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:24.830732 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:24.830925 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:24.875983 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.130:43835
I20260709 13:10:24.876093 22262 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.130:43835 every 8 connection(s)
I20260709 13:10:24.881210 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:24.889226 22266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:24.891220 22267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:24.894677 22269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:24.895310 22263 heartbeater.cc:344] Connected to a master server at 127.12.76.190:33127
I20260709 13:10:24.895771 22263 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:24.895962 12594 server_base.cc:1061] running on GCE node
I20260709 13:10:24.897112 22263 heartbeater.cc:507] Master 127.12.76.190:33127 requested a full tablet report, sending...
I20260709 13:10:24.897253 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:24.897540 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:24.897745 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602624897725 us; error 0 us; skew 500 ppm
I20260709 13:10:24.898454 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:24.899385 22061 ts_manager.cc:194] Registered new tserver with Master: 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:24.901077 12594 webserver.cc:533] Webserver started at http://127.12.76.131:34253/ using document root <none> and password file <none>
I20260709 13:10:24.901149 22061 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49894
I20260709 13:10:24.901650 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:24.901890 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:24.902164 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:24.903705 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/ts-2-root/instance:
uuid: "66d3606ce30b4661b5d62d403d7abca0"
format_stamp: "Formatted at 2026-07-09 13:10:24 on dist-test-slave-th5x"
I20260709 13:10:24.908257 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:24.911648 22274 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:24.912403 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:10:24.912703 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/ts-2-root
uuid: "66d3606ce30b4661b5d62d403d7abca0"
format_stamp: "Formatted at 2026-07-09 13:10:24 on dist-test-slave-th5x"
I20260709 13:10:24.912962 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:24.935802 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:24.937031 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:24.938521 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:24.940814 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:24.941053 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:24.941299 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:24.941473 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:24.983031 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.131:46871
I20260709 13:10:24.983146 22336 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.131:46871 every 8 connection(s)
I20260709 13:10:24.988075 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:24.995147 22340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:24.997344 22341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:24.998765 12594 server_base.cc:1061] running on GCE node
W20260709 13:10:24.999155 22343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:25.000317 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:25.000612 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:25.000845 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602625000826 us; error 0 us; skew 500 ppm
I20260709 13:10:25.001585 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:25.001750 22337 heartbeater.cc:344] Connected to a master server at 127.12.76.190:33127
I20260709 13:10:25.002198 22337 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:25.003188 22337 heartbeater.cc:507] Master 127.12.76.190:33127 requested a full tablet report, sending...
I20260709 13:10:25.004390 12594 webserver.cc:533] Webserver started at http://127.12.76.132:36059/ using document root <none> and password file <none>
I20260709 13:10:25.005009 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:25.005242 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:25.005548 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:25.005543 22061 ts_manager.cc:194] Registered new tserver with Master: 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:25.006999 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/ts-3-root/instance:
uuid: "edd63b54133d4c8d9149d57a2886916b"
format_stamp: "Formatted at 2026-07-09 13:10:25 on dist-test-slave-th5x"
I20260709 13:10:25.007064 22061 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49896
I20260709 13:10:25.011962 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 13:10:25.016084 22348 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:25.016867 12594 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:10:25.017185 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/ts-3-root
uuid: "edd63b54133d4c8d9149d57a2886916b"
format_stamp: "Formatted at 2026-07-09 13:10:25 on dist-test-slave-th5x"
I20260709 13:10:25.017496 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:25.035857 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:25.037102 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:25.038568 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:25.040851 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:25.041090 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:25.041335 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:25.041514 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:25.084085 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.132:45017
I20260709 13:10:25.084206 22410 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.132:45017 every 8 connection(s)
I20260709 13:10:25.097966 22411 heartbeater.cc:344] Connected to a master server at 127.12.76.190:33127
I20260709 13:10:25.098371 22411 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:25.099155 22411 heartbeater.cc:507] Master 127.12.76.190:33127 requested a full tablet report, sending...
I20260709 13:10:25.101202 22061 ts_manager.cc:194] Registered new tserver with Master: edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:25.102130 12594 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.01484156s
I20260709 13:10:25.102747 22061 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49902
I20260709 13:10:25.128310 22061 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49908:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:10:25.381863 22227 tablet_service.cc:1511] Processing CreateTablet for tablet c9fb0f415f654f798baa3cccc149e8a3 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:10:25.382107 22228 tablet_service.cc:1511] Processing CreateTablet for tablet 5ced150f7b0b41c5a9a55795474c3eed (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:10:25.383527 22227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9fb0f415f654f798baa3cccc149e8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.384099 22223 tablet_service.cc:1511] Processing CreateTablet for tablet 181a60684715425284af6a13cc16242f (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:10:25.386176 22224 tablet_service.cc:1511] Processing CreateTablet for tablet 44bb47d9fadc476296b95dba1bf4d037 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:10:25.386986 22223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 181a60684715425284af6a13cc16242f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.388613 22225 tablet_service.cc:1511] Processing CreateTablet for tablet bb5f23465fe44a799f3521c814b38d55 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:10:25.389536 22228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ced150f7b0b41c5a9a55795474c3eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.389430 22222 tablet_service.cc:1511] Processing CreateTablet for tablet 339b03c27dab449090201492ec507025 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:10:25.391115 22222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 339b03c27dab449090201492ec507025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.391019 22226 tablet_service.cc:1511] Processing CreateTablet for tablet c7b7f9ed1b11429d98f831e122707ae2 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:10:25.392439 22226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7b7f9ed1b11429d98f831e122707ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.394624 22224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44bb47d9fadc476296b95dba1bf4d037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.396358 22225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb5f23465fe44a799f3521c814b38d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.396296 22221 tablet_service.cc:1511] Processing CreateTablet for tablet 63af5dcbd69043a6a704a5fdedd3d371 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:10:25.398478 22221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63af5dcbd69043a6a704a5fdedd3d371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.405443 22220 tablet_service.cc:1511] Processing CreateTablet for tablet 3a65572e11044c94ba6e4bf799385437 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:10:25.406944 22220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a65572e11044c94ba6e4bf799385437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.421641 22376 tablet_service.cc:1511] Processing CreateTablet for tablet af8b0a3da29749fdb5bffa995ff8ac1e (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:10:25.423810 22376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af8b0a3da29749fdb5bffa995ff8ac1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.431804 22219 tablet_service.cc:1511] Processing CreateTablet for tablet 40b118b701f94b3bacbbca2df47fe5bd (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:10:25.433326 22219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40b118b701f94b3bacbbca2df47fe5bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.445726 22375 tablet_service.cc:1511] Processing CreateTablet for tablet c9fb0f415f654f798baa3cccc149e8a3 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:10:25.447751 22375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9fb0f415f654f798baa3cccc149e8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.457919 22374 tablet_service.cc:1511] Processing CreateTablet for tablet c7b7f9ed1b11429d98f831e122707ae2 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:10:25.458827 22372 tablet_service.cc:1511] Processing CreateTablet for tablet aa3c95d8e81a462283bc0799ade2104b (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:10:25.460068 22374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7b7f9ed1b11429d98f831e122707ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.460796 22372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa3c95d8e81a462283bc0799ade2104b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.462323 22373 tablet_service.cc:1511] Processing CreateTablet for tablet 44bb47d9fadc476296b95dba1bf4d037 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:10:25.463757 22373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44bb47d9fadc476296b95dba1bf4d037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.464629 22153 tablet_service.cc:1511] Processing CreateTablet for tablet af8b0a3da29749fdb5bffa995ff8ac1e (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:10:25.466015 22153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af8b0a3da29749fdb5bffa995ff8ac1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.466105 22149 tablet_service.cc:1511] Processing CreateTablet for tablet 44bb47d9fadc476296b95dba1bf4d037 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:10:25.468604 22152 tablet_service.cc:1511] Processing CreateTablet for tablet 5ced150f7b0b41c5a9a55795474c3eed (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:10:25.469007 22226 tablet_service.cc:1511] Processing CreateTablet for tablet 2959be4ebd674047ba6d57a27b8b5865 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:10:25.469807 22147 tablet_service.cc:1511] Processing CreateTablet for tablet 339b03c27dab449090201492ec507025 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:10:25.470376 22226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2959be4ebd674047ba6d57a27b8b5865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.472187 22146 tablet_service.cc:1511] Processing CreateTablet for tablet 63af5dcbd69043a6a704a5fdedd3d371 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:10:25.472635 22150 tablet_service.cc:1511] Processing CreateTablet for tablet bb5f23465fe44a799f3521c814b38d55 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:10:25.470960 22151 tablet_service.cc:1511] Processing CreateTablet for tablet c9fb0f415f654f798baa3cccc149e8a3 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:10:25.474511 22145 tablet_service.cc:1511] Processing CreateTablet for tablet da53827c80a54c43a6cdcb57b857f7a3 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:10:25.476888 22144 tablet_service.cc:1511] Processing CreateTablet for tablet 40b118b701f94b3bacbbca2df47fe5bd (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:10:25.468611 22148 tablet_service.cc:1511] Processing CreateTablet for tablet aa3c95d8e81a462283bc0799ade2104b (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:10:25.479962 22149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44bb47d9fadc476296b95dba1bf4d037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.480633 22151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9fb0f415f654f798baa3cccc149e8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.481665 22147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 339b03c27dab449090201492ec507025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.482478 22145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da53827c80a54c43a6cdcb57b857f7a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.483819 22148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa3c95d8e81a462283bc0799ade2104b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.487099 22146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63af5dcbd69043a6a704a5fdedd3d371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.488508 22144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40b118b701f94b3bacbbca2df47fe5bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.489884 22152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ced150f7b0b41c5a9a55795474c3eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.491376 22150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb5f23465fe44a799f3521c814b38d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.516580 22219 tablet_service.cc:1511] Processing CreateTablet for tablet 4805089364594284ba715cf71e92f20c (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:10:25.518644 22219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4805089364594284ba715cf71e92f20c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.538136 22220 tablet_service.cc:1511] Processing CreateTablet for tablet 90ecf0583df84abeae688412d6870da7 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:10:25.540099 22220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90ecf0583df84abeae688412d6870da7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.561002 22371 tablet_service.cc:1511] Processing CreateTablet for tablet 63af5dcbd69043a6a704a5fdedd3d371 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:10:25.562374 22371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63af5dcbd69043a6a704a5fdedd3d371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.560777 22373 tablet_service.cc:1511] Processing CreateTablet for tablet 181a60684715425284af6a13cc16242f (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:10:25.565115 22373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 181a60684715425284af6a13cc16242f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.569111 22370 tablet_service.cc:1511] Processing CreateTablet for tablet da53827c80a54c43a6cdcb57b857f7a3 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:10:25.570509 22370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da53827c80a54c43a6cdcb57b857f7a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.572623 22369 tablet_service.cc:1511] Processing CreateTablet for tablet 3a65572e11044c94ba6e4bf799385437 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:10:25.573994 22369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a65572e11044c94ba6e4bf799385437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.574322 22153 tablet_service.cc:1511] Processing CreateTablet for tablet 2959be4ebd674047ba6d57a27b8b5865 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:10:25.575582 22153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2959be4ebd674047ba6d57a27b8b5865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.576519 22368 tablet_service.cc:1511] Processing CreateTablet for tablet 2959be4ebd674047ba6d57a27b8b5865 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:10:25.577855 22368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2959be4ebd674047ba6d57a27b8b5865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.579802 22367 tablet_service.cc:1511] Processing CreateTablet for tablet 69ff2881b0ad428984068a6150870c61 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:10:25.581175 22367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ff2881b0ad428984068a6150870c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.584544 22226 tablet_service.cc:1511] Processing CreateTablet for tablet 8f1e603414db46e7bf2cdd620118e39d (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:10:25.585780 22226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f1e603414db46e7bf2cdd620118e39d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.586216 22151 tablet_service.cc:1511] Processing CreateTablet for tablet 69ff2881b0ad428984068a6150870c61 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
W20260709 13:10:25.592275 22109 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:25.600800 22431 tablet_bootstrap.cc:492] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:25.611873 22302 tablet_service.cc:1511] Processing CreateTablet for tablet af8b0a3da29749fdb5bffa995ff8ac1e (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:10:25.604651 22151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ff2881b0ad428984068a6150870c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.613756 22302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af8b0a3da29749fdb5bffa995ff8ac1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.628793 22296 tablet_service.cc:1511] Processing CreateTablet for tablet 339b03c27dab449090201492ec507025 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:10:25.628981 22295 tablet_service.cc:1511] Processing CreateTablet for tablet da53827c80a54c43a6cdcb57b857f7a3 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:10:25.631254 22293 tablet_service.cc:1511] Processing CreateTablet for tablet 40b118b701f94b3bacbbca2df47fe5bd (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:10:25.640988 22294 tablet_service.cc:1511] Processing CreateTablet for tablet 3a65572e11044c94ba6e4bf799385437 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:10:25.648217 22297 tablet_service.cc:1511] Processing CreateTablet for tablet 181a60684715425284af6a13cc16242f (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:10:25.615384 22301 tablet_service.cc:1511] Processing CreateTablet for tablet 5ced150f7b0b41c5a9a55795474c3eed (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:10:25.618076 22299 tablet_service.cc:1511] Processing CreateTablet for tablet bb5f23465fe44a799f3521c814b38d55 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:10:25.616776 22300 tablet_service.cc:1511] Processing CreateTablet for tablet c7b7f9ed1b11429d98f831e122707ae2 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:10:25.619385 22298 tablet_service.cc:1511] Processing CreateTablet for tablet aa3c95d8e81a462283bc0799ade2104b (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:10:25.673944 22431 tablet_bootstrap.cc:654] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.676687 22372 tablet_service.cc:1511] Processing CreateTablet for tablet 4805089364594284ba715cf71e92f20c (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:10:25.678182 22372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4805089364594284ba715cf71e92f20c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.680142 22300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7b7f9ed1b11429d98f831e122707ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.680297 22434 tablet_bootstrap.cc:492] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:25.680958 22299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb5f23465fe44a799f3521c814b38d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.685300 22293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40b118b701f94b3bacbbca2df47fe5bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.686386 22373 tablet_service.cc:1511] Processing CreateTablet for tablet 8f1e603414db46e7bf2cdd620118e39d (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:10:25.687366 22298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa3c95d8e81a462283bc0799ade2104b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.687322 22374 tablet_service.cc:1511] Processing CreateTablet for tablet b570b00ae75a47cda3fcb47ad5f0f97c (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:10:25.703152 22297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 181a60684715425284af6a13cc16242f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.706347 22373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f1e603414db46e7bf2cdd620118e39d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.711741 22295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da53827c80a54c43a6cdcb57b857f7a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.717067 22434 tablet_bootstrap.cc:654] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.717849 22433 tablet_bootstrap.cc:492] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:25.715987 22374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b570b00ae75a47cda3fcb47ad5f0f97c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.739789 22431 tablet_bootstrap.cc:492] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:25.781404 22294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a65572e11044c94ba6e4bf799385437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.741446 22431 ts_tablet_manager.cc:1403] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.141s	user 0.016s	sys 0.000s
I20260709 13:10:25.794865 22296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 339b03c27dab449090201492ec507025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.796603 22433 tablet_bootstrap.cc:654] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.798213 22188 heartbeater.cc:499] Master 127.12.76.190:33127 was elected leader, sending a full tablet report...
I20260709 13:10:25.800238 22301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ced150f7b0b41c5a9a55795474c3eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.774829 22147 tablet_service.cc:1511] Processing CreateTablet for tablet 90ecf0583df84abeae688412d6870da7 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:10:25.821527 22147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90ecf0583df84abeae688412d6870da7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.821589 22225 tablet_service.cc:1511] Processing CreateTablet for tablet acf09c0982fd493caaf8c31bc1964c22 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:10:25.827602 22225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acf09c0982fd493caaf8c31bc1964c22. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:25.830585 22045 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.76.132:45017, user_credentials={real_user=slave}} blocked reactor thread for 67111.9us
I20260709 13:10:25.853042 22150 tablet_service.cc:1511] Processing CreateTablet for tablet b570b00ae75a47cda3fcb47ad5f0f97c (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:10:25.853861 22293 tablet_service.cc:1511] Processing CreateTablet for tablet 4805089364594284ba715cf71e92f20c (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:10:25.854751 22150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b570b00ae75a47cda3fcb47ad5f0f97c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.855314 22298 tablet_service.cc:1511] Processing CreateTablet for tablet 90ecf0583df84abeae688412d6870da7 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:10:25.855942 22293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4805089364594284ba715cf71e92f20c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.857131 22298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90ecf0583df84abeae688412d6870da7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:25.867648 22046 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.76.130:43835, user_credentials={real_user=slave}} blocked reactor thread for 76118.1us
I20260709 13:10:25.880365 22367 tablet_service.cc:1511] Processing CreateTablet for tablet acf09c0982fd493caaf8c31bc1964c22 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:10:25.881405 22227 tablet_service.cc:1511] Processing CreateTablet for tablet b9c1ffecc5b948bd8f3f48d9a7a40a96 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:10:25.882043 22367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acf09c0982fd493caaf8c31bc1964c22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.883008 22227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c1ffecc5b948bd8f3f48d9a7a40a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.882290 22298 tablet_service.cc:1511] Processing CreateTablet for tablet 69ff2881b0ad428984068a6150870c61 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:10:25.890779 22144 tablet_service.cc:1511] Processing CreateTablet for tablet b9c1ffecc5b948bd8f3f48d9a7a40a96 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:10:25.899554 22144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c1ffecc5b948bd8f3f48d9a7a40a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.904503 22263 heartbeater.cc:499] Master 127.12.76.190:33127 was elected leader, sending a full tablet report...
I20260709 13:10:25.917227 22299 tablet_service.cc:1511] Processing CreateTablet for tablet acf09c0982fd493caaf8c31bc1964c22 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:10:25.923528 22148 tablet_service.cc:1511] Processing CreateTablet for tablet 8f1e603414db46e7bf2cdd620118e39d (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:10:25.924958 22148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f1e603414db46e7bf2cdd620118e39d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.928207 22302 tablet_service.cc:1511] Processing CreateTablet for tablet b570b00ae75a47cda3fcb47ad5f0f97c (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:10:25.933633 22434 tablet_bootstrap.cc:492] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:25.934552 22434 ts_tablet_manager.cc:1403] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.255s	user 0.015s	sys 0.005s
I20260709 13:10:25.956256 22373 tablet_service.cc:1511] Processing CreateTablet for tablet 39c5c419abe445e9ba439d1a0792991e (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:10:25.957782 22373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39c5c419abe445e9ba439d1a0792991e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.958205 22226 tablet_service.cc:1511] Processing CreateTablet for tablet ebca88391e7141659bba4fdc89e8a954 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:10:25.958917 22299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acf09c0982fd493caaf8c31bc1964c22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.959483 22226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebca88391e7141659bba4fdc89e8a954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.957799 22372 tablet_service.cc:1511] Processing CreateTablet for tablet 3559a60bb91946b988a872f1f28f20f8 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:10:25.964470 22437 tablet_bootstrap.cc:492] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:25.964815 22372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3559a60bb91946b988a872f1f28f20f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.941298 22431 raft_consensus.cc:359] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:25.966596 22431 raft_consensus.cc:385] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.966912 22431 raft_consensus.cc:740] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.970182 22298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ff2881b0ad428984068a6150870c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.947722 22297 tablet_service.cc:1511] Processing CreateTablet for tablet b9c1ffecc5b948bd8f3f48d9a7a40a96 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:10:25.972404 22433 tablet_bootstrap.cc:492] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:25.973332 22433 ts_tablet_manager.cc:1403] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.256s	user 0.030s	sys 0.026s
I20260709 13:10:25.978101 22434 raft_consensus.cc:359] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:25.978943 22434 raft_consensus.cc:385] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.948608 22222 tablet_service.cc:1511] Processing CreateTablet for tablet 39c5c419abe445e9ba439d1a0792991e (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:10:25.982024 22222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39c5c419abe445e9ba439d1a0792991e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.972466 22297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c1ffecc5b948bd8f3f48d9a7a40a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.984068 22433 raft_consensus.cc:359] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:25.986766 22433 raft_consensus.cc:385] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.968995 22431 consensus_queue.cc:260] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:25.991047 22437 tablet_bootstrap.cc:654] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.991796 22302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b570b00ae75a47cda3fcb47ad5f0f97c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.993608 22149 tablet_service.cc:1511] Processing CreateTablet for tablet 3559a60bb91946b988a872f1f28f20f8 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:10:25.994846 22149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3559a60bb91946b988a872f1f28f20f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.996569 22374 tablet_service.cc:1511] Processing CreateTablet for tablet ebca88391e7141659bba4fdc89e8a954 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:10:25.998090 22374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebca88391e7141659bba4fdc89e8a954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.003284 22144 tablet_service.cc:1511] Processing CreateTablet for tablet 12df2e627ea748c5908bd073b917bf29 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:10:26.003532 22293 tablet_service.cc:1511] Processing CreateTablet for tablet 3559a60bb91946b988a872f1f28f20f8 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:10:26.004846 22144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12df2e627ea748c5908bd073b917bf29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.004846 22293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3559a60bb91946b988a872f1f28f20f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.004495 22151 tablet_service.cc:1511] Processing CreateTablet for tablet 39c5c419abe445e9ba439d1a0792991e (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:10:26.010042 22337 heartbeater.cc:499] Master 127.12.76.190:33127 was elected leader, sending a full tablet report...
I20260709 13:10:26.014496 22151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39c5c419abe445e9ba439d1a0792991e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.015326 22220 tablet_service.cc:1511] Processing CreateTablet for tablet 12df2e627ea748c5908bd073b917bf29 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:10:26.016737 22220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12df2e627ea748c5908bd073b917bf29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.991075 22433 raft_consensus.cc:740] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.024370 22433 consensus_queue.cc:260] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:25.979243 22434 raft_consensus.cc:740] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.031148 22434 consensus_queue.cc:260] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:26.056501 22367 tablet_service.cc:1511] Processing CreateTablet for tablet 56d963b71e2742f3a74e1bed72d29186 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:10:26.057916 22367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d963b71e2742f3a74e1bed72d29186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.063467 22153 tablet_service.cc:1511] Processing CreateTablet for tablet 56d963b71e2742f3a74e1bed72d29186 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:10:26.064982 22153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d963b71e2742f3a74e1bed72d29186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.066932 22433 ts_tablet_manager.cc:1434] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.005s
I20260709 13:10:26.083254 22431 ts_tablet_manager.cc:1434] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.288s	user 0.018s	sys 0.000s
I20260709 13:10:26.084434 22431 tablet_bootstrap.cc:492] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:26.085330 22295 tablet_service.cc:1511] Processing CreateTablet for tablet ebca88391e7141659bba4fdc89e8a954 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
W20260709 13:10:26.090094 22412 tablet.cc:2406] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:10:26.092250 22434 ts_tablet_manager.cc:1434] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.157s	user 0.016s	sys 0.001s
I20260709 13:10:26.093075 22411 heartbeater.cc:499] Master 127.12.76.190:33127 was elected leader, sending a full tablet report...
I20260709 13:10:26.093240 22433 tablet_bootstrap.cc:492] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:26.093430 22434 tablet_bootstrap.cc:492] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:26.102669 22433 tablet_bootstrap.cc:654] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.106465 22437 tablet_bootstrap.cc:492] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:26.107038 22437 ts_tablet_manager.cc:1403] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.158s	user 0.014s	sys 0.004s
I20260709 13:10:26.110265 22437 raft_consensus.cc:359] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:26.112131 22295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebca88391e7141659bba4fdc89e8a954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.114388 22298 tablet_service.cc:1511] Processing CreateTablet for tablet 12df2e627ea748c5908bd073b917bf29 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:10:26.116102 22148 tablet_service.cc:1511] Processing CreateTablet for tablet b14e4aeab76f42f7a5a63d191494a79c (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:10:26.116285 22226 tablet_service.cc:1511] Processing CreateTablet for tablet 56d963b71e2742f3a74e1bed72d29186 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:10:26.129267 22148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b14e4aeab76f42f7a5a63d191494a79c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.121291 22372 tablet_service.cc:1511] Processing CreateTablet for tablet 97e1c9af3eb64e7dbff4f9df54341806 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:10:26.130805 22372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97e1c9af3eb64e7dbff4f9df54341806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.131705 22439 raft_consensus.cc:493] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.132278 22439 raft_consensus.cc:515] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:26.116496 22227 tablet_service.cc:1511] Processing CreateTablet for tablet 97e1c9af3eb64e7dbff4f9df54341806 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:10:26.134068 22374 tablet_service.cc:1511] Processing CreateTablet for tablet 4179392a8cb048c1982df1ea690bb4b9 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:10:26.135357 22374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4179392a8cb048c1982df1ea690bb4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.126368 22373 tablet_service.cc:1511] Processing CreateTablet for tablet b14e4aeab76f42f7a5a63d191494a79c (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:10:26.126474 22150 tablet_service.cc:1511] Processing CreateTablet for tablet 6f91956634f346fbaed9bc3d2785f528 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:10:26.129308 22226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d963b71e2742f3a74e1bed72d29186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.122870 22434 tablet_bootstrap.cc:654] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.124768 22437 raft_consensus.cc:385] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.154774 22298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12df2e627ea748c5908bd073b917bf29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.156431 22433 tablet_bootstrap.cc:492] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:26.157317 22373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b14e4aeab76f42f7a5a63d191494a79c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.158612 22294 tablet_service.cc:1511] Processing CreateTablet for tablet 97e1c9af3eb64e7dbff4f9df54341806 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:10:26.158946 22149 tablet_service.cc:1511] Processing CreateTablet for tablet 4179392a8cb048c1982df1ea690bb4b9 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:10:26.162434 22227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97e1c9af3eb64e7dbff4f9df54341806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.162263 22300 tablet_service.cc:1511] Processing CreateTablet for tablet b14e4aeab76f42f7a5a63d191494a79c (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:10:26.168484 22300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b14e4aeab76f42f7a5a63d191494a79c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.168569 22220 tablet_service.cc:1511] Processing CreateTablet for tablet 4179392a8cb048c1982df1ea690bb4b9 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:10:26.169888 22220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4179392a8cb048c1982df1ea690bb4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.149271 22437 raft_consensus.cc:740] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.186182 22301 tablet_service.cc:1511] Processing CreateTablet for tablet 94b3204b820c4446bb957d44063ecbe0 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:10:26.186679 22299 tablet_service.cc:1511] Processing CreateTablet for tablet 6f91956634f346fbaed9bc3d2785f528 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:10:26.194337 22368 tablet_service.cc:1511] Processing CreateTablet for tablet 94b3204b820c4446bb957d44063ecbe0 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:10:26.196312 22368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b3204b820c4446bb957d44063ecbe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.149623 22439 leader_election.cc:290] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:26.200416 22225 tablet_service.cc:1511] Processing CreateTablet for tablet 6f91956634f346fbaed9bc3d2785f528 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:10:26.201174 22431 tablet_bootstrap.cc:654] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.201800 22225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f91956634f346fbaed9bc3d2785f528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.183305 22433 ts_tablet_manager.cc:1403] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.090s	user 0.017s	sys 0.015s
I20260709 13:10:26.207744 22151 tablet_service.cc:1511] Processing CreateTablet for tablet 94b3204b820c4446bb957d44063ecbe0 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:10:26.210577 22433 raft_consensus.cc:359] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:26.212010 22294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97e1c9af3eb64e7dbff4f9df54341806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.214591 22301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b3204b820c4446bb957d44063ecbe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.215631 22222 tablet_service.cc:1511] Processing CreateTablet for tablet 394fa17836c34b6d8e074e7ec63d4387 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:10:26.216858 22222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394fa17836c34b6d8e074e7ec63d4387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.219973 22440 raft_consensus.cc:493] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.220494 22440 raft_consensus.cc:515] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:26.223232 22440 leader_election.cc:290] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:26.223562 22150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f91956634f346fbaed9bc3d2785f528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.224560 22433 raft_consensus.cc:385] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.236994 22151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b3204b820c4446bb957d44063ecbe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.231118 22433 raft_consensus.cc:740] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.244953 22375 tablet_service.cc:1511] Processing CreateTablet for tablet 394fa17836c34b6d8e074e7ec63d4387 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:10:26.246344 22375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394fa17836c34b6d8e074e7ec63d4387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.251863 22149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4179392a8cb048c1982df1ea690bb4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.242448 22299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f91956634f346fbaed9bc3d2785f528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.268538 22434 tablet_bootstrap.cc:492] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:26.269241 22434 ts_tablet_manager.cc:1403] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.176s	user 0.015s	sys 0.005s
I20260709 13:10:26.238180 22437 consensus_queue.cc:260] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:26.269881 22302 tablet_service.cc:1511] Processing CreateTablet for tablet 394fa17836c34b6d8e074e7ec63d4387 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:10:26.272838 22434 raft_consensus.cc:359] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:26.280723 22302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394fa17836c34b6d8e074e7ec63d4387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.299485 22434 raft_consensus.cc:385] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.299983 22434 raft_consensus.cc:740] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.301216 22434 consensus_queue.cc:260] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:26.302735 22433 consensus_queue.cc:260] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:26.307192 22433 ts_tablet_manager.cc:1434] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.099s	user 0.007s	sys 0.000s
I20260709 13:10:26.308203 22433 tablet_bootstrap.cc:492] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:26.319587 22434 ts_tablet_manager.cc:1434] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 13:10:26.350735 22153 tablet_service.cc:1511] Processing CreateTablet for tablet d1d8b26b38b341878e580b51c9014cec (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:10:26.352185 22153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d8b26b38b341878e580b51c9014cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.353042 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ced150f7b0b41c5a9a55795474c3eed" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:26.356060 22372 tablet_service.cc:1511] Processing CreateTablet for tablet b2c563b0b9ff42638139dc08d9fd2e23 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:10:26.356496 22223 tablet_service.cc:1511] Processing CreateTablet for tablet d1d8b26b38b341878e580b51c9014cec (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
W20260709 13:10:26.357800 22201 leader_election.cc:343] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.358444 22372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2c563b0b9ff42638139dc08d9fd2e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.361447 22301 tablet_service.cc:1511] Processing CreateTablet for tablet d1d8b26b38b341878e580b51c9014cec (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:10:26.362800 22301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d8b26b38b341878e580b51c9014cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.362687 22440 raft_consensus.cc:493] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.363340 22440 raft_consensus.cc:515] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:26.366060 22440 leader_election.cc:290] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:26.367300 22441 raft_consensus.cc:493] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.367866 22441 raft_consensus.cc:515] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:26.370537 22441 leader_election.cc:290] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:26.375185 22223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d8b26b38b341878e580b51c9014cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.378706 22434 tablet_bootstrap.cc:492] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:26.425436 22433 tablet_bootstrap.cc:654] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.455905 22221 tablet_service.cc:1511] Processing CreateTablet for tablet b2c563b0b9ff42638139dc08d9fd2e23 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:10:26.457158 22437 ts_tablet_manager.cc:1434] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.350s	user 0.012s	sys 0.009s
I20260709 13:10:26.459692 22437 tablet_bootstrap.cc:492] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:26.460034 22431 tablet_bootstrap.cc:492] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:26.460556 22431 ts_tablet_manager.cc:1403] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.376s	user 0.018s	sys 0.005s
I20260709 13:10:26.466794 22431 raft_consensus.cc:359] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:26.467687 22431 raft_consensus.cc:385] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.468056 22431 raft_consensus.cc:740] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.468866 22431 consensus_queue.cc:260] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:26.479068 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b7f9ed1b11429d98f831e122707ae2" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:26.480999 22237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bb47d9fadc476296b95dba1bf4d037" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:26.481400 22300 tablet_service.cc:1511] Processing CreateTablet for tablet b501417270f5431da901577c6e5da05f (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:10:26.482793 22300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b501417270f5431da901577c6e5da05f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.483989 22238 raft_consensus.cc:2468] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
W20260709 13:10:26.485271 22350 leader_election.cc:343] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.485603 22221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2c563b0b9ff42638139dc08d9fd2e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.485987 22350 leader_election.cc:304] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:26.486907 22440 raft_consensus.cc:2804] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.487279 22440 raft_consensus.cc:493] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.487638 22440 raft_consensus.cc:3060] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.492093 22223 tablet_service.cc:1511] Processing CreateTablet for tablet 486fbb450f854f00af3362b34a0ef614 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:10:26.494148 22223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 486fbb450f854f00af3362b34a0ef614. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.499783 22434 tablet_bootstrap.cc:654] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.504528 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339b03c27dab449090201492ec507025" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:26.505167 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ced150f7b0b41c5a9a55795474c3eed" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:26.506793 22311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b7f9ed1b11429d98f831e122707ae2" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:26.508750 22302 tablet_service.cc:1511] Processing CreateTablet for tablet 486fbb450f854f00af3362b34a0ef614 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:10:26.509469 22149 tablet_service.cc:1511] Processing CreateTablet for tablet b501417270f5431da901577c6e5da05f (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
W20260709 13:10:26.510398 22127 leader_election.cc:343] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.511505 22149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b501417270f5431da901577c6e5da05f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:26.511648 22203 leader_election.cc:343] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.512074 22431 ts_tablet_manager.cc:1434] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.051s	user 0.003s	sys 0.004s
I20260709 13:10:26.513273 22431 tablet_bootstrap.cc:492] T 3a65572e11044c94ba6e4bf799385437 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:26.511523 22148 tablet_service.cc:1511] Processing CreateTablet for tablet c6f0ec01ac814561a087cb72983b73de (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:10:26.512176 22203 leader_election.cc:304] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565; no voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:26.516408 22148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6f0ec01ac814561a087cb72983b73de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.516918 22437 tablet_bootstrap.cc:654] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.520081 22439 raft_consensus.cc:2749] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:26.509752 22151 tablet_service.cc:1511] Processing CreateTablet for tablet b2c563b0b9ff42638139dc08d9fd2e23 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
W20260709 13:10:26.510095 22351 leader_election.cc:343] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.521974 22151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2c563b0b9ff42638139dc08d9fd2e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.521768 22222 tablet_service.cc:1511] Processing CreateTablet for tablet c6f0ec01ac814561a087cb72983b73de (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:10:26.523041 22222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6f0ec01ac814561a087cb72983b73de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.525318 22440 raft_consensus.cc:515] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:26.531306 22311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339b03c27dab449090201492ec507025" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
W20260709 13:10:26.532932 22128 leader_election.cc:343] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.533394 22128 leader_election.cc:304] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:26.534162 22441 raft_consensus.cc:2749] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:26.531553 22302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 486fbb450f854f00af3362b34a0ef614. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.539700 22433 tablet_bootstrap.cc:492] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:26.540238 22433 ts_tablet_manager.cc:1403] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.232s	user 0.016s	sys 0.006s
I20260709 13:10:26.540061 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b7f9ed1b11429d98f831e122707ae2" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:26.540843 22238 raft_consensus.cc:3060] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.545459 22434 tablet_bootstrap.cc:492] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:26.545990 22434 ts_tablet_manager.cc:1403] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.202s	user 0.008s	sys 0.004s
I20260709 13:10:26.546519 22238 raft_consensus.cc:2468] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:26.547745 22350 leader_election.cc:304] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:26.550113 22440 leader_election.cc:290] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:26.550460 22375 tablet_service.cc:1511] Processing CreateTablet for tablet 486fbb450f854f00af3362b34a0ef614 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:10:26.550902 22440 raft_consensus.cc:2804] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.551594 22440 raft_consensus.cc:697] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Leader. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:26.553045 22311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b7f9ed1b11429d98f831e122707ae2" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:26.552790 22440 consensus_queue.cc:237] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
W20260709 13:10:26.554534 22351 leader_election.cc:343] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.556156 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bb47d9fadc476296b95dba1bf4d037" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:26.562296 22431 tablet_bootstrap.cc:654] T 3a65572e11044c94ba6e4bf799385437 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.562777 22372 tablet_service.cc:1511] Processing CreateTablet for tablet b501417270f5431da901577c6e5da05f (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:10:26.565672 22301 tablet_service.cc:1511] Processing CreateTablet for tablet c6f0ec01ac814561a087cb72983b73de (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:10:26.551977 22375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 486fbb450f854f00af3362b34a0ef614. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:26.559947 22349 leader_election.cc:343] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.573704 22349 leader_election.cc:304] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:26.575452 22301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6f0ec01ac814561a087cb72983b73de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.578336 22437 tablet_bootstrap.cc:492] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:26.579058 22437 ts_tablet_manager.cc:1403] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.121s	user 0.012s	sys 0.002s
I20260709 13:10:26.582037 22372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b501417270f5431da901577c6e5da05f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.585897 22451 raft_consensus.cc:493] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.572774 22153 tablet_service.cc:1511] Processing CreateTablet for tablet 5634eebf5657424c9f136d8f08e8e8f6 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:10:26.589149 22153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5634eebf5657424c9f136d8f08e8e8f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.589012 22462 raft_consensus.cc:2749] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:26.574980 22433 raft_consensus.cc:359] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:26.591982 22433 raft_consensus.cc:385] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.592741 22451 raft_consensus.cc:515] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:26.597772 22451 leader_election.cc:290] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:26.593708 22433 raft_consensus.cc:740] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.599056 22433 consensus_queue.cc:260] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:26.597441 22222 tablet_service.cc:1511] Processing CreateTablet for tablet 5634eebf5657424c9f136d8f08e8e8f6 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:10:26.583346 22437 raft_consensus.cc:359] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:26.604085 22222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5634eebf5657424c9f136d8f08e8e8f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.604343 22437 raft_consensus.cc:385] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.604658 22437 raft_consensus.cc:740] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.605379 22437 consensus_queue.cc:260] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:26.609808 22294 tablet_service.cc:1511] Processing CreateTablet for tablet 8e4e00f55ac949c2a073e99cf9bc9290 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:10:26.611137 22294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e4e00f55ac949c2a073e99cf9bc9290. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:26.618898 22109 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:26.629650 22433 ts_tablet_manager.cc:1434] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.089s	user 0.009s	sys 0.000s
I20260709 13:10:26.630752 22433 tablet_bootstrap.cc:492] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:26.620483 22151 tablet_service.cc:1511] Processing CreateTablet for tablet 8e4e00f55ac949c2a073e99cf9bc9290 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:10:26.632427 22151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e4e00f55ac949c2a073e99cf9bc9290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.634744 22300 tablet_service.cc:1511] Processing CreateTablet for tablet 9de1c7b16c2347058e4b97f057c06690 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:10:26.635596 22437 ts_tablet_manager.cc:1434] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.056s	user 0.003s	sys 0.005s
I20260709 13:10:26.636101 22300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9de1c7b16c2347058e4b97f057c06690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.636860 22437 tablet_bootstrap.cc:492] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
W20260709 13:10:26.601586 22350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:43835, user_credentials={real_user=slave}} blocked reactor thread for 53942.7us
I20260709 13:10:26.626914 22223 tablet_service.cc:1511] Processing CreateTablet for tablet 9de1c7b16c2347058e4b97f057c06690 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:10:26.600970 22434 raft_consensus.cc:359] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:26.639760 22434 raft_consensus.cc:385] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.640079 22434 raft_consensus.cc:740] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.640297 22223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9de1c7b16c2347058e4b97f057c06690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.641049 22434 consensus_queue.cc:260] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:26.658146 22441 raft_consensus.cc:493] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.658679 22441 raft_consensus.cc:515] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:26.659058 22433 tablet_bootstrap.cc:654] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.663019 22311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8b0a3da29749fdb5bffa995ff8ac1e" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:26.662758 22059 catalog_manager.cc:5697] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b reported cstate change: term changed from 0 to 1, leader changed from <none> to edd63b54133d4c8d9149d57a2886916b (127.12.76.132). New cstate: current_term: 1 leader_uuid: "edd63b54133d4c8d9149d57a2886916b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:26.673108 22128 leader_election.cc:343] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.676460 22434 ts_tablet_manager.cc:1434] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.130s	user 0.008s	sys 0.001s
W20260709 13:10:26.677158 22349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:33591, user_credentials={real_user=slave}} blocked reactor thread for 117402us
I20260709 13:10:26.677716 22434 tablet_bootstrap.cc:492] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:26.668210 22441 leader_election.cc:290] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:26.687542 22431 tablet_bootstrap.cc:492] T 3a65572e11044c94ba6e4bf799385437 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:26.688167 22431 ts_tablet_manager.cc:1403] T 3a65572e11044c94ba6e4bf799385437 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.175s	user 0.022s	sys 0.002s
I20260709 13:10:26.688485 22148 tablet_service.cc:1511] Processing CreateTablet for tablet 535cc40e1cc04f16a78d6fbd34a69f3f (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:10:26.700795 22431 raft_consensus.cc:359] T 3a65572e11044c94ba6e4bf799385437 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:26.701664 22431 raft_consensus.cc:385] T 3a65572e11044c94ba6e4bf799385437 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.702009 22431 raft_consensus.cc:740] T 3a65572e11044c94ba6e4bf799385437 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.702190 22148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535cc40e1cc04f16a78d6fbd34a69f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.708676 22222 tablet_service.cc:1511] Processing CreateTablet for tablet 535cc40e1cc04f16a78d6fbd34a69f3f (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:10:26.710587 22222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535cc40e1cc04f16a78d6fbd34a69f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.711768 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5f23465fe44a799f3521c814b38d55" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
W20260709 13:10:26.715212 22275 leader_election.cc:343] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.716575 22294 tablet_service.cc:1511] Processing CreateTablet for tablet 535cc40e1cc04f16a78d6fbd34a69f3f (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:10:26.718148 22294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535cc40e1cc04f16a78d6fbd34a69f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.720783 22437 tablet_bootstrap.cc:654] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.723949 22431 consensus_queue.cc:260] T 3a65572e11044c94ba6e4bf799385437 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:26.725011 22439 raft_consensus.cc:493] T 3a65572e11044c94ba6e4bf799385437 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.726104 22439 raft_consensus.cc:515] T 3a65572e11044c94ba6e4bf799385437 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:26.708814 22434 tablet_bootstrap.cc:654] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.733772 22311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a65572e11044c94ba6e4bf799385437" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
W20260709 13:10:26.736796 22203 leader_election.cc:343] T 3a65572e11044c94ba6e4bf799385437 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.742782 22149 tablet_service.cc:1511] Processing CreateTablet for tablet 9dee9596873a4f1da4230b8f9b4467fc (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:10:26.744242 22149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dee9596873a4f1da4230b8f9b4467fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.750480 22221 tablet_service.cc:1511] Processing CreateTablet for tablet 9dee9596873a4f1da4230b8f9b4467fc (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:10:26.752043 22221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dee9596873a4f1da4230b8f9b4467fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.752229 22300 tablet_service.cc:1511] Processing CreateTablet for tablet 172a5324a0f04ae9b78b1bc0b106dbea (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:10:26.755880 22300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172a5324a0f04ae9b78b1bc0b106dbea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.758410 22439 leader_election.cc:290] T 3a65572e11044c94ba6e4bf799385437 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:26.759785 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5f23465fe44a799f3521c814b38d55" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
W20260709 13:10:26.761999 22276 leader_election.cc:343] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.762494 22276 leader_election.cc:304] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:26.764199 22451 raft_consensus.cc:2749] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:26.764205 22431 ts_tablet_manager.cc:1434] T 3a65572e11044c94ba6e4bf799385437 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.076s	user 0.012s	sys 0.014s
I20260709 13:10:26.772913 22431 tablet_bootstrap.cc:492] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:26.767637 22433 tablet_bootstrap.cc:492] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:26.784072 22433 ts_tablet_manager.cc:1403] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.154s	user 0.028s	sys 0.017s
I20260709 13:10:26.788291 22433 raft_consensus.cc:359] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:26.789311 22433 raft_consensus.cc:385] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.789700 22433 raft_consensus.cc:740] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.790927 22433 consensus_queue.cc:260] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:26.794061 22433 ts_tablet_manager.cc:1434] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:10:26.801679 22431 tablet_bootstrap.cc:654] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.803594 22433 tablet_bootstrap.cc:492] T 181a60684715425284af6a13cc16242f P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:26.807893 22434 tablet_bootstrap.cc:492] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:26.837196 22434 ts_tablet_manager.cc:1403] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.160s	user 0.013s	sys 0.000s
I20260709 13:10:26.839157 22153 tablet_service.cc:1511] Processing CreateTablet for tablet c7698abde6404f019732b30297ad5923 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:10:26.840538 22153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7698abde6404f019732b30297ad5923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.840658 22434 raft_consensus.cc:359] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:26.842417 22434 raft_consensus.cc:385] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.842813 22434 raft_consensus.cc:740] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.809382 22149 tablet_service.cc:1511] Processing CreateTablet for tablet 172a5324a0f04ae9b78b1bc0b106dbea (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:10:26.843693 22299 tablet_service.cc:1511] Processing CreateTablet for tablet bb2e1e35ba2d4732a195046335a7af7c (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:10:26.844657 22149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172a5324a0f04ae9b78b1bc0b106dbea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.844970 22299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb2e1e35ba2d4732a195046335a7af7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.846861 22372 tablet_service.cc:1511] Processing CreateTablet for tablet bb2e1e35ba2d4732a195046335a7af7c (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:10:26.810622 22294 tablet_service.cc:1511] Processing CreateTablet for tablet 0368f9bb9bc94a05bcbf9cfdcb7eac4e (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:10:26.814708 22148 tablet_service.cc:1511] Processing CreateTablet for tablet a4695de4c0534d2d8d2a4c79aab3654d (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:10:26.848982 22148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4695de4c0534d2d8d2a4c79aab3654d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.849429 22220 tablet_service.cc:1511] Processing CreateTablet for tablet bb2e1e35ba2d4732a195046335a7af7c (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:10:26.850682 22220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb2e1e35ba2d4732a195046335a7af7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.815713 22368 tablet_service.cc:1511] Processing CreateTablet for tablet 8e4e00f55ac949c2a073e99cf9bc9290 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:10:26.816286 22374 tablet_service.cc:1511] Processing CreateTablet for tablet 9de1c7b16c2347058e4b97f057c06690 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:10:26.814713 22375 tablet_service.cc:1511] Processing CreateTablet for tablet 5634eebf5657424c9f136d8f08e8e8f6 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:10:26.817267 22373 tablet_service.cc:1511] Processing CreateTablet for tablet 172a5324a0f04ae9b78b1bc0b106dbea (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:10:26.815753 22367 tablet_service.cc:1511] Processing CreateTablet for tablet 9dee9596873a4f1da4230b8f9b4467fc (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:10:26.817859 22369 tablet_service.cc:1511] Processing CreateTablet for tablet 0368f9bb9bc94a05bcbf9cfdcb7eac4e (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:10:26.853193 22225 tablet_service.cc:1511] Processing CreateTablet for tablet 2434ada128f843908123ae8965e66222 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:10:26.854480 22225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2434ada128f843908123ae8965e66222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.856814 22150 tablet_service.cc:1511] Processing CreateTablet for tablet 2434ada128f843908123ae8965e66222 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:10:26.857064 22371 tablet_service.cc:1511] Processing CreateTablet for tablet 3a23c35530d84893bfc638fe35760483 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:10:26.858115 22150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2434ada128f843908123ae8965e66222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.859304 22144 tablet_service.cc:1511] Processing CreateTablet for tablet 3a23c35530d84893bfc638fe35760483 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:10:26.861004 22144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a23c35530d84893bfc638fe35760483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.854508 22294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0368f9bb9bc94a05bcbf9cfdcb7eac4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.861788 22295 tablet_service.cc:1511] Processing CreateTablet for tablet e56649a39ed04a1682d5f0473dbb791e (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:10:26.863068 22295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e56649a39ed04a1682d5f0473dbb791e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.812597 22437 tablet_bootstrap.cc:492] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:26.867815 22437 ts_tablet_manager.cc:1403] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.231s	user 0.015s	sys 0.000s
I20260709 13:10:26.867537 22147 tablet_service.cc:1511] Processing CreateTablet for tablet e56649a39ed04a1682d5f0473dbb791e (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:10:26.868870 22147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e56649a39ed04a1682d5f0473dbb791e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.821945 22302 tablet_service.cc:1511] Processing CreateTablet for tablet a4695de4c0534d2d8d2a4c79aab3654d (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:10:26.843667 22434 consensus_queue.cc:260] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:26.872175 22302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4695de4c0534d2d8d2a4c79aab3654d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.873718 22434 ts_tablet_manager.cc:1434] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 13:10:26.824368 22151 tablet_service.cc:1511] Processing CreateTablet for tablet 9c9023b52992475a8b8ad4949867582a (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:10:26.828372 22466 raft_consensus.cc:493] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.875926 22466 raft_consensus.cc:515] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:26.879453 22311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3c95d8e81a462283bc0799ade2104b" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:26.829921 22370 tablet_service.cc:1511] Processing CreateTablet for tablet 9c9023b52992475a8b8ad4949867582a (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:10:26.830039 22227 tablet_service.cc:1511] Processing CreateTablet for tablet 9c9023b52992475a8b8ad4949867582a (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:10:26.882658 22227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9023b52992475a8b8ad4949867582a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.884268 22434 tablet_bootstrap.cc:492] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:26.884069 22226 tablet_service.cc:1511] Processing CreateTablet for tablet c144955449774c3c90f8e0ed28cc5155 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:10:26.885357 22226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c144955449774c3c90f8e0ed28cc5155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.832285 22301 tablet_service.cc:1511] Processing CreateTablet for tablet c7698abde6404f019732b30297ad5923 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:10:26.888531 22301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7698abde6404f019732b30297ad5923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.889374 22146 tablet_service.cc:1511] Processing CreateTablet for tablet 3a808c750d4749df9579874d7371e2e9 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:10:26.832386 22376 tablet_service.cc:1511] Processing CreateTablet for tablet c7698abde6404f019732b30297ad5923 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:10:26.808230 22222 tablet_service.cc:1511] Processing CreateTablet for tablet 0368f9bb9bc94a05bcbf9cfdcb7eac4e (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:10:26.890568 22298 tablet_service.cc:1511] Processing CreateTablet for tablet c144955449774c3c90f8e0ed28cc5155 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:10:26.891583 22222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0368f9bb9bc94a05bcbf9cfdcb7eac4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.891799 22298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c144955449774c3c90f8e0ed28cc5155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.893162 22300 tablet_service.cc:1511] Processing CreateTablet for tablet 2434ada128f843908123ae8965e66222 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:10:26.894363 22300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2434ada128f843908123ae8965e66222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.895931 22297 tablet_service.cc:1511] Processing CreateTablet for tablet 3a808c750d4749df9579874d7371e2e9 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:10:26.897145 22297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a808c750d4749df9579874d7371e2e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.842976 22433 tablet_bootstrap.cc:654] T 181a60684715425284af6a13cc16242f P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.900310 22152 tablet_service.cc:1511] Processing CreateTablet for tablet dbec8a84225648c28ea36cf425bc09d2 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:10:26.820685 22223 tablet_service.cc:1511] Processing CreateTablet for tablet a4695de4c0534d2d8d2a4c79aab3654d (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:10:26.903939 22146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a808c750d4749df9579874d7371e2e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.906762 22151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9023b52992475a8b8ad4949867582a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.907436 22152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbec8a84225648c28ea36cf425bc09d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.910055 22228 tablet_service.cc:1511] Processing CreateTablet for tablet dbec8a84225648c28ea36cf425bc09d2 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:10:26.910056 22219 tablet_service.cc:1511] Processing CreateTablet for tablet 3a808c750d4749df9579874d7371e2e9 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:10:26.913254 22228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbec8a84225648c28ea36cf425bc09d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.915037 22219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a808c750d4749df9579874d7371e2e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.931770 22223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4695de4c0534d2d8d2a4c79aab3654d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.933645 22434 tablet_bootstrap.cc:654] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.871019 22437 raft_consensus.cc:359] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:26.934476 22437 raft_consensus.cc:385] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.935026 22437 raft_consensus.cc:740] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.942710 22293 tablet_service.cc:1511] Processing CreateTablet for tablet 45d6ad58386642cd897d5378d8b9bc58 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:10:26.944068 22293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d6ad58386642cd897d5378d8b9bc58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.960637 22147 tablet_service.cc:1511] Processing CreateTablet for tablet 45d6ad58386642cd897d5378d8b9bc58 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:10:26.962023 22147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d6ad58386642cd897d5378d8b9bc58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.963770 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3c95d8e81a462283bc0799ade2104b" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:26.975379 22221 tablet_service.cc:1511] Processing CreateTablet for tablet 3a23c35530d84893bfc638fe35760483 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:10:26.976037 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8b0a3da29749fdb5bffa995ff8ac1e" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:26.977034 22221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a23c35530d84893bfc638fe35760483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.987056 22434 tablet_bootstrap.cc:492] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:26.982333 22372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb2e1e35ba2d4732a195046335a7af7c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:26.991703 22126 leader_election.cc:343] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:26.992247 22126 leader_election.cc:304] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:26.987784 22441 raft_consensus.cc:493] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.956159 22437 consensus_queue.cc:260] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:26.991381 22434 ts_tablet_manager.cc:1403] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.002s
I20260709 13:10:27.002905 22311 raft_consensus.cc:2468] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:27.006588 22226 tablet_service.cc:1511] Processing CreateTablet for tablet 255341bbdc0147aca3a664fdaa81ebf5 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:10:27.007949 22226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 255341bbdc0147aca3a664fdaa81ebf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.009277 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a65572e11044c94ba6e4bf799385437" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:27.011196 22466 leader_election.cc:290] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
W20260709 13:10:27.013895 22201 leader_election.cc:343] T 3a65572e11044c94ba6e4bf799385437 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.014387 22201 leader_election.cc:304] T 3a65572e11044c94ba6e4bf799385437 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565; no voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:27.015723 22471 raft_consensus.cc:2749] T 3a65572e11044c94ba6e4bf799385437 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.017632 22368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e4e00f55ac949c2a073e99cf9bc9290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.020004 22370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9023b52992475a8b8ad4949867582a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.021822 22433 tablet_bootstrap.cc:492] T 181a60684715425284af6a13cc16242f P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:27.022372 22433 ts_tablet_manager.cc:1403] T 181a60684715425284af6a13cc16242f P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.227s	user 0.014s	sys 0.013s
I20260709 13:10:27.022646 22295 tablet_service.cc:1511] Processing CreateTablet for tablet 255341bbdc0147aca3a664fdaa81ebf5 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:10:27.026111 22351 leader_election.cc:304] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:27.026468 22369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0368f9bb9bc94a05bcbf9cfdcb7eac4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.027076 22466 raft_consensus.cc:2804] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.027467 22466 raft_consensus.cc:493] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.027818 22466 raft_consensus.cc:3060] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.031960 22367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dee9596873a4f1da4230b8f9b4467fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.034560 22376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7698abde6404f019732b30297ad5923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.035262 22371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a23c35530d84893bfc638fe35760483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.001748 22441 raft_consensus.cc:515] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:27.040413 22373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172a5324a0f04ae9b78b1bc0b106dbea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.046092 22375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5634eebf5657424c9f136d8f08e8e8f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.049454 22374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9de1c7b16c2347058e4b97f057c06690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.053678 22441 leader_election.cc:290] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:27.054286 22441 raft_consensus.cc:2749] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.055652 22440 consensus_queue.cc:1048] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:27.057672 22451 raft_consensus.cc:493] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.057804 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5f23465fe44a799f3521c814b38d55" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:27.058203 22451 raft_consensus.cc:515] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:27.058501 22312 raft_consensus.cc:2468] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 0.
I20260709 13:10:27.057278 22437 ts_tablet_manager.cc:1434] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.189s	user 0.008s	sys 0.000s
I20260709 13:10:27.060439 22437 tablet_bootstrap.cc:492] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
W20260709 13:10:27.060801 22351 consensus_peers.cc:597] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b -> Peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Couldn't send request to peer 66d3606ce30b4661b5d62d403d7abca0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:27.061542 22128 leader_election.cc:304] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:27.061813 22451 leader_election.cc:290] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:27.062817 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5f23465fe44a799f3521c814b38d55" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:27.063397 22237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b118b701f94b3bacbbca2df47fe5bd" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
W20260709 13:10:27.064262 22127 leader_election.cc:343] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:27.065208 22276 leader_election.cc:343] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.065678 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b118b701f94b3bacbbca2df47fe5bd" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
W20260709 13:10:27.069752 22275 leader_election.cc:343] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.070180 22275 leader_election.cc:304] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:27.078939 22440 raft_consensus.cc:493] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.079613 22440 raft_consensus.cc:515] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:27.081861 22150 tablet_service.cc:1511] Processing CreateTablet for tablet f92f72a0e3ac48d480bb25e4f8f64c43 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:10:27.082321 22434 raft_consensus.cc:359] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.083050 22434 raft_consensus.cc:385] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.083194 22150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92f72a0e3ac48d480bb25e4f8f64c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.085289 22440 leader_election.cc:290] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
W20260709 13:10:27.044888 22126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:45017, user_credentials={real_user=slave}} blocked reactor thread for 55802.1us
W20260709 13:10:27.091109 22349 leader_election.cc:343] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.092615 22466 raft_consensus.cc:515] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.095777 22227 tablet_service.cc:1511] Processing CreateTablet for tablet f92f72a0e3ac48d480bb25e4f8f64c43 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:10:27.097129 22227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92f72a0e3ac48d480bb25e4f8f64c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.083351 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63af5dcbd69043a6a704a5fdedd3d371" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:27.099805 22311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3c95d8e81a462283bc0799ade2104b" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:27.100399 22311 raft_consensus.cc:3060] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.100742 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63af5dcbd69043a6a704a5fdedd3d371" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
W20260709 13:10:27.102098 22349 leader_election.cc:343] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.085678 22295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 255341bbdc0147aca3a664fdaa81ebf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.086592 22451 raft_consensus.cc:2749] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.086409 22441 raft_consensus.cc:2804] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.109330 22441 raft_consensus.cc:493] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.109681 22441 raft_consensus.cc:3060] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.079030 22433 raft_consensus.cc:359] T 181a60684715425284af6a13cc16242f P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:27.115782 22433 raft_consensus.cc:385] T 181a60684715425284af6a13cc16242f P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.116153 22433 raft_consensus.cc:740] T 181a60684715425284af6a13cc16242f P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.116990 22433 consensus_queue.cc:260] T 181a60684715425284af6a13cc16242f P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
W20260709 13:10:27.119382 22350 leader_election.cc:343] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.121085 22350 leader_election.cc:304] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:27.123662 22482 raft_consensus.cc:493] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.124164 22482 raft_consensus.cc:515] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.126194 22440 raft_consensus.cc:2749] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.127015 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9fb0f415f654f798baa3cccc149e8a3" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
W20260709 13:10:27.128448 22127 leader_election.cc:343] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.132689 22482 leader_election.cc:290] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:27.083367 22434 raft_consensus.cc:740] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.136328 22434 consensus_queue.cc:260] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.138552 22434 ts_tablet_manager.cc:1434] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.139s	user 0.004s	sys 0.000s
I20260709 13:10:27.143520 22466 leader_election.cc:290] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:27.145937 22431 tablet_bootstrap.cc:492] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:27.146472 22431 ts_tablet_manager.cc:1403] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.374s	user 0.026s	sys 0.013s
I20260709 13:10:27.150810 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3c95d8e81a462283bc0799ade2104b" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:27.151499 22163 raft_consensus.cc:3060] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.153877 22369 tablet_service.cc:1511] Processing CreateTablet for tablet e56649a39ed04a1682d5f0473dbb791e (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:10:27.155212 22369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e56649a39ed04a1682d5f0473dbb791e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.150813 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9fb0f415f654f798baa3cccc149e8a3" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:27.162955 22297 tablet_service.cc:1511] Processing CreateTablet for tablet f92f72a0e3ac48d480bb25e4f8f64c43 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:10:27.164289 22297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92f72a0e3ac48d480bb25e4f8f64c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.164335 22368 tablet_service.cc:1511] Processing CreateTablet for tablet c144955449774c3c90f8e0ed28cc5155 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:10:27.165774 22368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c144955449774c3c90f8e0ed28cc5155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.166448 22441 raft_consensus.cc:515] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:27.169207 22371 tablet_service.cc:1511] Processing CreateTablet for tablet dbec8a84225648c28ea36cf425bc09d2 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:10:27.156294 22433 ts_tablet_manager.cc:1434] T 181a60684715425284af6a13cc16242f P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.134s	user 0.009s	sys 0.001s
I20260709 13:10:27.178130 22433 tablet_bootstrap.cc:492] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:27.178630 22376 tablet_service.cc:1511] Processing CreateTablet for tablet 45d6ad58386642cd897d5378d8b9bc58 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:10:27.181217 22225 tablet_service.cc:1511] Processing CreateTablet for tablet ecb5c885975e4259a69644775bb930f1 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:10:27.173637 22163 raft_consensus.cc:2468] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
W20260709 13:10:27.175968 22126 leader_election.cc:343] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.190631 22126 leader_election.cc:304] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:27.192734 22349 leader_election.cc:304] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:27.193606 22466 raft_consensus.cc:2804] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.194072 22466 raft_consensus.cc:697] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Leader. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:27.194923 22466 consensus_queue.cc:237] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.213534 22437 tablet_bootstrap.cc:654] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.217903 22431 raft_consensus.cc:359] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:27.218792 22431 raft_consensus.cc:385] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.219228 22431 raft_consensus.cc:740] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.220224 22431 consensus_queue.cc:260] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:27.204433 22434 tablet_bootstrap.cc:492] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:27.218469 22370 tablet_service.cc:1511] Processing CreateTablet for tablet ecb5c885975e4259a69644775bb930f1 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:10:27.223541 22225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb5c885975e4259a69644775bb930f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.174047 22311 raft_consensus.cc:2468] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:27.209069 22376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d6ad58386642cd897d5378d8b9bc58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.204829 22482 raft_consensus.cc:493] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.211191 22302 tablet_service.cc:1511] Processing CreateTablet for tablet b28d9c95ac3d49219dc6a5d5739f6ead (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:10:27.236888 22484 raft_consensus.cc:2749] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.236088 22369 tablet_service.cc:1511] Processing CreateTablet for tablet b28d9c95ac3d49219dc6a5d5739f6ead (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:10:27.243878 22302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b28d9c95ac3d49219dc6a5d5739f6ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.234133 22482 raft_consensus.cc:515] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.247139 22369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b28d9c95ac3d49219dc6a5d5739f6ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.228267 22367 tablet_service.cc:1511] Processing CreateTablet for tablet 255341bbdc0147aca3a664fdaa81ebf5 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:10:27.268945 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3c95d8e81a462283bc0799ade2104b" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:27.268765 22150 tablet_service.cc:1511] Processing CreateTablet for tablet ecb5c885975e4259a69644775bb930f1 (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:10:27.270687 22150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb5c885975e4259a69644775bb930f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.281085 22371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbec8a84225648c28ea36cf425bc09d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.284494 22370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb5c885975e4259a69644775bb930f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.288045 22433 tablet_bootstrap.cc:654] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.278860 22061 catalog_manager.cc:5697] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b reported cstate change: term changed from 0 to 1, leader changed from <none> to edd63b54133d4c8d9149d57a2886916b (127.12.76.132). New cstate: current_term: 1 leader_uuid: "edd63b54133d4c8d9149d57a2886916b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.300547 22431 ts_tablet_manager.cc:1434] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.154s	user 0.006s	sys 0.003s
I20260709 13:10:27.301920 22431 tablet_bootstrap.cc:492] T 2959be4ebd674047ba6d57a27b8b5865 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:27.307531 22485 raft_consensus.cc:493] T 181a60684715425284af6a13cc16242f P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.308037 22485 raft_consensus.cc:515] T 181a60684715425284af6a13cc16242f P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:27.308633 22441 leader_election.cc:290] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:27.310156 22485 leader_election.cc:290] T 181a60684715425284af6a13cc16242f P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:27.310190 22367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 255341bbdc0147aca3a664fdaa81ebf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.265410 22434 tablet_bootstrap.cc:654] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.316458 22311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181a60684715425284af6a13cc16242f" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:27.317145 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5f23465fe44a799f3521c814b38d55" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
W20260709 13:10:27.317947 22351 leader_election.cc:343] T 181a60684715425284af6a13cc16242f P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:27.318531 22127 leader_election.cc:343] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.304018 22482 leader_election.cc:290] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:27.323814 22147 tablet_service.cc:1511] Processing CreateTablet for tablet b28d9c95ac3d49219dc6a5d5739f6ead (DEFAULT_TABLE table=test-workload [id=9778c704a5064704a033dd40572b181d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:10:27.324316 22237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181a60684715425284af6a13cc16242f" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:27.325093 22147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b28d9c95ac3d49219dc6a5d5739f6ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.352384 22311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3c95d8e81a462283bc0799ade2104b" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:27.352886 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5f23465fe44a799f3521c814b38d55" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:27.353116 22311 raft_consensus.cc:2468] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 1.
I20260709 13:10:27.353494 22312 raft_consensus.cc:3060] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.359869 22128 leader_election.cc:304] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: edd63b54133d4c8d9149d57a2886916b
W20260709 13:10:27.348752 22350 leader_election.cc:343] T 181a60684715425284af6a13cc16242f P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.361258 22350 leader_election.cc:304] T 181a60684715425284af6a13cc16242f P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:27.362054 22485 raft_consensus.cc:2749] T 181a60684715425284af6a13cc16242f P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.363315 22482 raft_consensus.cc:2804] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:27.363888 22482 raft_consensus.cc:493] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.364280 22482 raft_consensus.cc:3060] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.373183 22431 tablet_bootstrap.cc:654] T 2959be4ebd674047ba6d57a27b8b5865 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.375706 22312 raft_consensus.cc:2468] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 1.
I20260709 13:10:27.377138 22128 leader_election.cc:304] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: 371d38ec3c7f493e9aea62dae121e565
I20260709 13:10:27.378029 22441 raft_consensus.cc:2804] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.378551 22441 raft_consensus.cc:697] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [term 1 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:27.379490 22441 consensus_queue.cc:237] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:27.393391 22434 tablet_bootstrap.cc:492] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:27.402428 22433 tablet_bootstrap.cc:492] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:27.403211 22433 ts_tablet_manager.cc:1403] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.225s	user 0.012s	sys 0.004s
I20260709 13:10:27.399210 22434 ts_tablet_manager.cc:1403] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.208s	user 0.019s	sys 0.020s
I20260709 13:10:27.412966 22433 raft_consensus.cc:359] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:27.414072 22433 raft_consensus.cc:385] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.414503 22433 raft_consensus.cc:740] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.416043 22434 raft_consensus.cc:359] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.415994 22433 consensus_queue.cc:260] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:27.417214 22434 raft_consensus.cc:385] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.417686 22434 raft_consensus.cc:740] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.421283 22433 ts_tablet_manager.cc:1434] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.004s
I20260709 13:10:27.422315 22437 tablet_bootstrap.cc:492] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:27.423059 22437 ts_tablet_manager.cc:1403] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.363s	user 0.019s	sys 0.003s
I20260709 13:10:27.426641 22437 raft_consensus.cc:359] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.427449 22437 raft_consensus.cc:385] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.427860 22437 raft_consensus.cc:740] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.428857 22437 consensus_queue.cc:260] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.431573 22434 consensus_queue.cc:260] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.423017 22433 tablet_bootstrap.cc:492] T af8b0a3da29749fdb5bffa995ff8ac1e P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:27.398845 22482 raft_consensus.cc:515] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.435607 22482 leader_election.cc:290] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:27.436626 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3c95d8e81a462283bc0799ade2104b" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:27.437250 22312 raft_consensus.cc:3060] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.441116 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3c95d8e81a462283bc0799ade2104b" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:27.443382 22431 tablet_bootstrap.cc:492] T 2959be4ebd674047ba6d57a27b8b5865 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:27.444003 22431 ts_tablet_manager.cc:1403] T 2959be4ebd674047ba6d57a27b8b5865 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.142s	user 0.018s	sys 0.019s
I20260709 13:10:27.446791 22312 raft_consensus.cc:2468] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
I20260709 13:10:27.447261 22431 raft_consensus.cc:359] T 2959be4ebd674047ba6d57a27b8b5865 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:27.448673 22431 raft_consensus.cc:385] T 2959be4ebd674047ba6d57a27b8b5865 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.449095 22431 raft_consensus.cc:740] T 2959be4ebd674047ba6d57a27b8b5865 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.448799 22128 leader_election.cc:304] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:27.450148 22431 consensus_queue.cc:260] T 2959be4ebd674047ba6d57a27b8b5865 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:27.451385 22441 raft_consensus.cc:2804] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:27.451910 22437 ts_tablet_manager.cc:1434] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:10:27.451992 22441 raft_consensus.cc:697] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:27.454089 22431 ts_tablet_manager.cc:1434] T 2959be4ebd674047ba6d57a27b8b5865 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:10:27.455371 22431 tablet_bootstrap.cc:492] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:27.456233 22434 ts_tablet_manager.cc:1434] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.001s
I20260709 13:10:27.457679 22437 tablet_bootstrap.cc:492] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:27.458792 22433 tablet_bootstrap.cc:654] T af8b0a3da29749fdb5bffa995ff8ac1e P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.453925 22441 consensus_queue.cc:237] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.459472 22434 tablet_bootstrap.cc:492] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:27.462760 22431 tablet_bootstrap.cc:654] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.468770 22060 catalog_manager.cc:5697] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.473304 22437 tablet_bootstrap.cc:654] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.477109 22431 tablet_bootstrap.cc:492] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:27.477645 22431 ts_tablet_manager.cc:1403] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.007s
I20260709 13:10:27.481354 22433 tablet_bootstrap.cc:492] T af8b0a3da29749fdb5bffa995ff8ac1e P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:27.481374 22431 raft_consensus.cc:359] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:27.482450 22433 ts_tablet_manager.cc:1403] T af8b0a3da29749fdb5bffa995ff8ac1e P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.013s
I20260709 13:10:27.482793 22431 raft_consensus.cc:385] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.483141 22431 raft_consensus.cc:740] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.483976 22431 consensus_queue.cc:260] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:27.486769 22431 ts_tablet_manager.cc:1434] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.005s
I20260709 13:10:27.486443 22433 raft_consensus.cc:359] T af8b0a3da29749fdb5bffa995ff8ac1e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.487507 22433 raft_consensus.cc:385] T af8b0a3da29749fdb5bffa995ff8ac1e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.487907 22431 tablet_bootstrap.cc:492] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:27.487952 22433 raft_consensus.cc:740] T af8b0a3da29749fdb5bffa995ff8ac1e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.489248 22433 consensus_queue.cc:260] T af8b0a3da29749fdb5bffa995ff8ac1e P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.492506 22433 ts_tablet_manager.cc:1434] T af8b0a3da29749fdb5bffa995ff8ac1e P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:10:27.493640 22433 tablet_bootstrap.cc:492] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:27.495159 22437 tablet_bootstrap.cc:492] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:27.496061 22431 tablet_bootstrap.cc:654] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.496788 22437 ts_tablet_manager.cc:1403] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.004s
I20260709 13:10:27.503110 22433 tablet_bootstrap.cc:654] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.502767 22437 raft_consensus.cc:359] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:27.505085 22434 tablet_bootstrap.cc:654] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.511323 22482 raft_consensus.cc:493] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.512377 22431 tablet_bootstrap.cc:492] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:27.513263 22431 ts_tablet_manager.cc:1403] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.000s
I20260709 13:10:27.513144 22482 raft_consensus.cc:515] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.516654 22431 raft_consensus.cc:359] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:27.517395 22431 raft_consensus.cc:385] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.517673 22431 raft_consensus.cc:740] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.518476 22431 consensus_queue.cc:260] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:27.518652 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da53827c80a54c43a6cdcb57b857f7a3" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:27.520504 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da53827c80a54c43a6cdcb57b857f7a3" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:27.523480 22482 leader_election.cc:290] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:27.525539 22431 ts_tablet_manager.cc:1434] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:10:27.526645 22431 tablet_bootstrap.cc:492] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
W20260709 13:10:27.524796 22128 leader_election.cc:343] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:27.527752 22126 leader_election.cc:343] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.528442 22126 leader_election.cc:304] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:27.530102 22482 raft_consensus.cc:2749] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.533253 22431 tablet_bootstrap.cc:654] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.534804 22437 raft_consensus.cc:385] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.535270 22437 raft_consensus.cc:740] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.536461 22437 consensus_queue.cc:260] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:27.538205 22434 tablet_bootstrap.cc:492] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:27.538858 22434 ts_tablet_manager.cc:1403] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.080s	user 0.005s	sys 0.007s
I20260709 13:10:27.539264 22437 ts_tablet_manager.cc:1434] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.042s	user 0.003s	sys 0.004s
I20260709 13:10:27.541023 22437 tablet_bootstrap.cc:492] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:27.542143 22434 raft_consensus.cc:359] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:27.542954 22434 raft_consensus.cc:385] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.543268 22434 raft_consensus.cc:740] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.546427 22434 consensus_queue.cc:260] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:27.548898 22434 ts_tablet_manager.cc:1434] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:10:27.549940 22434 tablet_bootstrap.cc:492] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:27.552472 22061 catalog_manager.cc:5697] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 1 to 2, leader changed from edd63b54133d4c8d9149d57a2886916b (127.12.76.132) to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:27.565678 22437 tablet_bootstrap.cc:654] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.566924 22434 tablet_bootstrap.cc:654] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.579941 22434 tablet_bootstrap.cc:492] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:27.580315 22471 raft_consensus.cc:493] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.580639 22434 ts_tablet_manager.cc:1403] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.000s
I20260709 13:10:27.580927 22471 raft_consensus.cc:515] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:27.583176 22471 leader_election.cc:290] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:27.584733 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bb47d9fadc476296b95dba1bf4d037" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:27.585404 22385 raft_consensus.cc:2468] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 0.
I20260709 13:10:27.585438 22434 raft_consensus.cc:359] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:27.586102 22431 tablet_bootstrap.cc:492] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:27.586347 22437 tablet_bootstrap.cc:492] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:27.586344 22434 raft_consensus.cc:385] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.586625 22431 ts_tablet_manager.cc:1403] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.060s	user 0.022s	sys 0.027s
I20260709 13:10:27.587010 22434 raft_consensus.cc:740] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.587174 22437 ts_tablet_manager.cc:1403] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.008s
I20260709 13:10:27.587220 22201 leader_election.cc:304] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:27.587854 22434 consensus_queue.cc:260] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:27.588395 22471 raft_consensus.cc:2804] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.588804 22471 raft_consensus.cc:493] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.584733 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bb47d9fadc476296b95dba1bf4d037" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:27.589193 22471 raft_consensus.cc:3060] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.589612 22431 raft_consensus.cc:359] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:27.590282 22431 raft_consensus.cc:385] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:10:27.590600 22201 leader_election.cc:343] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.590611 22431 raft_consensus.cc:740] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.590925 22437 raft_consensus.cc:359] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:27.591888 22437 raft_consensus.cc:385] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.592284 22437 raft_consensus.cc:740] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.591769 22431 consensus_queue.cc:260] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:27.593060 22437 consensus_queue.cc:260] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:27.594244 22433 tablet_bootstrap.cc:492] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:27.594898 22433 ts_tablet_manager.cc:1403] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.101s	user 0.039s	sys 0.020s
I20260709 13:10:27.597409 22471 raft_consensus.cc:515] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:27.598961 22433 raft_consensus.cc:359] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.599972 22433 raft_consensus.cc:385] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.600245 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bb47d9fadc476296b95dba1bf4d037" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:27.600414 22433 raft_consensus.cc:740] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.601035 22385 raft_consensus.cc:3060] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.601786 22433 consensus_queue.cc:260] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.603397 22437 ts_tablet_manager.cc:1434] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:10:27.610509 22385 raft_consensus.cc:2468] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:27.611543 22437 tablet_bootstrap.cc:492] T 4805089364594284ba715cf71e92f20c P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:27.611835 22201 leader_election.cc:304] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:27.614411 22433 ts_tablet_manager.cc:1434] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 13:10:27.615211 22434 ts_tablet_manager.cc:1434] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 13:10:27.616340 22434 tablet_bootstrap.cc:492] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:27.620839 22471 leader_election.cc:290] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:27.623361 22451 raft_consensus.cc:493] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.623890 22451 raft_consensus.cc:515] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.624363 22433 tablet_bootstrap.cc:492] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:27.626243 22451 leader_election.cc:290] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:27.626530 22471 raft_consensus.cc:2804] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.627096 22471 raft_consensus.cc:697] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Becoming Leader. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:27.628067 22471 consensus_queue.cc:237] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
W20260709 13:10:27.630509 22109 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:27.633704 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bb47d9fadc476296b95dba1bf4d037" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:27.634697 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8b0a3da29749fdb5bffa995ff8ac1e" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:27.635679 22431 ts_tablet_manager.cc:1434] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.049s	user 0.016s	sys 0.013s
I20260709 13:10:27.646821 22433 tablet_bootstrap.cc:654] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.647091 22431 tablet_bootstrap.cc:492] T 181a60684715425284af6a13cc16242f P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:27.635633 22162 raft_consensus.cc:2468] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 0.
W20260709 13:10:27.640594 22201 leader_election.cc:343] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.653570 22508 raft_consensus.cc:493] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.654062 22508 raft_consensus.cc:515] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:27.656183 22508 leader_election.cc:290] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:27.656893 22466 raft_consensus.cc:493] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.657029 22275 leader_election.cc:304] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:27.657413 22466 raft_consensus.cc:515] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:27.657940 22451 raft_consensus.cc:2804] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.658119 22437 tablet_bootstrap.cc:654] T 4805089364594284ba715cf71e92f20c P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.658366 22451 raft_consensus.cc:493] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.658774 22451 raft_consensus.cc:3060] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.659494 22466 leader_election.cc:290] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:27.657048 22434 tablet_bootstrap.cc:654] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.660693 22485 raft_consensus.cc:493] T af8b0a3da29749fdb5bffa995ff8ac1e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.661222 22485 raft_consensus.cc:515] T af8b0a3da29749fdb5bffa995ff8ac1e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.661607 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a65572e11044c94ba6e4bf799385437" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
W20260709 13:10:27.663221 22351 leader_election.cc:343] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.663060 22237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a65572e11044c94ba6e4bf799385437" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:27.663576 22485 leader_election.cc:290] T af8b0a3da29749fdb5bffa995ff8ac1e P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:27.664109 22237 raft_consensus.cc:2468] T 3a65572e11044c94ba6e4bf799385437 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:27.664750 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8b0a3da29749fdb5bffa995ff8ac1e" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:27.665426 22350 leader_election.cc:304] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:27.664773 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8b0a3da29749fdb5bffa995ff8ac1e" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:27.665428 22162 raft_consensus.cc:2468] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:27.667174 22311 raft_consensus.cc:1240] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Rejecting Update request from peer edd63b54133d4c8d9149d57a2886916b for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:27.667750 22349 leader_election.cc:304] T af8b0a3da29749fdb5bffa995ff8ac1e P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:27.668607 22440 raft_consensus.cc:2804] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.668994 22440 raft_consensus.cc:493] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.669308 22440 raft_consensus.cc:3060] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.670042 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63af5dcbd69043a6a704a5fdedd3d371" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:27.670742 22385 raft_consensus.cc:2468] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 0.
I20260709 13:10:27.671252 22451 raft_consensus.cc:515] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.672863 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63af5dcbd69043a6a704a5fdedd3d371" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:27.674055 22466 raft_consensus.cc:2804] T af8b0a3da29749fdb5bffa995ff8ac1e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.674453 22466 raft_consensus.cc:493] T af8b0a3da29749fdb5bffa995ff8ac1e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.674782 22312 raft_consensus.cc:2393] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edd63b54133d4c8d9149d57a2886916b in current term 1: Already voted for candidate 66d3606ce30b4661b5d62d403d7abca0 in this term.
I20260709 13:10:27.674980 22451 leader_election.cc:290] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:27.676429 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8b0a3da29749fdb5bffa995ff8ac1e" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:27.674388 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8b0a3da29749fdb5bffa995ff8ac1e" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:27.674868 22466 raft_consensus.cc:3060] T af8b0a3da29749fdb5bffa995ff8ac1e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.684286 22482 raft_consensus.cc:493] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.684832 22482 raft_consensus.cc:515] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:27.684914 22440 raft_consensus.cc:515] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:27.675302 22485 raft_consensus.cc:493] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.688009 22237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a65572e11044c94ba6e4bf799385437" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:27.687813 22485 raft_consensus.cc:515] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.688686 22237 raft_consensus.cc:3060] T 3a65572e11044c94ba6e4bf799385437 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.690241 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ced150f7b0b41c5a9a55795474c3eed" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:27.690470 22485 leader_election.cc:290] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:27.690996 22238 raft_consensus.cc:2468] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 0.
I20260709 13:10:27.691946 22441 raft_consensus.cc:493] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.692464 22441 raft_consensus.cc:515] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:27.694811 22441 leader_election.cc:290] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:27.688700 22311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ced150f7b0b41c5a9a55795474c3eed" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:27.696894 22440 leader_election.cc:290] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
W20260709 13:10:27.697969 22128 leader_election.cc:343] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.699270 22127 leader_election.cc:304] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:27.691184 22485 consensus_queue.cc:1059] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:10:27.699754 22237 raft_consensus.cc:2468] T 3a65572e11044c94ba6e4bf799385437 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:27.687170 22482 leader_election.cc:290] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:27.702342 22441 raft_consensus.cc:2804] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.705123 22441 raft_consensus.cc:493] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.702502 22350 leader_election.cc:304] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:27.701527 22440 raft_consensus.cc:3055] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:27.704172 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8b0a3da29749fdb5bffa995ff8ac1e" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:27.707449 22162 raft_consensus.cc:3060] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.707856 22466 raft_consensus.cc:515] T af8b0a3da29749fdb5bffa995ff8ac1e P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.706586 22441 raft_consensus.cc:3060] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.709628 22386 raft_consensus.cc:2393] T af8b0a3da29749fdb5bffa995ff8ac1e P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 66d3606ce30b4661b5d62d403d7abca0 in current term 1: Already voted for candidate edd63b54133d4c8d9149d57a2886916b in this term.
I20260709 13:10:27.704543 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9fb0f415f654f798baa3cccc149e8a3" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:27.704310 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9fb0f415f654f798baa3cccc149e8a3" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:27.712728 22163 raft_consensus.cc:2468] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
W20260709 13:10:27.713786 22350 leader_election.cc:343] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.702944 22311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b118b701f94b3bacbbca2df47fe5bd" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:27.714615 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8b0a3da29749fdb5bffa995ff8ac1e" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:27.714757 22311 raft_consensus.cc:2468] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 0.
I20260709 13:10:27.716912 22466 leader_election.cc:290] T af8b0a3da29749fdb5bffa995ff8ac1e P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:27.684018 22431 tablet_bootstrap.cc:654] T 181a60684715425284af6a13cc16242f P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.717792 22433 tablet_bootstrap.cc:492] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:27.718401 22433 ts_tablet_manager.cc:1403] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.094s	user 0.019s	sys 0.011s
I20260709 13:10:27.706949 22440 raft_consensus.cc:740] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:27.718537 22128 leader_election.cc:304] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:27.719924 22482 raft_consensus.cc:2804] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.717355 22349 leader_election.cc:304] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 371d38ec3c7f493e9aea62dae121e565
I20260709 13:10:27.717602 22466 raft_consensus.cc:2804] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:10:27.705634 22201 leader_election.cc:343] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.721060 22482 raft_consensus.cc:493] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.719931 22440 consensus_queue.cc:260] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.726642 22482 raft_consensus.cc:3060] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.717928 22237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b118b701f94b3bacbbca2df47fe5bd" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:27.730290 22237 raft_consensus.cc:2468] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 0.
I20260709 13:10:27.733659 22437 tablet_bootstrap.cc:492] T 4805089364594284ba715cf71e92f20c P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:27.734372 22437 ts_tablet_manager.cc:1403] T 4805089364594284ba715cf71e92f20c P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.123s	user 0.018s	sys 0.031s
I20260709 13:10:27.736083 22433 raft_consensus.cc:359] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.736917 22433 raft_consensus.cc:385] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.737277 22433 raft_consensus.cc:740] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.738063 22433 consensus_queue.cc:260] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.728366 22201 leader_election.cc:304] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:27.738543 22437 raft_consensus.cc:359] T 4805089364594284ba715cf71e92f20c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:27.741266 22437 raft_consensus.cc:385] T 4805089364594284ba715cf71e92f20c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.742039 22437 raft_consensus.cc:740] T 4805089364594284ba715cf71e92f20c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.740940 22471 raft_consensus.cc:493] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.742699 22471 raft_consensus.cc:515] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:27.743739 22509 raft_consensus.cc:2804] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.744131 22509 raft_consensus.cc:493] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.744521 22509 raft_consensus.cc:3060] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.744993 22471 leader_election.cc:290] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:27.743129 22058 catalog_manager.cc:5697] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 reported cstate change: term changed from 0 to 1, leader changed from <none> to 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "371d38ec3c7f493e9aea62dae121e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:27.741406 22351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46871, user_credentials={real_user=slave}} blocked reactor thread for 67511.2us
I20260709 13:10:27.746420 22485 raft_consensus.cc:2804] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.746887 22485 raft_consensus.cc:493] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.747260 22485 raft_consensus.cc:3060] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:27.747575 22351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.748672 22311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a65572e11044c94ba6e4bf799385437" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:27.750312 22434 tablet_bootstrap.cc:492] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:27.750563 22311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4805089364594284ba715cf71e92f20c" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:27.750820 22434 ts_tablet_manager.cc:1403] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.135s	user 0.013s	sys 0.015s
I20260709 13:10:27.750577 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8b0a3da29749fdb5bffa995ff8ac1e" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:27.752228 22312 raft_consensus.cc:2393] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate edd63b54133d4c8d9149d57a2886916b in current term 1: Already voted for candidate 66d3606ce30b4661b5d62d403d7abca0 in this term.
I20260709 13:10:27.753862 22440 raft_consensus.cc:3060] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.754177 22434 raft_consensus.cc:359] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:27.754949 22434 raft_consensus.cc:385] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.755240 22434 raft_consensus.cc:740] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.760492 22434 consensus_queue.cc:260] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:27.761797 22509 raft_consensus.cc:515] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:27.762192 22162 raft_consensus.cc:2468] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 1.
I20260709 13:10:27.763994 22275 leader_election.cc:304] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:27.764027 22509 leader_election.cc:290] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:27.764885 22451 raft_consensus.cc:2804] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.765533 22441 raft_consensus.cc:515] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:27.776805 22484 raft_consensus.cc:493] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.776948 22237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ced150f7b0b41c5a9a55795474c3eed" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:27.777392 22484 raft_consensus.cc:515] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:27.777885 22237 raft_consensus.cc:3060] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.779773 22484 leader_election.cc:290] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:27.780560 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4805089364594284ba715cf71e92f20c" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:27.782653 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63af5dcbd69043a6a704a5fdedd3d371" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:27.783447 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63af5dcbd69043a6a704a5fdedd3d371" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:27.784307 22386 raft_consensus.cc:2468] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 0.
I20260709 13:10:27.787307 22515 raft_consensus.cc:493] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.787848 22515 raft_consensus.cc:515] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.788270 22126 leader_election.cc:304] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:27.783463 22238 raft_consensus.cc:2393] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d515385609945e5837e85b77de385e2 in current term 1: Already voted for candidate 371d38ec3c7f493e9aea62dae121e565 in this term.
I20260709 13:10:27.790083 22515 leader_election.cc:290] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:27.791097 22441 leader_election.cc:290] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:27.792055 22441 raft_consensus.cc:2804] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.792241 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ced150f7b0b41c5a9a55795474c3eed" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:27.795966 22441 raft_consensus.cc:493] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.792241 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da53827c80a54c43a6cdcb57b857f7a3" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:27.796360 22441 raft_consensus.cc:3060] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.796447 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63af5dcbd69043a6a704a5fdedd3d371" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:27.796753 22162 raft_consensus.cc:2468] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:27.742990 22437 consensus_queue.cc:260] T 4805089364594284ba715cf71e92f20c P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:27.797122 22386 raft_consensus.cc:3060] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.797444 22311 raft_consensus.cc:2468] T 4805089364594284ba715cf71e92f20c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 0.
W20260709 13:10:27.798112 22128 leader_election.cc:343] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:27.785079 22351 leader_election.cc:343] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.798579 22349 leader_election.cc:304] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:27.785362 22466 raft_consensus.cc:697] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Leader. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:27.799607 22517 raft_consensus.cc:2804] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.800038 22517 raft_consensus.cc:493] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.800364 22517 raft_consensus.cc:3060] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.800556 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da53827c80a54c43a6cdcb57b857f7a3" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:27.800869 22466 consensus_queue.cc:237] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:27.802237 22351 leader_election.cc:304] T af8b0a3da29749fdb5bffa995ff8ac1e P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:27.803071 22515 raft_consensus.cc:2749] T af8b0a3da29749fdb5bffa995ff8ac1e P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:10:27.804163 22351 leader_election.cc:343] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.804095 22485 raft_consensus.cc:515] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.804601 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63af5dcbd69043a6a704a5fdedd3d371" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:27.807349 22431 tablet_bootstrap.cc:492] T 181a60684715425284af6a13cc16242f P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:27.807874 22431 ts_tablet_manager.cc:1403] T 181a60684715425284af6a13cc16242f P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.161s	user 0.034s	sys 0.006s
I20260709 13:10:27.807960 22509 raft_consensus.cc:493] T 2959be4ebd674047ba6d57a27b8b5865 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:27.808212 22201 leader_election.cc:343] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.808487 22509 raft_consensus.cc:515] T 2959be4ebd674047ba6d57a27b8b5865 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:27.810647 22431 raft_consensus.cc:359] T 181a60684715425284af6a13cc16242f P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:27.811314 22431 raft_consensus.cc:385] T 181a60684715425284af6a13cc16242f P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.811590 22431 raft_consensus.cc:740] T 181a60684715425284af6a13cc16242f P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.812651 22509 leader_election.cc:290] T 2959be4ebd674047ba6d57a27b8b5865 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:27.812382 22431 consensus_queue.cc:260] T 181a60684715425284af6a13cc16242f P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:27.812853 22451 raft_consensus.cc:697] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 [term 1 LEADER]: Becoming Leader. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Running, Role: LEADER
I20260709 13:10:27.815513 22451 consensus_queue.cc:237] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.816378 22237 raft_consensus.cc:2468] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 1.
I20260709 13:10:27.817691 22127 leader_election.cc:304] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:27.804095 22482 raft_consensus.cc:515] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:27.819494 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2959be4ebd674047ba6d57a27b8b5865" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:27.820341 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2959be4ebd674047ba6d57a27b8b5865" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:27.820726 22482 leader_election.cc:290] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:27.821064 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b118b701f94b3bacbbca2df47fe5bd" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:27.821732 22312 raft_consensus.cc:3060] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.822408 22433 ts_tablet_manager.cc:1434] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.104s	user 0.009s	sys 0.003s
I20260709 13:10:27.822958 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b118b701f94b3bacbbca2df47fe5bd" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:27.823392 22433 tablet_bootstrap.cc:492] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:27.823576 22238 raft_consensus.cc:3060] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.824929 22441 raft_consensus.cc:515] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:27.827749 22162 raft_consensus.cc:2393] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 371d38ec3c7f493e9aea62dae121e565 in current term 1: Already voted for candidate 5d515385609945e5837e85b77de385e2 in this term.
I20260709 13:10:27.828322 22386 raft_consensus.cc:2468] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:27.828995 22312 raft_consensus.cc:2468] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 1.
I20260709 13:10:27.829242 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63af5dcbd69043a6a704a5fdedd3d371" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:27.830040 22385 raft_consensus.cc:2393] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d515385609945e5837e85b77de385e2 in current term 1: Already voted for candidate 371d38ec3c7f493e9aea62dae121e565 in this term.
I20260709 13:10:27.830252 22128 leader_election.cc:304] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:27.831265 22431 ts_tablet_manager.cc:1434] T 181a60684715425284af6a13cc16242f P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:10:27.831491 22482 raft_consensus.cc:2804] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.819464 22484 raft_consensus.cc:2804] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.832760 22482 raft_consensus.cc:697] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [term 1 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:27.833653 22482 consensus_queue.cc:237] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:27.836903 22431 tablet_bootstrap.cc:492] T 90ecf0583df84abeae688412d6870da7 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:27.838877 22203 leader_election.cc:304] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:27.840468 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9fb0f415f654f798baa3cccc149e8a3" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:27.841882 22441 leader_election.cc:290] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
W20260709 13:10:27.842063 22350 leader_election.cc:343] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.843144 22485 leader_election.cc:290] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:27.843991 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63af5dcbd69043a6a704a5fdedd3d371" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:27.844516 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9fb0f415f654f798baa3cccc149e8a3" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:27.844817 22236 raft_consensus.cc:2393] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d515385609945e5837e85b77de385e2 in current term 1: Already voted for candidate 371d38ec3c7f493e9aea62dae121e565 in this term.
I20260709 13:10:27.845121 22162 raft_consensus.cc:3060] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.845984 22509 raft_consensus.cc:2804] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.846443 22509 raft_consensus.cc:493] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.846840 22509 raft_consensus.cc:3060] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.849524 22127 leader_election.cc:304] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:27.854650 22162 raft_consensus.cc:2468] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
W20260709 13:10:27.856305 22201 leader_election.cc:343] T 2959be4ebd674047ba6d57a27b8b5865 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.857748 22238 raft_consensus.cc:2468] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 1.
I20260709 13:10:27.855486 22441 raft_consensus.cc:2749] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.857620 22349 leader_election.cc:304] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 371d38ec3c7f493e9aea62dae121e565
I20260709 13:10:27.859762 22485 raft_consensus.cc:2804] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.860512 22485 raft_consensus.cc:697] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Leader. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:27.861362 22485 consensus_queue.cc:237] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.862689 22517 raft_consensus.cc:515] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.858174 22433 tablet_bootstrap.cc:654] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.855886 22431 tablet_bootstrap.cc:654] T 90ecf0583df84abeae688412d6870da7 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.854676 22509 raft_consensus.cc:515] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:27.867111 22484 raft_consensus.cc:697] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [term 1 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:27.879261 22484 consensus_queue.cc:237] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:27.886509 22434 ts_tablet_manager.cc:1434] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.135s	user 0.015s	sys 0.005s
I20260709 13:10:27.875676 22437 ts_tablet_manager.cc:1434] T 4805089364594284ba715cf71e92f20c P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.141s	user 0.013s	sys 0.011s
I20260709 13:10:27.886926 22058 catalog_manager.cc:5697] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "66d3606ce30b4661b5d62d403d7abca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.888679 22434 tablet_bootstrap.cc:492] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:27.888962 22437 tablet_bootstrap.cc:492] T da53827c80a54c43a6cdcb57b857f7a3 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:27.889776 22311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da53827c80a54c43a6cdcb57b857f7a3" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:27.891537 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da53827c80a54c43a6cdcb57b857f7a3" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:27.892176 22162 raft_consensus.cc:3060] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.887531 22517 leader_election.cc:290] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:27.893807 22061 catalog_manager.cc:5697] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b reported cstate change: term changed from 0 to 1, leader changed from <none> to edd63b54133d4c8d9149d57a2886916b (127.12.76.132). New cstate: current_term: 1 leader_uuid: "edd63b54133d4c8d9149d57a2886916b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:27.870666 22201 leader_election.cc:343] T 2959be4ebd674047ba6d57a27b8b5865 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:27.898613 22351 leader_election.cc:343] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.902949 22311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4805089364594284ba715cf71e92f20c" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:27.903957 22311 raft_consensus.cc:3060] T 4805089364594284ba715cf71e92f20c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.910226 22385 raft_consensus.cc:1275] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:10:27.910673 22385 pending_rounds.cc:85] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b: Aborting all ops after (but not including) 0
I20260709 13:10:27.910939 22385 pending_rounds.cc:107] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:10:27.911269 22385 raft_consensus.cc:2889] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:27.913252 22525 consensus_queue.cc:1048] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:27.913561 22162 raft_consensus.cc:2468] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:27.915015 22451 raft_consensus.cc:493] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.915700 22451 raft_consensus.cc:515] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:27.916127 22349 leader_election.cc:304] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:27.918001 22451 leader_election.cc:290] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:27.897826 22201 leader_election.cc:304] T 2959be4ebd674047ba6d57a27b8b5865 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565; no voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:27.919175 22485 raft_consensus.cc:2804] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.921747 22525 consensus_queue.cc:1048] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:27.922646 22471 raft_consensus.cc:2749] T 2959be4ebd674047ba6d57a27b8b5865 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:27.922799 22201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:45017, user_credentials={real_user=slave}} blocked reactor thread for 52446.5us
I20260709 13:10:27.920347 22509 leader_election.cc:290] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:27.923849 22485 raft_consensus.cc:697] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Leader. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:27.928201 22485 consensus_queue.cc:237] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:27.935540 22437 tablet_bootstrap.cc:654] T da53827c80a54c43a6cdcb57b857f7a3 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.934906 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ecf0583df84abeae688412d6870da7" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:27.937429 22311 raft_consensus.cc:2468] T 4805089364594284ba715cf71e92f20c P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:27.941354 22433 tablet_bootstrap.cc:492] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:27.942085 22433 ts_tablet_manager.cc:1403] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.119s	user 0.024s	sys 0.012s
W20260709 13:10:27.943984 22275 leader_election.cc:343] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.933655 22201 leader_election.cc:304] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:27.954247 22061 catalog_manager.cc:5697] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:27.958916 22127 consensus_peers.cc:597] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 -> Peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Couldn't send request to peer 371d38ec3c7f493e9aea62dae121e565. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:27.959179 22203 leader_election.cc:304] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:27.957528 22061 catalog_manager.cc:5697] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.965384 22509 raft_consensus.cc:2804] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.965775 22311 raft_consensus.cc:1275] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:27.965935 22509 raft_consensus.cc:697] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Becoming Leader. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:27.966778 22509 consensus_queue.cc:237] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:27.967295 22482 consensus_queue.cc:1048] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:27.971653 22451 raft_consensus.cc:493] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.973711 22508 raft_consensus.cc:2804] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.982802 22431 tablet_bootstrap.cc:492] T 90ecf0583df84abeae688412d6870da7 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:27.983281 22431 ts_tablet_manager.cc:1403] T 90ecf0583df84abeae688412d6870da7 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.151s	user 0.012s	sys 0.011s
I20260709 13:10:27.987959 22434 tablet_bootstrap.cc:654] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:27.975217 22201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:45017, user_credentials={real_user=slave}} blocked reactor thread for 49089.9us
I20260709 13:10:27.990327 22431 raft_consensus.cc:359] T 90ecf0583df84abeae688412d6870da7 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:27.991225 22431 raft_consensus.cc:385] T 90ecf0583df84abeae688412d6870da7 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.986755 22508 raft_consensus.cc:697] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Becoming Leader. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:27.991519 22431 raft_consensus.cc:740] T 90ecf0583df84abeae688412d6870da7 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.992233 22431 consensus_queue.cc:260] T 90ecf0583df84abeae688412d6870da7 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:27.982197 22451 raft_consensus.cc:515] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:27.992062 22508 consensus_queue.cc:237] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:28.001482 22431 ts_tablet_manager.cc:1434] T 90ecf0583df84abeae688412d6870da7 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:10:28.002358 22431 tablet_bootstrap.cc:492] T c9fb0f415f654f798baa3cccc149e8a3 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:28.005201 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ecf0583df84abeae688412d6870da7" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:28.006021 22238 raft_consensus.cc:2468] T 90ecf0583df84abeae688412d6870da7 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 0.
I20260709 13:10:28.009573 22437 tablet_bootstrap.cc:492] T da53827c80a54c43a6cdcb57b857f7a3 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:28.010049 22437 ts_tablet_manager.cc:1403] T da53827c80a54c43a6cdcb57b857f7a3 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.121s	user 0.021s	sys 0.001s
I20260709 13:10:28.008463 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181a60684715425284af6a13cc16242f" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:28.011957 22386 raft_consensus.cc:2468] T 181a60684715425284af6a13cc16242f P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 0.
I20260709 13:10:28.006609 22451 leader_election.cc:290] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:28.006688 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4805089364594284ba715cf71e92f20c" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:28.018890 22433 raft_consensus.cc:359] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:28.020164 22433 raft_consensus.cc:385] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.020474 22433 raft_consensus.cc:740] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.022794 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181a60684715425284af6a13cc16242f" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:28.023537 22238 raft_consensus.cc:2468] T 181a60684715425284af6a13cc16242f P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 0.
I20260709 13:10:28.025359 22276 leader_election.cc:304] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:28.026309 22451 raft_consensus.cc:2804] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.026719 22451 raft_consensus.cc:493] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.026697 22275 leader_election.cc:304] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:28.027438 22451 raft_consensus.cc:3060] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.028163 22521 raft_consensus.cc:2804] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.028659 22521 raft_consensus.cc:493] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.029052 22521 raft_consensus.cc:3060] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.026611 22433 consensus_queue.cc:260] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:28.032661 22433 ts_tablet_manager.cc:1434] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.090s	user 0.008s	sys 0.002s
I20260709 13:10:28.033650 22433 tablet_bootstrap.cc:492] T 4805089364594284ba715cf71e92f20c P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
W20260709 13:10:28.036522 22527 log.cc:927] Time spent T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:10:28.035005 22437 raft_consensus.cc:359] T da53827c80a54c43a6cdcb57b857f7a3 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.041538 22437 raft_consensus.cc:385] T da53827c80a54c43a6cdcb57b857f7a3 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.043942 22437 raft_consensus.cc:740] T da53827c80a54c43a6cdcb57b857f7a3 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.048688 22437 consensus_queue.cc:260] T da53827c80a54c43a6cdcb57b857f7a3 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.051323 22433 tablet_bootstrap.cc:654] T 4805089364594284ba715cf71e92f20c P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.049502 22521 raft_consensus.cc:515] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:28.052100 22061 catalog_manager.cc:5697] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b reported cstate change: term changed from 0 to 1, leader changed from <none> to edd63b54133d4c8d9149d57a2886916b (127.12.76.132). New cstate: current_term: 1 leader_uuid: "edd63b54133d4c8d9149d57a2886916b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:28.050202 22201 leader_election.cc:343] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.057119 22437 ts_tablet_manager.cc:1434] T da53827c80a54c43a6cdcb57b857f7a3 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:10:28.058161 22437 tablet_bootstrap.cc:492] T b570b00ae75a47cda3fcb47ad5f0f97c P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:28.051153 22451 raft_consensus.cc:515] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.059361 22061 catalog_manager.cc:5697] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b reported cstate change: term changed from 0 to 1, leader changed from <none> to edd63b54133d4c8d9149d57a2886916b (127.12.76.132). New cstate: current_term: 1 leader_uuid: "edd63b54133d4c8d9149d57a2886916b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.064239 22521 leader_election.cc:290] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:28.065663 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181a60684715425284af6a13cc16242f" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:28.066358 22386 raft_consensus.cc:3060] T 181a60684715425284af6a13cc16242f P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.071736 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ecf0583df84abeae688412d6870da7" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:28.075450 22509 consensus_queue.cc:1048] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.070387 22060 catalog_manager.cc:5697] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565 reported cstate change: term changed from 0 to 1, leader changed from <none> to 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "371d38ec3c7f493e9aea62dae121e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.073372 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181a60684715425284af6a13cc16242f" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:28.074276 22237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ecf0583df84abeae688412d6870da7" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:28.080035 22237 raft_consensus.cc:3060] T 90ecf0583df84abeae688412d6870da7 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.073086 22451 leader_election.cc:290] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:28.078619 22431 tablet_bootstrap.cc:654] T c9fb0f415f654f798baa3cccc149e8a3 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.085887 22434 tablet_bootstrap.cc:492] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:28.084271 22238 raft_consensus.cc:3060] T 181a60684715425284af6a13cc16242f P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.086419 22434 ts_tablet_manager.cc:1403] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.198s	user 0.012s	sys 0.001s
I20260709 13:10:28.089793 22434 raft_consensus.cc:359] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
W20260709 13:10:28.090050 22275 leader_election.cc:343] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.090682 22434 raft_consensus.cc:385] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.091063 22434 raft_consensus.cc:740] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.091794 22434 consensus_queue.cc:260] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:28.094005 22434 ts_tablet_manager.cc:1434] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:10:28.095160 22434 tablet_bootstrap.cc:492] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:28.097946 22386 raft_consensus.cc:2468] T 181a60684715425284af6a13cc16242f P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 1.
I20260709 13:10:28.101401 22238 raft_consensus.cc:2468] T 181a60684715425284af6a13cc16242f P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 1.
I20260709 13:10:28.103050 22237 raft_consensus.cc:2468] T 90ecf0583df84abeae688412d6870da7 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 1.
I20260709 13:10:28.124783 22276 leader_election.cc:304] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:28.106966 22434 tablet_bootstrap.cc:654] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.126410 22276 leader_election.cc:304] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:28.127599 22451 raft_consensus.cc:2804] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.128146 22451 raft_consensus.cc:697] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0 [term 1 LEADER]: Becoming Leader. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Running, Role: LEADER
I20260709 13:10:28.128275 22521 raft_consensus.cc:2804] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.128764 22521 raft_consensus.cc:697] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 LEADER]: Becoming Leader. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Running, Role: LEADER
I20260709 13:10:28.129012 22451 consensus_queue.cc:237] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:28.129576 22521 consensus_queue.cc:237] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.130970 22059 catalog_manager.cc:5697] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 reported cstate change: term changed from 0 to 1, leader changed from <none> to 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "371d38ec3c7f493e9aea62dae121e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:28.111068 22437 tablet_bootstrap.cc:654] T b570b00ae75a47cda3fcb47ad5f0f97c P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.115818 22433 tablet_bootstrap.cc:492] T 4805089364594284ba715cf71e92f20c P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:28.123529 22162 raft_consensus.cc:3060] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.136865 22433 ts_tablet_manager.cc:1403] T 4805089364594284ba715cf71e92f20c P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.103s	user 0.021s	sys 0.003s
I20260709 13:10:28.139693 22433 raft_consensus.cc:359] T 4805089364594284ba715cf71e92f20c P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:28.140326 22433 raft_consensus.cc:385] T 4805089364594284ba715cf71e92f20c P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.140564 22433 raft_consensus.cc:740] T 4805089364594284ba715cf71e92f20c P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.141214 22433 consensus_queue.cc:260] T 4805089364594284ba715cf71e92f20c P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:28.143226 22433 ts_tablet_manager.cc:1434] T 4805089364594284ba715cf71e92f20c P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:10:28.120609 22431 tablet_bootstrap.cc:492] T c9fb0f415f654f798baa3cccc149e8a3 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:28.144177 22433 tablet_bootstrap.cc:492] T 69ff2881b0ad428984068a6150870c61 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:28.144464 22431 ts_tablet_manager.cc:1403] T c9fb0f415f654f798baa3cccc149e8a3 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.142s	user 0.024s	sys 0.014s
I20260709 13:10:28.147801 22437 tablet_bootstrap.cc:492] T b570b00ae75a47cda3fcb47ad5f0f97c P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:28.148299 22437 ts_tablet_manager.cc:1403] T b570b00ae75a47cda3fcb47ad5f0f97c P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.090s	user 0.008s	sys 0.005s
I20260709 13:10:28.147177 22431 raft_consensus.cc:359] T c9fb0f415f654f798baa3cccc149e8a3 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.160728 22431 raft_consensus.cc:385] T c9fb0f415f654f798baa3cccc149e8a3 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.161089 22431 raft_consensus.cc:740] T c9fb0f415f654f798baa3cccc149e8a3 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.161775 22431 consensus_queue.cc:260] T c9fb0f415f654f798baa3cccc149e8a3 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.162072 22437 raft_consensus.cc:359] T b570b00ae75a47cda3fcb47ad5f0f97c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.162837 22437 raft_consensus.cc:385] T b570b00ae75a47cda3fcb47ad5f0f97c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.163357 22437 raft_consensus.cc:740] T b570b00ae75a47cda3fcb47ad5f0f97c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.164137 22437 consensus_queue.cc:260] T b570b00ae75a47cda3fcb47ad5f0f97c P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.166075 22525 raft_consensus.cc:493] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.166393 22437 ts_tablet_manager.cc:1434] T b570b00ae75a47cda3fcb47ad5f0f97c P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.013s
I20260709 13:10:28.167181 22431 ts_tablet_manager.cc:1434] T c9fb0f415f654f798baa3cccc149e8a3 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:10:28.166636 22525 raft_consensus.cc:515] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:28.167541 22437 tablet_bootstrap.cc:492] T acf09c0982fd493caaf8c31bc1964c22 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:28.169234 22434 tablet_bootstrap.cc:492] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:28.169642 22434 ts_tablet_manager.cc:1403] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.075s	user 0.009s	sys 0.000s
I20260709 13:10:28.167263 22509 consensus_queue.cc:1048] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.171300 22525 leader_election.cc:290] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:28.172149 22431 tablet_bootstrap.cc:492] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:28.172462 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bb47d9fadc476296b95dba1bf4d037" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:28.173730 22237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bb47d9fadc476296b95dba1bf4d037" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:28.173640 22434 raft_consensus.cc:359] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.173383 22058 catalog_manager.cc:5697] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "66d3606ce30b4661b5d62d403d7abca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:28.174413 22434 raft_consensus.cc:385] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.174777 22434 raft_consensus.cc:740] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.175437 22434 consensus_queue.cc:260] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.175295 22058 catalog_manager.cc:5697] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "66d3606ce30b4661b5d62d403d7abca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.176088 22127 leader_election.cc:304] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:28.177484 22434 ts_tablet_manager.cc:1434] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:28.177408 22482 raft_consensus.cc:2749] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:28.178774 22431 tablet_bootstrap.cc:654] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.181188 22434 tablet_bootstrap.cc:492] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:28.185209 22437 tablet_bootstrap.cc:654] T acf09c0982fd493caaf8c31bc1964c22 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.186844 22434 tablet_bootstrap.cc:654] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.187789 22433 tablet_bootstrap.cc:654] T 69ff2881b0ad428984068a6150870c61 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.196290 22437 tablet_bootstrap.cc:492] T acf09c0982fd493caaf8c31bc1964c22 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:28.196810 22437 ts_tablet_manager.cc:1403] T acf09c0982fd493caaf8c31bc1964c22 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.000s
I20260709 13:10:28.199522 22437 raft_consensus.cc:359] T acf09c0982fd493caaf8c31bc1964c22 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:28.200263 22437 raft_consensus.cc:385] T acf09c0982fd493caaf8c31bc1964c22 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.200508 22437 raft_consensus.cc:740] T acf09c0982fd493caaf8c31bc1964c22 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
W20260709 13:10:28.203914 22351 consensus_peers.cc:597] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b -> Peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Couldn't send request to peer 66d3606ce30b4661b5d62d403d7abca0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:28.204334 22437 consensus_queue.cc:260] T acf09c0982fd493caaf8c31bc1964c22 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:28.207536 22525 raft_consensus.cc:493] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.207890 22433 tablet_bootstrap.cc:492] T 69ff2881b0ad428984068a6150870c61 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:28.208017 22525 raft_consensus.cc:515] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.208428 22433 ts_tablet_manager.cc:1403] T 69ff2881b0ad428984068a6150870c61 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.064s	user 0.008s	sys 0.010s
I20260709 13:10:28.210283 22525 leader_election.cc:290] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:28.211277 22434 tablet_bootstrap.cc:492] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:28.211803 22434 ts_tablet_manager.cc:1403] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:10:28.211483 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ff2881b0ad428984068a6150870c61" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:28.211407 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ff2881b0ad428984068a6150870c61" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
W20260709 13:10:28.213128 22128 leader_election.cc:343] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:28.213660 22126 leader_election.cc:343] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.214110 22126 leader_election.cc:304] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:28.214850 22525 raft_consensus.cc:2749] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.214875 22431 tablet_bootstrap.cc:492] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:28.215991 22437 ts_tablet_manager.cc:1434] T acf09c0982fd493caaf8c31bc1964c22 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:10:28.215859 22433 raft_consensus.cc:359] T 69ff2881b0ad428984068a6150870c61 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.216786 22433 raft_consensus.cc:385] T 69ff2881b0ad428984068a6150870c61 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.217135 22437 tablet_bootstrap.cc:492] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:28.214493 22434 raft_consensus.cc:359] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.217638 22434 raft_consensus.cc:385] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.217891 22434 raft_consensus.cc:740] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.218490 22434 consensus_queue.cc:260] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.217056 22433 raft_consensus.cc:740] T 69ff2881b0ad428984068a6150870c61 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.215904 22431 ts_tablet_manager.cc:1403] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.007s
I20260709 13:10:28.219717 22433 consensus_queue.cc:260] T 69ff2881b0ad428984068a6150870c61 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.221906 22433 ts_tablet_manager.cc:1434] T 69ff2881b0ad428984068a6150870c61 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:10:28.222100 22431 raft_consensus.cc:359] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.222777 22431 raft_consensus.cc:385] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.223023 22431 raft_consensus.cc:740] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.223438 22437 tablet_bootstrap.cc:654] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.223565 22434 ts_tablet_manager.cc:1434] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:10:28.223668 22431 consensus_queue.cc:260] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.224521 22434 tablet_bootstrap.cc:492] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:28.230340 22433 tablet_bootstrap.cc:492] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:28.230636 22509 raft_consensus.cc:493] T c9fb0f415f654f798baa3cccc149e8a3 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.231164 22509 raft_consensus.cc:515] T c9fb0f415f654f798baa3cccc149e8a3 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.233233 22509 leader_election.cc:290] T c9fb0f415f654f798baa3cccc149e8a3 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:28.235028 22509 raft_consensus.cc:493] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.235085 22521 consensus_queue.cc:1048] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.235567 22509 raft_consensus.cc:515] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.237993 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9fb0f415f654f798baa3cccc149e8a3" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:28.238216 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5f23465fe44a799f3521c814b38d55" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:28.238782 22162 raft_consensus.cc:2393] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 371d38ec3c7f493e9aea62dae121e565 in current term 1: Already voted for candidate edd63b54133d4c8d9149d57a2886916b in this term.
I20260709 13:10:28.238904 22433 tablet_bootstrap.cc:654] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.239946 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9fb0f415f654f798baa3cccc149e8a3" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:28.241071 22509 leader_election.cc:290] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:28.241634 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5f23465fe44a799f3521c814b38d55" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:28.242093 22431 ts_tablet_manager.cc:1434] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:10:28.243120 22431 tablet_bootstrap.cc:492] T 8f1e603414db46e7bf2cdd620118e39d P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:28.243220 22201 leader_election.cc:304] T c9fb0f415f654f798baa3cccc149e8a3 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565; no voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:28.244014 22509 raft_consensus.cc:3060] T c9fb0f415f654f798baa3cccc149e8a3 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.245114 22203 leader_election.cc:304] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565; no voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:28.245837 22434 tablet_bootstrap.cc:654] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.245898 22508 raft_consensus.cc:2749] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.246313 22485 raft_consensus.cc:493] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.246806 22485 raft_consensus.cc:515] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:28.250535 22237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2959be4ebd674047ba6d57a27b8b5865" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:28.251297 22237 raft_consensus.cc:2468] T 2959be4ebd674047ba6d57a27b8b5865 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:28.252256 22485 leader_election.cc:290] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:28.252808 22350 leader_election.cc:304] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:28.254289 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2959be4ebd674047ba6d57a27b8b5865" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
W20260709 13:10:28.256102 22349 leader_election.cc:343] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.257254 22485 raft_consensus.cc:2804] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.257753 22485 raft_consensus.cc:493] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.258208 22485 raft_consensus.cc:3060] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.265831 22509 raft_consensus.cc:2749] T c9fb0f415f654f798baa3cccc149e8a3 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.275028 22431 tablet_bootstrap.cc:654] T 8f1e603414db46e7bf2cdd620118e39d P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.276832 22521 raft_consensus.cc:493] T da53827c80a54c43a6cdcb57b857f7a3 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.277333 22521 raft_consensus.cc:515] T da53827c80a54c43a6cdcb57b857f7a3 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.279522 22521 leader_election.cc:290] T da53827c80a54c43a6cdcb57b857f7a3 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:28.281405 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da53827c80a54c43a6cdcb57b857f7a3" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:28.283245 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da53827c80a54c43a6cdcb57b857f7a3" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:28.284027 22162 raft_consensus.cc:2393] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66d3606ce30b4661b5d62d403d7abca0 in current term 1: Already voted for candidate edd63b54133d4c8d9149d57a2886916b in this term.
I20260709 13:10:28.281409 22451 consensus_queue.cc:1048] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:10:28.285629 22440 consensus_queue.cc:1048] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.287946 22437 tablet_bootstrap.cc:492] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:28.288498 22437 ts_tablet_manager.cc:1403] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.015s
I20260709 13:10:28.291388 22275 leader_election.cc:304] T da53827c80a54c43a6cdcb57b857f7a3 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:28.293439 22521 raft_consensus.cc:3060] T da53827c80a54c43a6cdcb57b857f7a3 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.298758 22437 raft_consensus.cc:359] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.299697 22437 raft_consensus.cc:385] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.300033 22437 raft_consensus.cc:740] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.300843 22437 consensus_queue.cc:260] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.310521 22521 raft_consensus.cc:2749] T da53827c80a54c43a6cdcb57b857f7a3 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.270804 22485 raft_consensus.cc:515] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:28.313658 22433 tablet_bootstrap.cc:492] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:28.314164 22433 ts_tablet_manager.cc:1403] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.022s
I20260709 13:10:28.314636 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2959be4ebd674047ba6d57a27b8b5865" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
W20260709 13:10:28.316087 22349 leader_election.cc:343] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.317169 22433 raft_consensus.cc:359] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:28.318216 22433 raft_consensus.cc:385] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.318478 22433 raft_consensus.cc:740] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.319250 22433 consensus_queue.cc:260] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:28.321709 22433 ts_tablet_manager.cc:1434] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:28.322507 22485 leader_election.cc:290] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:28.324429 22434 tablet_bootstrap.cc:492] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:28.324908 22434 ts_tablet_manager.cc:1403] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.101s	user 0.011s	sys 0.031s
I20260709 13:10:28.326412 22437 ts_tablet_manager.cc:1434] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:10:28.327351 22437 tablet_bootstrap.cc:492] T c7b7f9ed1b11429d98f831e122707ae2 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:28.328951 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2959be4ebd674047ba6d57a27b8b5865" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:28.329540 22238 raft_consensus.cc:3060] T 2959be4ebd674047ba6d57a27b8b5865 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.322736 22433 tablet_bootstrap.cc:492] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:28.338250 22434 raft_consensus.cc:359] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:28.339035 22434 raft_consensus.cc:385] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.340188 22525 consensus_queue.cc:1048] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.342525 22517 consensus_queue.cc:1048] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.347579 22238 raft_consensus.cc:2468] T 2959be4ebd674047ba6d57a27b8b5865 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:28.349835 22350 leader_election.cc:304] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:28.350641 22485 raft_consensus.cc:2804] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.351537 22485 raft_consensus.cc:697] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Leader. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:28.339569 22434 raft_consensus.cc:740] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.352579 22485 consensus_queue.cc:237] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:28.356530 22433 tablet_bootstrap.cc:654] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.353763 22434 consensus_queue.cc:260] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:28.359822 22521 raft_consensus.cc:493] T b570b00ae75a47cda3fcb47ad5f0f97c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.360379 22521 raft_consensus.cc:515] T b570b00ae75a47cda3fcb47ad5f0f97c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.361557 22434 ts_tablet_manager.cc:1434] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:10:28.362512 22434 tablet_bootstrap.cc:492] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:28.363938 22384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b570b00ae75a47cda3fcb47ad5f0f97c" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:28.363144 22519 raft_consensus.cc:493] T acf09c0982fd493caaf8c31bc1964c22 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.365213 22519 raft_consensus.cc:515] T acf09c0982fd493caaf8c31bc1964c22 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
W20260709 13:10:28.365834 22128 consensus_peers.cc:597] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 -> Peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Couldn't send request to peer 66d3606ce30b4661b5d62d403d7abca0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:28.366322 22431 tablet_bootstrap.cc:492] T 8f1e603414db46e7bf2cdd620118e39d P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:28.366791 22431 ts_tablet_manager.cc:1403] T 8f1e603414db46e7bf2cdd620118e39d P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.124s	user 0.013s	sys 0.015s
W20260709 13:10:28.368963 22275 leader_election.cc:343] T b570b00ae75a47cda3fcb47ad5f0f97c P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.369768 22431 raft_consensus.cc:359] T 8f1e603414db46e7bf2cdd620118e39d P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:28.370530 22431 raft_consensus.cc:385] T 8f1e603414db46e7bf2cdd620118e39d P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.370749 22519 leader_election.cc:290] T acf09c0982fd493caaf8c31bc1964c22 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:28.370831 22431 raft_consensus.cc:740] T 8f1e603414db46e7bf2cdd620118e39d P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.371840 22431 consensus_queue.cc:260] T 8f1e603414db46e7bf2cdd620118e39d P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:28.372421 22384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf09c0982fd493caaf8c31bc1964c22" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:28.373111 22517 consensus_queue.cc:1048] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:28.373870 22275 leader_election.cc:343] T acf09c0982fd493caaf8c31bc1964c22 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.374075 22431 ts_tablet_manager.cc:1434] T 8f1e603414db46e7bf2cdd620118e39d P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:28.370316 22509 consensus_queue.cc:1048] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:10:28.375234 22431 tablet_bootstrap.cc:492] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:28.379837 22521 leader_election.cc:290] T b570b00ae75a47cda3fcb47ad5f0f97c P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:28.381595 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b570b00ae75a47cda3fcb47ad5f0f97c" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:28.383693 22431 tablet_bootstrap.cc:654] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.383059 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf09c0982fd493caaf8c31bc1964c22" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
W20260709 13:10:28.385486 22276 leader_election.cc:343] T acf09c0982fd493caaf8c31bc1964c22 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.385947 22276 leader_election.cc:304] T acf09c0982fd493caaf8c31bc1964c22 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b
W20260709 13:10:28.394872 22275 leader_election.cc:343] T b570b00ae75a47cda3fcb47ad5f0f97c P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.395447 22275 leader_election.cc:304] T b570b00ae75a47cda3fcb47ad5f0f97c P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:28.396651 22519 raft_consensus.cc:2749] T acf09c0982fd493caaf8c31bc1964c22 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.397293 22519 raft_consensus.cc:2749] T b570b00ae75a47cda3fcb47ad5f0f97c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.402480 22434 tablet_bootstrap.cc:654] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.403201 22431 tablet_bootstrap.cc:492] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:28.403793 22431 ts_tablet_manager.cc:1403] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.007s
I20260709 13:10:28.406805 22431 raft_consensus.cc:359] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.408643 22431 raft_consensus.cc:385] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.408926 22431 raft_consensus.cc:740] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.412351 22431 consensus_queue.cc:260] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.414422 22431 ts_tablet_manager.cc:1434] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:10:28.417527 22431 tablet_bootstrap.cc:492] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:28.418572 22437 tablet_bootstrap.cc:654] T c7b7f9ed1b11429d98f831e122707ae2 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.424563 22433 tablet_bootstrap.cc:492] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:28.425057 22433 ts_tablet_manager.cc:1403] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.103s	user 0.008s	sys 0.004s
I20260709 13:10:28.426923 22525 consensus_queue.cc:1048] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.428157 22433 raft_consensus.cc:359] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.428936 22433 raft_consensus.cc:385] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.429224 22433 raft_consensus.cc:740] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.429314 22059 catalog_manager.cc:5697] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b reported cstate change: term changed from 0 to 1, leader changed from <none> to edd63b54133d4c8d9149d57a2886916b (127.12.76.132). New cstate: current_term: 1 leader_uuid: "edd63b54133d4c8d9149d57a2886916b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.439374 22384 raft_consensus.cc:3060] T 4805089364594284ba715cf71e92f20c P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.447703 22236 raft_consensus.cc:3060] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.450058 22434 tablet_bootstrap.cc:492] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:28.450443 22437 tablet_bootstrap.cc:492] T c7b7f9ed1b11429d98f831e122707ae2 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:28.450555 22434 ts_tablet_manager.cc:1403] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.088s	user 0.008s	sys 0.012s
I20260709 13:10:28.450938 22437 ts_tablet_manager.cc:1403] T c7b7f9ed1b11429d98f831e122707ae2 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.124s	user 0.018s	sys 0.003s
I20260709 13:10:28.430090 22433 consensus_queue.cc:260] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.453204 22521 raft_consensus.cc:493] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.453285 22433 ts_tablet_manager.cc:1434] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:10:28.453498 22434 raft_consensus.cc:359] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.453701 22521 raft_consensus.cc:515] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.454249 22434 raft_consensus.cc:385] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.454547 22434 raft_consensus.cc:740] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.454689 22433 tablet_bootstrap.cc:492] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:28.455796 22521 leader_election.cc:290] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:28.457693 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ff2881b0ad428984068a6150870c61" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:28.458344 22386 raft_consensus.cc:2468] T 69ff2881b0ad428984068a6150870c61 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 0.
I20260709 13:10:28.459365 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ff2881b0ad428984068a6150870c61" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:28.460039 22162 raft_consensus.cc:2468] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 0.
I20260709 13:10:28.461433 22431 tablet_bootstrap.cc:654] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.464476 22275 leader_election.cc:304] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:28.465672 22521 raft_consensus.cc:2804] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.466156 22521 raft_consensus.cc:493] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.466570 22521 raft_consensus.cc:3060] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.466507 22471 consensus_queue.cc:1048] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:28.473242 22471 raft_consensus.cc:493] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.473675 22471 raft_consensus.cc:515] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.474874 22433 tablet_bootstrap.cc:654] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.475751 22522 raft_consensus.cc:493] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.476415 22522 raft_consensus.cc:515] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.477906 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339b03c27dab449090201492ec507025" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:28.478538 22162 raft_consensus.cc:2468] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 0.
I20260709 13:10:28.479015 22522 leader_election.cc:290] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:28.480540 22485 raft_consensus.cc:493] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.481134 22201 leader_election.cc:304] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 
I20260709 13:10:28.482067 22508 raft_consensus.cc:2804] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.482431 22508 raft_consensus.cc:493] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.482852 22508 raft_consensus.cc:3060] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.485924 22521 raft_consensus.cc:515] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.481083 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339b03c27dab449090201492ec507025" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:28.456039 22437 raft_consensus.cc:359] T c7b7f9ed1b11429d98f831e122707ae2 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:28.490626 22437 raft_consensus.cc:385] T c7b7f9ed1b11429d98f831e122707ae2 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.481096 22485 raft_consensus.cc:515] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:28.490909 22437 raft_consensus.cc:740] T c7b7f9ed1b11429d98f831e122707ae2 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.491670 22434 consensus_queue.cc:260] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.492769 22437 consensus_queue.cc:260] T c7b7f9ed1b11429d98f831e122707ae2 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:28.494689 22237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1e603414db46e7bf2cdd620118e39d" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:28.495584 22485 leader_election.cc:290] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:28.501076 22437 ts_tablet_manager.cc:1434] T c7b7f9ed1b11429d98f831e122707ae2 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.002s
I20260709 13:10:28.502108 22437 tablet_bootstrap.cc:492] T 339b03c27dab449090201492ec507025 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:28.495332 22237 raft_consensus.cc:2468] T 8f1e603414db46e7bf2cdd620118e39d P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:28.504629 22509 consensus_queue.cc:1048] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.505862 22350 leader_election.cc:304] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:28.495380 22434 ts_tablet_manager.cc:1434] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260709 13:10:28.507799 22521 leader_election.cc:290] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:28.510581 22237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339b03c27dab449090201492ec507025" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:28.509393 22434 tablet_bootstrap.cc:492] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:28.520262 22484 consensus_queue.cc:1048] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:28.507769 22128 leader_election.cc:343] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.513546 22384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ff2881b0ad428984068a6150870c61" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:28.524174 22384 raft_consensus.cc:3060] T 69ff2881b0ad428984068a6150870c61 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.516398 22509 consensus_queue.cc:1048] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:10:28.529237 22471 leader_election.cc:290] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:28.530453 22440 raft_consensus.cc:2804] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.530886 22440 raft_consensus.cc:493] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.515107 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ff2881b0ad428984068a6150870c61" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:28.531881 22163 raft_consensus.cc:3060] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.531227 22440 raft_consensus.cc:3060] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.531234 22466 consensus_queue.cc:1048] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:10:28.536566 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339b03c27dab449090201492ec507025" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:28.539060 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1e603414db46e7bf2cdd620118e39d" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:28.539623 22384 raft_consensus.cc:2468] T 69ff2881b0ad428984068a6150870c61 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 1.
I20260709 13:10:28.540587 22437 tablet_bootstrap.cc:654] T 339b03c27dab449090201492ec507025 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.539320 22163 raft_consensus.cc:2468] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 1.
I20260709 13:10:28.546810 22434 tablet_bootstrap.cc:654] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:28.546898 22349 leader_election.cc:343] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.547571 22485 consensus_queue.cc:1048] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:28.510663 22525 raft_consensus.cc:493] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.548723 22525 raft_consensus.cc:515] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.551168 22275 leader_election.cc:304] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:28.552281 22521 raft_consensus.cc:2804] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.552825 22521 raft_consensus.cc:697] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 LEADER]: Becoming Leader. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Running, Role: LEADER
I20260709 13:10:28.553658 22521 consensus_queue.cc:237] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
W20260709 13:10:28.551755 22203 leader_election.cc:343] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.567261 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ecf0583df84abeae688412d6870da7" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:28.568249 22525 leader_election.cc:290] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:28.568336 22238 raft_consensus.cc:2393] T 90ecf0583df84abeae688412d6870da7 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d515385609945e5837e85b77de385e2 in current term 1: Already voted for candidate 66d3606ce30b4661b5d62d403d7abca0 in this term.
I20260709 13:10:28.570636 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ecf0583df84abeae688412d6870da7" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:28.573232 22127 leader_election.cc:304] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:28.575479 22525 raft_consensus.cc:3060] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.577574 22484 raft_consensus.cc:493] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.578330 22484 raft_consensus.cc:515] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.580482 22484 leader_election.cc:290] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:28.581760 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c1ffecc5b948bd8f3f48d9a7a40a96" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:28.583637 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c1ffecc5b948bd8f3f48d9a7a40a96" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
W20260709 13:10:28.585592 22128 leader_election.cc:343] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:28.586584 22127 leader_election.cc:343] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.587174 22127 leader_election.cc:304] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:28.588836 22312 raft_consensus.cc:3060] T c7b7f9ed1b11429d98f831e122707ae2 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.589406 22522 raft_consensus.cc:2749] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.600329 22431 tablet_bootstrap.cc:492] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:28.601064 22431 ts_tablet_manager.cc:1403] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.186s	user 0.015s	sys 0.016s
I20260709 13:10:28.602218 22440 raft_consensus.cc:515] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:28.606437 22508 raft_consensus.cc:515] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.607712 22237 raft_consensus.cc:2393] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d515385609945e5837e85b77de385e2 in current term 1: Already voted for candidate 371d38ec3c7f493e9aea62dae121e565 in this term.
I20260709 13:10:28.617378 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1e603414db46e7bf2cdd620118e39d" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
W20260709 13:10:28.619256 22349 leader_election.cc:343] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.620708 22440 leader_election.cc:290] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:28.620986 22127 leader_election.cc:304] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:28.622351 22578 raft_consensus.cc:3060] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.624284 22237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1e603414db46e7bf2cdd620118e39d" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:28.624886 22237 raft_consensus.cc:3060] T 8f1e603414db46e7bf2cdd620118e39d P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.628962 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339b03c27dab449090201492ec507025" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:28.629865 22508 leader_election.cc:290] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:28.632664 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339b03c27dab449090201492ec507025" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
W20260709 13:10:28.634167 22203 leader_election.cc:343] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.635788 22519 consensus_queue.cc:1048] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:28.644757 22431 raft_consensus.cc:359] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.645479 22431 raft_consensus.cc:385] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.645745 22431 raft_consensus.cc:740] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.646387 22431 consensus_queue.cc:260] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.651098 22431 ts_tablet_manager.cc:1434] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.001s
I20260709 13:10:28.652154 22431 tablet_bootstrap.cc:492] T ebca88391e7141659bba4fdc89e8a954 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:28.662633 22237 raft_consensus.cc:2468] T 8f1e603414db46e7bf2cdd620118e39d P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:28.662961 22431 tablet_bootstrap.cc:654] T ebca88391e7141659bba4fdc89e8a954 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.663954 22350 leader_election.cc:304] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:28.665308 22440 raft_consensus.cc:2804] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.665907 22440 raft_consensus.cc:697] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Leader. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:28.665367 22058 catalog_manager.cc:5697] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "66d3606ce30b4661b5d62d403d7abca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.667835 22440 consensus_queue.cc:237] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:28.681622 22485 raft_consensus.cc:493] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.681958 22437 tablet_bootstrap.cc:492] T 339b03c27dab449090201492ec507025 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:28.682415 22437 ts_tablet_manager.cc:1403] T 339b03c27dab449090201492ec507025 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.181s	user 0.023s	sys 0.020s
I20260709 13:10:28.682193 22485 raft_consensus.cc:515] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.682955 22434 tablet_bootstrap.cc:492] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:28.683458 22434 ts_tablet_manager.cc:1403] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.174s	user 0.007s	sys 0.038s
I20260709 13:10:28.684960 22578 raft_consensus.cc:2749] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.686062 22434 raft_consensus.cc:359] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:28.686594 22433 tablet_bootstrap.cc:492] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:28.686734 22434 raft_consensus.cc:385] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.687080 22434 raft_consensus.cc:740] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.687160 22433 ts_tablet_manager.cc:1403] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.233s	user 0.052s	sys 0.049s
I20260709 13:10:28.690150 22525 raft_consensus.cc:2749] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.691278 22434 consensus_queue.cc:260] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:28.693372 22434 ts_tablet_manager.cc:1434] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:10:28.694357 22434 tablet_bootstrap.cc:492] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:28.690414 22433 raft_consensus.cc:359] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:28.696949 22433 raft_consensus.cc:385] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.697314 22433 raft_consensus.cc:740] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.685158 22437 raft_consensus.cc:359] T 339b03c27dab449090201492ec507025 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.701421 22437 raft_consensus.cc:385] T 339b03c27dab449090201492ec507025 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.701709 22437 raft_consensus.cc:740] T 339b03c27dab449090201492ec507025 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.702931 22437 consensus_queue.cc:260] T 339b03c27dab449090201492ec507025 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.703112 22433 consensus_queue.cc:260] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:28.711063 22437 ts_tablet_manager.cc:1434] T 339b03c27dab449090201492ec507025 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
W20260709 13:10:28.711920 22109 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:28.716377 22437 tablet_bootstrap.cc:492] T 3a65572e11044c94ba6e4bf799385437 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:28.716979 22485 leader_election.cc:290] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:28.718556 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b570b00ae75a47cda3fcb47ad5f0f97c" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:28.718763 22433 ts_tablet_manager.cc:1434] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:10:28.719246 22310 raft_consensus.cc:2468] T b570b00ae75a47cda3fcb47ad5f0f97c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:28.719873 22433 tablet_bootstrap.cc:492] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:28.709421 22521 consensus_queue.cc:1048] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:10:28.724177 22434 tablet_bootstrap.cc:654] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.724588 22351 leader_election.cc:304] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:28.725414 22519 consensus_queue.cc:1048] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.725744 22466 raft_consensus.cc:2804] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.726104 22466 raft_consensus.cc:493] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.726445 22466 raft_consensus.cc:3060] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.727433 22519 consensus_queue.cc:1048] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.731256 22437 tablet_bootstrap.cc:654] T 3a65572e11044c94ba6e4bf799385437 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.723289 22525 raft_consensus.cc:493] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.732363 22525 raft_consensus.cc:515] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:28.734555 22525 leader_election.cc:290] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:28.736445 22433 tablet_bootstrap.cc:654] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.741921 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2959be4ebd674047ba6d57a27b8b5865" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:28.742537 22485 raft_consensus.cc:493] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.744033 22485 raft_consensus.cc:515] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:28.745685 22431 tablet_bootstrap.cc:492] T ebca88391e7141659bba4fdc89e8a954 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:28.746158 22431 ts_tablet_manager.cc:1403] T ebca88391e7141659bba4fdc89e8a954 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.094s	user 0.027s	sys 0.004s
I20260709 13:10:28.747818 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf09c0982fd493caaf8c31bc1964c22" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:28.749544 22236 raft_consensus.cc:2393] T 2959be4ebd674047ba6d57a27b8b5865 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d515385609945e5837e85b77de385e2 in current term 1: Already voted for candidate edd63b54133d4c8d9149d57a2886916b in this term.
I20260709 13:10:28.750967 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b570b00ae75a47cda3fcb47ad5f0f97c" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:28.761857 22485 leader_election.cc:290] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:28.772136 22431 raft_consensus.cc:359] T ebca88391e7141659bba4fdc89e8a954 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:28.773088 22431 raft_consensus.cc:385] T ebca88391e7141659bba4fdc89e8a954 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.773407 22431 raft_consensus.cc:740] T ebca88391e7141659bba4fdc89e8a954 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.763280 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf09c0982fd493caaf8c31bc1964c22" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
W20260709 13:10:28.774066 22349 leader_election.cc:343] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.774194 22310 raft_consensus.cc:2468] T acf09c0982fd493caaf8c31bc1964c22 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:28.774626 22431 consensus_queue.cc:260] T ebca88391e7141659bba4fdc89e8a954 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:28.775756 22351 leader_election.cc:304] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b; no voters: 
W20260709 13:10:28.776530 22350 leader_election.cc:343] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.776762 22440 raft_consensus.cc:2804] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.777792 22440 raft_consensus.cc:493] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.778385 22440 raft_consensus.cc:3060] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.748977 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2959be4ebd674047ba6d57a27b8b5865" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:28.788095 22058 catalog_manager.cc:5697] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b reported cstate change: term changed from 0 to 1, leader changed from <none> to edd63b54133d4c8d9149d57a2886916b (127.12.76.132). New cstate: current_term: 1 leader_uuid: "edd63b54133d4c8d9149d57a2886916b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.791989 22431 ts_tablet_manager.cc:1434] T ebca88391e7141659bba4fdc89e8a954 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.009s
I20260709 13:10:28.792917 22431 tablet_bootstrap.cc:492] T acf09c0982fd493caaf8c31bc1964c22 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:28.797226 22508 raft_consensus.cc:493] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.797827 22508 raft_consensus.cc:515] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.798228 22466 raft_consensus.cc:515] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.802888 22126 leader_election.cc:304] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:28.803913 22578 raft_consensus.cc:3060] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.809660 22508 leader_election.cc:290] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:28.811627 22578 raft_consensus.cc:2749] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.814637 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c1ffecc5b948bd8f3f48d9a7a40a96" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:28.815153 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c1ffecc5b948bd8f3f48d9a7a40a96" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:28.815800 22163 raft_consensus.cc:2468] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 0.
W20260709 13:10:28.816774 22203 leader_election.cc:343] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.817420 22201 leader_election.cc:304] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:28.819808 22508 raft_consensus.cc:2804] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.820282 22508 raft_consensus.cc:493] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.820784 22508 raft_consensus.cc:3060] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.823918 22162 raft_consensus.cc:2468] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:28.829394 22437 tablet_bootstrap.cc:492] T 3a65572e11044c94ba6e4bf799385437 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:28.830194 22437 ts_tablet_manager.cc:1403] T 3a65572e11044c94ba6e4bf799385437 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.114s	user 0.013s	sys 0.011s
I20260709 13:10:28.827463 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b570b00ae75a47cda3fcb47ad5f0f97c" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:28.838200 22310 raft_consensus.cc:3060] T b570b00ae75a47cda3fcb47ad5f0f97c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.846951 22310 raft_consensus.cc:2468] T b570b00ae75a47cda3fcb47ad5f0f97c P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:28.848214 22351 leader_election.cc:304] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:28.849553 22517 raft_consensus.cc:2804] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.850018 22517 raft_consensus.cc:697] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Leader. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:28.851666 22517 consensus_queue.cc:237] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.850571 22466 leader_election.cc:290] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:28.853806 22437 raft_consensus.cc:359] T 3a65572e11044c94ba6e4bf799385437 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:28.859653 22437 raft_consensus.cc:385] T 3a65572e11044c94ba6e4bf799385437 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.860013 22437 raft_consensus.cc:740] T 3a65572e11044c94ba6e4bf799385437 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.854315 22161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b570b00ae75a47cda3fcb47ad5f0f97c" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:28.860797 22437 consensus_queue.cc:260] T 3a65572e11044c94ba6e4bf799385437 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
W20260709 13:10:28.862370 22349 leader_election.cc:343] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.863569 22437 ts_tablet_manager.cc:1434] T 3a65572e11044c94ba6e4bf799385437 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.001s
I20260709 13:10:28.864684 22437 tablet_bootstrap.cc:492] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:28.864917 22508 raft_consensus.cc:515] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.867012 22508 leader_election.cc:290] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:28.867404 22434 tablet_bootstrap.cc:492] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:28.867915 22434 ts_tablet_manager.cc:1403] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.174s	user 0.013s	sys 0.009s
I20260709 13:10:28.854672 22440 raft_consensus.cc:515] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:28.855782 22201 leader_election.cc:304] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:28.859163 22431 tablet_bootstrap.cc:654] T acf09c0982fd493caaf8c31bc1964c22 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.875778 22434 raft_consensus.cc:359] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.876821 22434 raft_consensus.cc:385] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.877130 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c1ffecc5b948bd8f3f48d9a7a40a96" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:28.883342 22508 raft_consensus.cc:2804] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.884253 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c1ffecc5b948bd8f3f48d9a7a40a96" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:28.886950 22508 raft_consensus.cc:697] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Becoming Leader. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:28.887038 22162 raft_consensus.cc:3060] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.890542 22508 consensus_queue.cc:237] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
W20260709 13:10:28.889024 22203 leader_election.cc:343] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.877187 22434 raft_consensus.cc:740] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.895896 22434 consensus_queue.cc:260] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.898398 22440 leader_election.cc:290] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:28.905633 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf09c0982fd493caaf8c31bc1964c22" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:28.906384 22312 raft_consensus.cc:3060] T acf09c0982fd493caaf8c31bc1964c22 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.900781 22434 ts_tablet_manager.cc:1434] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.001s
I20260709 13:10:28.902762 22433 tablet_bootstrap.cc:492] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:28.907207 22433 ts_tablet_manager.cc:1403] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.188s	user 0.026s	sys 0.016s
I20260709 13:10:28.903450 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf09c0982fd493caaf8c31bc1964c22" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:28.910001 22433 raft_consensus.cc:359] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.910682 22433 raft_consensus.cc:385] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.910960 22433 raft_consensus.cc:740] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
W20260709 13:10:28.911052 22350 leader_election.cc:343] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.911645 22433 consensus_queue.cc:260] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:28.913209 22434 tablet_bootstrap.cc:492] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:28.899430 22162 raft_consensus.cc:2468] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:28.915485 22466 consensus_queue.cc:1048] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.916458 22201 leader_election.cc:304] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:28.917625 22471 raft_consensus.cc:2804] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.918089 22471 raft_consensus.cc:697] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Becoming Leader. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:28.918905 22471 consensus_queue.cc:237] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.922602 22433 ts_tablet_manager.cc:1434] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:10:28.923682 22433 tablet_bootstrap.cc:492] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:28.906458 22437 tablet_bootstrap.cc:654] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.938992 22484 raft_consensus.cc:493] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.957302 22433 tablet_bootstrap.cc:654] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.965363 22312 raft_consensus.cc:2468] T acf09c0982fd493caaf8c31bc1964c22 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:28.966796 22351 leader_election.cc:304] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b; no voters: 371d38ec3c7f493e9aea62dae121e565
I20260709 13:10:28.961758 22484 raft_consensus.cc:515] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:28.969880 22440 raft_consensus.cc:2804] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.970381 22440 raft_consensus.cc:697] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Leader. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:28.970659 22431 tablet_bootstrap.cc:492] T acf09c0982fd493caaf8c31bc1964c22 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:28.960647 22466 consensus_queue.cc:1048] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:10:28.971300 22431 ts_tablet_manager.cc:1403] T acf09c0982fd493caaf8c31bc1964c22 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.179s	user 0.011s	sys 0.007s
I20260709 13:10:28.971213 22484 leader_election.cc:290] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:28.976706 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12df2e627ea748c5908bd073b917bf29" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
W20260709 13:10:28.978576 22127 leader_election.cc:343] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.972756 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12df2e627ea748c5908bd073b917bf29" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:28.971199 22440 consensus_queue.cc:237] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
W20260709 13:10:28.988830 22128 leader_election.cc:343] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.989341 22128 leader_election.cc:304] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:28.990130 22484 raft_consensus.cc:2749] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.004321 22434 tablet_bootstrap.cc:654] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.007697 22484 raft_consensus.cc:493] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.008225 22484 raft_consensus.cc:515] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.008360 22431 raft_consensus.cc:359] T acf09c0982fd493caaf8c31bc1964c22 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:29.009249 22431 raft_consensus.cc:385] T acf09c0982fd493caaf8c31bc1964c22 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.009626 22431 raft_consensus.cc:740] T acf09c0982fd493caaf8c31bc1964c22 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.009161 22057 catalog_manager.cc:5697] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b reported cstate change: term changed from 0 to 1, leader changed from <none> to edd63b54133d4c8d9149d57a2886916b (127.12.76.132). New cstate: current_term: 1 leader_uuid: "edd63b54133d4c8d9149d57a2886916b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.010897 22431 consensus_queue.cc:260] T acf09c0982fd493caaf8c31bc1964c22 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:29.013417 22431 ts_tablet_manager.cc:1434] T acf09c0982fd493caaf8c31bc1964c22 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:10:29.014394 22431 tablet_bootstrap.cc:492] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:29.015396 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1e603414db46e7bf2cdd620118e39d" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:29.018314 22484 leader_election.cc:290] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:29.014384 22059 catalog_manager.cc:5697] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 reported cstate change: term changed from 0 to 1, leader changed from <none> to 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "371d38ec3c7f493e9aea62dae121e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.019944 22237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1e603414db46e7bf2cdd620118e39d" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:29.020752 22237 raft_consensus.cc:2393] T 8f1e603414db46e7bf2cdd620118e39d P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d515385609945e5837e85b77de385e2 in current term 1: Already voted for candidate edd63b54133d4c8d9149d57a2886916b in this term.
I20260709 13:10:29.020520 22059 catalog_manager.cc:5697] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 reported cstate change: term changed from 0 to 1, leader changed from <none> to 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "371d38ec3c7f493e9aea62dae121e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.025606 22437 tablet_bootstrap.cc:492] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:29.026078 22437 ts_tablet_manager.cc:1403] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.162s	user 0.004s	sys 0.011s
I20260709 13:10:29.026038 22126 leader_election.cc:304] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:29.027160 22484 raft_consensus.cc:3060] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.027848 22543 raft_consensus.cc:493] T 339b03c27dab449090201492ec507025 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.028331 22543 raft_consensus.cc:515] T 339b03c27dab449090201492ec507025 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:29.028945 22437 raft_consensus.cc:359] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:29.029587 22437 raft_consensus.cc:385] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.029846 22437 raft_consensus.cc:740] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.030450 22543 leader_election.cc:290] T 339b03c27dab449090201492ec507025 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:29.031524 22161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339b03c27dab449090201492ec507025" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:29.031493 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339b03c27dab449090201492ec507025" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:29.032447 22161 raft_consensus.cc:2393] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66d3606ce30b4661b5d62d403d7abca0 in current term 1: Already voted for candidate 371d38ec3c7f493e9aea62dae121e565 in this term.
I20260709 13:10:29.030450 22437 consensus_queue.cc:260] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:29.035715 22431 tablet_bootstrap.cc:654] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.036307 22275 leader_election.cc:304] T 339b03c27dab449090201492ec507025 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:29.037160 22543 raft_consensus.cc:3060] T 339b03c27dab449090201492ec507025 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.045957 22543 raft_consensus.cc:2749] T 339b03c27dab449090201492ec507025 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.047204 22437 ts_tablet_manager.cc:1434] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:10:29.048233 22437 tablet_bootstrap.cc:492] T 3559a60bb91946b988a872f1f28f20f8 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:29.048063 22060 catalog_manager.cc:5697] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b reported cstate change: term changed from 0 to 1, leader changed from <none> to edd63b54133d4c8d9149d57a2886916b (127.12.76.132). New cstate: current_term: 1 leader_uuid: "edd63b54133d4c8d9149d57a2886916b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.051808 22543 raft_consensus.cc:493] T 3a65572e11044c94ba6e4bf799385437 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.052326 22543 raft_consensus.cc:515] T 3a65572e11044c94ba6e4bf799385437 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:29.054152 22484 raft_consensus.cc:2749] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.055267 22543 leader_election.cc:290] T 3a65572e11044c94ba6e4bf799385437 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:29.056321 22433 tablet_bootstrap.cc:492] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:29.056761 22433 ts_tablet_manager.cc:1403] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.133s	user 0.016s	sys 0.003s
I20260709 13:10:29.055704 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a65572e11044c94ba6e4bf799385437" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:29.058943 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a65572e11044c94ba6e4bf799385437" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:29.061801 22276 leader_election.cc:304] T 3a65572e11044c94ba6e4bf799385437 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:29.062556 22451 raft_consensus.cc:2749] T 3a65572e11044c94ba6e4bf799385437 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.063050 22433 raft_consensus.cc:359] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.063853 22433 raft_consensus.cc:385] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.064162 22433 raft_consensus.cc:740] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.065371 22433 consensus_queue.cc:260] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.066000 22434 tablet_bootstrap.cc:492] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:29.071864 22543 consensus_queue.cc:1048] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:10:29.076206 22434 ts_tablet_manager.cc:1403] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.163s	user 0.013s	sys 0.003s
I20260709 13:10:29.068095 22433 ts_tablet_manager.cc:1434] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:10:29.072145 22312 raft_consensus.cc:3060] T 3a65572e11044c94ba6e4bf799385437 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.078261 22433 tablet_bootstrap.cc:492] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:29.082814 22437 tablet_bootstrap.cc:654] T 3559a60bb91946b988a872f1f28f20f8 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.082828 22431 tablet_bootstrap.cc:492] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:29.079155 22434 raft_consensus.cc:359] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:29.087868 22431 ts_tablet_manager.cc:1403] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.074s	user 0.009s	sys 0.003s
I20260709 13:10:29.087951 22434 raft_consensus.cc:385] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.088366 22434 raft_consensus.cc:740] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.089180 22434 consensus_queue.cc:260] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:29.086898 22433 tablet_bootstrap.cc:654] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.091497 22431 raft_consensus.cc:359] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:29.092276 22431 raft_consensus.cc:385] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.092589 22431 raft_consensus.cc:740] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.094475 22431 consensus_queue.cc:260] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:29.097142 22431 ts_tablet_manager.cc:1434] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:10:29.094475 22434 ts_tablet_manager.cc:1434] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:10:29.098426 22434 tablet_bootstrap.cc:492] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:29.099761 22431 tablet_bootstrap.cc:492] T 39c5c419abe445e9ba439d1a0792991e P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:29.107615 22543 consensus_queue.cc:1048] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.117108 22434 tablet_bootstrap.cc:654] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.119932 22604 raft_consensus.cc:493] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.120489 22604 raft_consensus.cc:515] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:29.121485 22431 tablet_bootstrap.cc:654] T 39c5c419abe445e9ba439d1a0792991e P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.126562 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12df2e627ea748c5908bd073b917bf29" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:29.127343 22162 raft_consensus.cc:2468] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 0.
I20260709 13:10:29.122840 22604 leader_election.cc:290] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:29.133420 22201 leader_election.cc:304] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 
I20260709 13:10:29.137558 22604 raft_consensus.cc:2804] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.138000 22604 raft_consensus.cc:493] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.138366 22604 raft_consensus.cc:3060] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.139770 22431 tablet_bootstrap.cc:492] T 39c5c419abe445e9ba439d1a0792991e P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:29.140267 22431 ts_tablet_manager.cc:1403] T 39c5c419abe445e9ba439d1a0792991e P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.000s
I20260709 13:10:29.139256 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12df2e627ea748c5908bd073b917bf29" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
W20260709 13:10:29.143623 22203 leader_election.cc:343] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.143141 22431 raft_consensus.cc:359] T 39c5c419abe445e9ba439d1a0792991e P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.153229 22431 raft_consensus.cc:385] T 39c5c419abe445e9ba439d1a0792991e P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.153548 22431 raft_consensus.cc:740] T 39c5c419abe445e9ba439d1a0792991e P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.154277 22431 consensus_queue.cc:260] T 39c5c419abe445e9ba439d1a0792991e P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.156503 22431 ts_tablet_manager.cc:1434] T 39c5c419abe445e9ba439d1a0792991e P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:10:29.157413 22431 tablet_bootstrap.cc:492] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:29.158483 22604 raft_consensus.cc:515] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:29.161789 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12df2e627ea748c5908bd073b917bf29" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:29.162525 22162 raft_consensus.cc:3060] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.179809 22431 tablet_bootstrap.cc:654] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.186434 22509 raft_consensus.cc:493] T ebca88391e7141659bba4fdc89e8a954 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.187150 22509 raft_consensus.cc:515] T ebca88391e7141659bba4fdc89e8a954 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:29.201702 22604 leader_election.cc:290] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:29.202490 22509 leader_election.cc:290] T ebca88391e7141659bba4fdc89e8a954 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:29.204627 22451 raft_consensus.cc:493] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.205085 22162 raft_consensus.cc:2468] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:29.205322 22451 raft_consensus.cc:515] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:29.207854 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12df2e627ea748c5908bd073b917bf29" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:29.211858 22434 tablet_bootstrap.cc:492] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:29.211719 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebca88391e7141659bba4fdc89e8a954" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:29.212294 22434 ts_tablet_manager.cc:1403] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.114s	user 0.016s	sys 0.017s
I20260709 13:10:29.213073 22201 leader_election.cc:304] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 
I20260709 13:10:29.214499 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebca88391e7141659bba4fdc89e8a954" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:29.215140 22434 raft_consensus.cc:359] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:29.215830 22434 raft_consensus.cc:385] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.216094 22434 raft_consensus.cc:740] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
W20260709 13:10:29.216236 22203 leader_election.cc:343] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.216797 22434 consensus_queue.cc:260] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
W20260709 13:10:29.217561 22203 leader_election.cc:343] T ebca88391e7141659bba4fdc89e8a954 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:29.218472 22201 leader_election.cc:343] T ebca88391e7141659bba4fdc89e8a954 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.219056 22434 ts_tablet_manager.cc:1434] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:10:29.218904 22201 leader_election.cc:304] T ebca88391e7141659bba4fdc89e8a954 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565; no voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:29.219981 22434 tablet_bootstrap.cc:492] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:29.220075 22471 raft_consensus.cc:2804] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.220552 22471 raft_consensus.cc:697] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Becoming Leader. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:29.221333 22471 consensus_queue.cc:237] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:29.223186 22604 raft_consensus.cc:2749] T ebca88391e7141659bba4fdc89e8a954 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.226419 22434 tablet_bootstrap.cc:654] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.228998 22451 leader_election.cc:290] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:29.229387 22433 tablet_bootstrap.cc:492] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:29.229876 22433 ts_tablet_manager.cc:1403] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.152s	user 0.033s	sys 0.023s
I20260709 13:10:29.232136 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ced150f7b0b41c5a9a55795474c3eed" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:29.232738 22433 raft_consensus.cc:359] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:29.233428 22433 raft_consensus.cc:385] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.233268 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ced150f7b0b41c5a9a55795474c3eed" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:29.233843 22433 raft_consensus.cc:740] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.234268 22440 raft_consensus.cc:493] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.234704 22433 consensus_queue.cc:260] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:29.234776 22440 raft_consensus.cc:515] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:29.235302 22276 leader_election.cc:304] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:29.237039 22440 leader_election.cc:290] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:29.237251 22437 tablet_bootstrap.cc:492] T 3559a60bb91946b988a872f1f28f20f8 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:29.237938 22437 ts_tablet_manager.cc:1403] T 3559a60bb91946b988a872f1f28f20f8 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.190s	user 0.068s	sys 0.068s
I20260709 13:10:29.239372 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3559a60bb91946b988a872f1f28f20f8" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:29.240559 22433 ts_tablet_manager.cc:1434] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
W20260709 13:10:29.240953 22351 leader_election.cc:343] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.241552 22433 tablet_bootstrap.cc:492] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:29.241333 22437 raft_consensus.cc:359] T 3559a60bb91946b988a872f1f28f20f8 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:29.242012 22437 raft_consensus.cc:385] T 3559a60bb91946b988a872f1f28f20f8 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.242300 22437 raft_consensus.cc:740] T 3559a60bb91946b988a872f1f28f20f8 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.243156 22437 consensus_queue.cc:260] T 3559a60bb91946b988a872f1f28f20f8 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:29.244277 22543 raft_consensus.cc:2749] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.246181 22440 consensus_queue.cc:1048] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.249013 22437 ts_tablet_manager.cc:1434] T 3559a60bb91946b988a872f1f28f20f8 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:10:29.250921 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3559a60bb91946b988a872f1f28f20f8" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:29.262653 22162 raft_consensus.cc:2468] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:29.264050 22349 leader_election.cc:304] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:29.264911 22517 consensus_queue.cc:1048] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.267710 22437 tablet_bootstrap.cc:492] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:29.270430 22517 raft_consensus.cc:2804] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.270903 22517 raft_consensus.cc:493] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.271273 22517 raft_consensus.cc:3060] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.275524 22437 tablet_bootstrap.cc:654] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.282080 22060 catalog_manager.cc:5697] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 reported cstate change: term changed from 0 to 1, leader changed from <none> to 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "371d38ec3c7f493e9aea62dae121e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.290452 22471 raft_consensus.cc:493] T acf09c0982fd493caaf8c31bc1964c22 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.292984 22471 raft_consensus.cc:515] T acf09c0982fd493caaf8c31bc1964c22 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:29.295104 22471 leader_election.cc:290] T acf09c0982fd493caaf8c31bc1964c22 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:29.297799 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf09c0982fd493caaf8c31bc1964c22" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:29.298903 22310 raft_consensus.cc:2393] T acf09c0982fd493caaf8c31bc1964c22 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 371d38ec3c7f493e9aea62dae121e565 in current term 1: Already voted for candidate edd63b54133d4c8d9149d57a2886916b in this term.
I20260709 13:10:29.302561 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf09c0982fd493caaf8c31bc1964c22" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:29.302847 22600 consensus_queue.cc:1048] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.310382 22431 tablet_bootstrap.cc:492] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:29.310847 22434 tablet_bootstrap.cc:492] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:29.310926 22431 ts_tablet_manager.cc:1403] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.154s	user 0.020s	sys 0.018s
I20260709 13:10:29.311509 22434 ts_tablet_manager.cc:1403] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.092s	user 0.005s	sys 0.010s
I20260709 13:10:29.314226 22434 raft_consensus.cc:359] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.314949 22434 raft_consensus.cc:385] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.315578 22433 tablet_bootstrap.cc:654] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.319276 22431 raft_consensus.cc:359] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.315238 22434 raft_consensus.cc:740] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.319983 22431 raft_consensus.cc:385] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.320302 22431 raft_consensus.cc:740] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.320536 22517 raft_consensus.cc:515] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:29.320475 22434 consensus_queue.cc:260] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.320976 22431 consensus_queue.cc:260] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.323237 22434 ts_tablet_manager.cc:1434] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:10:29.323503 22517 leader_election.cc:290] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:29.324201 22434 tablet_bootstrap.cc:492] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:29.326467 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3559a60bb91946b988a872f1f28f20f8" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:29.327055 22162 raft_consensus.cc:3060] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.327579 22431 ts_tablet_manager.cc:1434] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.004s
I20260709 13:10:29.328357 22431 tablet_bootstrap.cc:492] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:29.333688 22434 tablet_bootstrap.cc:654] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.334547 22431 tablet_bootstrap.cc:654] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.335743 22311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3559a60bb91946b988a872f1f28f20f8" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:29.336346 22311 raft_consensus.cc:3060] T 3559a60bb91946b988a872f1f28f20f8 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.339783 22203 leader_election.cc:304] T acf09c0982fd493caaf8c31bc1964c22 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565; no voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:29.340911 22471 raft_consensus.cc:3060] T acf09c0982fd493caaf8c31bc1964c22 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.353073 22482 raft_consensus.cc:493] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.353645 22482 raft_consensus.cc:515] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:29.356745 22482 leader_election.cc:290] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:29.358328 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b570b00ae75a47cda3fcb47ad5f0f97c" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:29.361294 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b570b00ae75a47cda3fcb47ad5f0f97c" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:29.367403 22128 leader_election.cc:304] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:29.369496 22484 raft_consensus.cc:2749] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.369505 22434 tablet_bootstrap.cc:492] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:29.370208 22434 ts_tablet_manager.cc:1403] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.001s
I20260709 13:10:29.371002 22484 raft_consensus.cc:493] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.371507 22484 raft_consensus.cc:515] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.373250 22434 raft_consensus.cc:359] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.373975 22434 raft_consensus.cc:385] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.374094 22600 raft_consensus.cc:493] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.374300 22434 raft_consensus.cc:740] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.374830 22600 raft_consensus.cc:515] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.375160 22434 consensus_queue.cc:260] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.377705 22434 ts_tablet_manager.cc:1434] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:29.377588 22604 consensus_queue.cc:1048] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.377851 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c5c419abe445e9ba439d1a0792991e" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:29.378472 22385 raft_consensus.cc:2468] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 0.
I20260709 13:10:29.378716 22434 tablet_bootstrap.cc:492] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:29.379213 22237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c5c419abe445e9ba439d1a0792991e" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:29.379861 22237 raft_consensus.cc:2468] T 39c5c419abe445e9ba439d1a0792991e P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:29.379915 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c5c419abe445e9ba439d1a0792991e" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:29.382063 22163 raft_consensus.cc:2468] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:29.381415 22466 raft_consensus.cc:493] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.382472 22350 leader_election.cc:304] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:29.383003 22466 raft_consensus.cc:515] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:29.383325 22517 raft_consensus.cc:2804] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.383539 22431 tablet_bootstrap.cc:492] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:29.383875 22517 raft_consensus.cc:493] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.384166 22431 ts_tablet_manager.cc:1403] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.056s	user 0.001s	sys 0.037s
I20260709 13:10:29.384297 22517 raft_consensus.cc:3060] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.384634 22126 leader_election.cc:304] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:29.379236 22600 leader_election.cc:290] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:29.387162 22466 leader_election.cc:290] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:29.387045 22431 raft_consensus.cc:359] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:29.387748 22431 raft_consensus.cc:385] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.388019 22431 raft_consensus.cc:740] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.389045 22237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebca88391e7141659bba4fdc89e8a954" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:29.389636 22237 raft_consensus.cc:2468] T ebca88391e7141659bba4fdc89e8a954 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:29.390112 22431 consensus_queue.cc:260] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:29.391089 22517 raft_consensus.cc:515] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.391470 22309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebca88391e7141659bba4fdc89e8a954" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
W20260709 13:10:29.393018 22351 leader_election.cc:343] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.393839 22350 leader_election.cc:304] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:29.394870 22517 leader_election.cc:290] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:29.395429 22517 raft_consensus.cc:2804] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.395773 22517 raft_consensus.cc:493] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.396080 22517 raft_consensus.cc:3060] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.396275 22484 leader_election.cc:290] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:29.398872 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c5c419abe445e9ba439d1a0792991e" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:29.399520 22236 raft_consensus.cc:3060] T 39c5c419abe445e9ba439d1a0792991e P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.401297 22431 ts_tablet_manager.cc:1434] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:10:29.401727 22311 raft_consensus.cc:2468] T 3559a60bb91946b988a872f1f28f20f8 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:29.405215 22431 tablet_bootstrap.cc:492] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:29.405447 22482 raft_consensus.cc:2804] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.405867 22482 raft_consensus.cc:493] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.406221 22482 raft_consensus.cc:3060] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.407796 22237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c5c419abe445e9ba439d1a0792991e" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:29.410988 22236 raft_consensus.cc:2468] T 39c5c419abe445e9ba439d1a0792991e P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:29.412158 22350 leader_election.cc:304] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:29.413033 22600 raft_consensus.cc:2804] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.414243 22600 raft_consensus.cc:697] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Leader. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:29.415225 22604 raft_consensus.cc:493] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.415328 22600 consensus_queue.cc:237] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.415838 22604 raft_consensus.cc:515] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:29.419463 22351 leader_election.cc:304] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:29.419580 22161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c5c419abe445e9ba439d1a0792991e" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:29.419682 22604 leader_election.cc:290] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:29.421564 22440 raft_consensus.cc:2804] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.422035 22431 tablet_bootstrap.cc:654] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.421911 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f91956634f346fbaed9bc3d2785f528" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
W20260709 13:10:29.423626 22201 leader_election.cc:343] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.425074 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f91956634f346fbaed9bc3d2785f528" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:29.414826 22434 tablet_bootstrap.cc:654] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.422071 22440 raft_consensus.cc:697] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Leader. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:29.431665 22440 consensus_queue.cc:237] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:29.440479 22434 tablet_bootstrap.cc:492] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:29.442785 22434 ts_tablet_manager.cc:1403] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.001s
I20260709 13:10:29.389626 22471 raft_consensus.cc:2749] T acf09c0982fd493caaf8c31bc1964c22 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.444155 22162 raft_consensus.cc:2468] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:29.437218 22517 raft_consensus.cc:515] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:29.446480 22434 raft_consensus.cc:359] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:29.451153 22434 raft_consensus.cc:385] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.451267 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebca88391e7141659bba4fdc89e8a954" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:29.452493 22434 raft_consensus.cc:740] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.452710 22236 raft_consensus.cc:3060] T ebca88391e7141659bba4fdc89e8a954 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.453423 22434 consensus_queue.cc:260] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:29.449517 22482 raft_consensus.cc:515] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.455113 22161 raft_consensus.cc:2393] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate edd63b54133d4c8d9149d57a2886916b in current term 1: Already voted for candidate 5d515385609945e5837e85b77de385e2 in this term.
W20260709 13:10:29.455642 22203 leader_election.cc:343] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.456147 22203 leader_election.cc:304] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565; no voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:29.457665 22434 ts_tablet_manager.cc:1434] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:10:29.457827 22604 raft_consensus.cc:2749] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.460559 22236 raft_consensus.cc:2468] T ebca88391e7141659bba4fdc89e8a954 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:29.451994 22517 leader_election.cc:290] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:29.472054 22162 raft_consensus.cc:3060] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.463852 22237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c5c419abe445e9ba439d1a0792991e" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:29.472810 22350 leader_election.cc:304] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:29.473578 22237 raft_consensus.cc:2393] T 39c5c419abe445e9ba439d1a0792991e P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d515385609945e5837e85b77de385e2 in current term 1: Already voted for candidate edd63b54133d4c8d9149d57a2886916b in this term.
I20260709 13:10:29.473516 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c5c419abe445e9ba439d1a0792991e" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:29.474462 22517 raft_consensus.cc:2804] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.474980 22517 raft_consensus.cc:697] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Leader. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:29.483031 22434 tablet_bootstrap.cc:492] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:29.491351 22437 tablet_bootstrap.cc:492] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:29.491245 22127 leader_election.cc:304] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:29.491953 22437 ts_tablet_manager.cc:1403] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.224s	user 0.023s	sys 0.013s
I20260709 13:10:29.492295 22484 raft_consensus.cc:2749] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.469977 22482 leader_election.cc:290] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
W20260709 13:10:29.485677 22203 consensus_peers.cc:597] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 -> Peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Couldn't send request to peer 66d3606ce30b4661b5d62d403d7abca0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:29.475895 22517 consensus_queue.cc:237] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:29.470129 22466 consensus_queue.cc:1048] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.494908 22509 consensus_queue.cc:1048] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 13:10:29.525296 22508 raft_consensus.cc:493] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.510528 22604 consensus_queue.cc:1048] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:10:29.528448 22508 raft_consensus.cc:515] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.529234 22057 catalog_manager.cc:5697] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b reported cstate change: term changed from 0 to 1, leader changed from <none> to edd63b54133d4c8d9149d57a2886916b (127.12.76.132). New cstate: current_term: 1 leader_uuid: "edd63b54133d4c8d9149d57a2886916b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.530535 22508 leader_election.cc:290] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:29.518910 22482 raft_consensus.cc:493] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.531535 22482 raft_consensus.cc:515] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.532572 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebca88391e7141659bba4fdc89e8a954" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:29.533036 22466 consensus_queue.cc:1048] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.533502 22482 leader_election.cc:290] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:29.536842 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d963b71e2742f3a74e1bed72d29186" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:29.537475 22163 raft_consensus.cc:2468] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 0.
I20260709 13:10:29.538424 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d963b71e2742f3a74e1bed72d29186" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:29.539512 22310 raft_consensus.cc:3060] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:29.540004 22201 leader_election.cc:343] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.538043 22485 consensus_queue.cc:1048] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:10:29.539948 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d963b71e2742f3a74e1bed72d29186" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
W20260709 13:10:29.543857 22126 leader_election.cc:343] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.545730 22237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d963b71e2742f3a74e1bed72d29186" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:29.546371 22237 raft_consensus.cc:2468] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 0.
I20260709 13:10:29.548573 22127 leader_election.cc:304] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:29.546310 22201 leader_election.cc:304] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:29.549598 22482 raft_consensus.cc:2804] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.550117 22482 raft_consensus.cc:493] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.550487 22482 raft_consensus.cc:3060] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.551072 22508 raft_consensus.cc:2804] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.551502 22508 raft_consensus.cc:493] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.551852 22508 raft_consensus.cc:3060] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.527769 22434 tablet_bootstrap.cc:654] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.563475 22060 catalog_manager.cc:5697] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b reported cstate change: term changed from 0 to 1, leader changed from <none> to edd63b54133d4c8d9149d57a2886916b (127.12.76.132). New cstate: current_term: 1 leader_uuid: "edd63b54133d4c8d9149d57a2886916b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.564540 22482 raft_consensus.cc:515] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.565729 22060 catalog_manager.cc:5697] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b reported cstate change: term changed from 0 to 1, leader changed from <none> to edd63b54133d4c8d9149d57a2886916b (127.12.76.132). New cstate: current_term: 1 leader_uuid: "edd63b54133d4c8d9149d57a2886916b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.567260 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d963b71e2742f3a74e1bed72d29186" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
W20260709 13:10:29.568668 22126 leader_election.cc:343] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.570641 22482 leader_election.cc:290] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:29.571296 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d963b71e2742f3a74e1bed72d29186" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:29.575035 22434 tablet_bootstrap.cc:492] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:29.575554 22434 ts_tablet_manager.cc:1403] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.093s	user 0.015s	sys 0.023s
I20260709 13:10:29.581090 22434 raft_consensus.cc:359] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.582696 22434 raft_consensus.cc:385] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.582954 22434 raft_consensus.cc:740] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.583616 22434 consensus_queue.cc:260] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.585775 22434 ts_tablet_manager.cc:1434] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:29.585559 22508 raft_consensus.cc:515] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.586745 22434 tablet_bootstrap.cc:492] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:29.586851 22236 raft_consensus.cc:2393] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d515385609945e5837e85b77de385e2 in current term 1: Already voted for candidate 371d38ec3c7f493e9aea62dae121e565 in this term.
I20260709 13:10:29.588591 22127 leader_election.cc:304] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:29.590003 22482 raft_consensus.cc:2749] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.593187 22434 tablet_bootstrap.cc:654] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.599663 22433 tablet_bootstrap.cc:492] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:29.600368 22433 ts_tablet_manager.cc:1403] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.359s	user 0.017s	sys 0.020s
I20260709 13:10:29.494683 22437 raft_consensus.cc:359] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:29.604458 22437 raft_consensus.cc:385] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.604892 22437 raft_consensus.cc:740] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.605811 22437 consensus_queue.cc:260] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:29.617863 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d963b71e2742f3a74e1bed72d29186" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:29.619719 22508 leader_election.cc:290] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
W20260709 13:10:29.626684 22201 leader_election.cc:343] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.628495 22437 ts_tablet_manager.cc:1434] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.136s	user 0.003s	sys 0.004s
W20260709 13:10:29.631753 22203 consensus_peers.cc:597] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 -> Peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Couldn't send request to peer 66d3606ce30b4661b5d62d403d7abca0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:29.622531 22434 tablet_bootstrap.cc:492] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
W20260709 13:10:29.622152 22351 leader_election.cc:343] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.619928 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d963b71e2742f3a74e1bed72d29186" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:29.633880 22163 raft_consensus.cc:2393] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 371d38ec3c7f493e9aea62dae121e565 in current term 1: Already voted for candidate 5d515385609945e5837e85b77de385e2 in this term.
I20260709 13:10:29.635159 22201 leader_election.cc:304] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565; no voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:29.636051 22434 ts_tablet_manager.cc:1403] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.018s
I20260709 13:10:29.629220 22433 raft_consensus.cc:359] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.636485 22433 raft_consensus.cc:385] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.636857 22433 raft_consensus.cc:740] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.637617 22433 consensus_queue.cc:260] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.649721 22433 ts_tablet_manager.cc:1434] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
I20260709 13:10:29.641486 22431 tablet_bootstrap.cc:492] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:29.641841 22471 raft_consensus.cc:2749] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.657593 22433 tablet_bootstrap.cc:492] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:29.666320 22433 tablet_bootstrap.cc:654] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.642319 22437 tablet_bootstrap.cc:492] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:29.639173 22434 raft_consensus.cc:359] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:29.669284 22434 raft_consensus.cc:385] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.669589 22434 raft_consensus.cc:740] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.670254 22434 consensus_queue.cc:260] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:29.671854 22434 ts_tablet_manager.cc:1434] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.001s
I20260709 13:10:29.672797 22434 tablet_bootstrap.cc:492] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:29.674463 22437 tablet_bootstrap.cc:654] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.675863 22431 ts_tablet_manager.cc:1403] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.271s	user 0.058s	sys 0.076s
I20260709 13:10:29.678715 22434 tablet_bootstrap.cc:654] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.678588 22431 raft_consensus.cc:359] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.685465 22431 raft_consensus.cc:385] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.685755 22431 raft_consensus.cc:740] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.686466 22431 consensus_queue.cc:260] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.687152 22433 tablet_bootstrap.cc:492] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:29.688453 22431 ts_tablet_manager.cc:1434] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:10:29.703502 22433 ts_tablet_manager.cc:1403] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.000s
I20260709 13:10:29.702838 22437 tablet_bootstrap.cc:492] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:29.704528 22437 ts_tablet_manager.cc:1403] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.017s
I20260709 13:10:29.704538 22431 tablet_bootstrap.cc:492] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:29.702828 22434 tablet_bootstrap.cc:492] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:29.705552 22434 ts_tablet_manager.cc:1403] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.006s
I20260709 13:10:29.708163 22434 raft_consensus.cc:359] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:29.708915 22434 raft_consensus.cc:385] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.709182 22434 raft_consensus.cc:740] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.709851 22434 consensus_queue.cc:260] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:29.710006 22437 raft_consensus.cc:359] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:29.710673 22437 raft_consensus.cc:385] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.710990 22437 raft_consensus.cc:740] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.711642 22437 consensus_queue.cc:260] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:29.712273 22434 ts_tablet_manager.cc:1434] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:29.713282 22437 ts_tablet_manager.cc:1434] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:10:29.706902 22433 raft_consensus.cc:359] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:29.713889 22433 raft_consensus.cc:385] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.714169 22433 raft_consensus.cc:740] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.714870 22431 tablet_bootstrap.cc:654] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.715718 22433 consensus_queue.cc:260] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:29.716776 22517 raft_consensus.cc:493] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.717206 22517 raft_consensus.cc:515] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:29.718132 22434 tablet_bootstrap.cc:492] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:29.718948 22482 raft_consensus.cc:493] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.719467 22482 raft_consensus.cc:515] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:29.721592 22482 leader_election.cc:290] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:29.723097 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b3204b820c4446bb957d44063ecbe0" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:29.723547 22309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b3204b820c4446bb957d44063ecbe0" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:29.724169 22309 raft_consensus.cc:2468] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 0.
I20260709 13:10:29.724355 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14e4aeab76f42f7a5a63d191494a79c" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:29.724840 22434 tablet_bootstrap.cc:654] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.725482 22128 leader_election.cc:304] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
W20260709 13:10:29.726542 22351 leader_election.cc:343] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.727198 22482 raft_consensus.cc:2804] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:10:29.727311 22126 leader_election.cc:343] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.727681 22482 raft_consensus.cc:493] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.733301 22482 raft_consensus.cc:3060] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.736011 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14e4aeab76f42f7a5a63d191494a79c" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:29.736953 22162 raft_consensus.cc:2468] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:29.728283 22437 tablet_bootstrap.cc:492] T 12df2e627ea748c5908bd073b917bf29 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:29.732383 22517 leader_election.cc:290] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:29.739117 22349 leader_election.cc:304] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:29.740839 22517 raft_consensus.cc:2804] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.741467 22517 raft_consensus.cc:493] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.742427 22517 raft_consensus.cc:3060] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.752957 22517 raft_consensus.cc:515] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:29.763636 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14e4aeab76f42f7a5a63d191494a79c" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:29.764693 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14e4aeab76f42f7a5a63d191494a79c" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:29.780665 22162 raft_consensus.cc:3060] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:29.781823 22351 leader_election.cc:343] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.759688 22433 ts_tablet_manager.cc:1434] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.055s	user 0.011s	sys 0.000s
I20260709 13:10:29.769675 22437 tablet_bootstrap.cc:654] T 12df2e627ea748c5908bd073b917bf29 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.791051 22433 tablet_bootstrap.cc:492] T 97e1c9af3eb64e7dbff4f9df54341806 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:29.793119 22434 tablet_bootstrap.cc:492] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:29.793602 22434 ts_tablet_manager.cc:1403] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.076s	user 0.044s	sys 0.026s
I20260709 13:10:29.758498 22482 raft_consensus.cc:515] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:29.796478 22434 raft_consensus.cc:359] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:29.796954 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b3204b820c4446bb957d44063ecbe0" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:29.797066 22162 raft_consensus.cc:2468] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:29.797628 22310 raft_consensus.cc:3060] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:29.805389 22109 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:29.800110 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b3204b820c4446bb957d44063ecbe0" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:29.802596 22431 tablet_bootstrap.cc:492] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:29.806434 22431 ts_tablet_manager.cc:1403] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.102s	user 0.009s	sys 0.037s
W20260709 13:10:29.807245 22126 leader_election.cc:343] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.809151 22431 raft_consensus.cc:359] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:29.809768 22431 raft_consensus.cc:385] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.809940 22431 raft_consensus.cc:740] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.810449 22431 consensus_queue.cc:260] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:29.800201 22482 leader_election.cc:290] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:29.797215 22434 raft_consensus.cc:385] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.812042 22310 raft_consensus.cc:2468] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 1.
I20260709 13:10:29.812423 22434 raft_consensus.cc:740] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.805048 22517 leader_election.cc:290] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:29.814620 22433 tablet_bootstrap.cc:654] T 97e1c9af3eb64e7dbff4f9df54341806 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.815177 22349 leader_election.cc:304] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:29.816489 22517 raft_consensus.cc:2804] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.816987 22517 raft_consensus.cc:697] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Leader. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:29.812278 22431 ts_tablet_manager.cc:1434] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:29.817795 22517 consensus_queue.cc:237] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:29.818738 22128 leader_election.cc:304] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:29.819089 22431 tablet_bootstrap.cc:492] T 394fa17836c34b6d8e074e7ec63d4387 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:29.819563 22482 raft_consensus.cc:2804] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.822115 22482 raft_consensus.cc:697] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 1 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:29.823218 22482 consensus_queue.cc:237] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:29.813326 22434 consensus_queue.cc:260] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:29.829540 22434 ts_tablet_manager.cc:1434] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.004s
I20260709 13:10:29.830719 22434 tablet_bootstrap.cc:492] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:29.830885 22451 raft_consensus.cc:493] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.831430 22451 raft_consensus.cc:515] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:29.833671 22451 leader_election.cc:290] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:29.834425 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c1ffecc5b948bd8f3f48d9a7a40a96" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:29.836356 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c1ffecc5b948bd8f3f48d9a7a40a96" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:29.837545 22433 tablet_bootstrap.cc:492] T 97e1c9af3eb64e7dbff4f9df54341806 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:29.838594 22433 ts_tablet_manager.cc:1403] T 97e1c9af3eb64e7dbff4f9df54341806 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.008s
I20260709 13:10:29.838542 22276 leader_election.cc:304] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:29.840353 22471 consensus_queue.cc:1048] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.842248 22433 raft_consensus.cc:359] T 97e1c9af3eb64e7dbff4f9df54341806 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:29.843120 22433 raft_consensus.cc:385] T 97e1c9af3eb64e7dbff4f9df54341806 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.843470 22433 raft_consensus.cc:740] T 97e1c9af3eb64e7dbff4f9df54341806 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.844372 22433 consensus_queue.cc:260] T 97e1c9af3eb64e7dbff4f9df54341806 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:29.843547 22451 raft_consensus.cc:2749] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.836356 22431 tablet_bootstrap.cc:654] T 394fa17836c34b6d8e074e7ec63d4387 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.861498 22057 catalog_manager.cc:5697] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b reported cstate change: term changed from 0 to 1, leader changed from <none> to edd63b54133d4c8d9149d57a2886916b (127.12.76.132). New cstate: current_term: 1 leader_uuid: "edd63b54133d4c8d9149d57a2886916b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.865767 22431 tablet_bootstrap.cc:492] T 394fa17836c34b6d8e074e7ec63d4387 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:29.852860 22434 tablet_bootstrap.cc:654] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.855293 22433 ts_tablet_manager.cc:1434] T 97e1c9af3eb64e7dbff4f9df54341806 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.004s
I20260709 13:10:29.866405 22431 ts_tablet_manager.cc:1403] T 394fa17836c34b6d8e074e7ec63d4387 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.000s
I20260709 13:10:29.867663 22433 tablet_bootstrap.cc:492] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:29.870143 22431 raft_consensus.cc:359] T 394fa17836c34b6d8e074e7ec63d4387 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:29.870882 22431 raft_consensus.cc:385] T 394fa17836c34b6d8e074e7ec63d4387 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.857285 22629 consensus_queue.cc:1048] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.871198 22431 raft_consensus.cc:740] T 394fa17836c34b6d8e074e7ec63d4387 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.872164 22431 consensus_queue.cc:260] T 394fa17836c34b6d8e074e7ec63d4387 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:29.872558 22629 raft_consensus.cc:493] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.873136 22629 raft_consensus.cc:515] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.876719 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d963b71e2742f3a74e1bed72d29186" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:29.877517 22236 raft_consensus.cc:2393] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edd63b54133d4c8d9149d57a2886916b in current term 1: Already voted for candidate 371d38ec3c7f493e9aea62dae121e565 in this term.
I20260709 13:10:29.879199 22437 tablet_bootstrap.cc:492] T 12df2e627ea748c5908bd073b917bf29 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:29.879776 22437 ts_tablet_manager.cc:1403] T 12df2e627ea748c5908bd073b917bf29 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.152s	user 0.025s	sys 0.014s
I20260709 13:10:29.880149 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d963b71e2742f3a74e1bed72d29186" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:29.876935 22433 tablet_bootstrap.cc:654] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.880950 22163 raft_consensus.cc:2393] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edd63b54133d4c8d9149d57a2886916b in current term 1: Already voted for candidate 5d515385609945e5837e85b77de385e2 in this term.
I20260709 13:10:29.883085 22437 raft_consensus.cc:359] T 12df2e627ea748c5908bd073b917bf29 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:29.883970 22437 raft_consensus.cc:385] T 12df2e627ea748c5908bd073b917bf29 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.884364 22437 raft_consensus.cc:740] T 12df2e627ea748c5908bd073b917bf29 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.885531 22437 consensus_queue.cc:260] T 12df2e627ea748c5908bd073b917bf29 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:29.887923 22060 catalog_manager.cc:5697] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.888808 22349 leader_election.cc:304] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:29.890658 22517 raft_consensus.cc:3060] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.892788 22629 leader_election.cc:290] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:29.894527 22437 ts_tablet_manager.cc:1434] T 12df2e627ea748c5908bd073b917bf29 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:10:29.895707 22437 tablet_bootstrap.cc:492] T ebca88391e7141659bba4fdc89e8a954 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:29.899868 22517 raft_consensus.cc:2749] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.901284 22484 raft_consensus.cc:493] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.901834 22484 raft_consensus.cc:515] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:29.902568 22437 tablet_bootstrap.cc:654] T ebca88391e7141659bba4fdc89e8a954 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.902972 22431 ts_tablet_manager.cc:1434] T 394fa17836c34b6d8e074e7ec63d4387 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:10:29.904017 22431 tablet_bootstrap.cc:492] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:29.905023 22433 tablet_bootstrap.cc:492] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:29.905555 22433 ts_tablet_manager.cc:1403] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.002s
I20260709 13:10:29.906232 22484 leader_election.cc:290] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:29.907099 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f91956634f346fbaed9bc3d2785f528" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:29.907670 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f91956634f346fbaed9bc3d2785f528" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:29.908600 22236 raft_consensus.cc:2468] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 0.
I20260709 13:10:29.909595 22517 consensus_queue.cc:1048] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:29.909987 22128 leader_election.cc:343] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.910874 22127 leader_election.cc:304] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:29.911428 22431 tablet_bootstrap.cc:654] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.912132 22484 raft_consensus.cc:2804] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.912655 22484 raft_consensus.cc:493] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.912848 22471 raft_consensus.cc:493] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.913111 22484 raft_consensus.cc:3060] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.913389 22471 raft_consensus.cc:515] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:29.913420 22433 raft_consensus.cc:359] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.914526 22433 raft_consensus.cc:385] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.915999 22471 leader_election.cc:290] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:29.918596 22309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e1c9af3eb64e7dbff4f9df54341806" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:29.917689 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e1c9af3eb64e7dbff4f9df54341806" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:29.919772 22385 raft_consensus.cc:2468] T 97e1c9af3eb64e7dbff4f9df54341806 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 0.
I20260709 13:10:29.920877 22201 leader_election.cc:304] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:29.922260 22509 raft_consensus.cc:2804] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.922627 22509 raft_consensus.cc:493] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.922966 22509 raft_consensus.cc:3060] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:29.924126 22351 consensus_peers.cc:597] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b -> Peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Couldn't send request to peer 66d3606ce30b4661b5d62d403d7abca0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:29.914943 22433 raft_consensus.cc:740] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.925451 22433 consensus_queue.cc:260] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
W20260709 13:10:29.927591 22203 leader_election.cc:343] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.931223 22309 raft_consensus.cc:3060] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.931304 22433 ts_tablet_manager.cc:1434] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:10:29.933840 22433 tablet_bootstrap.cc:492] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:29.934180 22482 raft_consensus.cc:493] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.934701 22482 raft_consensus.cc:515] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.937459 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4179392a8cb048c1982df1ea690bb4b9" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:29.938068 22385 raft_consensus.cc:2468] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 0.
I20260709 13:10:29.939299 22126 leader_election.cc:304] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:29.941004 22482 leader_election.cc:290] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:29.953986 22630 consensus_queue.cc:1048] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.946990 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4179392a8cb048c1982df1ea690bb4b9" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:29.955761 22236 raft_consensus.cc:2468] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 0.
I20260709 13:10:29.958374 22509 raft_consensus.cc:515] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:29.948354 22437 tablet_bootstrap.cc:492] T ebca88391e7141659bba4fdc89e8a954 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:29.964737 22437 ts_tablet_manager.cc:1403] T ebca88391e7141659bba4fdc89e8a954 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.069s	user 0.023s	sys 0.004s
I20260709 13:10:29.968598 22437 raft_consensus.cc:359] T ebca88391e7141659bba4fdc89e8a954 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:29.950471 22663 raft_consensus.cc:2804] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.950654 22433 tablet_bootstrap.cc:654] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.970046 22663 raft_consensus.cc:493] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.970443 22663 raft_consensus.cc:3060] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.969336 22437 raft_consensus.cc:385] T ebca88391e7141659bba4fdc89e8a954 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.976857 22437 raft_consensus.cc:740] T ebca88391e7141659bba4fdc89e8a954 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.977566 22437 consensus_queue.cc:260] T ebca88391e7141659bba4fdc89e8a954 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:29.982545 22437 ts_tablet_manager.cc:1434] T ebca88391e7141659bba4fdc89e8a954 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:10:29.985316 22437 tablet_bootstrap.cc:492] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:29.991694 22433 tablet_bootstrap.cc:492] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:29.991590 22663 raft_consensus.cc:515] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:29.992894 22433 ts_tablet_manager.cc:1403] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.006s
I20260709 13:10:29.995007 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4179392a8cb048c1982df1ea690bb4b9" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:29.995790 22385 raft_consensus.cc:3060] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.995891 22433 raft_consensus.cc:359] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:29.996927 22433 raft_consensus.cc:385] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.997238 22433 raft_consensus.cc:740] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.997947 22433 consensus_queue.cc:260] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:30.001920 22437 tablet_bootstrap.cc:654] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.005177 22433 ts_tablet_manager.cc:1434] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:10:30.007176 22433 tablet_bootstrap.cc:492] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:30.010681 22385 raft_consensus.cc:2468] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 1.
I20260709 13:10:30.012323 22126 leader_election.cc:304] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:30.013340 22662 raft_consensus.cc:2804] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.013911 22662 raft_consensus.cc:697] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [term 1 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:30.014936 22662 consensus_queue.cc:237] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:30.019698 22433 tablet_bootstrap.cc:654] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.020654 22663 leader_election.cc:290] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:30.026081 22437 tablet_bootstrap.cc:492] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:30.026604 22437 ts_tablet_manager.cc:1403] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.006s
I20260709 13:10:30.030306 22433 tablet_bootstrap.cc:492] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:30.030822 22433 ts_tablet_manager.cc:1403] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.003s
I20260709 13:10:30.031361 22437 raft_consensus.cc:359] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:30.032090 22237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4179392a8cb048c1982df1ea690bb4b9" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:30.032397 22437 raft_consensus.cc:385] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.032774 22237 raft_consensus.cc:3060] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.032816 22437 raft_consensus.cc:740] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.033628 22433 raft_consensus.cc:359] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:30.038724 22433 raft_consensus.cc:385] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.039026 22433 raft_consensus.cc:740] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.039726 22433 consensus_queue.cc:260] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:30.033939 22437 consensus_queue.cc:260] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:30.038002 22440 consensus_queue.cc:1048] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:10:30.042631 22437 ts_tablet_manager.cc:1434] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:10:30.046411 22433 ts_tablet_manager.cc:1434] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:10:30.047403 22433 tablet_bootstrap.cc:492] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:30.048064 22237 raft_consensus.cc:2468] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 1.
I20260709 13:10:30.048450 22632 consensus_queue.cc:1048] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.055039 22437 tablet_bootstrap.cc:492] T 394fa17836c34b6d8e074e7ec63d4387 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:30.061048 22433 tablet_bootstrap.cc:654] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.075704 22517 raft_consensus.cc:493] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.076233 22517 raft_consensus.cc:515] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:30.079536 22517 leader_election.cc:290] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:30.076181 22434 tablet_bootstrap.cc:492] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:30.081466 22434 ts_tablet_manager.cc:1403] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.251s	user 0.011s	sys 0.001s
I20260709 13:10:30.086009 22509 leader_election.cc:290] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:29.962792 22484 raft_consensus.cc:515] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:30.089916 22484 leader_election.cc:290] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:30.095239 22235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f91956634f346fbaed9bc3d2785f528" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:30.096194 22235 raft_consensus.cc:3060] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.101338 22309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f91956634f346fbaed9bc3d2785f528" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:30.103916 22434 raft_consensus.cc:359] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:30.105010 22434 raft_consensus.cc:385] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.105392 22434 raft_consensus.cc:740] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
W20260709 13:10:30.108237 22128 leader_election.cc:343] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.112604 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e1c9af3eb64e7dbff4f9df54341806" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:30.114109 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e1c9af3eb64e7dbff4f9df54341806" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:30.114884 22385 raft_consensus.cc:3060] T 97e1c9af3eb64e7dbff4f9df54341806 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.118112 22309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394fa17836c34b6d8e074e7ec63d4387" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:30.124563 22434 consensus_queue.cc:260] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:30.126718 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394fa17836c34b6d8e074e7ec63d4387" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:30.127525 22663 raft_consensus.cc:493] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.135905 22451 raft_consensus.cc:493] T 12df2e627ea748c5908bd073b917bf29 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.142016 22451 raft_consensus.cc:515] T 12df2e627ea748c5908bd073b917bf29 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:30.146262 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12df2e627ea748c5908bd073b917bf29" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
W20260709 13:10:30.146727 22351 leader_election.cc:343] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.147001 22235 raft_consensus.cc:2468] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 1.
I20260709 13:10:30.148442 22437 tablet_bootstrap.cc:654] T 394fa17836c34b6d8e074e7ec63d4387 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:30.133478 22203 leader_election.cc:343] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.134641 22236 raft_consensus.cc:2468] T 394fa17836c34b6d8e074e7ec63d4387 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:30.157704 22127 leader_election.cc:304] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:30.158576 22433 tablet_bootstrap.cc:492] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:30.159075 22433 ts_tablet_manager.cc:1403] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.112s	user 0.042s	sys 0.011s
I20260709 13:10:30.148981 22663 raft_consensus.cc:515] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:30.159336 22662 raft_consensus.cc:2804] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.161652 22433 raft_consensus.cc:359] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:30.167857 22433 raft_consensus.cc:385] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.166749 22662 raft_consensus.cc:697] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [term 1 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:30.168210 22433 raft_consensus.cc:740] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.168969 22433 consensus_queue.cc:260] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:30.168998 22662 consensus_queue.cc:237] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:30.171768 22350 leader_election.cc:304] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:30.164696 22161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12df2e627ea748c5908bd073b917bf29" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:30.172749 22517 raft_consensus.cc:2804] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.173112 22517 raft_consensus.cc:493] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.173449 22517 raft_consensus.cc:3060] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.150269 22451 leader_election.cc:290] T 12df2e627ea748c5908bd073b917bf29 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:30.180781 22517 raft_consensus.cc:515] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:30.182050 22663 leader_election.cc:290] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:30.172185 22433 ts_tablet_manager.cc:1434] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.002s
I20260709 13:10:30.183772 22235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394fa17836c34b6d8e074e7ec63d4387" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:30.183940 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d8b26b38b341878e580b51c9014cec" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:30.184362 22235 raft_consensus.cc:3060] T 394fa17836c34b6d8e074e7ec63d4387 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.186514 22309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d8b26b38b341878e580b51c9014cec" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:30.161983 22385 raft_consensus.cc:2468] T 97e1c9af3eb64e7dbff4f9df54341806 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
W20260709 13:10:30.188956 22128 leader_election.cc:343] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.189356 22517 leader_election.cc:290] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:30.189167 22057 catalog_manager.cc:5697] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.190454 22201 leader_election.cc:304] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:30.192154 22509 raft_consensus.cc:2804] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.184387 22433 tablet_bootstrap.cc:492] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
W20260709 13:10:30.194648 22127 leader_election.cc:343] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.195379 22127 leader_election.cc:304] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:30.192792 22509 raft_consensus.cc:697] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Becoming Leader. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:30.198659 22509 consensus_queue.cc:237] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:30.193370 22434 ts_tablet_manager.cc:1434] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.111s	user 0.009s	sys 0.000s
I20260709 13:10:30.209427 22434 tablet_bootstrap.cc:492] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:30.206257 22663 raft_consensus.cc:2749] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.238766 22629 raft_consensus.cc:493] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.239568 22629 raft_consensus.cc:515] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:30.243396 22517 raft_consensus.cc:493] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.243742 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c563b0b9ff42638139dc08d9fd2e23" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:30.243959 22517 raft_consensus.cc:515] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
W20260709 13:10:30.245627 22350 leader_election.cc:343] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.246075 22517 leader_election.cc:290] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:30.247494 22629 leader_election.cc:290] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:30.265391 22431 tablet_bootstrap.cc:492] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:30.265947 22431 ts_tablet_manager.cc:1403] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.362s	user 0.047s	sys 0.040s
I20260709 13:10:30.277601 22431 raft_consensus.cc:359] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:30.278394 22431 raft_consensus.cc:385] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.278689 22431 raft_consensus.cc:740] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.279685 22431 consensus_queue.cc:260] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
W20260709 13:10:30.272687 22275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:45017, user_credentials={real_user=slave}} blocked reactor thread for 104278us
I20260709 13:10:30.285120 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c563b0b9ff42638139dc08d9fd2e23" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:30.287338 22437 tablet_bootstrap.cc:492] T 394fa17836c34b6d8e074e7ec63d4387 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:30.287907 22437 ts_tablet_manager.cc:1403] T 394fa17836c34b6d8e074e7ec63d4387 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.233s	user 0.017s	sys 0.014s
I20260709 13:10:30.288446 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b3204b820c4446bb957d44063ecbe0" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:30.290392 22437 raft_consensus.cc:359] T 394fa17836c34b6d8e074e7ec63d4387 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:30.291075 22437 raft_consensus.cc:385] T 394fa17836c34b6d8e074e7ec63d4387 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.291337 22437 raft_consensus.cc:740] T 394fa17836c34b6d8e074e7ec63d4387 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.291993 22437 consensus_queue.cc:260] T 394fa17836c34b6d8e074e7ec63d4387 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:30.293525 22431 ts_tablet_manager.cc:1434] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:10:30.294333 22431 tablet_bootstrap.cc:492] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:30.297020 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394fa17836c34b6d8e074e7ec63d4387" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:30.297255 22311 raft_consensus.cc:3060] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.297631 22312 raft_consensus.cc:3060] T 394fa17836c34b6d8e074e7ec63d4387 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.295073 22235 raft_consensus.cc:2468] T 394fa17836c34b6d8e074e7ec63d4387 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:30.298947 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b3204b820c4446bb957d44063ecbe0" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:30.300870 22437 ts_tablet_manager.cc:1434] T 394fa17836c34b6d8e074e7ec63d4387 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:10:30.304447 22437 tablet_bootstrap.cc:492] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:30.304956 22350 leader_election.cc:304] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:30.300930 22310 raft_consensus.cc:2393] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edd63b54133d4c8d9149d57a2886916b in current term 1: Already voted for candidate 5d515385609945e5837e85b77de385e2 in this term.
I20260709 13:10:30.305925 22517 raft_consensus.cc:2804] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.306360 22312 raft_consensus.cc:2468] T 394fa17836c34b6d8e074e7ec63d4387 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:30.306445 22517 raft_consensus.cc:697] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Leader. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:30.307519 22517 consensus_queue.cc:237] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:30.309526 22275 leader_election.cc:304] T 12df2e627ea748c5908bd073b917bf29 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:30.310612 22451 raft_consensus.cc:2749] T 12df2e627ea748c5908bd073b917bf29 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.311904 22310 raft_consensus.cc:3060] T 12df2e627ea748c5908bd073b917bf29 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.317137 22437 tablet_bootstrap.cc:654] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.329941 22434 tablet_bootstrap.cc:654] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.333889 22676 raft_consensus.cc:493] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.334432 22676 raft_consensus.cc:515] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:30.346194 22629 consensus_queue.cc:1048] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.348582 22681 raft_consensus.cc:493] T ebca88391e7141659bba4fdc89e8a954 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.358816 22681 raft_consensus.cc:515] T ebca88391e7141659bba4fdc89e8a954 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:30.360953 22681 leader_election.cc:290] T ebca88391e7141659bba4fdc89e8a954 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:30.362699 22308 raft_consensus.cc:3060] T ebca88391e7141659bba4fdc89e8a954 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.365706 22060 catalog_manager.cc:5697] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.369367 22385 raft_consensus.cc:3060] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.370816 22433 tablet_bootstrap.cc:654] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.374138 22235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebca88391e7141659bba4fdc89e8a954" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:30.376982 22437 tablet_bootstrap.cc:492] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:30.377449 22437 ts_tablet_manager.cc:1403] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.003s
I20260709 13:10:30.378787 22431 tablet_bootstrap.cc:654] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.384094 22058 catalog_manager.cc:5697] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 reported cstate change: term changed from 0 to 1, leader changed from <none> to 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "371d38ec3c7f493e9aea62dae121e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.386574 22437 raft_consensus.cc:359] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:30.387365 22437 raft_consensus.cc:385] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.387789 22437 raft_consensus.cc:740] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.391211 22057 catalog_manager.cc:5697] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b reported cstate change: term changed from 0 to 1, leader changed from <none> to edd63b54133d4c8d9149d57a2886916b (127.12.76.132). New cstate: current_term: 1 leader_uuid: "edd63b54133d4c8d9149d57a2886916b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:30.373479 22349 leader_election.cc:343] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.409212 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14e4aeab76f42f7a5a63d191494a79c" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:30.401304 22676 leader_election.cc:290] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:30.420810 22161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14e4aeab76f42f7a5a63d191494a79c" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:30.415657 22437 consensus_queue.cc:260] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:30.421519 22161 raft_consensus.cc:2468] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 1.
I20260709 13:10:30.424892 22437 ts_tablet_manager.cc:1434] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 13:10:30.405671 22662 consensus_queue.cc:1048] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:10:30.418422 22349 leader_election.cc:304] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:30.432898 22437 tablet_bootstrap.cc:492] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:30.433633 22629 raft_consensus.cc:2749] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.434828 22434 tablet_bootstrap.cc:492] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:30.435354 22434 ts_tablet_manager.cc:1403] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.226s	user 0.007s	sys 0.012s
I20260709 13:10:30.439821 22434 raft_consensus.cc:359] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:30.446137 22434 raft_consensus.cc:385] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.446673 22434 raft_consensus.cc:740] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.447889 22434 consensus_queue.cc:260] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:30.448558 22677 raft_consensus.cc:493] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.452169 22677 raft_consensus.cc:515] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:30.454846 22677 leader_election.cc:290] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:30.443820 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebca88391e7141659bba4fdc89e8a954" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
W20260709 13:10:30.444618 22349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:33591, user_credentials={real_user=slave}} blocked reactor thread for 72825.4us
I20260709 13:10:30.467912 22434 ts_tablet_manager.cc:1434] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:10:30.468887 22434 tablet_bootstrap.cc:492] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:30.469672 22235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f91956634f346fbaed9bc3d2785f528" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:30.470468 22235 raft_consensus.cc:2393] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66d3606ce30b4661b5d62d403d7abca0 in current term 1: Already voted for candidate 5d515385609945e5837e85b77de385e2 in this term.
I20260709 13:10:30.473085 22431 tablet_bootstrap.cc:492] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:30.473542 22431 ts_tablet_manager.cc:1403] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.179s	user 0.010s	sys 0.009s
I20260709 13:10:30.465144 22275 leader_election.cc:304] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:30.483289 22431 raft_consensus.cc:359] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:30.484053 22431 raft_consensus.cc:385] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.484289 22431 raft_consensus.cc:740] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.484897 22431 consensus_queue.cc:260] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:30.485011 22161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f91956634f346fbaed9bc3d2785f528" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:30.489607 22431 ts_tablet_manager.cc:1434] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:10:30.490545 22431 tablet_bootstrap.cc:492] T 486fbb450f854f00af3362b34a0ef614 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:30.488818 22677 raft_consensus.cc:2804] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:30.493580 22677 raft_consensus.cc:493] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader edd63b54133d4c8d9149d57a2886916b)
I20260709 13:10:30.496209 22677 raft_consensus.cc:3060] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.476781 22349 leader_election.cc:304] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:30.506736 22662 raft_consensus.cc:493] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.506731 22677 raft_consensus.cc:515] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:30.507331 22662 raft_consensus.cc:515] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:30.510973 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f0ec01ac814561a087cb72983b73de" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:30.511546 22431 tablet_bootstrap.cc:654] T 486fbb450f854f00af3362b34a0ef614 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:30.512418 22128 leader_election.cc:343] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.513345 22437 tablet_bootstrap.cc:654] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.514055 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f0ec01ac814561a087cb72983b73de" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:30.514734 22236 raft_consensus.cc:2468] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 0.
I20260709 13:10:30.515493 22275 leader_election.cc:304] T ebca88391e7141659bba4fdc89e8a954 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:30.515978 22127 leader_election.cc:304] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:30.516609 22676 raft_consensus.cc:2749] T ebca88391e7141659bba4fdc89e8a954 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.516889 22663 raft_consensus.cc:2804] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.517345 22663 raft_consensus.cc:493] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.517792 22663 raft_consensus.cc:3060] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.519369 22275 leader_election.cc:304] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:30.520655 22440 raft_consensus.cc:2749] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:30.520845 22349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:33591, user_credentials={real_user=slave}} blocked reactor thread for 46662.9us
I20260709 13:10:30.522365 22161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14e4aeab76f42f7a5a63d191494a79c" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:30.522917 22161 raft_consensus.cc:3060] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.526712 22433 tablet_bootstrap.cc:492] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:30.527352 22433 ts_tablet_manager.cc:1403] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.343s	user 0.015s	sys 0.016s
I20260709 13:10:30.517422 22677 leader_election.cc:290] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:30.531713 22676 raft_consensus.cc:3060] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.534106 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14e4aeab76f42f7a5a63d191494a79c" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:30.536396 22679 consensus_queue.cc:1048] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.542946 22434 tablet_bootstrap.cc:654] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.542302 22662 leader_election.cc:290] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:30.561159 22676 raft_consensus.cc:2749] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.583578 22437 tablet_bootstrap.cc:492] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:30.584311 22437 ts_tablet_manager.cc:1403] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.152s	user 0.033s	sys 0.008s
I20260709 13:10:30.587725 22437 raft_consensus.cc:359] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:30.588733 22437 raft_consensus.cc:385] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.589064 22437 raft_consensus.cc:740] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.568910 22663 raft_consensus.cc:515] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:30.589948 22437 consensus_queue.cc:260] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:30.592531 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f0ec01ac814561a087cb72983b73de" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:30.592887 22437 ts_tablet_manager.cc:1434] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:30.593115 22236 raft_consensus.cc:3060] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.594139 22437 tablet_bootstrap.cc:492] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:30.595361 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f0ec01ac814561a087cb72983b73de" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
W20260709 13:10:30.597018 22128 leader_election.cc:343] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.597615 22663 leader_election.cc:290] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:30.600271 22434 tablet_bootstrap.cc:492] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:30.600759 22434 ts_tablet_manager.cc:1403] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.132s	user 0.007s	sys 0.005s
I20260709 13:10:30.601382 22236 raft_consensus.cc:2468] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 1.
I20260709 13:10:30.602676 22127 leader_election.cc:304] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:30.605132 22437 tablet_bootstrap.cc:654] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.563891 22433 raft_consensus.cc:359] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:30.566258 22308 raft_consensus.cc:1240] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Rejecting Update request from peer edd63b54133d4c8d9149d57a2886916b for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:30.560516 22161 raft_consensus.cc:2468] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 2.
I20260709 13:10:30.612422 22162 raft_consensus.cc:1240] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Rejecting Update request from peer edd63b54133d4c8d9149d57a2886916b for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:30.613632 22437 tablet_bootstrap.cc:492] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:30.614046 22437 ts_tablet_manager.cc:1403] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.004s
I20260709 13:10:30.603677 22663 raft_consensus.cc:2804] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.615106 22663 raft_consensus.cc:697] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [term 1 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:30.617031 22437 raft_consensus.cc:359] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:30.617436 22431 tablet_bootstrap.cc:492] T 486fbb450f854f00af3362b34a0ef614 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:30.617594 22437 raft_consensus.cc:385] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.617959 22431 ts_tablet_manager.cc:1403] T 486fbb450f854f00af3362b34a0ef614 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.128s	user 0.029s	sys 0.064s
I20260709 13:10:30.617957 22437 raft_consensus.cc:740] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.618892 22437 consensus_queue.cc:260] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:30.620553 22437 ts_tablet_manager.cc:1434] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 13:10:30.620178 22663 consensus_queue.cc:237] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:30.621301 22437 tablet_bootstrap.cc:492] T d1d8b26b38b341878e580b51c9014cec P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:30.623402 22434 raft_consensus.cc:359] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:30.624080 22434 raft_consensus.cc:385] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.624353 22434 raft_consensus.cc:740] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.624315 22431 raft_consensus.cc:359] T 486fbb450f854f00af3362b34a0ef614 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:30.625147 22431 raft_consensus.cc:385] T 486fbb450f854f00af3362b34a0ef614 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.625437 22431 raft_consensus.cc:740] T 486fbb450f854f00af3362b34a0ef614 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.625363 22434 consensus_queue.cc:260] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:30.626259 22431 consensus_queue.cc:260] T 486fbb450f854f00af3362b34a0ef614 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:30.612468 22433 raft_consensus.cc:385] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.627328 22433 raft_consensus.cc:740] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.627645 22437 tablet_bootstrap.cc:654] T d1d8b26b38b341878e580b51c9014cec P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.627998 22433 consensus_queue.cc:260] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:30.628526 22434 ts_tablet_manager.cc:1434] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:10:30.629452 22434 tablet_bootstrap.cc:492] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:30.633406 22662 consensus_queue.cc:1048] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.634801 22434 tablet_bootstrap.cc:654] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.639806 22437 tablet_bootstrap.cc:492] T d1d8b26b38b341878e580b51c9014cec P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:30.640309 22437 ts_tablet_manager.cc:1403] T d1d8b26b38b341878e580b51c9014cec P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.009s
I20260709 13:10:30.642093 22057 catalog_manager.cc:5697] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.642951 22433 ts_tablet_manager.cc:1434] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.115s	user 0.006s	sys 0.000s
I20260709 13:10:30.642872 22440 consensus_queue.cc:1059] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.644598 22433 tablet_bootstrap.cc:492] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:30.646314 22431 ts_tablet_manager.cc:1434] T 486fbb450f854f00af3362b34a0ef614 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.002s
I20260709 13:10:30.647262 22431 tablet_bootstrap.cc:492] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:30.649596 22629 raft_consensus.cc:3055] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.649992 22629 raft_consensus.cc:740] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:30.650817 22629 consensus_queue.cc:260] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:30.651895 22440 consensus_queue.cc:1059] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.653065 22603 raft_consensus.cc:493] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.653541 22603 raft_consensus.cc:515] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:30.655794 22629 raft_consensus.cc:3060] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.657358 22662 raft_consensus.cc:493] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.657868 22662 raft_consensus.cc:515] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:30.658941 22161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d8b26b38b341878e580b51c9014cec" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:30.659577 22161 raft_consensus.cc:2468] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 0.
I20260709 13:10:30.660343 22662 leader_election.cc:290] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:30.661836 22308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b501417270f5431da901577c6e5da05f" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:30.668308 22308 raft_consensus.cc:2468] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 0.
I20260709 13:10:30.662779 22201 leader_election.cc:304] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 
I20260709 13:10:30.669392 22663 consensus_queue.cc:1048] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.670703 22128 leader_election.cc:304] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:30.671868 22604 raft_consensus.cc:2804] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.672268 22604 raft_consensus.cc:493] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.672593 22604 raft_consensus.cc:3060] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.672672 22603 leader_election.cc:290] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:30.675691 22663 raft_consensus.cc:2804] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.676213 22663 raft_consensus.cc:493] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.676579 22663 raft_consensus.cc:3060] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.683053 22275 leader_election.cc:304] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:30.684437 22676 raft_consensus.cc:2804] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:30.685185 22676 raft_consensus.cc:697] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 [term 2 LEADER]: Becoming Leader. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Running, Role: LEADER
I20260709 13:10:30.686405 22676 consensus_queue.cc:237] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:30.663219 22433 tablet_bootstrap.cc:654] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.665952 22437 raft_consensus.cc:359] T d1d8b26b38b341878e580b51c9014cec P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:30.706393 22437 raft_consensus.cc:385] T d1d8b26b38b341878e580b51c9014cec P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.706776 22437 raft_consensus.cc:740] T d1d8b26b38b341878e580b51c9014cec P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.707458 22437 consensus_queue.cc:260] T d1d8b26b38b341878e580b51c9014cec P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:30.709465 22437 ts_tablet_manager.cc:1434] T d1d8b26b38b341878e580b51c9014cec P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.000s
I20260709 13:10:30.709793 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b501417270f5431da901577c6e5da05f" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:30.710400 22437 tablet_bootstrap.cc:492] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:30.713605 22060 catalog_manager.cc:5697] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 reported cstate change: term changed from 1 to 2, leader changed from edd63b54133d4c8d9149d57a2886916b (127.12.76.132) to 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131). New cstate: current_term: 2 leader_uuid: "66d3606ce30b4661b5d62d403d7abca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.714771 22662 consensus_queue.cc:1048] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.717218 22699 consensus_queue.cc:1048] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.719985 22679 consensus_queue.cc:1048] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.757472 22437 tablet_bootstrap.cc:654] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:30.759145 22126 leader_election.cc:343] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.761613 22312 raft_consensus.cc:3060] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.762168 22308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d8b26b38b341878e580b51c9014cec" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:30.762851 22308 raft_consensus.cc:2468] T d1d8b26b38b341878e580b51c9014cec P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 0.
I20260709 13:10:30.766232 22431 tablet_bootstrap.cc:654] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.777029 22663 raft_consensus.cc:515] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:30.782923 22699 consensus_queue.cc:1048] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.785960 22604 raft_consensus.cc:515] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:30.792650 22383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b501417270f5431da901577c6e5da05f" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
W20260709 13:10:30.794130 22126 leader_election.cc:343] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.795747 22604 leader_election.cc:290] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:30.796788 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b501417270f5431da901577c6e5da05f" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:30.796928 22517 raft_consensus.cc:493] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.797426 22517 raft_consensus.cc:515] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:30.798698 22308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d8b26b38b341878e580b51c9014cec" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:30.799216 22308 raft_consensus.cc:3060] T d1d8b26b38b341878e580b51c9014cec P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.800750 22235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486fbb450f854f00af3362b34a0ef614" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:30.801448 22235 raft_consensus.cc:2468] T 486fbb450f854f00af3362b34a0ef614 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:30.801473 22517 leader_election.cc:290] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:30.802353 22663 leader_election.cc:290] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:30.802840 22350 leader_election.cc:304] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:30.804523 22440 raft_consensus.cc:2804] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.804566 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d8b26b38b341878e580b51c9014cec" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:30.805038 22440 raft_consensus.cc:493] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.805169 22309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486fbb450f854f00af3362b34a0ef614" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:30.805346 22162 raft_consensus.cc:3060] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.805469 22440 raft_consensus.cc:3060] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:30.806500 22351 leader_election.cc:343] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.809930 22312 raft_consensus.cc:3060] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.820768 22440 raft_consensus.cc:515] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:30.823621 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486fbb450f854f00af3362b34a0ef614" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:30.824273 22238 raft_consensus.cc:3060] T 486fbb450f854f00af3362b34a0ef614 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.825655 22440 leader_election.cc:290] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:30.827857 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486fbb450f854f00af3362b34a0ef614" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
W20260709 13:10:30.829519 22351 leader_election.cc:343] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.830082 22162 raft_consensus.cc:2468] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:30.832247 22201 leader_election.cc:304] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 
I20260709 13:10:30.833385 22604 raft_consensus.cc:2804] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.836294 22238 raft_consensus.cc:2468] T 486fbb450f854f00af3362b34a0ef614 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:30.837731 22350 leader_election.cc:304] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:30.838541 22604 raft_consensus.cc:697] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Becoming Leader. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:30.839051 22673 raft_consensus.cc:2804] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.839586 22673 raft_consensus.cc:697] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Leader. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:30.839509 22604 consensus_queue.cc:237] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:30.840473 22673 consensus_queue.cc:237] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:30.838027 22308 raft_consensus.cc:2468] T d1d8b26b38b341878e580b51c9014cec P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:30.855052 22312 raft_consensus.cc:2468] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 1.
I20260709 13:10:30.856370 22128 leader_election.cc:304] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:30.857797 22663 raft_consensus.cc:2804] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.857688 22440 consensus_queue.cc:1048] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.858369 22663 raft_consensus.cc:697] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [term 1 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:30.859248 22663 consensus_queue.cc:237] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:30.861789 22433 tablet_bootstrap.cc:492] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:30.862453 22433 ts_tablet_manager.cc:1403] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.218s	user 0.010s	sys 0.002s
I20260709 13:10:30.863834 22434 tablet_bootstrap.cc:492] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:30.865806 22434 ts_tablet_manager.cc:1403] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.237s	user 0.043s	sys 0.036s
I20260709 13:10:30.869437 22434 raft_consensus.cc:359] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:30.870324 22434 raft_consensus.cc:385] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.870666 22434 raft_consensus.cc:740] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.871769 22434 consensus_queue.cc:260] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:30.886350 22440 consensus_queue.cc:1048] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.888307 22433 raft_consensus.cc:359] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:30.889298 22433 raft_consensus.cc:385] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.889654 22433 raft_consensus.cc:740] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.911006 22434 ts_tablet_manager.cc:1434] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260709 13:10:30.912060 22434 tablet_bootstrap.cc:492] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:30.914336 22060 catalog_manager.cc:5697] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b reported cstate change: term changed from 0 to 1, leader changed from <none> to edd63b54133d4c8d9149d57a2886916b (127.12.76.132). New cstate: current_term: 1 leader_uuid: "edd63b54133d4c8d9149d57a2886916b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:30.919822 22437 tablet_bootstrap.cc:492] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:30.920449 22437 ts_tablet_manager.cc:1403] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.210s	user 0.013s	sys 0.000s
I20260709 13:10:30.929376 22482 raft_consensus.cc:493] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.930102 22482 raft_consensus.cc:515] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:30.933899 22384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5634eebf5657424c9f136d8f08e8e8f6" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:30.934127 22482 leader_election.cc:290] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:30.935137 22437 raft_consensus.cc:359] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
W20260709 13:10:30.935452 22126 leader_election.cc:343] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.924145 22433 consensus_queue.cc:260] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:30.937131 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5634eebf5657424c9f136d8f08e8e8f6" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:30.938002 22433 ts_tablet_manager.cc:1434] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.075s	user 0.009s	sys 0.000s
I20260709 13:10:30.939284 22433 tablet_bootstrap.cc:492] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:30.940811 22437 raft_consensus.cc:385] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:10:30.941216 22127 leader_election.cc:343] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.942042 22127 leader_election.cc:304] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:30.941227 22437 raft_consensus.cc:740] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.945609 22437 consensus_queue.cc:260] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:30.948597 22437 ts_tablet_manager.cc:1434] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:10:30.950098 22437 tablet_bootstrap.cc:492] T 486fbb450f854f00af3362b34a0ef614 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:30.950237 22482 raft_consensus.cc:2749] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.983551 22060 catalog_manager.cc:5697] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 reported cstate change: term changed from 0 to 1, leader changed from <none> to 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "371d38ec3c7f493e9aea62dae121e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.992477 22437 tablet_bootstrap.cc:654] T 486fbb450f854f00af3362b34a0ef614 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.998102 22434 tablet_bootstrap.cc:654] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.003384 22058 catalog_manager.cc:5697] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:31.011015 22433 tablet_bootstrap.cc:654] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.017845 22431 tablet_bootstrap.cc:492] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:31.018618 22431 ts_tablet_manager.cc:1403] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.372s	user 0.036s	sys 0.074s
W20260709 13:10:31.018786 22109 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:31.022672 22431 raft_consensus.cc:359] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.023676 22431 raft_consensus.cc:385] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.024021 22431 raft_consensus.cc:740] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.024819 22431 consensus_queue.cc:260] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.039779 22431 ts_tablet_manager.cc:1434] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:10:31.040755 22431 tablet_bootstrap.cc:492] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:31.040942 22676 raft_consensus.cc:493] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.041504 22676 raft_consensus.cc:515] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:31.045433 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f0ec01ac814561a087cb72983b73de" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:31.051520 22235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f0ec01ac814561a087cb72983b73de" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:31.052366 22235 raft_consensus.cc:2393] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66d3606ce30b4661b5d62d403d7abca0 in current term 1: Already voted for candidate 5d515385609945e5837e85b77de385e2 in this term.
I20260709 13:10:31.053417 22431 tablet_bootstrap.cc:654] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.053467 22276 leader_election.cc:304] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:31.053925 22676 leader_election.cc:290] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:31.054884 22676 raft_consensus.cc:3060] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.056967 22434 tablet_bootstrap.cc:492] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:31.057837 22434 ts_tablet_manager.cc:1403] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.146s	user 0.011s	sys 0.011s
I20260709 13:10:31.065776 22604 raft_consensus.cc:493] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.066560 22604 raft_consensus.cc:515] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.069389 22604 leader_election.cc:290] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:31.069900 22384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c563b0b9ff42638139dc08d9fd2e23" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:31.070591 22384 raft_consensus.cc:2468] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 0.
I20260709 13:10:31.071349 22482 raft_consensus.cc:493] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.071861 22482 raft_consensus.cc:515] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.073966 22482 leader_election.cc:290] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:31.076943 22201 leader_election.cc:304] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:31.078796 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c563b0b9ff42638139dc08d9fd2e23" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:31.079560 22236 raft_consensus.cc:2468] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 0.
I20260709 13:10:31.080407 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c563b0b9ff42638139dc08d9fd2e23" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:31.080418 22699 raft_consensus.cc:2804] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.081161 22699 raft_consensus.cc:493] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.081082 22162 raft_consensus.cc:2468] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 0.
I20260709 13:10:31.082453 22699 raft_consensus.cc:3060] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.080992 22127 leader_election.cc:304] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 
I20260709 13:10:31.082160 22482 consensus_queue.cc:1048] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:10:31.086750 22482 raft_consensus.cc:2804] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.087344 22482 raft_consensus.cc:493] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.088058 22482 raft_consensus.cc:3060] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.090061 22437 tablet_bootstrap.cc:492] T 486fbb450f854f00af3362b34a0ef614 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:31.092088 22437 ts_tablet_manager.cc:1403] T 486fbb450f854f00af3362b34a0ef614 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.142s	user 0.012s	sys 0.005s
I20260709 13:10:31.077437 22676 raft_consensus.cc:2749] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.082388 22384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c563b0b9ff42638139dc08d9fd2e23" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:31.099803 22384 raft_consensus.cc:2468] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 0.
I20260709 13:10:31.107542 22433 tablet_bootstrap.cc:492] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:31.108106 22433 ts_tablet_manager.cc:1403] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.169s	user 0.020s	sys 0.015s
I20260709 13:10:31.113824 22433 raft_consensus.cc:359] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:31.114696 22433 raft_consensus.cc:385] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.115212 22433 raft_consensus.cc:740] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.117686 22433 consensus_queue.cc:260] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:31.120213 22433 ts_tablet_manager.cc:1434] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:10:31.122197 22433 tablet_bootstrap.cc:492] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:31.130997 22434 raft_consensus.cc:359] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:31.132762 22434 raft_consensus.cc:385] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.133144 22434 raft_consensus.cc:740] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.113606 22663 consensus_queue.cc:1048] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:10:31.142629 22434 consensus_queue.cc:260] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:31.148516 22433 tablet_bootstrap.cc:654] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.150363 22437 raft_consensus.cc:359] T 486fbb450f854f00af3362b34a0ef614 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:31.150887 22437 raft_consensus.cc:385] T 486fbb450f854f00af3362b34a0ef614 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.151100 22437 raft_consensus.cc:740] T 486fbb450f854f00af3362b34a0ef614 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.151872 22431 tablet_bootstrap.cc:492] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:31.152815 22431 ts_tablet_manager.cc:1403] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.112s	user 0.021s	sys 0.022s
I20260709 13:10:31.151850 22437 consensus_queue.cc:260] T 486fbb450f854f00af3362b34a0ef614 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:31.159546 22431 raft_consensus.cc:359] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.160153 22431 raft_consensus.cc:385] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.160419 22431 raft_consensus.cc:740] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.161197 22431 consensus_queue.cc:260] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.162106 22437 ts_tablet_manager.cc:1434] T 486fbb450f854f00af3362b34a0ef614 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.000s
I20260709 13:10:31.163065 22437 tablet_bootstrap.cc:492] T 9de1c7b16c2347058e4b97f057c06690 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:31.163689 22431 ts_tablet_manager.cc:1434] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:10:31.164491 22431 tablet_bootstrap.cc:492] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:31.175920 22434 ts_tablet_manager.cc:1434] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.118s	user 0.004s	sys 0.003s
I20260709 13:10:31.176957 22434 tablet_bootstrap.cc:492] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:31.166021 22699 raft_consensus.cc:515] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.181645 22437 tablet_bootstrap.cc:654] T 9de1c7b16c2347058e4b97f057c06690 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.183302 22384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c563b0b9ff42638139dc08d9fd2e23" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:31.183899 22384 raft_consensus.cc:3060] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.184245 22482 raft_consensus.cc:515] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.187752 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c563b0b9ff42638139dc08d9fd2e23" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:31.188495 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c563b0b9ff42638139dc08d9fd2e23" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:31.188776 22236 raft_consensus.cc:2393] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d515385609945e5837e85b77de385e2 in current term 1: Already voted for candidate 371d38ec3c7f493e9aea62dae121e565 in this term.
I20260709 13:10:31.189221 22162 raft_consensus.cc:2393] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 371d38ec3c7f493e9aea62dae121e565 in current term 1: Already voted for candidate 5d515385609945e5837e85b77de385e2 in this term.
I20260709 13:10:31.191526 22699 leader_election.cc:290] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:31.193317 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c563b0b9ff42638139dc08d9fd2e23" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:31.195127 22126 leader_election.cc:304] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:31.196020 22679 raft_consensus.cc:2749] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.200127 22482 leader_election.cc:290] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:31.206987 22386 raft_consensus.cc:1275] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Refusing update from remote peer 66d3606ce30b4661b5d62d403d7abca0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.207242 22431 tablet_bootstrap.cc:654] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.208817 22434 tablet_bootstrap.cc:654] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.208724 22676 consensus_queue.cc:1048] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:31.219660 22384 raft_consensus.cc:2468] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:31.221387 22201 leader_election.cc:304] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:31.222894 22699 raft_consensus.cc:2804] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.223539 22699 raft_consensus.cc:697] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Becoming Leader. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:31.224627 22699 consensus_queue.cc:237] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.229652 22517 consensus_queue.cc:1048] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.232148 22434 tablet_bootstrap.cc:492] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:31.232861 22434 ts_tablet_manager.cc:1403] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.005s
I20260709 13:10:31.233139 22308 raft_consensus.cc:3060] T 486fbb450f854f00af3362b34a0ef614 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.245200 22433 tablet_bootstrap.cc:492] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:31.245903 22433 ts_tablet_manager.cc:1403] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.125s	user 0.017s	sys 0.002s
I20260709 13:10:31.248597 22431 tablet_bootstrap.cc:492] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:31.249092 22431 ts_tablet_manager.cc:1403] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.004s
I20260709 13:10:31.252526 22431 raft_consensus.cc:359] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:31.253180 22431 raft_consensus.cc:385] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.253443 22431 raft_consensus.cc:740] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.254052 22431 consensus_queue.cc:260] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:31.257526 22434 raft_consensus.cc:359] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:31.258733 22434 raft_consensus.cc:385] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.259070 22434 raft_consensus.cc:740] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.263564 22162 raft_consensus.cc:1275] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Refusing update from remote peer 66d3606ce30b4661b5d62d403d7abca0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.265504 22727 consensus_queue.cc:1048] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:31.269739 22517 consensus_queue.cc:1048] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:31.271242 22433 raft_consensus.cc:359] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:31.271981 22433 raft_consensus.cc:385] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.272249 22433 raft_consensus.cc:740] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.272927 22433 consensus_queue.cc:260] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:31.273808 22673 raft_consensus.cc:493] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.274255 22673 raft_consensus.cc:515] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:31.274931 22433 ts_tablet_manager.cc:1434] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.000s
I20260709 13:10:31.276393 22673 leader_election.cc:290] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:31.276906 22434 consensus_queue.cc:260] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:31.279033 22434 ts_tablet_manager.cc:1434] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:10:31.278887 22161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b501417270f5431da901577c6e5da05f" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:31.281633 22431 ts_tablet_manager.cc:1434] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:10:31.282789 22434 tablet_bootstrap.cc:492] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:31.283358 22311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b501417270f5431da901577c6e5da05f" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:31.284227 22311 raft_consensus.cc:2393] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edd63b54133d4c8d9149d57a2886916b in current term 1: Already voted for candidate 5d515385609945e5837e85b77de385e2 in this term.
I20260709 13:10:31.286623 22351 leader_election.cc:304] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:31.287771 22440 raft_consensus.cc:3060] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.288280 22433 tablet_bootstrap.cc:492] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:31.290786 22437 tablet_bootstrap.cc:492] T 9de1c7b16c2347058e4b97f057c06690 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:31.291283 22437 ts_tablet_manager.cc:1403] T 9de1c7b16c2347058e4b97f057c06690 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.128s	user 0.026s	sys 0.015s
I20260709 13:10:31.295087 22431 tablet_bootstrap.cc:492] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:31.294370 22437 raft_consensus.cc:359] T 9de1c7b16c2347058e4b97f057c06690 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:31.302554 22437 raft_consensus.cc:385] T 9de1c7b16c2347058e4b97f057c06690 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.303143 22437 raft_consensus.cc:740] T 9de1c7b16c2347058e4b97f057c06690 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.303973 22437 consensus_queue.cc:260] T 9de1c7b16c2347058e4b97f057c06690 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:31.303993 22434 tablet_bootstrap.cc:654] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.306198 22431 tablet_bootstrap.cc:654] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.308007 22437 ts_tablet_manager.cc:1434] T 9de1c7b16c2347058e4b97f057c06690 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:10:31.310756 22437 tablet_bootstrap.cc:492] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:31.311769 22604 consensus_queue.cc:1048] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.312362 22433 tablet_bootstrap.cc:654] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.317809 22437 tablet_bootstrap.cc:654] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.330989 22434 tablet_bootstrap.cc:492] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:31.331506 22434 ts_tablet_manager.cc:1403] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.000s
I20260709 13:10:31.334120 22434 raft_consensus.cc:359] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.334798 22440 raft_consensus.cc:2749] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.340349 22433 tablet_bootstrap.cc:492] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:31.340945 22433 ts_tablet_manager.cc:1403] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.001s
I20260709 13:10:31.342690 22437 tablet_bootstrap.cc:492] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:31.343250 22437 ts_tablet_manager.cc:1403] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.001s
I20260709 13:10:31.342793 22059 catalog_manager.cc:5697] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 reported cstate change: term changed from 0 to 1, leader changed from <none> to 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "371d38ec3c7f493e9aea62dae121e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:31.343624 22433 raft_consensus.cc:359] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.344388 22433 raft_consensus.cc:385] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.344746 22433 raft_consensus.cc:740] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.346558 22437 raft_consensus.cc:359] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:31.347303 22437 raft_consensus.cc:385] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.347476 22431 tablet_bootstrap.cc:492] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:31.347666 22437 raft_consensus.cc:740] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.348043 22431 ts_tablet_manager.cc:1403] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.006s
I20260709 13:10:31.348434 22437 consensus_queue.cc:260] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:31.350751 22437 ts_tablet_manager.cc:1434] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:31.350870 22431 raft_consensus.cc:359] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:31.351644 22431 raft_consensus.cc:385] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.351815 22437 tablet_bootstrap.cc:492] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:31.352020 22431 raft_consensus.cc:740] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.334793 22434 raft_consensus.cc:385] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.352900 22431 consensus_queue.cc:260] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:31.354081 22434 raft_consensus.cc:740] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.355628 22434 consensus_queue.cc:260] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.357539 22431 ts_tablet_manager.cc:1434] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:10:31.363559 22431 tablet_bootstrap.cc:492] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:31.358243 22433 consensus_queue.cc:260] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.366777 22433 ts_tablet_manager.cc:1434] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:10:31.367823 22433 tablet_bootstrap.cc:492] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:31.362344 22437 tablet_bootstrap.cc:654] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.361974 22662 consensus_queue.cc:1048] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:31.370115 22431 tablet_bootstrap.cc:654] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.378484 22604 consensus_queue.cc:1048] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:31.395452 22440 raft_consensus.cc:493] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.396293 22440 raft_consensus.cc:515] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:31.395896 22434 ts_tablet_manager.cc:1434] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.000s
I20260709 13:10:31.400429 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0368f9bb9bc94a05bcbf9cfdcb7eac4e" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:31.401734 22434 tablet_bootstrap.cc:492] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:31.401829 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0368f9bb9bc94a05bcbf9cfdcb7eac4e" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:31.407016 22433 tablet_bootstrap.cc:654] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.407244 22440 leader_election.cc:290] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:31.411587 22604 raft_consensus.cc:493] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.412143 22604 raft_consensus.cc:515] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.416113 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5634eebf5657424c9f136d8f08e8e8f6" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:31.416115 22161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5634eebf5657424c9f136d8f08e8e8f6" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:31.417831 22161 raft_consensus.cc:2468] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 0.
I20260709 13:10:31.418257 22434 tablet_bootstrap.cc:654] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.419308 22201 leader_election.cc:304] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 
I20260709 13:10:31.420323 22699 raft_consensus.cc:2804] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.420910 22699 raft_consensus.cc:493] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.421295 22699 raft_consensus.cc:3060] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:31.427729 22201 leader_election.cc:343] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.420357 22604 leader_election.cc:290] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
W20260709 13:10:31.432579 22350 leader_election.cc:343] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:31.433612 22351 leader_election.cc:343] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.432155 22699 raft_consensus.cc:515] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.434109 22351 leader_election.cc:304] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:31.437973 22517 raft_consensus.cc:2749] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.443298 22434 tablet_bootstrap.cc:492] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:31.443876 22434 ts_tablet_manager.cc:1403] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.004s
I20260709 13:10:31.446241 22437 tablet_bootstrap.cc:492] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:31.446794 22437 ts_tablet_manager.cc:1403] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.095s	user 0.009s	sys 0.003s
I20260709 13:10:31.446873 22679 consensus_queue.cc:1048] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:31.449026 22433 tablet_bootstrap.cc:492] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:31.449538 22433 ts_tablet_manager.cc:1403] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.082s	user 0.027s	sys 0.008s
I20260709 13:10:31.449750 22437 raft_consensus.cc:359] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:31.450479 22437 raft_consensus.cc:385] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.450778 22437 raft_consensus.cc:740] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.452512 22433 raft_consensus.cc:359] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:31.453264 22433 raft_consensus.cc:385] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.453559 22433 raft_consensus.cc:740] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.446820 22434 raft_consensus.cc:359] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:31.454236 22433 consensus_queue.cc:260] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:31.455344 22434 raft_consensus.cc:385] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.457111 22433 ts_tablet_manager.cc:1434] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:31.458173 22431 tablet_bootstrap.cc:492] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:31.458334 22433 tablet_bootstrap.cc:492] T 9dee9596873a4f1da4230b8f9b4467fc P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:31.458722 22431 ts_tablet_manager.cc:1403] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.095s	user 0.032s	sys 0.012s
I20260709 13:10:31.461627 22431 raft_consensus.cc:359] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.462381 22431 raft_consensus.cc:385] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.462664 22431 raft_consensus.cc:740] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.463368 22431 consensus_queue.cc:260] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.466019 22431 ts_tablet_manager.cc:1434] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:10:31.466486 22433 tablet_bootstrap.cc:654] T 9dee9596873a4f1da4230b8f9b4467fc P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.466952 22431 tablet_bootstrap.cc:492] T c144955449774c3c90f8e0ed28cc5155 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:31.463629 22437 consensus_queue.cc:260] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:31.469977 22437 ts_tablet_manager.cc:1434] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.003s
I20260709 13:10:31.470986 22437 tablet_bootstrap.cc:492] T 172a5324a0f04ae9b78b1bc0b106dbea P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:31.474752 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5634eebf5657424c9f136d8f08e8e8f6" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:31.455709 22434 raft_consensus.cc:740] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
W20260709 13:10:31.477051 22201 leader_election.cc:343] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.477504 22434 consensus_queue.cc:260] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:31.479776 22699 leader_election.cc:290] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:31.480007 22434 ts_tablet_manager.cc:1434] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:10:31.481024 22434 tablet_bootstrap.cc:492] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:31.482702 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5634eebf5657424c9f136d8f08e8e8f6" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:31.483564 22162 raft_consensus.cc:3060] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.484957 22679 raft_consensus.cc:493] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.485524 22679 raft_consensus.cc:515] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:31.488029 22437 tablet_bootstrap.cc:654] T 172a5324a0f04ae9b78b1bc0b106dbea P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.489003 22679 leader_election.cc:290] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:31.490717 22308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4e00f55ac949c2a073e99cf9bc9290" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:31.491722 22308 raft_consensus.cc:2468] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 0.
I20260709 13:10:31.493608 22128 leader_election.cc:304] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:31.504832 22162 raft_consensus.cc:2468] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:31.511639 22201 leader_election.cc:304] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:31.512022 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4e00f55ac949c2a073e99cf9bc9290" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:31.513079 22386 raft_consensus.cc:2468] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 0.
I20260709 13:10:31.513386 22603 raft_consensus.cc:2804] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.513931 22603 raft_consensus.cc:697] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Becoming Leader. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:31.514227 22679 raft_consensus.cc:2804] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.514863 22679 raft_consensus.cc:493] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.515596 22679 raft_consensus.cc:3060] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.512591 22604 raft_consensus.cc:493] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.516824 22604 raft_consensus.cc:515] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:31.518815 22604 leader_election.cc:290] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:31.514796 22603 consensus_queue.cc:237] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.519865 22662 raft_consensus.cc:493] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.520341 22662 raft_consensus.cc:515] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:31.522367 22662 leader_election.cc:290] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:31.524986 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535cc40e1cc04f16a78d6fbd34a69f3f" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:31.525629 22238 raft_consensus.cc:2468] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 0.
I20260709 13:10:31.526849 22728 raft_consensus.cc:493] T 9de1c7b16c2347058e4b97f057c06690 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.527318 22728 raft_consensus.cc:515] T 9de1c7b16c2347058e4b97f057c06690 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:31.529424 22728 leader_election.cc:290] T 9de1c7b16c2347058e4b97f057c06690 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:31.533034 22127 leader_election.cc:304] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 
I20260709 13:10:31.537034 22431 tablet_bootstrap.cc:654] T c144955449774c3c90f8e0ed28cc5155 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.547925 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de1c7b16c2347058e4b97f057c06690" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:31.549172 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de1c7b16c2347058e4b97f057c06690" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:31.549822 22312 raft_consensus.cc:2468] T 9de1c7b16c2347058e4b97f057c06690 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 0.
I20260709 13:10:31.535189 22662 raft_consensus.cc:2804] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.559919 22662 raft_consensus.cc:493] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.560411 22662 raft_consensus.cc:3060] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.577340 22603 raft_consensus.cc:493] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.579759 22603 raft_consensus.cc:515] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.581955 22603 leader_election.cc:290] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:31.585705 22308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535cc40e1cc04f16a78d6fbd34a69f3f" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:31.592619 22308 raft_consensus.cc:2468] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 0.
I20260709 13:10:31.595258 22663 raft_consensus.cc:493] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.596031 22663 raft_consensus.cc:515] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.600921 22663 leader_election.cc:290] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:31.601029 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d963b71e2742f3a74e1bed72d29186" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:31.602010 22386 raft_consensus.cc:2468] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 1.
I20260709 13:10:31.602370 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d963b71e2742f3a74e1bed72d29186" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:31.603755 22126 leader_election.cc:304] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:31.603669 22238 raft_consensus.cc:2468] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 1.
I20260709 13:10:31.607438 22679 raft_consensus.cc:515] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:31.609079 22663 raft_consensus.cc:2804] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:31.615125 22203 leader_election.cc:304] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:31.617223 22603 raft_consensus.cc:2804] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.617573 22603 raft_consensus.cc:493] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.617898 22603 raft_consensus.cc:3060] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.627614 22440 raft_consensus.cc:493] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.628156 22440 raft_consensus.cc:515] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:31.628726 22057 catalog_manager.cc:5697] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 reported cstate change: term changed from 0 to 1, leader changed from <none> to 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "371d38ec3c7f493e9aea62dae121e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:31.631467 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7698abde6404f019732b30297ad5923" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
W20260709 13:10:31.633294 22349 leader_election.cc:343] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.633818 22440 leader_election.cc:290] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:31.634253 22663 raft_consensus.cc:493] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.634711 22663 raft_consensus.cc:3060] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:31.644519 22603 raft_consensus.cc:515] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:31.648250 22603 leader_election.cc:290] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:31.648414 22437 tablet_bootstrap.cc:492] T 172a5324a0f04ae9b78b1bc0b106dbea P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:31.648912 22437 ts_tablet_manager.cc:1403] T 172a5324a0f04ae9b78b1bc0b106dbea P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.178s	user 0.015s	sys 0.001s
I20260709 13:10:31.648983 22663 raft_consensus.cc:515] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.652010 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d963b71e2742f3a74e1bed72d29186" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:31.652575 22386 raft_consensus.cc:3060] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:31.655506 22437 raft_consensus.cc:359] T 172a5324a0f04ae9b78b1bc0b106dbea P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:31.656204 22437 raft_consensus.cc:385] T 172a5324a0f04ae9b78b1bc0b106dbea P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.656476 22437 raft_consensus.cc:740] T 172a5324a0f04ae9b78b1bc0b106dbea P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.656499 22482 raft_consensus.cc:493] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.657055 22482 raft_consensus.cc:515] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:31.657351 22437 consensus_queue.cc:260] T 172a5324a0f04ae9b78b1bc0b106dbea P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:31.663861 22384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56649a39ed04a1682d5f0473dbb791e" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:31.666752 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56649a39ed04a1682d5f0473dbb791e" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
W20260709 13:10:31.668188 22126 leader_election.cc:343] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:31.669476 22350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:43835, user_credentials={real_user=slave}} blocked reactor thread for 53468.2us
I20260709 13:10:31.675705 22434 tablet_bootstrap.cc:654] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.678220 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4e00f55ac949c2a073e99cf9bc9290" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:31.678831 22312 raft_consensus.cc:3060] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.682929 22308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7698abde6404f019732b30297ad5923" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
W20260709 13:10:31.684005 22275 leader_election.cc:343] T 9de1c7b16c2347058e4b97f057c06690 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.686357 22384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4e00f55ac949c2a073e99cf9bc9290" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:31.686941 22384 raft_consensus.cc:3060] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:31.687875 22351 leader_election.cc:343] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.688333 22351 leader_election.cc:304] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:31.689379 22673 raft_consensus.cc:2749] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.691717 22679 leader_election.cc:290] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:31.659222 22482 leader_election.cc:290] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:31.699864 22386 raft_consensus.cc:2468] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
I20260709 13:10:31.678982 22437 ts_tablet_manager.cc:1434] T 172a5324a0f04ae9b78b1bc0b106dbea P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:10:31.704049 22437 tablet_bootstrap.cc:492] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:31.723404 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d963b71e2742f3a74e1bed72d29186" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:31.723594 22126 leader_election.cc:304] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:31.724128 22236 raft_consensus.cc:3060] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:31.724721 22433 tablet_bootstrap.cc:492] T 9dee9596873a4f1da4230b8f9b4467fc P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:31.725229 22433 ts_tablet_manager.cc:1403] T 9dee9596873a4f1da4230b8f9b4467fc P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.267s	user 0.085s	sys 0.125s
I20260709 13:10:31.725172 22632 raft_consensus.cc:493] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.734988 22308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de1c7b16c2347058e4b97f057c06690" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:31.735671 22308 raft_consensus.cc:3060] T 9de1c7b16c2347058e4b97f057c06690 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.735153 22632 raft_consensus.cc:515] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.738188 22632 leader_election.cc:290] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:31.728437 22482 raft_consensus.cc:2804] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:31.739285 22482 raft_consensus.cc:697] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:31.740445 22482 consensus_queue.cc:237] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.741338 22161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a23c35530d84893bfc638fe35760483" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
W20260709 13:10:31.743768 22349 leader_election.cc:343] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.709472 22384 raft_consensus.cc:2468] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 1.
I20260709 13:10:31.727545 22663 leader_election.cc:290] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:31.747630 22727 raft_consensus.cc:493] T 172a5324a0f04ae9b78b1bc0b106dbea P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.756814 22727 raft_consensus.cc:515] T 172a5324a0f04ae9b78b1bc0b106dbea P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:31.758191 22434 tablet_bootstrap.cc:492] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:31.758684 22434 ts_tablet_manager.cc:1403] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.278s	user 0.011s	sys 0.003s
I20260709 13:10:31.758846 22727 leader_election.cc:290] T 172a5324a0f04ae9b78b1bc0b106dbea P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:31.753994 22126 leader_election.cc:304] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 
W20260709 13:10:31.751713 22128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46871, user_credentials={real_user=slave}} blocked reactor thread for 81052.5us
W20260709 13:10:31.761168 22128 leader_election.cc:343] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.761615 22128 leader_election.cc:304] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:31.761919 22384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172a5324a0f04ae9b78b1bc0b106dbea" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:31.762593 22312 raft_consensus.cc:2468] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 1.
I20260709 13:10:31.763396 22663 raft_consensus.cc:2749] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.767935 22308 raft_consensus.cc:2468] T 9de1c7b16c2347058e4b97f057c06690 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:31.768702 22433 raft_consensus.cc:359] T 9dee9596873a4f1da4230b8f9b4467fc P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.769701 22482 raft_consensus.cc:2804] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.769470 22161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172a5324a0f04ae9b78b1bc0b106dbea" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:31.770339 22482 raft_consensus.cc:697] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [term 1 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
W20260709 13:10:31.771158 22275 leader_election.cc:343] T 172a5324a0f04ae9b78b1bc0b106dbea P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.771358 22482 consensus_queue.cc:237] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:31.772519 22203 leader_election.cc:304] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:31.773581 22747 raft_consensus.cc:2804] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.774618 22236 raft_consensus.cc:2468] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
W20260709 13:10:31.774320 22275 leader_election.cc:343] T 172a5324a0f04ae9b78b1bc0b106dbea P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.774717 22747 raft_consensus.cc:697] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Becoming Leader. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:31.776912 22434 raft_consensus.cc:359] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:31.777596 22434 raft_consensus.cc:385] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.777881 22434 raft_consensus.cc:740] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.780098 22603 raft_consensus.cc:493] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.775295 22275 leader_election.cc:304] T 172a5324a0f04ae9b78b1bc0b106dbea P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:31.780707 22603 raft_consensus.cc:515] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.780975 22434 consensus_queue.cc:260] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:31.781527 22727 raft_consensus.cc:2749] T 172a5324a0f04ae9b78b1bc0b106dbea P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.783301 22603 leader_election.cc:290] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:31.777984 22747 consensus_queue.cc:237] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:31.783353 22434 ts_tablet_manager.cc:1434] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.003s
I20260709 13:10:31.769424 22433 raft_consensus.cc:385] T 9dee9596873a4f1da4230b8f9b4467fc P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.787674 22433 raft_consensus.cc:740] T 9dee9596873a4f1da4230b8f9b4467fc P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.791042 22434 tablet_bootstrap.cc:492] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:31.788704 22433 consensus_queue.cc:260] T 9dee9596873a4f1da4230b8f9b4467fc P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.808385 22433 ts_tablet_manager.cc:1434] T 9dee9596873a4f1da4230b8f9b4467fc P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.003s
I20260709 13:10:31.809508 22433 tablet_bootstrap.cc:492] T 9c9023b52992475a8b8ad4949867582a P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:31.809331 22235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a23c35530d84893bfc638fe35760483" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:31.810401 22431 tablet_bootstrap.cc:492] T c144955449774c3c90f8e0ed28cc5155 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:31.810837 22431 ts_tablet_manager.cc:1403] T c144955449774c3c90f8e0ed28cc5155 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.344s	user 0.017s	sys 0.003s
I20260709 13:10:31.794960 22662 raft_consensus.cc:515] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:31.819881 22433 tablet_bootstrap.cc:654] T 9c9023b52992475a8b8ad4949867582a P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:31.822785 22201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:33591, user_credentials={real_user=slave}} blocked reactor thread for 311219us
I20260709 13:10:31.825839 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d963b71e2742f3a74e1bed72d29186" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:31.826666 22386 raft_consensus.cc:2393] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 371d38ec3c7f493e9aea62dae121e565 in current term 2: Already voted for candidate 5d515385609945e5837e85b77de385e2 in this term.
I20260709 13:10:31.828207 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de1c7b16c2347058e4b97f057c06690" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:31.829847 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de1c7b16c2347058e4b97f057c06690" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:31.830178 22276 leader_election.cc:304] T 9de1c7b16c2347058e4b97f057c06690 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:31.831368 22727 raft_consensus.cc:2749] T 9de1c7b16c2347058e4b97f057c06690 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:31.832842 22350 leader_election.cc:343] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.833333 22350 leader_election.cc:304] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:31.834084 22517 raft_consensus.cc:2749] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.828456 22431 raft_consensus.cc:359] T c144955449774c3c90f8e0ed28cc5155 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:31.837113 22431 raft_consensus.cc:385] T c144955449774c3c90f8e0ed28cc5155 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.837404 22431 raft_consensus.cc:740] T c144955449774c3c90f8e0ed28cc5155 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.839674 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d963b71e2742f3a74e1bed72d29186" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:31.842110 22159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dee9596873a4f1da4230b8f9b4467fc" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:31.842854 22159 raft_consensus.cc:2468] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 0.
I20260709 13:10:31.843883 22384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de1c7b16c2347058e4b97f057c06690" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:31.847823 22431 consensus_queue.cc:260] T c144955449774c3c90f8e0ed28cc5155 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:31.849354 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dee9596873a4f1da4230b8f9b4467fc" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:31.850076 22386 raft_consensus.cc:2468] T 9dee9596873a4f1da4230b8f9b4467fc P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 0.
I20260709 13:10:31.850255 22431 ts_tablet_manager.cc:1434] T c144955449774c3c90f8e0ed28cc5155 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.002s
I20260709 13:10:31.851123 22431 tablet_bootstrap.cc:492] T bb2e1e35ba2d4732a195046335a7af7c P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:31.856997 22061 catalog_manager.cc:5697] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 0 to 2, leader changed from <none> to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:31.865805 22431 tablet_bootstrap.cc:654] T bb2e1e35ba2d4732a195046335a7af7c P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.882622 22201 leader_election.cc:304] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 
I20260709 13:10:31.886178 22699 raft_consensus.cc:2804] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.886588 22699 raft_consensus.cc:493] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.886925 22699 raft_consensus.cc:3060] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.895300 22604 consensus_queue.cc:1048] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.890921 22201 leader_election.cc:304] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565; no voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b
W20260709 13:10:31.899971 22753 log.cc:927] Time spent T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:10:31.904044 22437 tablet_bootstrap.cc:654] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.906556 22603 raft_consensus.cc:2749] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:31.907738 22201 leader_election.cc:343] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.908677 22603 consensus_queue.cc:1048] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.910912 22662 leader_election.cc:290] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:31.909608 22061 catalog_manager.cc:5697] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:31.914122 22235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535cc40e1cc04f16a78d6fbd34a69f3f" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
W20260709 13:10:31.914386 22201 leader_election.cc:343] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.914742 22235 raft_consensus.cc:3060] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.921157 22311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535cc40e1cc04f16a78d6fbd34a69f3f" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:31.921829 22311 raft_consensus.cc:3060] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.934814 22434 tablet_bootstrap.cc:654] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:31.938333 22754 log.cc:927] Time spent T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:10:31.938431 22235 raft_consensus.cc:2468] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 1.
I20260709 13:10:31.940114 22127 leader_election.cc:304] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 
I20260709 13:10:31.894969 22699 raft_consensus.cc:515] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:31.944504 22750 raft_consensus.cc:2804] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.955955 22750 raft_consensus.cc:697] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 1 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:31.957198 22750 consensus_queue.cc:237] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:31.962543 22311 raft_consensus.cc:2468] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 1.
W20260709 13:10:31.991178 22275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:33591, user_credentials={real_user=slave}} blocked reactor thread for 48231.2us
I20260709 13:10:31.994189 22757 raft_consensus.cc:493] T c144955449774c3c90f8e0ed28cc5155 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.997197 22437 tablet_bootstrap.cc:492] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:31.997743 22437 ts_tablet_manager.cc:1403] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.294s	user 0.019s	sys 0.000s
I20260709 13:10:31.997480 22061 catalog_manager.cc:5697] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565 reported cstate change: term changed from 0 to 1, leader changed from <none> to 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "371d38ec3c7f493e9aea62dae121e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:32.000550 22431 tablet_bootstrap.cc:492] T bb2e1e35ba2d4732a195046335a7af7c P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:32.001116 22431 ts_tablet_manager.cc:1403] T bb2e1e35ba2d4732a195046335a7af7c P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.150s	user 0.022s	sys 0.025s
I20260709 13:10:32.000590 22437 raft_consensus.cc:359] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:32.001914 22437 raft_consensus.cc:385] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.002269 22437 raft_consensus.cc:740] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.003031 22437 consensus_queue.cc:260] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
W20260709 13:10:32.004719 22201 consensus_peers.cc:597] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 -> Peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Couldn't send request to peer edd63b54133d4c8d9149d57a2886916b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:32.005311 22437 ts_tablet_manager.cc:1434] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:32.005931 22699 leader_election.cc:290] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:32.006403 22437 tablet_bootstrap.cc:492] T e56649a39ed04a1682d5f0473dbb791e P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:32.000854 22434 tablet_bootstrap.cc:492] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:32.009120 22434 ts_tablet_manager.cc:1403] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.219s	user 0.023s	sys 0.005s
I20260709 13:10:31.994836 22757 raft_consensus.cc:515] T c144955449774c3c90f8e0ed28cc5155 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:32.014384 22757 leader_election.cc:290] T c144955449774c3c90f8e0ed28cc5155 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:32.086668 22384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dee9596873a4f1da4230b8f9b4467fc" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:32.087340 22384 raft_consensus.cc:3060] T 9dee9596873a4f1da4230b8f9b4467fc P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.107461 22431 raft_consensus.cc:359] T bb2e1e35ba2d4732a195046335a7af7c P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:32.108290 22431 raft_consensus.cc:385] T bb2e1e35ba2d4732a195046335a7af7c P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.108572 22431 raft_consensus.cc:740] T bb2e1e35ba2d4732a195046335a7af7c P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.109180 22431 consensus_queue.cc:260] T bb2e1e35ba2d4732a195046335a7af7c P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:32.111202 22431 ts_tablet_manager.cc:1434] T bb2e1e35ba2d4732a195046335a7af7c P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.110s	user 0.005s	sys 0.001s
I20260709 13:10:32.115232 22434 raft_consensus.cc:359] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:32.116897 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dee9596873a4f1da4230b8f9b4467fc" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:32.132103 22162 raft_consensus.cc:3060] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.132506 22431 tablet_bootstrap.cc:492] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:32.120890 22433 tablet_bootstrap.cc:492] T 9c9023b52992475a8b8ad4949867582a P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:32.132823 22434 raft_consensus.cc:385] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.133092 22433 ts_tablet_manager.cc:1403] T 9c9023b52992475a8b8ad4949867582a P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.324s	user 0.021s	sys 0.016s
I20260709 13:10:32.133116 22434 raft_consensus.cc:740] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.131389 22437 tablet_bootstrap.cc:654] T e56649a39ed04a1682d5f0473dbb791e P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.120288 22382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144955449774c3c90f8e0ed28cc5155" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
W20260709 13:10:32.134692 22275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:33591, user_credentials={real_user=slave}} blocked reactor thread for 140426us
W20260709 13:10:32.134697 22109 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:32.140404 22434 consensus_queue.cc:260] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:32.150833 22311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144955449774c3c90f8e0ed28cc5155" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:32.152307 22750 raft_consensus.cc:493] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.152851 22750 raft_consensus.cc:515] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:32.154973 22750 leader_election.cc:290] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:32.157894 22309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:32.159374 22728 raft_consensus.cc:493] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.159868 22728 raft_consensus.cc:515] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:32.166225 22162 raft_consensus.cc:2468] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:32.169126 22728 leader_election.cc:290] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:32.169747 22603 consensus_queue.cc:1048] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:32.171173 22434 ts_tablet_manager.cc:1434] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.162s	user 0.006s	sys 0.001s
I20260709 13:10:32.173633 22434 tablet_bootstrap.cc:492] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
W20260709 13:10:32.175431 22203 leader_election.cc:343] T c144955449774c3c90f8e0ed28cc5155 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.172230 22235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
W20260709 13:10:32.179203 22128 leader_election.cc:343] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.182345 22431 tablet_bootstrap.cc:654] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.185388 22382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2e1e35ba2d4732a195046335a7af7c" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
W20260709 13:10:32.187129 22127 leader_election.cc:343] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.187649 22127 leader_election.cc:304] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:32.189664 22057 catalog_manager.cc:5697] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:32.192572 22433 raft_consensus.cc:359] T 9c9023b52992475a8b8ad4949867582a P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:32.193282 22433 raft_consensus.cc:385] T 9c9023b52992475a8b8ad4949867582a P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.193534 22433 raft_consensus.cc:740] T 9c9023b52992475a8b8ad4949867582a P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.194170 22433 consensus_queue.cc:260] T 9c9023b52992475a8b8ad4949867582a P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:32.195969 22201 leader_election.cc:304] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 
W20260709 13:10:32.197744 22201 leader_election.cc:343] T c144955449774c3c90f8e0ed28cc5155 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.197849 22699 raft_consensus.cc:2804] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:32.198217 22201 leader_election.cc:304] T c144955449774c3c90f8e0ed28cc5155 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565; no voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:32.199031 22604 raft_consensus.cc:2749] T c144955449774c3c90f8e0ed28cc5155 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:32.199608 22699 raft_consensus.cc:697] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Becoming Leader. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:32.200492 22699 consensus_queue.cc:237] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:32.185791 22384 raft_consensus.cc:2468] T 9dee9596873a4f1da4230b8f9b4467fc P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:32.206693 22750 raft_consensus.cc:2749] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:32.209434 22433 ts_tablet_manager.cc:1434] T 9c9023b52992475a8b8ad4949867582a P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.076s	user 0.005s	sys 0.001s
I20260709 13:10:32.211534 22433 tablet_bootstrap.cc:492] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:32.219192 22433 tablet_bootstrap.cc:654] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:32.213030 22275 leader_election.cc:343] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.235872 22235 raft_consensus.cc:1275] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:32.237610 22750 consensus_queue.cc:1048] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:32.238993 22750 consensus_queue.cc:1048] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:32.261708 22237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2e1e35ba2d4732a195046335a7af7c" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:32.262373 22237 raft_consensus.cc:2468] T bb2e1e35ba2d4732a195046335a7af7c P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 0.
I20260709 13:10:32.262431 22384 raft_consensus.cc:1275] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:32.264240 22679 consensus_queue.cc:1048] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:32.267263 22434 tablet_bootstrap.cc:654] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.272914 22276 leader_election.cc:304] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:32.277019 22728 raft_consensus.cc:2804] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:32.277835 22728 raft_consensus.cc:493] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.278250 22728 raft_consensus.cc:3060] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.279203 22750 raft_consensus.cc:493] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.279748 22750 raft_consensus.cc:515] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:32.281785 22750 leader_election.cc:290] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:32.283149 22235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4695de4c0534d2d8d2a4c79aab3654d" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
W20260709 13:10:32.285795 22127 leader_election.cc:343] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.286586 22437 tablet_bootstrap.cc:492] T e56649a39ed04a1682d5f0473dbb791e P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:32.287084 22437 ts_tablet_manager.cc:1403] T e56649a39ed04a1682d5f0473dbb791e P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.281s	user 0.021s	sys 0.003s
I20260709 13:10:32.293571 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4695de4c0534d2d8d2a4c79aab3654d" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
W20260709 13:10:32.295224 22128 leader_election.cc:343] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.295449 22517 raft_consensus.cc:493] T 9c9023b52992475a8b8ad4949867582a P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.295782 22128 leader_election.cc:304] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:32.296186 22517 raft_consensus.cc:515] T 9c9023b52992475a8b8ad4949867582a P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:32.297204 22679 raft_consensus.cc:2749] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:32.300413 22517 leader_election.cc:290] T 9c9023b52992475a8b8ad4949867582a P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:32.301213 22728 raft_consensus.cc:515] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:32.302029 22161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9023b52992475a8b8ad4949867582a" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:32.318477 22057 catalog_manager.cc:5697] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 reported cstate change: term changed from 0 to 1, leader changed from <none> to 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "371d38ec3c7f493e9aea62dae121e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:32.322329 22349 leader_election.cc:343] T 9c9023b52992475a8b8ad4949867582a P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.334317 22235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9023b52992475a8b8ad4949867582a" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:32.342805 22728 leader_election.cc:290] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:32.369311 22437 raft_consensus.cc:359] T e56649a39ed04a1682d5f0473dbb791e P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:32.370033 22437 raft_consensus.cc:385] T e56649a39ed04a1682d5f0473dbb791e P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.370343 22437 raft_consensus.cc:740] T e56649a39ed04a1682d5f0473dbb791e P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.371737 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2e1e35ba2d4732a195046335a7af7c" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:32.372457 22236 raft_consensus.cc:3060] T bb2e1e35ba2d4732a195046335a7af7c P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.376760 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2e1e35ba2d4732a195046335a7af7c" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:32.371083 22437 consensus_queue.cc:260] T e56649a39ed04a1682d5f0473dbb791e P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
W20260709 13:10:32.382277 22350 leader_election.cc:343] T 9c9023b52992475a8b8ad4949867582a P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.382810 22350 leader_election.cc:304] T 9c9023b52992475a8b8ad4949867582a P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:32.385351 22437 ts_tablet_manager.cc:1434] T e56649a39ed04a1682d5f0473dbb791e P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.098s	user 0.009s	sys 0.000s
I20260709 13:10:32.386693 22517 raft_consensus.cc:2749] T 9c9023b52992475a8b8ad4949867582a P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:32.386708 22437 tablet_bootstrap.cc:492] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
W20260709 13:10:32.389709 22275 leader_election.cc:343] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.392804 22434 tablet_bootstrap.cc:492] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:32.393348 22434 ts_tablet_manager.cc:1403] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.221s	user 0.032s	sys 0.019s
I20260709 13:10:32.409938 22750 consensus_queue.cc:1048] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:32.420647 22434 raft_consensus.cc:359] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:32.424826 22434 raft_consensus.cc:385] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.425128 22434 raft_consensus.cc:740] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.427801 22434 consensus_queue.cc:260] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:32.446009 22236 raft_consensus.cc:2468] T bb2e1e35ba2d4732a195046335a7af7c P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 1.
I20260709 13:10:32.447672 22276 leader_election.cc:304] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:32.449855 22762 raft_consensus.cc:2804] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:32.450387 22762 raft_consensus.cc:697] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 [term 1 LEADER]: Becoming Leader. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Running, Role: LEADER
I20260709 13:10:32.451231 22762 consensus_queue.cc:237] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:32.457636 22433 tablet_bootstrap.cc:492] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:32.458315 22433 ts_tablet_manager.cc:1403] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.248s	user 0.019s	sys 0.016s
W20260709 13:10:32.468744 22126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:45017, user_credentials={real_user=slave}} blocked reactor thread for 79444.1us
I20260709 13:10:32.473904 22433 raft_consensus.cc:359] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:32.474673 22433 raft_consensus.cc:385] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.474939 22433 raft_consensus.cc:740] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.468309 22604 consensus_queue.cc:1048] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:10:32.485572 22431 tablet_bootstrap.cc:492] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:32.486128 22431 ts_tablet_manager.cc:1403] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.354s	user 0.012s	sys 0.021s
I20260709 13:10:32.486675 22433 consensus_queue.cc:260] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
W20260709 13:10:32.487484 22201 consensus_peers.cc:597] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565 -> Peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Couldn't send request to peer edd63b54133d4c8d9149d57a2886916b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:32.484306 22127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:43835, user_credentials={real_user=slave}} blocked reactor thread for 60835.8us
W20260709 13:10:32.484285 22128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46871, user_credentials={real_user=slave}} blocked reactor thread for 92156.6us
I20260709 13:10:32.500301 22434 ts_tablet_manager.cc:1434] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.106s	user 0.018s	sys 0.003s
I20260709 13:10:32.501332 22434 tablet_bootstrap.cc:492] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:32.507617 22433 ts_tablet_manager.cc:1434] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.049s	user 0.004s	sys 0.003s
I20260709 13:10:32.524896 22431 raft_consensus.cc:359] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:32.525902 22431 raft_consensus.cc:385] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.526257 22431 raft_consensus.cc:740] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.527231 22431 consensus_queue.cc:260] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:32.527969 22437 tablet_bootstrap.cc:654] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.542557 22433 tablet_bootstrap.cc:492] T bb2e1e35ba2d4732a195046335a7af7c P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:32.555899 22431 ts_tablet_manager.cc:1434] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.001s
I20260709 13:10:32.558490 22431 tablet_bootstrap.cc:492] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:32.561069 22433 tablet_bootstrap.cc:654] T bb2e1e35ba2d4732a195046335a7af7c P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.564756 22673 raft_consensus.cc:493] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.565264 22673 raft_consensus.cc:515] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:32.568406 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56649a39ed04a1682d5f0473dbb791e" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:32.569062 22312 raft_consensus.cc:2468] T e56649a39ed04a1682d5f0473dbb791e P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:32.570029 22351 leader_election.cc:304] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:32.571313 22517 raft_consensus.cc:2804] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:32.571691 22517 raft_consensus.cc:493] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.571976 22517 raft_consensus.cc:3060] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.567303 22673 leader_election.cc:290] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:32.579833 22517 raft_consensus.cc:515] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:32.593834 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56649a39ed04a1682d5f0473dbb791e" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:32.594919 22312 raft_consensus.cc:3060] T e56649a39ed04a1682d5f0473dbb791e P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.596372 22786 consensus_queue.cc:1048] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:32.597839 22431 tablet_bootstrap.cc:654] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.602870 22312 raft_consensus.cc:2468] T e56649a39ed04a1682d5f0473dbb791e P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:32.609326 22437 tablet_bootstrap.cc:492] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:32.609645 22351 leader_election.cc:304] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:32.610596 22673 raft_consensus.cc:2804] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:32.611080 22673 raft_consensus.cc:697] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Leader. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:32.611912 22673 consensus_queue.cc:237] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:32.586925 22061 catalog_manager.cc:5697] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "66d3606ce30b4661b5d62d403d7abca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:32.581568 22434 tablet_bootstrap.cc:654] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.609836 22437 ts_tablet_manager.cc:1403] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.223s	user 0.014s	sys 0.000s
I20260709 13:10:32.607951 22517 leader_election.cc:290] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:32.636164 22603 consensus_queue.cc:1048] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:32.651270 22437 raft_consensus.cc:359] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:32.659406 22437 raft_consensus.cc:385] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.659827 22437 raft_consensus.cc:740] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.660707 22437 consensus_queue.cc:260] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:32.665729 22437 ts_tablet_manager.cc:1434] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:10:32.671679 22437 tablet_bootstrap.cc:492] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:32.666644 22727 raft_consensus.cc:493] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.674005 22699 consensus_queue.cc:1048] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:10:32.677712 22766 raft_consensus.cc:493] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.686194 22766 raft_consensus.cc:515] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:32.688510 22433 tablet_bootstrap.cc:492] T bb2e1e35ba2d4732a195046335a7af7c P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:32.686206 22060 catalog_manager.cc:5697] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b reported cstate change: term changed from 0 to 1, leader changed from <none> to edd63b54133d4c8d9149d57a2886916b (127.12.76.132). New cstate: current_term: 1 leader_uuid: "edd63b54133d4c8d9149d57a2886916b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:32.679191 22727 raft_consensus.cc:515] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:32.689036 22433 ts_tablet_manager.cc:1403] T bb2e1e35ba2d4732a195046335a7af7c P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.147s	user 0.027s	sys 0.026s
I20260709 13:10:32.732923 22431 tablet_bootstrap.cc:492] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:32.733515 22431 ts_tablet_manager.cc:1403] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.177s	user 0.011s	sys 0.039s
I20260709 13:10:32.734259 22766 leader_election.cc:290] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:32.735904 22437 tablet_bootstrap.cc:654] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.737252 22727 leader_election.cc:290] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:32.740130 22382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144955449774c3c90f8e0ed28cc5155" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:32.740149 22662 consensus_queue.cc:1048] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:32.742087 22275 leader_election.cc:343] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.743762 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144955449774c3c90f8e0ed28cc5155" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:32.744413 22236 raft_consensus.cc:2468] T c144955449774c3c90f8e0ed28cc5155 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 0.
I20260709 13:10:32.746971 22382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9023b52992475a8b8ad4949867582a" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:32.747382 22276 leader_election.cc:304] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:32.747634 22382 raft_consensus.cc:2468] T 9c9023b52992475a8b8ad4949867582a P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 0.
I20260709 13:10:32.749886 22431 raft_consensus.cc:359] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:32.750619 22431 raft_consensus.cc:385] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.750882 22431 raft_consensus.cc:740] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.752980 22762 raft_consensus.cc:2804] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:32.757870 22160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56649a39ed04a1682d5f0473dbb791e" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:32.758105 22762 raft_consensus.cc:493] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.758523 22762 raft_consensus.cc:3060] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.758564 22160 raft_consensus.cc:2468] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:32.757531 22161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9023b52992475a8b8ad4949867582a" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:32.756974 22662 raft_consensus.cc:493] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.759776 22662 raft_consensus.cc:515] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:32.760130 22160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56649a39ed04a1682d5f0473dbb791e" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:32.760699 22160 raft_consensus.cc:3060] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.761816 22662 leader_election.cc:290] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:32.762491 22161 raft_consensus.cc:2468] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 0.
I20260709 13:10:32.774250 22433 raft_consensus.cc:359] T bb2e1e35ba2d4732a195046335a7af7c P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:32.774955 22433 raft_consensus.cc:385] T bb2e1e35ba2d4732a195046335a7af7c P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.775683 22762 raft_consensus.cc:515] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:32.778050 22762 leader_election.cc:290] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:32.784049 22201 leader_election.cc:304] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:32.786983 22383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144955449774c3c90f8e0ed28cc5155" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:32.789158 22235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144955449774c3c90f8e0ed28cc5155" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:32.789705 22235 raft_consensus.cc:3060] T c144955449774c3c90f8e0ed28cc5155 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.789939 22603 raft_consensus.cc:2804] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:32.790351 22603 raft_consensus.cc:493] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:32.790591 22275 leader_election.cc:343] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.790714 22603 raft_consensus.cc:3060] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.792111 22160 raft_consensus.cc:2468] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:32.775214 22433 raft_consensus.cc:740] T bb2e1e35ba2d4732a195046335a7af7c P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.783835 22431 consensus_queue.cc:260] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:32.794395 22757 raft_consensus.cc:493] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.796603 22431 ts_tablet_manager.cc:1434] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.002s
I20260709 13:10:32.796308 22757 raft_consensus.cc:515] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:32.798157 22433 consensus_queue.cc:260] T bb2e1e35ba2d4732a195046335a7af7c P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:32.801050 22433 ts_tablet_manager.cc:1434] T bb2e1e35ba2d4732a195046335a7af7c P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.107s	user 0.006s	sys 0.000s
I20260709 13:10:32.802066 22433 tablet_bootstrap.cc:492] T 5634eebf5657424c9f136d8f08e8e8f6 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:32.806293 22603 raft_consensus.cc:515] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:32.811354 22433 tablet_bootstrap.cc:654] T 5634eebf5657424c9f136d8f08e8e8f6 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.812098 22757 leader_election.cc:290] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:32.816315 22383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0368f9bb9bc94a05bcbf9cfdcb7eac4e" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:32.816982 22383 raft_consensus.cc:2468] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 0.
I20260709 13:10:32.820250 22603 leader_election.cc:290] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:32.821841 22201 leader_election.cc:304] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:32.822052 22383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9023b52992475a8b8ad4949867582a" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:32.820292 22431 tablet_bootstrap.cc:492] T 3a808c750d4749df9579874d7371e2e9 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:32.822671 22383 raft_consensus.cc:3060] T 9c9023b52992475a8b8ad4949867582a P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.822947 22757 raft_consensus.cc:2804] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:32.828649 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9023b52992475a8b8ad4949867582a" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:32.829305 22163 raft_consensus.cc:3060] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.833877 22431 tablet_bootstrap.cc:654] T 3a808c750d4749df9579874d7371e2e9 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.823350 22757 raft_consensus.cc:493] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.835851 22757 raft_consensus.cc:3060] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.806489 22235 raft_consensus.cc:2468] T c144955449774c3c90f8e0ed28cc5155 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 1.
I20260709 13:10:32.856678 22276 leader_election.cc:304] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:32.858166 22383 raft_consensus.cc:2468] T 9c9023b52992475a8b8ad4949867582a P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:32.858352 22762 raft_consensus.cc:2804] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:32.861274 22434 tablet_bootstrap.cc:492] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:32.867914 22434 ts_tablet_manager.cc:1403] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.367s	user 0.011s	sys 0.010s
I20260709 13:10:32.870456 22434 raft_consensus.cc:359] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:32.859753 22382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9023b52992475a8b8ad4949867582a" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:32.878715 22382 raft_consensus.cc:2393] T 9c9023b52992475a8b8ad4949867582a P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d515385609945e5837e85b77de385e2 in current term 1: Already voted for candidate 371d38ec3c7f493e9aea62dae121e565 in this term.
I20260709 13:10:32.862969 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0368f9bb9bc94a05bcbf9cfdcb7eac4e" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:32.870906 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c9023b52992475a8b8ad4949867582a" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:32.880405 22236 raft_consensus.cc:2393] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d515385609945e5837e85b77de385e2 in current term 1: Already voted for candidate 371d38ec3c7f493e9aea62dae121e565 in this term.
I20260709 13:10:32.875397 22201 leader_election.cc:304] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:32.881888 22603 raft_consensus.cc:2804] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:10:32.880606 22203 leader_election.cc:343] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.882555 22603 raft_consensus.cc:697] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Becoming Leader. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:32.858440 22163 raft_consensus.cc:2468] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:32.883591 22603 consensus_queue.cc:237] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:32.880671 22433 tablet_bootstrap.cc:492] T 5634eebf5657424c9f136d8f08e8e8f6 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:32.885016 22433 ts_tablet_manager.cc:1403] T 5634eebf5657424c9f136d8f08e8e8f6 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.083s	user 0.014s	sys 0.018s
I20260709 13:10:32.886317 22126 leader_election.cc:304] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:32.887140 22780 raft_consensus.cc:2749] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:32.889206 22434 raft_consensus.cc:385] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.889523 22434 raft_consensus.cc:740] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.890353 22434 consensus_queue.cc:260] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:32.892724 22434 ts_tablet_manager.cc:1434] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.002s
I20260709 13:10:32.893613 22434 tablet_bootstrap.cc:492] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:32.887971 22433 raft_consensus.cc:359] T 5634eebf5657424c9f136d8f08e8e8f6 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:32.896106 22433 raft_consensus.cc:385] T 5634eebf5657424c9f136d8f08e8e8f6 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.896449 22433 raft_consensus.cc:740] T 5634eebf5657424c9f136d8f08e8e8f6 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.897509 22437 tablet_bootstrap.cc:492] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:32.898001 22437 ts_tablet_manager.cc:1403] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.227s	user 0.015s	sys 0.000s
I20260709 13:10:32.900255 22433 consensus_queue.cc:260] T 5634eebf5657424c9f136d8f08e8e8f6 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:32.902125 22433 ts_tablet_manager.cc:1434] T 5634eebf5657424c9f136d8f08e8e8f6 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:10:32.903096 22433 tablet_bootstrap.cc:492] T 9de1c7b16c2347058e4b97f057c06690 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:32.876319 22762 raft_consensus.cc:697] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 LEADER]: Becoming Leader. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Running, Role: LEADER
I20260709 13:10:32.909304 22762 consensus_queue.cc:237] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:32.910508 22433 tablet_bootstrap.cc:654] T 9de1c7b16c2347058e4b97f057c06690 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.926071 22431 tablet_bootstrap.cc:492] T 3a808c750d4749df9579874d7371e2e9 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:32.926774 22431 ts_tablet_manager.cc:1403] T 3a808c750d4749df9579874d7371e2e9 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.107s	user 0.019s	sys 0.008s
I20260709 13:10:32.926223 22437 raft_consensus.cc:359] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:32.928586 22437 raft_consensus.cc:385] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.928985 22437 raft_consensus.cc:740] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.930512 22433 tablet_bootstrap.cc:492] T 9de1c7b16c2347058e4b97f057c06690 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:32.931159 22433 ts_tablet_manager.cc:1403] T 9de1c7b16c2347058e4b97f057c06690 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.012s
I20260709 13:10:32.934015 22433 raft_consensus.cc:359] T 9de1c7b16c2347058e4b97f057c06690 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:32.913978 22757 raft_consensus.cc:515] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:32.936297 22433 raft_consensus.cc:385] T 9de1c7b16c2347058e4b97f057c06690 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.935868 22431 raft_consensus.cc:359] T 3a808c750d4749df9579874d7371e2e9 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:32.936626 22433 raft_consensus.cc:740] T 9de1c7b16c2347058e4b97f057c06690 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.940373 22384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0368f9bb9bc94a05bcbf9cfdcb7eac4e" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:32.941067 22384 raft_consensus.cc:3060] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.943537 22433 consensus_queue.cc:260] T 9de1c7b16c2347058e4b97f057c06690 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:32.945663 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0368f9bb9bc94a05bcbf9cfdcb7eac4e" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:32.946452 22433 ts_tablet_manager.cc:1434] T 9de1c7b16c2347058e4b97f057c06690 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:10:32.947466 22433 tablet_bootstrap.cc:492] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:32.952965 22433 tablet_bootstrap.cc:654] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.953969 22797 raft_consensus.cc:493] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.954501 22797 raft_consensus.cc:515] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:32.936748 22431 raft_consensus.cc:385] T 3a808c750d4749df9579874d7371e2e9 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.955433 22431 raft_consensus.cc:740] T 3a808c750d4749df9579874d7371e2e9 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.955734 22437 consensus_queue.cc:260] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:32.958540 22437 ts_tablet_manager.cc:1434] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.001s
I20260709 13:10:32.959265 22437 tablet_bootstrap.cc:492] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:32.956662 22757 leader_election.cc:290] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:32.962626 22431 consensus_queue.cc:260] T 3a808c750d4749df9579874d7371e2e9 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:32.955294 22384 raft_consensus.cc:2468] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:32.969249 22201 leader_election.cc:304] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:32.969655 22797 leader_election.cc:290] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:32.970171 22798 raft_consensus.cc:2804] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:32.970772 22798 raft_consensus.cc:697] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Becoming Leader. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:32.971642 22798 consensus_queue.cc:237] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:32.974933 22434 tablet_bootstrap.cc:654] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.974998 22382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbec8a84225648c28ea36cf425bc09d2" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:32.976989 22727 consensus_queue.cc:1048] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:32.979264 22126 leader_election.cc:343] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.981649 22235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbec8a84225648c28ea36cf425bc09d2" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
W20260709 13:10:32.984400 22127 leader_election.cc:343] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.984939 22127 leader_election.cc:304] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:32.985571 22061 catalog_manager.cc:5697] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "66d3606ce30b4661b5d62d403d7abca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:32.986708 22797 raft_consensus.cc:2749] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:32.960421 22310 raft_consensus.cc:3060] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.005491 22431 ts_tablet_manager.cc:1434] T 3a808c750d4749df9579874d7371e2e9 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.000s
I20260709 13:10:33.007277 22431 tablet_bootstrap.cc:492] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:33.041635 22310 raft_consensus.cc:2468] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:33.038918 22384 raft_consensus.cc:3060] T bb2e1e35ba2d4732a195046335a7af7c P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.048615 22061 catalog_manager.cc:5697] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 reported cstate change: term changed from 0 to 1, leader changed from <none> to 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "371d38ec3c7f493e9aea62dae121e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:33.062274 22437 tablet_bootstrap.cc:654] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.065886 22440 raft_consensus.cc:493] T 5634eebf5657424c9f136d8f08e8e8f6 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.066375 22440 raft_consensus.cc:515] T 5634eebf5657424c9f136d8f08e8e8f6 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:33.068259 22440 leader_election.cc:290] T 5634eebf5657424c9f136d8f08e8e8f6 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:33.071220 22431 tablet_bootstrap.cc:654] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.070732 22235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5634eebf5657424c9f136d8f08e8e8f6" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:33.082444 22160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5634eebf5657424c9f136d8f08e8e8f6" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:33.085383 22433 tablet_bootstrap.cc:492] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:33.086045 22433 ts_tablet_manager.cc:1403] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.139s	user 0.024s	sys 0.020s
I20260709 13:10:33.090636 22517 consensus_queue.cc:1048] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:33.093976 22433 raft_consensus.cc:359] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:33.094697 22433 raft_consensus.cc:385] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.094944 22433 raft_consensus.cc:740] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.095611 22433 consensus_queue.cc:260] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:33.097782 22433 ts_tablet_manager.cc:1434] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:10:33.100010 22762 consensus_queue.cc:1048] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:10:33.111123 22433 tablet_bootstrap.cc:492] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:33.103034 22349 leader_election.cc:304] T 5634eebf5657424c9f136d8f08e8e8f6 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:33.115667 22673 raft_consensus.cc:2749] T 5634eebf5657424c9f136d8f08e8e8f6 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:33.108879 22060 catalog_manager.cc:5697] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565 reported cstate change: term changed from 0 to 1, leader changed from <none> to 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "371d38ec3c7f493e9aea62dae121e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:33.082895 22434 tablet_bootstrap.cc:492] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:33.128895 22434 ts_tablet_manager.cc:1403] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.235s	user 0.014s	sys 0.013s
I20260709 13:10:33.130477 22517 raft_consensus.cc:493] T 9de1c7b16c2347058e4b97f057c06690 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.131036 22517 raft_consensus.cc:515] T 9de1c7b16c2347058e4b97f057c06690 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:33.133088 22434 raft_consensus.cc:359] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:33.133793 22434 raft_consensus.cc:385] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.134053 22434 raft_consensus.cc:740] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.134895 22235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de1c7b16c2347058e4b97f057c06690" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:33.135094 22517 leader_election.cc:290] T 9de1c7b16c2347058e4b97f057c06690 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:33.143978 22386 raft_consensus.cc:3060] T 5634eebf5657424c9f136d8f08e8e8f6 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.145787 22434 consensus_queue.cc:260] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:33.147675 22517 consensus_queue.cc:1048] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:33.157681 22309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de1c7b16c2347058e4b97f057c06690" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:33.174068 22434 ts_tablet_manager.cc:1434] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.002s
I20260709 13:10:33.171449 22351 leader_election.cc:304] T 9de1c7b16c2347058e4b97f057c06690 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:33.177000 22440 raft_consensus.cc:2749] T 9de1c7b16c2347058e4b97f057c06690 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:33.187243 22434 tablet_bootstrap.cc:492] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:33.220108 22813 raft_consensus.cc:493] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.220806 22813 raft_consensus.cc:515] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:33.224363 22433 tablet_bootstrap.cc:654] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.224097 22766 raft_consensus.cc:493] T 3a808c750d4749df9579874d7371e2e9 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.238410 22766 raft_consensus.cc:515] T 3a808c750d4749df9579874d7371e2e9 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:33.241600 22766 leader_election.cc:290] T 3a808c750d4749df9579874d7371e2e9 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:33.245409 22437 tablet_bootstrap.cc:492] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:33.245936 22437 ts_tablet_manager.cc:1403] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.287s	user 0.025s	sys 0.012s
I20260709 13:10:33.251617 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a808c750d4749df9579874d7371e2e9" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:33.253420 22160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a808c750d4749df9579874d7371e2e9" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
W20260709 13:10:33.254266 22203 leader_election.cc:343] T 3a808c750d4749df9579874d7371e2e9 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:33.255626 22201 leader_election.cc:343] T 3a808c750d4749df9579874d7371e2e9 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.256026 22201 leader_election.cc:304] T 3a808c750d4749df9579874d7371e2e9 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565; no voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:33.257117 22603 raft_consensus.cc:2749] T 3a808c750d4749df9579874d7371e2e9 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:33.264276 22431 tablet_bootstrap.cc:492] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:33.265100 22431 ts_tablet_manager.cc:1403] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.258s	user 0.008s	sys 0.013s
I20260709 13:10:33.268808 22431 raft_consensus.cc:359] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:33.274293 22813 leader_election.cc:290] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:33.275727 22431 raft_consensus.cc:385] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.276273 22431 raft_consensus.cc:740] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.289604 22433 tablet_bootstrap.cc:492] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:33.290234 22433 ts_tablet_manager.cc:1403] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.179s	user 0.011s	sys 0.016s
I20260709 13:10:33.287365 22431 consensus_queue.cc:260] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:33.280517 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172a5324a0f04ae9b78b1bc0b106dbea" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:33.284315 22308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172a5324a0f04ae9b78b1bc0b106dbea" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:33.293540 22162 raft_consensus.cc:2468] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:33.301085 22431 ts_tablet_manager.cc:1434] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:10:33.302191 22431 tablet_bootstrap.cc:492] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:33.298441 22308 raft_consensus.cc:2468] T 172a5324a0f04ae9b78b1bc0b106dbea P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:33.306442 22351 leader_election.cc:304] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:33.307466 22517 raft_consensus.cc:2804] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.307819 22517 raft_consensus.cc:493] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.308104 22517 raft_consensus.cc:3060] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.308597 22728 consensus_queue.cc:1048] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:33.310597 22433 raft_consensus.cc:359] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:33.311295 22433 raft_consensus.cc:385] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.311568 22433 raft_consensus.cc:740] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.312196 22433 consensus_queue.cc:260] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:33.317790 22431 tablet_bootstrap.cc:654] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.320878 22517 raft_consensus.cc:515] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:33.321521 22433 ts_tablet_manager.cc:1434] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:10:33.322839 22433 tablet_bootstrap.cc:492] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:33.323689 22437 raft_consensus.cc:359] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:33.324394 22437 raft_consensus.cc:385] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.324671 22437 raft_consensus.cc:740] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.325322 22437 consensus_queue.cc:260] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:33.326345 22308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172a5324a0f04ae9b78b1bc0b106dbea" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:33.326929 22308 raft_consensus.cc:3060] T 172a5324a0f04ae9b78b1bc0b106dbea P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.327646 22434 tablet_bootstrap.cc:654] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:33.335829 22109 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:33.331260 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172a5324a0f04ae9b78b1bc0b106dbea" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:33.338114 22162 raft_consensus.cc:3060] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.327399 22437 ts_tablet_manager.cc:1434] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.081s	user 0.005s	sys 0.000s
I20260709 13:10:33.328157 22517 leader_election.cc:290] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:33.347380 22437 tablet_bootstrap.cc:492] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:33.348397 22162 raft_consensus.cc:2468] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:33.336740 22603 consensus_queue.cc:1048] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:10:33.351874 22349 leader_election.cc:304] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:33.352646 22818 raft_consensus.cc:2804] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.353133 22818 raft_consensus.cc:697] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Leader. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:33.353929 22818 consensus_queue.cc:237] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:33.354951 22437 tablet_bootstrap.cc:654] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.360414 22308 raft_consensus.cc:2468] T 172a5324a0f04ae9b78b1bc0b106dbea P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:33.420240 22818 raft_consensus.cc:493] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.423292 22382 raft_consensus.cc:3060] T 9de1c7b16c2347058e4b97f057c06690 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.423715 22818 raft_consensus.cc:515] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:33.427311 22818 leader_election.cc:290] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:33.415956 22766 consensus_queue.cc:1048] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:10:33.432330 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7698abde6404f019732b30297ad5923" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:33.435770 22728 raft_consensus.cc:493] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.436766 22728 raft_consensus.cc:515] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:33.438652 22728 leader_election.cc:290] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:33.441481 22433 tablet_bootstrap.cc:654] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:33.436175 22349 leader_election.cc:343] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.440665 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7698abde6404f019732b30297ad5923" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:33.445990 22434 tablet_bootstrap.cc:492] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:33.440768 22766 consensus_queue.cc:1048] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:10:33.446170 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7698abde6404f019732b30297ad5923" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
W20260709 13:10:33.449065 22275 leader_election.cc:343] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.448706 22061 catalog_manager.cc:5697] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b reported cstate change: term changed from 0 to 1, leader changed from <none> to edd63b54133d4c8d9149d57a2886916b (127.12.76.132). New cstate: current_term: 1 leader_uuid: "edd63b54133d4c8d9149d57a2886916b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:33.449465 22386 raft_consensus.cc:2468] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 0.
I20260709 13:10:33.450663 22275 leader_election.cc:304] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:33.446312 22308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7698abde6404f019732b30297ad5923" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:33.451599 22727 raft_consensus.cc:2804] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.454411 22727 raft_consensus.cc:493] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.454785 22727 raft_consensus.cc:3060] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.462136 22434 ts_tablet_manager.cc:1403] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.275s	user 0.039s	sys 0.035s
I20260709 13:10:33.470132 22431 tablet_bootstrap.cc:492] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:33.470654 22431 ts_tablet_manager.cc:1403] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.169s	user 0.011s	sys 0.003s
I20260709 13:10:33.476024 22766 raft_consensus.cc:493] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.476487 22766 raft_consensus.cc:515] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:33.478533 22766 leader_election.cc:290] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
W20260709 13:10:33.479183 22275 consensus_peers.cc:597] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 -> Peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Couldn't send request to peer edd63b54133d4c8d9149d57a2886916b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:33.481803 22431 raft_consensus.cc:359] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:33.482669 22431 raft_consensus.cc:385] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.482918 22431 raft_consensus.cc:740] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.483695 22431 consensus_queue.cc:260] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:33.484398 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4695de4c0534d2d8d2a4c79aab3654d" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
W20260709 13:10:33.485944 22203 leader_election.cc:343] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.480515 22434 raft_consensus.cc:359] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:33.489251 22727 raft_consensus.cc:515] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:33.490356 22308 raft_consensus.cc:2393] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edd63b54133d4c8d9149d57a2886916b in current term 1: Already voted for candidate 66d3606ce30b4661b5d62d403d7abca0 in this term.
I20260709 13:10:33.492959 22160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4695de4c0534d2d8d2a4c79aab3654d" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:33.493641 22160 raft_consensus.cc:2468] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 0.
I20260709 13:10:33.495138 22431 ts_tablet_manager.cc:1434] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.002s
I20260709 13:10:33.496098 22431 tablet_bootstrap.cc:492] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:33.487350 22434 raft_consensus.cc:385] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.499583 22434 raft_consensus.cc:740] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.502344 22727 leader_election.cc:290] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:33.500212 22434 consensus_queue.cc:260] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:33.510668 22434 ts_tablet_manager.cc:1434] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:10:33.512913 22434 tablet_bootstrap.cc:492] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:33.517601 22431 tablet_bootstrap.cc:654] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.514220 22201 leader_election.cc:304] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:33.522904 22766 raft_consensus.cc:2804] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.523299 22766 raft_consensus.cc:493] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.523635 22766 raft_consensus.cc:3060] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.524231 22434 tablet_bootstrap.cc:654] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.534739 22818 raft_consensus.cc:493] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.535266 22818 raft_consensus.cc:515] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:33.538415 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a23c35530d84893bfc638fe35760483" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
W20260709 13:10:33.539710 22350 leader_election.cc:343] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.540215 22818 leader_election.cc:290] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:33.542228 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a23c35530d84893bfc638fe35760483" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:33.542829 22162 raft_consensus.cc:2468] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:33.543032 22434 tablet_bootstrap.cc:492] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:33.544459 22351 leader_election.cc:304] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:33.545256 22818 raft_consensus.cc:3060] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.546873 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7698abde6404f019732b30297ad5923" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:33.552448 22382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7698abde6404f019732b30297ad5923" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:33.552589 22818 raft_consensus.cc:2749] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:33.553221 22434 ts_tablet_manager.cc:1403] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.005s
I20260709 13:10:33.556576 22431 tablet_bootstrap.cc:492] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:33.557068 22431 ts_tablet_manager.cc:1403] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.005s
I20260709 13:10:33.559684 22431 raft_consensus.cc:359] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:33.560307 22431 raft_consensus.cc:385] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.560559 22431 raft_consensus.cc:740] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.561188 22431 consensus_queue.cc:260] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:33.565951 22434 raft_consensus.cc:359] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:33.566682 22434 raft_consensus.cc:385] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.566934 22434 raft_consensus.cc:740] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.567611 22434 consensus_queue.cc:260] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:33.563246 22431 ts_tablet_manager.cc:1434] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:33.569159 22431 tablet_bootstrap.cc:492] T 3a23c35530d84893bfc638fe35760483 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
W20260709 13:10:33.571782 22201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:33591, user_credentials={real_user=slave}} blocked reactor thread for 57653.4us
I20260709 13:10:33.574780 22431 tablet_bootstrap.cc:654] T 3a23c35530d84893bfc638fe35760483 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.578684 22603 consensus_queue.cc:1048] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:33.582109 22275 leader_election.cc:343] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.586153 22431 tablet_bootstrap.cc:492] T 3a23c35530d84893bfc638fe35760483 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:33.586669 22431 ts_tablet_manager.cc:1403] T 3a23c35530d84893bfc638fe35760483 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.018s	user 0.004s	sys 0.010s
I20260709 13:10:33.589355 22431 raft_consensus.cc:359] T 3a23c35530d84893bfc638fe35760483 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:33.589962 22431 raft_consensus.cc:385] T 3a23c35530d84893bfc638fe35760483 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.590209 22431 raft_consensus.cc:740] T 3a23c35530d84893bfc638fe35760483 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.590991 22431 consensus_queue.cc:260] T 3a23c35530d84893bfc638fe35760483 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:33.594094 22431 ts_tablet_manager.cc:1434] T 3a23c35530d84893bfc638fe35760483 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:33.595019 22431 tablet_bootstrap.cc:492] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:33.601433 22349 leader_election.cc:304] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 371d38ec3c7f493e9aea62dae121e565
I20260709 13:10:33.650085 22431 tablet_bootstrap.cc:654] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.613279 22818 raft_consensus.cc:493] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.650934 22818 raft_consensus.cc:515] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:33.653188 22818 leader_election.cc:290] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:33.614923 22757 raft_consensus.cc:493] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.654366 22757 raft_consensus.cc:515] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:33.657006 22757 leader_election.cc:290] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:33.611343 22434 ts_tablet_manager.cc:1434] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.058s	user 0.002s	sys 0.004s
I20260709 13:10:33.661456 22517 raft_consensus.cc:2804] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.643702 22780 raft_consensus.cc:493] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.662006 22517 raft_consensus.cc:493] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.662173 22437 tablet_bootstrap.cc:492] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:33.662436 22517 raft_consensus.cc:3060] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.662716 22437 ts_tablet_manager.cc:1403] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.316s	user 0.027s	sys 0.041s
I20260709 13:10:33.662351 22780 raft_consensus.cc:515] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:33.664702 22780 leader_election.cc:290] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:33.661510 22431 tablet_bootstrap.cc:492] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:33.665433 22308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7698abde6404f019732b30297ad5923" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:33.666102 22431 ts_tablet_manager.cc:1403] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.071s	user 0.016s	sys 0.041s
I20260709 13:10:33.666376 22308 raft_consensus.cc:2393] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d515385609945e5837e85b77de385e2 in current term 1: Already voted for candidate 66d3606ce30b4661b5d62d403d7abca0 in this term.
I20260709 13:10:33.671268 22517 raft_consensus.cc:515] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:33.673251 22437 raft_consensus.cc:359] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:33.673988 22437 raft_consensus.cc:385] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.674304 22437 raft_consensus.cc:740] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.675098 22437 consensus_queue.cc:260] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:33.680738 22433 tablet_bootstrap.cc:492] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:33.681305 22433 ts_tablet_manager.cc:1403] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.359s	user 0.032s	sys 0.037s
I20260709 13:10:33.683375 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbec8a84225648c28ea36cf425bc09d2" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:33.684016 22238 raft_consensus.cc:2468] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:33.681915 22437 ts_tablet_manager.cc:1434] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
W20260709 13:10:33.675694 22349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:33591, user_credentials={real_user=slave}} blocked reactor thread for 74347.7us
I20260709 13:10:33.622836 22766 raft_consensus.cc:515] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:33.677814 22431 raft_consensus.cc:359] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:33.684779 22433 raft_consensus.cc:359] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:33.685264 22431 raft_consensus.cc:385] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.685477 22433 raft_consensus.cc:385] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.685719 22431 raft_consensus.cc:740] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.686630 22431 consensus_queue.cc:260] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:33.689000 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbec8a84225648c28ea36cf425bc09d2" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:33.689592 22162 raft_consensus.cc:2468] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:33.692824 22431 ts_tablet_manager.cc:1434] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.004s
I20260709 13:10:33.693873 22431 tablet_bootstrap.cc:492] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:33.694506 22766 leader_election.cc:290] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:33.685825 22433 raft_consensus.cc:740] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.695393 22433 consensus_queue.cc:260] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:33.699064 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbec8a84225648c28ea36cf425bc09d2" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:33.699774 22163 raft_consensus.cc:2468] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 0.
I20260709 13:10:33.701076 22431 tablet_bootstrap.cc:654] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.701205 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4695de4c0534d2d8d2a4c79aab3654d" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:33.701681 22437 tablet_bootstrap.cc:492] T a4695de4c0534d2d8d2a4c79aab3654d P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:33.701843 22163 raft_consensus.cc:3060] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.708537 22517 leader_election.cc:290] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:33.709199 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4695de4c0534d2d8d2a4c79aab3654d" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:33.716150 22163 raft_consensus.cc:2468] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
W20260709 13:10:33.716495 22203 leader_election.cc:343] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.717770 22434 tablet_bootstrap.cc:492] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:33.720407 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a23c35530d84893bfc638fe35760483" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:33.720933 22433 ts_tablet_manager.cc:1434] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.039s	user 0.003s	sys 0.002s
I20260709 13:10:33.721287 22238 raft_consensus.cc:3060] T 3a23c35530d84893bfc638fe35760483 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.721932 22433 tablet_bootstrap.cc:492] T c144955449774c3c90f8e0ed28cc5155 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:33.734714 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a23c35530d84893bfc638fe35760483" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:33.735360 22162 raft_consensus.cc:3060] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.738696 22349 leader_election.cc:304] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:33.739908 22201 leader_election.cc:304] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 
I20260709 13:10:33.745400 22162 raft_consensus.cc:2468] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:33.737303 22384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbec8a84225648c28ea36cf425bc09d2" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:33.748744 22798 raft_consensus.cc:2804] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.749214 22798 raft_consensus.cc:493] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.749559 22798 raft_consensus.cc:3060] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.751644 22673 raft_consensus.cc:2804] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.752053 22673 raft_consensus.cc:493] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.754223 22673 raft_consensus.cc:3060] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.622663 22382 raft_consensus.cc:2468] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 1.
I20260709 13:10:33.766254 22762 raft_consensus.cc:493] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.777803 22431 tablet_bootstrap.cc:492] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:33.778512 22431 ts_tablet_manager.cc:1403] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.085s	user 0.025s	sys 0.037s
I20260709 13:10:33.777884 22433 tablet_bootstrap.cc:654] T c144955449774c3c90f8e0ed28cc5155 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.774814 22238 raft_consensus.cc:2468] T 3a23c35530d84893bfc638fe35760483 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:33.770033 22380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7698abde6404f019732b30297ad5923" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:33.780246 22762 raft_consensus.cc:515] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:33.842489 22434 tablet_bootstrap.cc:654] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.844120 22762 leader_election.cc:290] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
W20260709 13:10:33.845070 22128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46871, user_credentials={real_user=slave}} blocked reactor thread for 64230.3us
W20260709 13:10:33.847050 22350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:43835, user_credentials={real_user=slave}} blocked reactor thread for 93852.8us
I20260709 13:10:33.845276 22431 raft_consensus.cc:359] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:33.849146 22431 raft_consensus.cc:385] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.848852 22798 raft_consensus.cc:515] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:33.849442 22431 raft_consensus.cc:740] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.850692 22431 consensus_queue.cc:260] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:33.852813 22437 tablet_bootstrap.cc:654] T a4695de4c0534d2d8d2a4c79aab3654d P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.853295 22350 leader_election.cc:304] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
W20260709 13:10:33.845252 22351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46871, user_credentials={real_user=slave}} blocked reactor thread for 63829us
I20260709 13:10:33.855113 22440 raft_consensus.cc:2804] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.856668 22431 ts_tablet_manager.cc:1434] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.078s	user 0.011s	sys 0.012s
I20260709 13:10:33.862891 22440 raft_consensus.cc:697] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Leader. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:33.863209 22431 tablet_bootstrap.cc:492] T ecb5c885975e4259a69644775bb930f1 P 371d38ec3c7f493e9aea62dae121e565: Bootstrap starting.
I20260709 13:10:33.863864 22440 consensus_queue.cc:237] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
W20260709 13:10:33.879258 22201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:33591, user_credentials={real_user=slave}} blocked reactor thread for 139523us
I20260709 13:10:33.880013 22201 leader_election.cc:304] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 66d3606ce30b4661b5d62d403d7abca0
W20260709 13:10:33.892385 22349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:33591, user_credentials={real_user=slave}} blocked reactor thread for 131575us
I20260709 13:10:33.894315 22275 leader_election.cc:304] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:33.897723 22728 raft_consensus.cc:2804] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.888590 22766 raft_consensus.cc:2804] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.913515 22126 leader_election.cc:304] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:33.915767 22434 tablet_bootstrap.cc:492] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:33.917152 22434 ts_tablet_manager.cc:1403] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.200s	user 0.026s	sys 0.030s
I20260709 13:10:33.920837 22798 leader_election.cc:290] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:33.923574 22431 tablet_bootstrap.cc:654] T ecb5c885975e4259a69644775bb930f1 P 371d38ec3c7f493e9aea62dae121e565: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:33.927242 22350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:43835, user_credentials={real_user=slave}} blocked reactor thread for 49171.6us
I20260709 13:10:33.905754 22603 raft_consensus.cc:493] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.926138 22237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a808c750d4749df9579874d7371e2e9" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:33.932706 22237 raft_consensus.cc:2468] T 3a808c750d4749df9579874d7371e2e9 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 0.
I20260709 13:10:33.933279 22813 consensus_queue.cc:1048] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:33.934206 22433 tablet_bootstrap.cc:492] T c144955449774c3c90f8e0ed28cc5155 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:33.934710 22433 ts_tablet_manager.cc:1403] T c144955449774c3c90f8e0ed28cc5155 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.213s	user 0.006s	sys 0.013s
I20260709 13:10:33.977077 22437 tablet_bootstrap.cc:492] T a4695de4c0534d2d8d2a4c79aab3654d P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:33.977656 22437 ts_tablet_manager.cc:1403] T a4695de4c0534d2d8d2a4c79aab3654d P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.276s	user 0.011s	sys 0.016s
I20260709 13:10:33.981478 22437 raft_consensus.cc:359] T a4695de4c0534d2d8d2a4c79aab3654d P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:33.982169 22437 raft_consensus.cc:385] T a4695de4c0534d2d8d2a4c79aab3654d P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.982430 22437 raft_consensus.cc:740] T a4695de4c0534d2d8d2a4c79aab3654d P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.982666 22837 raft_consensus.cc:493] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.983371 22837 raft_consensus.cc:515] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:33.988831 22837 leader_election.cc:290] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:33.990087 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92f72a0e3ac48d480bb25e4f8f64c43" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
W20260709 13:10:33.991716 22203 leader_election.cc:343] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.919301 22673 raft_consensus.cc:515] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:33.994765 22673 leader_election.cc:290] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:33.934715 22603 raft_consensus.cc:515] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:33.998080 22603 leader_election.cc:290] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:33.999310 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
W20260709 13:10:34.001250 22203 leader_election.cc:343] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.001144 22797 raft_consensus.cc:3060] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.011730 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbec8a84225648c28ea36cf425bc09d2" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:34.012607 22238 raft_consensus.cc:2393] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate edd63b54133d4c8d9149d57a2886916b in current term 1: Already voted for candidate 371d38ec3c7f493e9aea62dae121e565 in this term.
I20260709 13:10:34.011821 22384 raft_consensus.cc:2393] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 371d38ec3c7f493e9aea62dae121e565 in current term 1: Already voted for candidate edd63b54133d4c8d9149d57a2886916b in this term.
I20260709 13:10:34.016471 22434 raft_consensus.cc:359] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:34.017343 22434 raft_consensus.cc:385] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.017623 22434 raft_consensus.cc:740] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.018270 22434 consensus_queue.cc:260] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
W20260709 13:10:34.028364 22127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:43835, user_credentials={real_user=slave}} blocked reactor thread for 123485us
I20260709 13:10:34.029158 22434 ts_tablet_manager.cc:1434] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.112s	user 0.007s	sys 0.000s
I20260709 13:10:34.033531 22434 tablet_bootstrap.cc:492] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:34.036814 22437 consensus_queue.cc:260] T a4695de4c0534d2d8d2a4c79aab3654d P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:34.048367 22437 ts_tablet_manager.cc:1434] T a4695de4c0534d2d8d2a4c79aab3654d P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.070s	user 0.010s	sys 0.002s
W20260709 13:10:34.049988 22201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:45017, user_credentials={real_user=slave}} blocked reactor thread for 142668us
I20260709 13:10:34.052932 22437 tablet_bootstrap.cc:492] T 45d6ad58386642cd897d5378d8b9bc58 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:34.026440 22728 raft_consensus.cc:697] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 LEADER]: Becoming Leader. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Running, Role: LEADER
W20260709 13:10:34.064342 22350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:43835, user_credentials={real_user=slave}} blocked reactor thread for 44417.4us
I20260709 13:10:34.073496 22433 raft_consensus.cc:359] T c144955449774c3c90f8e0ed28cc5155 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:34.074452 22433 raft_consensus.cc:385] T c144955449774c3c90f8e0ed28cc5155 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.074811 22433 raft_consensus.cc:740] T c144955449774c3c90f8e0ed28cc5155 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.080212 22433 consensus_queue.cc:260] T c144955449774c3c90f8e0ed28cc5155 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
W20260709 13:10:34.059957 22351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46871, user_credentials={real_user=slave}} blocked reactor thread for 98581.8us
I20260709 13:10:34.106047 22766 raft_consensus.cc:697] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Becoming Leader. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:34.107069 22766 consensus_queue.cc:237] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:34.107743 22433 ts_tablet_manager.cc:1434] T c144955449774c3c90f8e0ed28cc5155 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.173s	user 0.007s	sys 0.003s
I20260709 13:10:34.109010 22433 tablet_bootstrap.cc:492] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:34.082551 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbec8a84225648c28ea36cf425bc09d2" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:34.112236 22163 raft_consensus.cc:3060] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.115190 22434 tablet_bootstrap.cc:654] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.143038 22380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbec8a84225648c28ea36cf425bc09d2" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:34.144789 22380 raft_consensus.cc:2393] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 371d38ec3c7f493e9aea62dae121e565 in current term 1: Already voted for candidate edd63b54133d4c8d9149d57a2886916b in this term.
I20260709 13:10:34.199082 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a808c750d4749df9579874d7371e2e9" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:34.199993 22162 raft_consensus.cc:2468] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 0.
I20260709 13:10:34.225126 22163 raft_consensus.cc:2468] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:34.142095 22728 consensus_queue.cc:237] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
W20260709 13:10:34.267907 22127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:43835, user_credentials={real_user=slave}} blocked reactor thread for 173189us
I20260709 13:10:34.224144 22843 raft_consensus.cc:493] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.232577 22757 raft_consensus.cc:493] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:34.219833 22276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:43835, user_credentials={real_user=slave}} blocked reactor thread for 151072us
I20260709 13:10:34.276230 22849 raft_consensus.cc:493] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.300834 22162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbec8a84225648c28ea36cf425bc09d2" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:34.301895 22162 raft_consensus.cc:2393] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate edd63b54133d4c8d9149d57a2886916b in current term 1: Already voted for candidate 371d38ec3c7f493e9aea62dae121e565 in this term.
I20260709 13:10:34.288908 22160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92f72a0e3ac48d480bb25e4f8f64c43" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:34.276636 22844 raft_consensus.cc:493] T a4695de4c0534d2d8d2a4c79aab3654d P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:34.271513 22128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46871, user_credentials={real_user=slave}} blocked reactor thread for 203097us
I20260709 13:10:34.313886 22349 leader_election.cc:304] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:34.274439 22843 raft_consensus.cc:515] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
W20260709 13:10:34.317786 22275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.132:45017, user_credentials={real_user=slave}} blocked reactor thread for 241920us
I20260709 13:10:34.283676 22757 raft_consensus.cc:515] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:34.323405 22275 leader_election.cc:304] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:34.346127 22431 tablet_bootstrap.cc:492] T ecb5c885975e4259a69644775bb930f1 P 371d38ec3c7f493e9aea62dae121e565: No bootstrap required, opened a new log
I20260709 13:10:34.346670 22431 ts_tablet_manager.cc:1403] T ecb5c885975e4259a69644775bb930f1 P 371d38ec3c7f493e9aea62dae121e565: Time spent bootstrapping tablet: real 0.484s	user 0.016s	sys 0.020s
I20260709 13:10:34.339118 22673 raft_consensus.cc:2749] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:34.313733 22844 raft_consensus.cc:515] T a4695de4c0534d2d8d2a4c79aab3654d P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:34.365150 22159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:34.368954 22844 leader_election.cc:290] T a4695de4c0534d2d8d2a4c79aab3654d P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:34.369589 22843 leader_election.cc:290] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:34.370013 22727 raft_consensus.cc:2804] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:34.370502 22727 raft_consensus.cc:493] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.370875 22727 raft_consensus.cc:3060] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.371060 22852 consensus_queue.cc:1048] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.053s
I20260709 13:10:34.305827 22849 raft_consensus.cc:515] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
W20260709 13:10:34.383591 22201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.129:33591, user_credentials={real_user=slave}} blocked reactor thread for 114699us
I20260709 13:10:34.387609 22797 raft_consensus.cc:2749] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:34.387934 22854 log.cc:927] Time spent T 172a5324a0f04ae9b78b1bc0b106dbea P 66d3606ce30b4661b5d62d403d7abca0: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 13:10:34.396095 22349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.129:33591, user_credentials={real_user=slave}} blocked reactor thread for 82304.4us
I20260709 13:10:34.398177 22201 leader_election.cc:304] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:34.407194 22433 tablet_bootstrap.cc:654] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:34.407272 22127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:43835, user_credentials={real_user=slave}} blocked reactor thread for 88031.9us
I20260709 13:10:34.424396 22157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4695de4c0534d2d8d2a4c79aab3654d" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
W20260709 13:10:34.426153 22109 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:34.426625 22431 raft_consensus.cc:359] T ecb5c885975e4259a69644775bb930f1 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:34.439582 22431 raft_consensus.cc:385] T ecb5c885975e4259a69644775bb930f1 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.439863 22431 raft_consensus.cc:740] T ecb5c885975e4259a69644775bb930f1 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.428884 22437 tablet_bootstrap.cc:654] T 45d6ad58386642cd897d5378d8b9bc58 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.429746 22160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28d9c95ac3d49219dc6a5d5739f6ead" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:34.432066 22434 tablet_bootstrap.cc:492] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:34.441541 22434 ts_tablet_manager.cc:1403] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.412s	user 0.015s	sys 0.005s
I20260709 13:10:34.440557 22431 consensus_queue.cc:260] T ecb5c885975e4259a69644775bb930f1 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:34.402287 22837 raft_consensus.cc:2804] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:34.447155 22757 leader_election.cc:290] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:34.451023 22849 leader_election.cc:290] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:34.452842 22157 raft_consensus.cc:2393] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66d3606ce30b4661b5d62d403d7abca0 in current term 1: Already voted for candidate 371d38ec3c7f493e9aea62dae121e565 in this term.
I20260709 13:10:34.454432 22434 raft_consensus.cc:359] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:34.455185 22434 raft_consensus.cc:385] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.456216 22434 raft_consensus.cc:740] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.403752 22159 raft_consensus.cc:2468] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 0.
W20260709 13:10:34.416008 22276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:43835, user_credentials={real_user=slave}} blocked reactor thread for 52763.4us
I20260709 13:10:34.472350 22431 ts_tablet_manager.cc:1434] T ecb5c885975e4259a69644775bb930f1 P 371d38ec3c7f493e9aea62dae121e565: Time spent starting tablet: real 0.125s	user 0.004s	sys 0.004s
I20260709 13:10:34.460651 22434 consensus_queue.cc:260] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:34.488893 22433 tablet_bootstrap.cc:492] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:34.489427 22433 ts_tablet_manager.cc:1403] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.381s	user 0.012s	sys 0.030s
I20260709 13:10:34.489871 22434 ts_tablet_manager.cc:1434] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 13:10:34.456880 22837 raft_consensus.cc:697] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Becoming Leader. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:34.503346 22837 consensus_queue.cc:237] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:34.504879 22433 raft_consensus.cc:359] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:34.506841 22433 raft_consensus.cc:385] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.507059 22433 raft_consensus.cc:740] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.507951 22433 consensus_queue.cc:260] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
W20260709 13:10:34.512667 22853 log.cc:927] Time spent T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b: Append to log took a long time: real 0.297s	user 0.000s	sys 0.003s
I20260709 13:10:34.530030 22060 catalog_manager.cc:5697] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 reported cstate change: term changed from 0 to 1, leader changed from <none> to 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "371d38ec3c7f493e9aea62dae121e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.535631 22865 raft_consensus.cc:493] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.536211 22865 raft_consensus.cc:515] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:34.538285 22865 leader_election.cc:290] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:34.537678 22057 catalog_manager.cc:5697] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "66d3606ce30b4661b5d62d403d7abca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.542691 22852 consensus_queue.cc:1048] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.550655 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255341bbdc0147aca3a664fdaa81ebf5" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:34.551749 22236 raft_consensus.cc:2468] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:34.558084 22433 ts_tablet_manager.cc:1434] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 13:10:34.552516 22727 raft_consensus.cc:515] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:34.562776 22727 leader_election.cc:290] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:34.563558 22433 tablet_bootstrap.cc:492] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:34.570200 22237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4695de4c0534d2d8d2a4c79aab3654d" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:34.572999 22384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255341bbdc0147aca3a664fdaa81ebf5" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:34.573729 22384 raft_consensus.cc:2468] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 0.
I20260709 13:10:34.579712 22201 leader_election.cc:304] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:34.579792 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:34.585229 22699 raft_consensus.cc:2804] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:34.585646 22699 raft_consensus.cc:493] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.586210 22699 raft_consensus.cc:3060] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.585595 22238 raft_consensus.cc:2468] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 0.
I20260709 13:10:34.593153 22058 catalog_manager.cc:5697] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b reported cstate change: term changed from 0 to 1, leader changed from <none> to edd63b54133d4c8d9149d57a2886916b (127.12.76.132). New cstate: current_term: 1 leader_uuid: "edd63b54133d4c8d9149d57a2886916b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:34.594331 22349 leader_election.cc:343] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.595566 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255341bbdc0147aca3a664fdaa81ebf5" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:34.599345 22154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a808c750d4749df9579874d7371e2e9" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:34.600153 22154 raft_consensus.cc:3060] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.600085 22852 consensus_queue.cc:1048] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:34.571748 22350 leader_election.cc:304] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:34.559752 22673 raft_consensus.cc:493] T c144955449774c3c90f8e0ed28cc5155 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.603549 22869 raft_consensus.cc:2804] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:34.603988 22869 raft_consensus.cc:493] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.603845 22673 raft_consensus.cc:515] T c144955449774c3c90f8e0ed28cc5155 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:34.604477 22869 raft_consensus.cc:3060] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.582981 22434 tablet_bootstrap.cc:492] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
W20260709 13:10:34.608940 22201 leader_election.cc:343] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.610370 22201 leader_election.cc:304] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565; no voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:34.609011 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28d9c95ac3d49219dc6a5d5739f6ead" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:34.632678 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255341bbdc0147aca3a664fdaa81ebf5" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:34.643000 22127 leader_election.cc:304] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 
I20260709 13:10:34.644994 22797 raft_consensus.cc:2804] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:34.657397 22382 raft_consensus.cc:3060] T c144955449774c3c90f8e0ed28cc5155 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.665356 22238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a808c750d4749df9579874d7371e2e9" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:34.666102 22238 raft_consensus.cc:3060] T 3a808c750d4749df9579874d7371e2e9 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.667145 22673 leader_election.cc:290] T c144955449774c3c90f8e0ed28cc5155 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:34.679380 22603 consensus_queue.cc:1048] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.645527 22797 raft_consensus.cc:493] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.681591 22797 raft_consensus.cc:3060] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.682605 22869 raft_consensus.cc:515] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:34.712146 22433 tablet_bootstrap.cc:654] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.709983 22201 leader_election.cc:304] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:34.719137 22434 tablet_bootstrap.cc:654] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:34.676570 22351 leader_election.cc:343] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.708556 22235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144955449774c3c90f8e0ed28cc5155" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:34.702643 22154 raft_consensus.cc:2468] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 1.
I20260709 13:10:34.724171 22437 tablet_bootstrap.cc:492] T 45d6ad58386642cd897d5378d8b9bc58 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:34.741817 22437 ts_tablet_manager.cc:1403] T 45d6ad58386642cd897d5378d8b9bc58 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.691s	user 0.044s	sys 0.039s
I20260709 13:10:34.744715 22437 raft_consensus.cc:359] T 45d6ad58386642cd897d5378d8b9bc58 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:34.745358 22437 raft_consensus.cc:385] T 45d6ad58386642cd897d5378d8b9bc58 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.745605 22437 raft_consensus.cc:740] T 45d6ad58386642cd897d5378d8b9bc58 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.700182 22306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:34.717487 22766 raft_consensus.cc:2804] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:34.729424 22867 raft_consensus.cc:2749] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:34.729874 22276 leader_election.cc:304] T a4695de4c0534d2d8d2a4c79aab3654d P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:34.736071 22351 leader_election.cc:304] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:34.737998 22869 leader_election.cc:290] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:34.756731 22275 leader_election.cc:304] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:34.757936 22437 consensus_queue.cc:260] T 45d6ad58386642cd897d5378d8b9bc58 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
W20260709 13:10:34.770926 22351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.131:46871, user_credentials={real_user=slave}} blocked reactor thread for 100820us
W20260709 13:10:34.782055 22203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46871, user_credentials={real_user=slave}} blocked reactor thread for 118499us
W20260709 13:10:34.783071 22203 leader_election.cc:343] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.783152 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255341bbdc0147aca3a664fdaa81ebf5" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:34.755810 22766 raft_consensus.cc:493] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.786541 22312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255341bbdc0147aca3a664fdaa81ebf5" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:34.789369 22437 ts_tablet_manager.cc:1434] T 45d6ad58386642cd897d5378d8b9bc58 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:10:34.780691 22673 raft_consensus.cc:2749] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:34.793694 22128 leader_election.cc:343] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.792135 22727 raft_consensus.cc:3060] T a4695de4c0534d2d8d2a4c79aab3654d P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.791443 22766 raft_consensus.cc:3060] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.795339 22238 raft_consensus.cc:2468] T 3a808c750d4749df9579874d7371e2e9 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 1.
W20260709 13:10:34.787185 22351 leader_election.cc:343] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.806217 22871 raft_consensus.cc:2804] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:34.813181 22871 raft_consensus.cc:697] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 LEADER]: Becoming Leader. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Running, Role: LEADER
I20260709 13:10:34.814088 22871 consensus_queue.cc:237] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:34.790903 22306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144955449774c3c90f8e0ed28cc5155" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:34.785449 22797 raft_consensus.cc:515] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:34.821504 22727 raft_consensus.cc:2749] T a4695de4c0534d2d8d2a4c79aab3654d P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:34.821888 22797 leader_election.cc:290] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
W20260709 13:10:34.801604 22276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.130:43835, user_credentials={real_user=slave}} blocked reactor thread for 76083us
I20260709 13:10:34.825098 22235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:34.805193 22699 raft_consensus.cc:515] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:34.831760 22766 raft_consensus.cc:515] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:34.833350 22699 leader_election.cc:290] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:34.833861 22766 leader_election.cc:290] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:34.834609 22236 raft_consensus.cc:2393] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate edd63b54133d4c8d9149d57a2886916b in current term 1: Already voted for candidate 371d38ec3c7f493e9aea62dae121e565 in this term.
I20260709 13:10:34.843490 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255341bbdc0147aca3a664fdaa81ebf5" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:34.844388 22386 raft_consensus.cc:2393] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 371d38ec3c7f493e9aea62dae121e565 in current term 1: Already voted for candidate edd63b54133d4c8d9149d57a2886916b in this term.
W20260709 13:10:34.844825 22879 log.cc:927] Time spent T 3a23c35530d84893bfc638fe35760483 P 371d38ec3c7f493e9aea62dae121e565: Append to log took a long time: real 0.159s	user 0.003s	sys 0.000s
I20260709 13:10:34.846717 22235 raft_consensus.cc:2393] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d515385609945e5837e85b77de385e2 in current term 1: Already voted for candidate 371d38ec3c7f493e9aea62dae121e565 in this term.
I20260709 13:10:34.847436 22159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:34.848301 22159 raft_consensus.cc:2393] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 371d38ec3c7f493e9aea62dae121e565 in current term 1: Already voted for candidate 5d515385609945e5837e85b77de385e2 in this term.
I20260709 13:10:34.848906 22848 raft_consensus.cc:493] T ecb5c885975e4259a69644775bb930f1 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.849431 22848 raft_consensus.cc:515] T ecb5c885975e4259a69644775bb930f1 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:34.850481 22433 tablet_bootstrap.cc:492] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:34.851054 22433 ts_tablet_manager.cc:1403] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.292s	user 0.002s	sys 0.015s
I20260709 13:10:34.851769 22848 leader_election.cc:290] T ecb5c885975e4259a69644775bb930f1 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:34.843353 22307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:34.862689 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255341bbdc0147aca3a664fdaa81ebf5" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
W20260709 13:10:34.864216 22203 leader_election.cc:343] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.864748 22203 leader_election.cc:304] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565; no voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:34.875810 22433 raft_consensus.cc:359] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:34.876803 22433 raft_consensus.cc:385] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.877137 22433 raft_consensus.cc:740] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.880326 22433 consensus_queue.cc:260] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
W20260709 13:10:34.881580 22128 leader_election.cc:343] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.882078 22128 leader_election.cc:304] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:34.886605 22433 ts_tablet_manager.cc:1434] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.003s
I20260709 13:10:34.889513 22433 tablet_bootstrap.cc:492] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b: Bootstrap starting.
I20260709 13:10:34.877609 22306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:34.925146 22883 consensus_queue.cc:1048] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.056s
I20260709 13:10:34.899873 22861 raft_consensus.cc:2749] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:34.927211 22864 raft_consensus.cc:493] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.884630 22384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb5c885975e4259a69644775bb930f1" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:34.927757 22864 raft_consensus.cc:515] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:34.884999 22797 raft_consensus.cc:2749] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:10:34.895355 22351 leader_election.cc:343] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.894481 22155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb5c885975e4259a69644775bb930f1" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:34.929503 22351 leader_election.cc:304] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:34.929864 22864 leader_election.cc:290] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:34.931349 22434 tablet_bootstrap.cc:492] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:34.931936 22434 ts_tablet_manager.cc:1403] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.349s	user 0.009s	sys 0.017s
I20260709 13:10:34.931080 22351 leader_election.cc:304] T c144955449774c3c90f8e0ed28cc5155 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0
W20260709 13:10:34.934867 22203 leader_election.cc:343] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.936975 22203 leader_election.cc:304] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565; no voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:34.934322 22437 tablet_bootstrap.cc:492] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
W20260709 13:10:34.934281 22201 leader_election.cc:343] T ecb5c885975e4259a69644775bb930f1 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:34.938438 22201 leader_election.cc:343] T ecb5c885975e4259a69644775bb930f1 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.938825 22201 leader_election.cc:304] T ecb5c885975e4259a69644775bb930f1 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565; no voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:34.939646 22883 raft_consensus.cc:2749] T ecb5c885975e4259a69644775bb930f1 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:34.941350 22307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d6ad58386642cd897d5378d8b9bc58" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:34.942102 22307 raft_consensus.cc:2468] T 45d6ad58386642cd897d5378d8b9bc58 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 0.
I20260709 13:10:34.943089 22869 raft_consensus.cc:493] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.943614 22869 raft_consensus.cc:515] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:34.945029 22848 raft_consensus.cc:2749] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:34.899430 22727 consensus_queue.cc:1048] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 13:10:34.953547 22154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d6ad58386642cd897d5378d8b9bc58" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:34.954245 22154 raft_consensus.cc:2468] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:34.953768 22433 tablet_bootstrap.cc:654] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.945798 22869 leader_election.cc:290] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:34.963932 22349 leader_election.cc:304] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:34.936789 22865 raft_consensus.cc:2749] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:34.965093 22843 raft_consensus.cc:2804] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:34.965508 22843 raft_consensus.cc:493] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.965848 22843 raft_consensus.cc:3060] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.967469 22871 consensus_queue.cc:1048] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.975205 22128 leader_election.cc:304] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:34.977794 22434 raft_consensus.cc:359] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:34.978824 22434 raft_consensus.cc:385] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.979161 22434 raft_consensus.cc:740] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.947283 22852 raft_consensus.cc:2749] T c144955449774c3c90f8e0ed28cc5155 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:34.990607 22434 consensus_queue.cc:260] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:34.986976 22864 raft_consensus.cc:2804] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:35.002032 22434 ts_tablet_manager.cc:1434] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.001s
I20260709 13:10:35.004546 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d6ad58386642cd897d5378d8b9bc58" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:35.005358 22310 raft_consensus.cc:2468] T 45d6ad58386642cd897d5378d8b9bc58 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:34.998253 22864 raft_consensus.cc:493] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.025426 22843 raft_consensus.cc:515] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:35.031222 22867 consensus_queue.cc:1048] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:35.062386 22437 tablet_bootstrap.cc:654] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.065508 22867 consensus_queue.cc:1048] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:35.013028 22864 raft_consensus.cc:3060] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.101150 22434 tablet_bootstrap.cc:492] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:35.112886 22433 tablet_bootstrap.cc:492] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b: No bootstrap required, opened a new log
I20260709 13:10:35.113528 22433 ts_tablet_manager.cc:1403] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b: Time spent bootstrapping tablet: real 0.224s	user 0.005s	sys 0.015s
I20260709 13:10:35.122304 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d6ad58386642cd897d5378d8b9bc58" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:35.123039 22310 raft_consensus.cc:3060] T 45d6ad58386642cd897d5378d8b9bc58 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.123523 22157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d6ad58386642cd897d5378d8b9bc58" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:35.126004 22864 raft_consensus.cc:515] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:35.127230 22157 raft_consensus.cc:2393] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate edd63b54133d4c8d9149d57a2886916b in current term 1: Already voted for candidate 5d515385609945e5837e85b77de385e2 in this term.
I20260709 13:10:35.122396 22843 leader_election.cc:290] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:35.131547 22310 raft_consensus.cc:2468] T 45d6ad58386642cd897d5378d8b9bc58 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:35.135675 22351 leader_election.cc:304] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:35.136500 22838 raft_consensus.cc:2804] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:35.136976 22838 raft_consensus.cc:697] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Leader. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:35.137343 22434 tablet_bootstrap.cc:654] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.137804 22838 consensus_queue.cc:237] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:35.138309 22304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d6ad58386642cd897d5378d8b9bc58" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:35.139179 22304 raft_consensus.cc:2393] T 45d6ad58386642cd897d5378d8b9bc58 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d515385609945e5837e85b77de385e2 in current term 1: Already voted for candidate edd63b54133d4c8d9149d57a2886916b in this term.
I20260709 13:10:35.139587 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d6ad58386642cd897d5378d8b9bc58" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:35.141050 22126 leader_election.cc:304] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:35.141815 22857 raft_consensus.cc:2749] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:35.145843 22433 raft_consensus.cc:359] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:35.146552 22433 raft_consensus.cc:385] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.146996 22433 raft_consensus.cc:740] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.154495 22433 consensus_queue.cc:260] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:35.147102 22864 leader_election.cc:290] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:35.152664 22857 raft_consensus.cc:493] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.180311 22433 ts_tablet_manager.cc:1434] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 13:10:35.176395 22857 raft_consensus.cc:515] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:35.189296 22857 leader_election.cc:290] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:35.192268 22232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92f72a0e3ac48d480bb25e4f8f64c43" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:35.193246 22232 raft_consensus.cc:2468] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 0.
I20260709 13:10:35.196067 22127 leader_election.cc:304] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 
I20260709 13:10:35.197923 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92f72a0e3ac48d480bb25e4f8f64c43" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:35.200387 22864 raft_consensus.cc:2804] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:35.200976 22864 raft_consensus.cc:493] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.201421 22864 raft_consensus.cc:3060] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:35.201946 22128 leader_election.cc:343] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:35.203374 22384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d6ad58386642cd897d5378d8b9bc58" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
W20260709 13:10:35.278381 22885 log.cc:927] Time spent T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:10:35.293264 22434 tablet_bootstrap.cc:492] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:35.293788 22434 ts_tablet_manager.cc:1403] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.193s	user 0.040s	sys 0.024s
I20260709 13:10:35.295589 22871 consensus_queue.cc:1048] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:35.296788 22434 raft_consensus.cc:359] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:35.297509 22434 raft_consensus.cc:385] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.297796 22434 raft_consensus.cc:740] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.311810 22434 consensus_queue.cc:260] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:35.322960 22437 tablet_bootstrap.cc:492] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:35.323606 22437 ts_tablet_manager.cc:1403] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.389s	user 0.010s	sys 0.005s
I20260709 13:10:35.327018 22057 catalog_manager.cc:5697] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "66d3606ce30b4661b5d62d403d7abca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.328725 22864 raft_consensus.cc:515] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:35.331525 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92f72a0e3ac48d480bb25e4f8f64c43" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:35.331707 22864 leader_election.cc:290] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:35.332170 22236 raft_consensus.cc:3060] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.336895 22306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92f72a0e3ac48d480bb25e4f8f64c43" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
W20260709 13:10:35.338513 22128 leader_election.cc:343] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:35.345132 22434 ts_tablet_manager.cc:1434] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:10:35.346240 22434 tablet_bootstrap.cc:492] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:35.353186 22236 raft_consensus.cc:2468] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 1.
I20260709 13:10:35.354656 22127 leader_election.cc:304] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:35.355468 22864 raft_consensus.cc:2804] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:35.355921 22864 raft_consensus.cc:697] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [term 1 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:35.356725 22864 consensus_queue.cc:237] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:35.369566 22440 raft_consensus.cc:493] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.370151 22440 raft_consensus.cc:515] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:35.369875 22060 catalog_manager.cc:5697] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 reported cstate change: term changed from 0 to 1, leader changed from <none> to 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "371d38ec3c7f493e9aea62dae121e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.372283 22440 leader_election.cc:290] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:35.374903 22157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb5c885975e4259a69644775bb930f1" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
W20260709 13:10:35.377564 22349 leader_election.cc:343] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:35.385396 22873 consensus_queue.cc:1048] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:35.390642 22437 raft_consensus.cc:359] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:35.391518 22437 raft_consensus.cc:385] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.392042 22437 raft_consensus.cc:740] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.392774 22437 consensus_queue.cc:260] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:35.394783 22437 ts_tablet_manager.cc:1434] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.000s
I20260709 13:10:35.396632 22437 tablet_bootstrap.cc:492] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:35.403468 22437 tablet_bootstrap.cc:654] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.409446 22437 tablet_bootstrap.cc:492] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:35.409951 22437 ts_tablet_manager.cc:1403] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:10:35.409991 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb5c885975e4259a69644775bb930f1" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:35.419966 22236 raft_consensus.cc:2468] T ecb5c885975e4259a69644775bb930f1 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 0.
I20260709 13:10:35.422164 22350 leader_election.cc:304] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:35.423398 22836 raft_consensus.cc:2804] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:35.423823 22836 raft_consensus.cc:493] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.424166 22836 raft_consensus.cc:3060] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.432651 22061 catalog_manager.cc:5697] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b reported cstate change: term changed from 0 to 1, leader changed from <none> to edd63b54133d4c8d9149d57a2886916b (127.12.76.132). New cstate: current_term: 1 leader_uuid: "edd63b54133d4c8d9149d57a2886916b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.436192 22434 tablet_bootstrap.cc:654] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.437526 22836 raft_consensus.cc:515] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:35.463761 22434 tablet_bootstrap.cc:492] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2: No bootstrap required, opened a new log
I20260709 13:10:35.460619 22437 raft_consensus.cc:359] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:35.465432 22437 raft_consensus.cc:385] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.464241 22434 ts_tablet_manager.cc:1403] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.118s	user 0.011s	sys 0.001s
I20260709 13:10:35.463543 22057 catalog_manager.cc:5697] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.466641 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb5c885975e4259a69644775bb930f1" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:35.467499 22233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb5c885975e4259a69644775bb930f1" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:35.468124 22233 raft_consensus.cc:3060] T ecb5c885975e4259a69644775bb930f1 P 371d38ec3c7f493e9aea62dae121e565 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:35.470670 22349 leader_election.cc:343] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:35.474628 22437 raft_consensus.cc:740] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.478245 22437 consensus_queue.cc:260] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:35.471982 22434 raft_consensus.cc:359] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:35.481871 22434 raft_consensus.cc:385] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.482226 22434 raft_consensus.cc:740] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.483038 22434 consensus_queue.cc:260] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:35.485289 22434 ts_tablet_manager.cc:1434] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:10:35.491518 22836 leader_election.cc:290] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:35.492589 22233 raft_consensus.cc:2468] T ecb5c885975e4259a69644775bb930f1 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:35.493541 22437 ts_tablet_manager.cc:1434] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.083s	user 0.008s	sys 0.000s
I20260709 13:10:35.494737 22437 tablet_bootstrap.cc:492] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:35.496562 22350 leader_election.cc:304] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:35.497300 22836 raft_consensus.cc:2804] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:35.497828 22836 raft_consensus.cc:697] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Leader. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:35.498667 22836 consensus_queue.cc:237] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:35.502085 22437 tablet_bootstrap.cc:654] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:35.513867 22109 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:35.520748 22437 tablet_bootstrap.cc:492] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:35.521252 22437 ts_tablet_manager.cc:1403] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.007s
I20260709 13:10:35.523317 22060 catalog_manager.cc:5697] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b reported cstate change: term changed from 0 to 1, leader changed from <none> to edd63b54133d4c8d9149d57a2886916b (127.12.76.132). New cstate: current_term: 1 leader_uuid: "edd63b54133d4c8d9149d57a2886916b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.523939 22437 raft_consensus.cc:359] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:35.524580 22437 raft_consensus.cc:385] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.524863 22437 raft_consensus.cc:740] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.525480 22437 consensus_queue.cc:260] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:35.527529 22437 ts_tablet_manager.cc:1434] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:10:35.528430 22437 tablet_bootstrap.cc:492] T 255341bbdc0147aca3a664fdaa81ebf5 P 66d3606ce30b4661b5d62d403d7abca0: Bootstrap starting.
I20260709 13:10:35.534112 22437 tablet_bootstrap.cc:654] T 255341bbdc0147aca3a664fdaa81ebf5 P 66d3606ce30b4661b5d62d403d7abca0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.542156 22437 tablet_bootstrap.cc:492] T 255341bbdc0147aca3a664fdaa81ebf5 P 66d3606ce30b4661b5d62d403d7abca0: No bootstrap required, opened a new log
I20260709 13:10:35.542544 22437 ts_tablet_manager.cc:1403] T 255341bbdc0147aca3a664fdaa81ebf5 P 66d3606ce30b4661b5d62d403d7abca0: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:10:35.544775 22437 raft_consensus.cc:359] T 255341bbdc0147aca3a664fdaa81ebf5 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:35.545326 22437 raft_consensus.cc:385] T 255341bbdc0147aca3a664fdaa81ebf5 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.545550 22437 raft_consensus.cc:740] T 255341bbdc0147aca3a664fdaa81ebf5 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.546080 22437 consensus_queue.cc:260] T 255341bbdc0147aca3a664fdaa81ebf5 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:35.547613 22437 ts_tablet_manager.cc:1434] T 255341bbdc0147aca3a664fdaa81ebf5 P 66d3606ce30b4661b5d62d403d7abca0: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:10:35.617828 22907 raft_consensus.cc:493] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.618331 22907 raft_consensus.cc:515] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:35.620579 22907 leader_election.cc:290] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:35.621335 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92f72a0e3ac48d480bb25e4f8f64c43" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:35.621577 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92f72a0e3ac48d480bb25e4f8f64c43" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:35.622337 22236 raft_consensus.cc:2393] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66d3606ce30b4661b5d62d403d7abca0 in current term 1: Already voted for candidate 5d515385609945e5837e85b77de385e2 in this term.
I20260709 13:10:35.623342 22276 leader_election.cc:304] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:35.624084 22907 raft_consensus.cc:3060] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.630991 22907 raft_consensus.cc:2749] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:35.656070 22907 raft_consensus.cc:493] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.656457 22907 raft_consensus.cc:515] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:35.657974 22907 leader_election.cc:290] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:35.658649 22163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:35.658852 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:35.659336 22163 raft_consensus.cc:2393] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66d3606ce30b4661b5d62d403d7abca0 in current term 1: Already voted for candidate 5d515385609945e5837e85b77de385e2 in this term.
I20260709 13:10:35.659621 22236 raft_consensus.cc:2393] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66d3606ce30b4661b5d62d403d7abca0 in current term 1: Already voted for candidate 371d38ec3c7f493e9aea62dae121e565 in this term.
I20260709 13:10:35.660566 22276 leader_election.cc:304] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:35.661317 22907 raft_consensus.cc:3060] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.666122 22440 consensus_queue.cc:1048] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:35.667752 22907 raft_consensus.cc:2749] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:35.675263 22440 consensus_queue.cc:1048] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:35.761207 22841 raft_consensus.cc:493] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.761670 22841 raft_consensus.cc:515] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:35.763222 22841 leader_election.cc:290] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:35.764099 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb5c885975e4259a69644775bb930f1" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:35.764408 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb5c885975e4259a69644775bb930f1" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:35.765218 22236 raft_consensus.cc:2393] T ecb5c885975e4259a69644775bb930f1 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d515385609945e5837e85b77de385e2 in current term 1: Already voted for candidate edd63b54133d4c8d9149d57a2886916b in this term.
I20260709 13:10:35.766135 22127 leader_election.cc:304] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d515385609945e5837e85b77de385e2; no voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:35.766723 22841 raft_consensus.cc:3060] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.772454 22841 raft_consensus.cc:2749] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:35.782372 22841 raft_consensus.cc:493] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.782851 22841 raft_consensus.cc:515] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:35.784696 22841 leader_election.cc:290] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:35.785490 22306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28d9c95ac3d49219dc6a5d5739f6ead" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:35.785661 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28d9c95ac3d49219dc6a5d5739f6ead" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:35.786350 22306 raft_consensus.cc:2468] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 0.
I20260709 13:10:35.786454 22386 raft_consensus.cc:2468] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 0.
I20260709 13:10:35.787645 22128 leader_election.cc:304] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:35.788431 22841 raft_consensus.cc:2804] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:35.788821 22841 raft_consensus.cc:493] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.789213 22841 raft_consensus.cc:3060] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.792284 22864 consensus_queue.cc:1048] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:35.796284 22841 raft_consensus.cc:515] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:35.799013 22841 leader_election.cc:290] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:35.800045 22306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28d9c95ac3d49219dc6a5d5739f6ead" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:35.800658 22306 raft_consensus.cc:3060] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.802101 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28d9c95ac3d49219dc6a5d5739f6ead" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:35.802734 22386 raft_consensus.cc:3060] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.808116 22306 raft_consensus.cc:2468] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 1.
I20260709 13:10:35.811638 22128 leader_election.cc:304] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:35.811698 22386 raft_consensus.cc:2468] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 1.
I20260709 13:10:35.812450 22864 raft_consensus.cc:2804] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:35.816605 22864 raft_consensus.cc:697] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [term 1 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:35.817447 22864 consensus_queue.cc:237] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:35.832050 22919 consensus_queue.cc:1048] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:35.848311 22058 catalog_manager.cc:5697] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:36.030453 22440 consensus_queue.cc:1048] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:10:36.069947 22871 raft_consensus.cc:493] T 255341bbdc0147aca3a664fdaa81ebf5 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.071229 22871 raft_consensus.cc:515] T 255341bbdc0147aca3a664fdaa81ebf5 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:36.094871 22871 leader_election.cc:290] T 255341bbdc0147aca3a664fdaa81ebf5 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:36.098668 22233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255341bbdc0147aca3a664fdaa81ebf5" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:36.100363 22233 raft_consensus.cc:2393] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66d3606ce30b4661b5d62d403d7abca0 in current term 1: Already voted for candidate 371d38ec3c7f493e9aea62dae121e565 in this term.
I20260709 13:10:36.114521 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255341bbdc0147aca3a664fdaa81ebf5" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:36.115574 22386 raft_consensus.cc:2393] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66d3606ce30b4661b5d62d403d7abca0 in current term 1: Already voted for candidate edd63b54133d4c8d9149d57a2886916b in this term.
I20260709 13:10:36.127321 22275 leader_election.cc:304] T 255341bbdc0147aca3a664fdaa81ebf5 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:36.139890 22924 raft_consensus.cc:3060] T 255341bbdc0147aca3a664fdaa81ebf5 P 66d3606ce30b4661b5d62d403d7abca0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.170933 22838 consensus_queue.cc:1048] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:36.189309 22924 raft_consensus.cc:2749] T 255341bbdc0147aca3a664fdaa81ebf5 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:36.436482 22864 consensus_queue.cc:1048] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:36.440945 22917 consensus_queue.cc:1048] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:36.499599 22927 raft_consensus.cc:493] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.500090 22927 raft_consensus.cc:515] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:36.502177 22927 leader_election.cc:290] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:36.502777 22232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255341bbdc0147aca3a664fdaa81ebf5" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:36.503271 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255341bbdc0147aca3a664fdaa81ebf5" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:36.503525 22232 raft_consensus.cc:2468] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:36.503959 22310 raft_consensus.cc:2468] T 255341bbdc0147aca3a664fdaa81ebf5 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:36.504875 22350 leader_election.cc:304] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:36.505847 22927 raft_consensus.cc:2804] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.506194 22927 raft_consensus.cc:493] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.506496 22927 raft_consensus.cc:3060] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.513716 22927 raft_consensus.cc:515] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:36.515542 22927 leader_election.cc:290] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 2 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:36.516098 22232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255341bbdc0147aca3a664fdaa81ebf5" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:36.516728 22232 raft_consensus.cc:3060] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.516647 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255341bbdc0147aca3a664fdaa81ebf5" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:36.517704 22310 raft_consensus.cc:3060] T 255341bbdc0147aca3a664fdaa81ebf5 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.523984 22232 raft_consensus.cc:2468] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 2.
I20260709 13:10:36.525157 22350 leader_election.cc:304] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:36.525936 22927 raft_consensus.cc:2804] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:36.527034 22927 raft_consensus.cc:697] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [term 2 LEADER]: Becoming Leader. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:36.528456 22310 raft_consensus.cc:2468] T 255341bbdc0147aca3a664fdaa81ebf5 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 2.
I20260709 13:10:36.528088 22927 consensus_queue.cc:237] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:36.544096 22061 catalog_manager.cc:5697] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b reported cstate change: term changed from 0 to 2, leader changed from <none> to edd63b54133d4c8d9149d57a2886916b (127.12.76.132). New cstate: current_term: 2 leader_uuid: "edd63b54133d4c8d9149d57a2886916b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:36.559707 22109 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:36.832701 22935 raft_consensus.cc:493] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.833289 22935 raft_consensus.cc:515] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:36.835170 22935 leader_election.cc:290] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:36.836077 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:36.836153 22232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:36.837013 22310 raft_consensus.cc:2468] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 1.
I20260709 13:10:36.837066 22232 raft_consensus.cc:2468] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 1.
I20260709 13:10:36.838285 22128 leader_election.cc:304] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:36.839000 22935 raft_consensus.cc:2804] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.839385 22935 raft_consensus.cc:493] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.839749 22935 raft_consensus.cc:3060] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.846141 22935 raft_consensus.cc:515] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:36.848553 22935 leader_election.cc:290] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:36.848723 22232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:36.849027 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:36.849479 22232 raft_consensus.cc:3060] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.849548 22310 raft_consensus.cc:3060] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.855166 22310 raft_consensus.cc:2468] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
I20260709 13:10:36.857137 22232 raft_consensus.cc:2468] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
I20260709 13:10:36.863158 22128 leader_election.cc:304] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:36.864861 22935 raft_consensus.cc:2804] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:36.865439 22935 raft_consensus.cc:697] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:36.866433 22935 consensus_queue.cc:237] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:36.881570 22061 catalog_manager.cc:5697] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 0 to 2, leader changed from <none> to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:36.981330 22310 raft_consensus.cc:1275] T 255341bbdc0147aca3a664fdaa81ebf5 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Refusing update from remote peer edd63b54133d4c8d9149d57a2886916b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:36.982682 22927 consensus_queue.cc:1048] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:36.992893 22232 raft_consensus.cc:1275] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Refusing update from remote peer edd63b54133d4c8d9149d57a2886916b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:36.994462 22927 consensus_queue.cc:1048] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:37.339066 22309 raft_consensus.cc:1275] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:37.340412 22935 consensus_queue.cc:1048] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:37.352450 22236 raft_consensus.cc:1275] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:37.355826 22920 consensus_queue.cc:1048] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:37.445626 12594 tablet_server.cc:179] TabletServer@127.12.76.129:0 shutting down...
W20260709 13:10:37.450521 22201 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:37.457216 22201 consensus_peers.cc:597] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:37.464150 22349 consensus_peers.cc:597] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:37.475780 22349 consensus_peers.cc:597] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:37.484836 22275 consensus_peers.cc:597] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:37.489163 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:37.490448 12594 tablet_replica.cc:333] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.491490 12594 raft_consensus.cc:2243] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.492057 12594 raft_consensus.cc:2272] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.495019 12594 tablet_replica.cc:333] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.495791 12594 raft_consensus.cc:2243] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.496760 12594 raft_consensus.cc:2272] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.499051 12594 tablet_replica.cc:333] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.499662 12594 raft_consensus.cc:2243] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.500043 12594 raft_consensus.cc:2272] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.502259 12594 tablet_replica.cc:333] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.503046 12594 raft_consensus.cc:2243] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.503659 12594 raft_consensus.cc:2272] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.507110 12594 tablet_replica.cc:333] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.508037 12594 raft_consensus.cc:2243] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.508689 12594 raft_consensus.cc:2272] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.511358 12594 tablet_replica.cc:333] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.512073 12594 raft_consensus.cc:2243] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:37.512159 22201 consensus_peers.cc:597] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:37.512660 12594 raft_consensus.cc:2272] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.515622 12594 tablet_replica.cc:333] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.516300 12594 raft_consensus.cc:2243] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.516870 12594 raft_consensus.cc:2272] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:37.517145 22349 consensus_peers.cc:597] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:37.519896 12594 tablet_replica.cc:333] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.520951 12594 raft_consensus.cc:2243] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.521548 12594 raft_consensus.cc:2272] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.524636 12594 tablet_replica.cc:333] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.525506 12594 raft_consensus.cc:2243] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.526631 12594 raft_consensus.cc:2272] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.529455 12594 tablet_replica.cc:333] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.530081 12594 raft_consensus.cc:2243] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.530797 12594 raft_consensus.cc:2272] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.534111 12594 tablet_replica.cc:333] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.535020 12594 raft_consensus.cc:2243] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.535808 12594 raft_consensus.cc:2272] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.538126 12594 tablet_replica.cc:333] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.538707 12594 raft_consensus.cc:2243] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.539105 12594 raft_consensus.cc:2272] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.541025 12594 tablet_replica.cc:333] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.541500 12594 raft_consensus.cc:2243] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.542290 12594 raft_consensus.cc:2272] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.544989 12594 tablet_replica.cc:333] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.545933 12594 raft_consensus.cc:2243] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.546517 12594 raft_consensus.cc:2272] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:37.546875 22275 consensus_peers.cc:597] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:37.549072 12594 tablet_replica.cc:333] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.550091 12594 raft_consensus.cc:2243] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.550683 12594 raft_consensus.cc:2272] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:37.551622 22349 consensus_peers.cc:597] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:37.553318 12594 tablet_replica.cc:333] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.553957 12594 raft_consensus.cc:2243] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.554376 12594 raft_consensus.cc:2272] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.557005 12594 tablet_replica.cc:333] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.557796 12594 raft_consensus.cc:2243] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.558899 12594 raft_consensus.cc:2272] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:37.559199 22349 consensus_peers.cc:597] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:37.561156 12594 tablet_replica.cc:333] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.561882 12594 raft_consensus.cc:2243] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.562379 12594 raft_consensus.cc:2272] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.564743 12594 tablet_replica.cc:333] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.565353 12594 raft_consensus.cc:2243] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.565845 12594 raft_consensus.cc:2272] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.568044 12594 tablet_replica.cc:333] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.568616 12594 raft_consensus.cc:2243] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.569619 12594 raft_consensus.cc:2272] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.571935 12594 tablet_replica.cc:333] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.572463 12594 raft_consensus.cc:2243] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.572922 12594 raft_consensus.cc:2272] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.575001 12594 tablet_replica.cc:333] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.575726 12594 raft_consensus.cc:2243] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.576185 12594 raft_consensus.cc:2272] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.583045 12594 tablet_replica.cc:333] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.583698 12594 raft_consensus.cc:2243] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.584271 12594 raft_consensus.cc:2272] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.586417 12594 tablet_replica.cc:333] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.587033 12594 raft_consensus.cc:2243] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.587556 12594 raft_consensus.cc:2272] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.590013 12594 tablet_replica.cc:333] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.590801 12594 raft_consensus.cc:2243] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.591269 12594 raft_consensus.cc:2272] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.594535 12594 tablet_replica.cc:333] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.595213 12594 raft_consensus.cc:2243] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.595779 12594 raft_consensus.cc:2272] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.598162 12594 tablet_replica.cc:333] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.599054 12594 raft_consensus.cc:2243] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.600149 12594 raft_consensus.cc:2272] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.603034 12594 tablet_replica.cc:333] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.603921 12594 raft_consensus.cc:2243] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.604897 12594 raft_consensus.cc:2272] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:37.607532 22349 consensus_peers.cc:597] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:37.610061 12594 tablet_replica.cc:333] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.610956 12594 raft_consensus.cc:2243] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.611514 12594 raft_consensus.cc:2272] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:37.611629 22201 consensus_peers.cc:597] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:37.614490 12594 tablet_replica.cc:333] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.615347 12594 raft_consensus.cc:2243] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.616400 12594 raft_consensus.cc:2272] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.619392 12594 tablet_replica.cc:333] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.620220 12594 raft_consensus.cc:2243] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.621379 12594 raft_consensus.cc:2272] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.624429 12594 tablet_replica.cc:333] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.625201 12594 raft_consensus.cc:2243] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.626400 12594 raft_consensus.cc:2272] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:37.629328 22201 consensus_peers.cc:597] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:37.629400 12594 tablet_replica.cc:333] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.630576 12594 raft_consensus.cc:2243] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.631173 12594 raft_consensus.cc:2272] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.633687 12594 tablet_replica.cc:333] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.634352 12594 raft_consensus.cc:2243] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.635399 12594 raft_consensus.cc:2272] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.638049 12594 tablet_replica.cc:333] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.638686 12594 raft_consensus.cc:2243] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.639178 12594 raft_consensus.cc:2272] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.641489 12594 tablet_replica.cc:333] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.642053 12594 raft_consensus.cc:2243] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.643069 12594 raft_consensus.cc:2272] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:37.643515 22349 consensus_peers.cc:597] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:37.645807 12594 tablet_replica.cc:333] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.646605 12594 raft_consensus.cc:2243] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.647081 12594 raft_consensus.cc:2272] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.649770 12594 tablet_replica.cc:333] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.650442 12594 raft_consensus.cc:2243] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.650971 12594 raft_consensus.cc:2272] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.653488 12594 tablet_replica.cc:333] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.654204 12594 raft_consensus.cc:2243] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.655171 12594 raft_consensus.cc:2272] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.658159 12594 tablet_replica.cc:333] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
W20260709 13:10:37.658113 22201 consensus_peers.cc:597] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:37.659127 12594 raft_consensus.cc:2243] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.660068 12594 raft_consensus.cc:2272] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.662897 12594 tablet_replica.cc:333] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.663661 12594 raft_consensus.cc:2243] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.664202 12594 raft_consensus.cc:2272] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.666775 12594 tablet_replica.cc:333] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.667361 12594 raft_consensus.cc:2243] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.667846 12594 raft_consensus.cc:2272] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.669817 12594 tablet_replica.cc:333] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.670312 12594 raft_consensus.cc:2243] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.670732 12594 raft_consensus.cc:2272] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.672595 12594 tablet_replica.cc:333] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.673048 12594 raft_consensus.cc:2243] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.673497 12594 raft_consensus.cc:2272] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.675537 12594 tablet_replica.cc:333] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2: stopping tablet replica
I20260709 13:10:37.676005 12594 raft_consensus.cc:2243] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.676388 12594 raft_consensus.cc:2272] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:37.686092 22275 consensus_peers.cc:597] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:37.708153 22275 consensus_peers.cc:597] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:37.708180 22349 consensus_peers.cc:597] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:37.722666 22201 consensus_peers.cc:597] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:37.726687 22201 consensus_peers.cc:597] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:37.747187 22201 consensus_peers.cc:597] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:37.749764 22201 consensus_peers.cc:597] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:37.758479 22201 consensus_peers.cc:597] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:37.759532 12594 tablet_server.cc:196] TabletServer@127.12.76.129:0 shutdown complete.
W20260709 13:10:37.764212 22275 consensus_peers.cc:597] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:37.803876 22275 consensus_peers.cc:597] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:37.839273 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:37.846519 22959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:37.847225 22961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:37.847338 22958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:37.848250 12594 server_base.cc:1061] running on GCE node
I20260709 13:10:37.853439 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:37.853771 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:37.854027 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602637854000 us; error 0 us; skew 500 ppm
I20260709 13:10:37.854650 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:37.858065 12594 webserver.cc:533] Webserver started at http://127.12.76.129:45899/ using document root <none> and password file <none>
I20260709 13:10:37.858564 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:37.858757 12594 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 13:10:37.868073 22201 consensus_peers.cc:597] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:37.869048 12594 fs_manager.cc:714] Time spent opening directory manager: real 0.009s	user 0.000s	sys 0.008s
W20260709 13:10:37.878059 22349 consensus_peers.cc:597] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:37.878214 22967 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:37.879213 12594 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:10:37.879660 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/ts-0-root
uuid: "5d515385609945e5837e85b77de385e2"
format_stamp: "Formatted at 2026-07-09 13:10:24 on dist-test-slave-th5x"
I20260709 13:10:37.880062 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602303087285-12594-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:37.900197 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:37.901876 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260709 13:10:37.903184 22349 consensus_peers.cc:597] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:37.903649 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:37.909562 22974 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:10:37.918289 22349 consensus_peers.cc:597] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:37.945875 22201 consensus_peers.cc:597] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:37.953342 22349 consensus_peers.cc:597] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:38.209262 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:10:38.209703 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.302s	user 0.009s	sys 0.000s
I20260709 13:10:38.210045 12594 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:10:38.219044 22974 tablet_bootstrap.cc:492] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:38.254714 22974 tablet_bootstrap.cc:492] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:38.255731 22974 tablet_bootstrap.cc:492] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:38.256444 22974 ts_tablet_manager.cc:1403] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.038s	user 0.027s	sys 0.008s
I20260709 13:10:38.259032 22974 raft_consensus.cc:359] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.259653 22974 raft_consensus.cc:740] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.260315 22974 consensus_queue.cc:260] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.262679 22974 ts_tablet_manager.cc:1434] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:38.263440 22974 tablet_bootstrap.cc:492] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:38.281860 22974 tablet_bootstrap.cc:492] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:38.282771 22974 tablet_bootstrap.cc:492] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:38.283320 22974 ts_tablet_manager.cc:1403] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:10:38.285259 22974 raft_consensus.cc:359] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.285792 22974 raft_consensus.cc:740] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.286404 22974 consensus_queue.cc:260] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.288064 22974 ts_tablet_manager.cc:1434] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:38.288724 22974 tablet_bootstrap.cc:492] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:38.302452 22974 tablet_bootstrap.cc:492] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:38.303550 22974 tablet_bootstrap.cc:492] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:38.304253 22974 ts_tablet_manager.cc:1403] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.006s
I20260709 13:10:38.306958 22974 raft_consensus.cc:359] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.307760 22974 raft_consensus.cc:740] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.308434 22974 consensus_queue.cc:260] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.309919 22974 ts_tablet_manager.cc:1434] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.001s
I20260709 13:10:38.310576 22974 tablet_bootstrap.cc:492] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:38.322414 22974 tablet_bootstrap.cc:492] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:38.323210 22974 tablet_bootstrap.cc:492] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:38.323751 22974 ts_tablet_manager.cc:1403] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:10:38.325397 22974 raft_consensus.cc:359] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.325865 22974 raft_consensus.cc:740] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.326333 22974 consensus_queue.cc:260] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.327600 22974 ts_tablet_manager.cc:1434] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:38.328171 22974 tablet_bootstrap.cc:492] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:38.340760 22974 tablet_bootstrap.cc:492] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:38.341679 22974 tablet_bootstrap.cc:492] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:38.342265 22974 ts_tablet_manager.cc:1403] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:10:38.345366 22974 raft_consensus.cc:359] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:38.346035 22974 raft_consensus.cc:740] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.346767 22974 consensus_queue.cc:260] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:38.349059 22974 ts_tablet_manager.cc:1434] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:38.349768 22974 tablet_bootstrap.cc:492] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:38.369383 22974 tablet_bootstrap.cc:492] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:38.370169 22974 tablet_bootstrap.cc:492] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:38.370782 22974 ts_tablet_manager.cc:1403] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
I20260709 13:10:38.373291 22974 raft_consensus.cc:359] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:38.373746 22974 raft_consensus.cc:740] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.374183 22974 consensus_queue.cc:260] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:38.375627 22974 ts_tablet_manager.cc:1434] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:10:38.376212 22974 tablet_bootstrap.cc:492] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:38.388157 22974 tablet_bootstrap.cc:492] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:38.388963 22974 tablet_bootstrap.cc:492] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:38.389482 22974 ts_tablet_manager.cc:1403] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:10:38.391340 22974 raft_consensus.cc:359] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.391961 22974 raft_consensus.cc:740] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.392606 22974 consensus_queue.cc:260] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.394013 22974 ts_tablet_manager.cc:1434] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:38.394685 22974 tablet_bootstrap.cc:492] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:38.406297 22974 tablet_bootstrap.cc:492] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:38.407016 22974 tablet_bootstrap.cc:492] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:38.407601 22974 ts_tablet_manager.cc:1403] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:10:38.409957 22974 raft_consensus.cc:359] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.410586 22974 raft_consensus.cc:740] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.411216 22974 consensus_queue.cc:260] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.412804 22974 ts_tablet_manager.cc:1434] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:38.413502 22974 tablet_bootstrap.cc:492] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:38.418771 12594 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:10:38.419129 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.209s	user 0.201s	sys 0.000s
I20260709 13:10:38.427605 22974 tablet_bootstrap.cc:492] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:38.428493 22974 tablet_bootstrap.cc:492] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:38.430187 22974 ts_tablet_manager.cc:1403] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:10:38.432375 22974 raft_consensus.cc:359] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.432905 22974 raft_consensus.cc:740] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.433419 22974 consensus_queue.cc:260] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.434947 22974 ts_tablet_manager.cc:1434] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:10:38.435705 22974 tablet_bootstrap.cc:492] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:38.453691 22974 tablet_bootstrap.cc:492] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:38.454761 22974 tablet_bootstrap.cc:492] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:38.455375 22974 ts_tablet_manager.cc:1403] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 13:10:38.457934 22974 raft_consensus.cc:359] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.458616 22974 raft_consensus.cc:740] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.459453 22974 consensus_queue.cc:260] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.461609 22974 ts_tablet_manager.cc:1434] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:38.462365 22974 tablet_bootstrap.cc:492] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:38.482789 22974 tablet_bootstrap.cc:492] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:38.483623 22974 tablet_bootstrap.cc:492] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:38.484148 22974 ts_tablet_manager.cc:1403] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.004s
I20260709 13:10:38.486588 22974 raft_consensus.cc:359] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.493685 22974 raft_consensus.cc:740] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.494415 22974 consensus_queue.cc:260] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.495970 22974 ts_tablet_manager.cc:1434] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:10:38.496605 22974 tablet_bootstrap.cc:492] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:38.532375 22974 tablet_bootstrap.cc:492] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:38.534615 22974 tablet_bootstrap.cc:492] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:38.535219 22974 ts_tablet_manager.cc:1403] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.012s
I20260709 13:10:38.537281 22974 raft_consensus.cc:359] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:38.537786 22974 raft_consensus.cc:740] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.538546 22974 consensus_queue.cc:260] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:38.540556 22974 ts_tablet_manager.cc:1434] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:38.541193 22974 tablet_bootstrap.cc:492] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:38.552596 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.129:33591
I20260709 13:10:38.552807 23049 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.129:33591 every 8 connection(s)
I20260709 13:10:38.557163 22974 tablet_bootstrap.cc:492] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:38.558462 22974 tablet_bootstrap.cc:492] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:38.559578 22974 ts_tablet_manager.cc:1403] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.008s
I20260709 13:10:38.561518 22836 raft_consensus.cc:493] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.562158 22836 raft_consensus.cc:515] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.565148 22309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4e00f55ac949c2a073e99cf9bc9290" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:38.565974 22979 raft_consensus.cc:493] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.564015 22974 raft_consensus.cc:359] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:38.566510 22979 raft_consensus.cc:515] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:38.566810 22974 raft_consensus.cc:740] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.567765 22974 consensus_queue.cc:260] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:38.568645 22979 leader_election.cc:290] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:38.569264 22836 leader_election.cc:290] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:38.570386 22974 ts_tablet_manager.cc:1434] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:10:38.570269 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d963b71e2742f3a74e1bed72d29186" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:38.571377 22974 tablet_bootstrap.cc:492] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:38.612252 22836 raft_consensus.cc:493] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.612612 23022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4e00f55ac949c2a073e99cf9bc9290" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:38.613135 22836 raft_consensus.cc:515] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:38.615006 22940 raft_consensus.cc:493] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.619748 22940 raft_consensus.cc:515] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.620266 23018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d963b71e2742f3a74e1bed72d29186" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:38.620936 23018 raft_consensus.cc:2468] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 2.
I20260709 13:10:38.616242 22836 leader_election.cc:290] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:38.618557 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d963b71e2742f3a74e1bed72d29186" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
W20260709 13:10:38.619138 22349 leader_election.cc:343] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.622414 22236 raft_consensus.cc:2468] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 2.
I20260709 13:10:38.622442 22349 leader_election.cc:304] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:38.623678 22350 leader_election.cc:304] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:38.624511 22979 raft_consensus.cc:493] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.625247 22979 raft_consensus.cc:515] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.627192 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535cc40e1cc04f16a78d6fbd34a69f3f" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:38.627821 22236 raft_consensus.cc:2468] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 1.
I20260709 13:10:38.624527 22976 raft_consensus.cc:2749] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.628871 22979 leader_election.cc:290] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:38.629163 22309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535cc40e1cc04f16a78d6fbd34a69f3f" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:38.629812 22309 raft_consensus.cc:2468] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:38.630730 22276 leader_election.cc:304] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:38.631649 22977 raft_consensus.cc:2804] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:38.632004 22977 raft_consensus.cc:493] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.632331 22977 raft_consensus.cc:3060] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.632426 22974 tablet_bootstrap.cc:492] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:38.633380 22974 tablet_bootstrap.cc:492] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:38.633993 22974 ts_tablet_manager.cc:1403] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.063s	user 0.028s	sys 0.022s
I20260709 13:10:38.634589 22203 leader_election.cc:304] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:38.635514 22940 leader_election.cc:290] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:38.635614 22979 raft_consensus.cc:2804] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:38.636202 22979 raft_consensus.cc:493] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.636606 22979 raft_consensus.cc:3060] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.636610 22974 raft_consensus.cc:359] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.638232 22974 raft_consensus.cc:740] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.639019 22974 consensus_queue.cc:260] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.641301 22974 ts_tablet_manager.cc:1434] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:38.642102 22974 tablet_bootstrap.cc:492] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:38.642259 22977 raft_consensus.cc:515] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.625298 22836 raft_consensus.cc:2804] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:38.643776 22836 raft_consensus.cc:493] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.644126 22836 raft_consensus.cc:3060] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.646526 22979 raft_consensus.cc:515] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.649293 22979 leader_election.cc:290] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:38.649808 22309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535cc40e1cc04f16a78d6fbd34a69f3f" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:38.655220 22977 leader_election.cc:290] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:38.657784 22309 raft_consensus.cc:2393] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 371d38ec3c7f493e9aea62dae121e565 in current term 2: Already voted for candidate 66d3606ce30b4661b5d62d403d7abca0 in this term.
I20260709 13:10:38.659868 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535cc40e1cc04f16a78d6fbd34a69f3f" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:38.660944 22236 raft_consensus.cc:2393] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 66d3606ce30b4661b5d62d403d7abca0 in current term 2: Already voted for candidate 371d38ec3c7f493e9aea62dae121e565 in this term.
I20260709 13:10:38.662768 22979 raft_consensus.cc:493] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.663470 22979 raft_consensus.cc:515] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.668267 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5f23465fe44a799f3521c814b38d55" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:38.674573 23051 heartbeater.cc:344] Connected to a master server at 127.12.76.190:33127
I20260709 13:10:38.675009 23051 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:38.676000 23051 heartbeater.cc:507] Master 127.12.76.190:33127 requested a full tablet report, sending...
I20260709 13:10:38.676389 22977 raft_consensus.cc:493] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.676954 22977 raft_consensus.cc:515] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.679394 22974 tablet_bootstrap.cc:492] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:38.680430 22974 tablet_bootstrap.cc:492] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:38.681165 22974 ts_tablet_manager.cc:1403] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.039s	user 0.024s	sys 0.012s
I20260709 13:10:38.683811 22974 raft_consensus.cc:359] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.684556 22974 raft_consensus.cc:740] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.681602 22977 leader_election.cc:290] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:38.683218 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f0ec01ac814561a087cb72983b73de" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:38.685319 22974 consensus_queue.cc:260] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.688062 22974 ts_tablet_manager.cc:1434] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:38.690941 23017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535cc40e1cc04f16a78d6fbd34a69f3f" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:38.699950 22061 ts_manager.cc:194] Re-registered known tserver with Master: 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:38.666183 22979 leader_election.cc:290] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:38.692211 22836 raft_consensus.cc:515] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:38.694556 23019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d963b71e2742f3a74e1bed72d29186" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:38.703888 23019 raft_consensus.cc:2468] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 2.
I20260709 13:10:38.696432 23015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5f23465fe44a799f3521c814b38d55" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:38.702797 22974 tablet_bootstrap.cc:492] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:38.699630 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535cc40e1cc04f16a78d6fbd34a69f3f" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
W20260709 13:10:38.703233 22201 leader_election.cc:343] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.706517 22201 leader_election.cc:304] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565; no voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:38.708119 22975 raft_consensus.cc:2749] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.709642 22201 leader_election.cc:304] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: edd63b54133d4c8d9149d57a2886916b
W20260709 13:10:38.710698 22201 leader_election.cc:343] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.710903 22975 raft_consensus.cc:2804] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:38.711114 22201 leader_election.cc:304] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565; no voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:38.711392 22975 raft_consensus.cc:493] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.711863 22975 raft_consensus.cc:3060] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.714354 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d963b71e2742f3a74e1bed72d29186" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:38.714885 23022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f0ec01ac814561a087cb72983b73de" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:38.716758 22978 raft_consensus.cc:2749] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:38.718143 22201 leader_election.cc:343] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.718237 23020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d963b71e2742f3a74e1bed72d29186" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:38.718894 23020 raft_consensus.cc:3060] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.719448 23019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535cc40e1cc04f16a78d6fbd34a69f3f" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:38.720642 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535cc40e1cc04f16a78d6fbd34a69f3f" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:38.720775 22836 leader_election.cc:290] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 3 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
W20260709 13:10:38.722761 22275 leader_election.cc:343] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.723991 22275 leader_election.cc:304] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:38.724753 22940 raft_consensus.cc:2749] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:38.725646 22275 leader_election.cc:343] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.726042 22275 leader_election.cc:304] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:38.726900 22955 raft_consensus.cc:2749] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:10:38.728608 22275 leader_election.cc:343] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.733644 23020 raft_consensus.cc:2468] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 3.
I20260709 13:10:38.734972 22349 leader_election.cc:304] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:38.736088 22838 raft_consensus.cc:2804] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:38.736724 22838 raft_consensus.cc:697] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [term 3 LEADER]: Becoming Leader. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:38.737743 22838 consensus_queue.cc:237] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:38.739398 22955 raft_consensus.cc:493] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.739941 22955 raft_consensus.cc:515] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.741933 22955 leader_election.cc:290] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:38.744225 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b3204b820c4446bb957d44063ecbe0" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:38.746282 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b3204b820c4446bb957d44063ecbe0" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:38.746896 23023 raft_consensus.cc:2468] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 1.
I20260709 13:10:38.748162 22275 leader_election.cc:304] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:38.748890 22955 raft_consensus.cc:2804] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:38.749301 22955 raft_consensus.cc:493] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.749625 22955 raft_consensus.cc:3060] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.752667 22861 raft_consensus.cc:493] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.753196 22861 raft_consensus.cc:515] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.753387 22977 raft_consensus.cc:493] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.753976 22977 raft_consensus.cc:515] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.755667 22861 leader_election.cc:290] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:38.751788 22975 raft_consensus.cc:515] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:38.756116 22977 leader_election.cc:290] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:38.756021 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b118b701f94b3bacbbca2df47fe5bd" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:38.757027 22236 raft_consensus.cc:2393] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate edd63b54133d4c8d9149d57a2886916b in current term 3: Already voted for candidate 371d38ec3c7f493e9aea62dae121e565 in this term.
W20260709 13:10:38.758000 22201 leader_election.cc:343] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.758353 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b501417270f5431da901577c6e5da05f" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:38.758849 22976 raft_consensus.cc:493] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.759451 22976 raft_consensus.cc:515] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.760883 22385 raft_consensus.cc:2468] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 1.
I20260709 13:10:38.762960 22975 leader_election.cc:290] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 3 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:38.763700 22927 raft_consensus.cc:493] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.763888 23020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b501417270f5431da901577c6e5da05f" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:38.764680 22976 leader_election.cc:290] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:38.765405 22309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b501417270f5431da901577c6e5da05f" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
W20260709 13:10:38.765522 22349 leader_election.cc:343] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.766019 22309 raft_consensus.cc:2468] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 1.
I20260709 13:10:38.764400 22927 raft_consensus.cc:515] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:38.767002 22275 leader_election.cc:304] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:38.768579 22927 leader_election.cc:290] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:38.769331 23020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4179392a8cb048c1982df1ea690bb4b9" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:38.770098 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4179392a8cb048c1982df1ea690bb4b9" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:38.770820 22977 raft_consensus.cc:2804] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:10:38.771688 22349 leader_election.cc:343] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.772128 23017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d963b71e2742f3a74e1bed72d29186" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:38.772899 23017 raft_consensus.cc:2393] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 371d38ec3c7f493e9aea62dae121e565 in current term 3: Already voted for candidate edd63b54133d4c8d9149d57a2886916b in this term.
I20260709 13:10:38.774276 22350 leader_election.cc:304] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:38.763746 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b118b701f94b3bacbbca2df47fe5bd" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:38.769548 22955 raft_consensus.cc:515] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.778510 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b501417270f5431da901577c6e5da05f" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:38.779867 22927 raft_consensus.cc:2749] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.771940 22977 raft_consensus.cc:493] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.771456 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d963b71e2742f3a74e1bed72d29186" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:38.782243 22977 raft_consensus.cc:3060] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.782613 22201 leader_election.cc:304] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565; no voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:38.783703 22975 raft_consensus.cc:2749] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:38.781693 22955 leader_election.cc:290] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:38.791010 22974 tablet_bootstrap.cc:492] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:38.791239 22351 leader_election.cc:304] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:38.792078 22974 tablet_bootstrap.cc:492] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:38.792459 22927 raft_consensus.cc:2804] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:38.793149 22927 raft_consensus.cc:493] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.793259 22203 leader_election.cc:304] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565; no voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:38.794023 22975 raft_consensus.cc:2749] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.792759 22974 ts_tablet_manager.cc:1403] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.090s	user 0.020s	sys 0.003s
I20260709 13:10:38.794075 22927 raft_consensus.cc:3060] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.797088 22974 raft_consensus.cc:359] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:38.797847 22974 raft_consensus.cc:740] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.797595 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b3204b820c4446bb957d44063ecbe0" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:38.799692 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b3204b820c4446bb957d44063ecbe0" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:38.800262 23023 raft_consensus.cc:3060] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.805912 22927 raft_consensus.cc:515] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
W20260709 13:10:38.806725 22275 leader_election.cc:343] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.807837 23023 raft_consensus.cc:2468] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 2.
I20260709 13:10:38.798761 22974 consensus_queue.cc:260] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:38.809804 23020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b501417270f5431da901577c6e5da05f" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:38.810729 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b501417270f5431da901577c6e5da05f" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
W20260709 13:10:38.811638 22349 leader_election.cc:343] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.812629 22927 leader_election.cc:290] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 2 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:38.814666 22977 raft_consensus.cc:515] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.810753 22974 ts_tablet_manager.cc:1434] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 13:10:38.815927 22310 raft_consensus.cc:2393] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate edd63b54133d4c8d9149d57a2886916b in current term 2: Already voted for candidate 66d3606ce30b4661b5d62d403d7abca0 in this term.
I20260709 13:10:38.816613 22974 tablet_bootstrap.cc:492] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:38.818563 22275 leader_election.cc:304] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:38.819314 22955 raft_consensus.cc:2804] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:38.819801 22955 raft_consensus.cc:697] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 LEADER]: Becoming Leader. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Running, Role: LEADER
I20260709 13:10:38.820621 22955 consensus_queue.cc:237] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.824797 22351 leader_election.cc:304] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:38.826858 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b501417270f5431da901577c6e5da05f" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:38.827651 22386 raft_consensus.cc:2393] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 66d3606ce30b4661b5d62d403d7abca0 in current term 2: Already voted for candidate edd63b54133d4c8d9149d57a2886916b in this term.
I20260709 13:10:38.828306 22836 raft_consensus.cc:2749] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.832427 22060 catalog_manager.cc:5697] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b reported cstate change: term changed from 2 to 3, leader changed from 5d515385609945e5837e85b77de385e2 (127.12.76.129) to edd63b54133d4c8d9149d57a2886916b (127.12.76.132). New cstate: current_term: 3 leader_uuid: "edd63b54133d4c8d9149d57a2886916b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.833926 22861 raft_consensus.cc:493] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.834444 22861 raft_consensus.cc:515] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.836582 22861 leader_election.cc:290] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:38.844707 22861 raft_consensus.cc:493] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.841847 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b501417270f5431da901577c6e5da05f" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:38.855263 22861 raft_consensus.cc:515] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.837965 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ced150f7b0b41c5a9a55795474c3eed" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:38.837608 22977 leader_election.cc:290] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
W20260709 13:10:38.856753 22275 leader_election.cc:343] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.857630 22275 leader_election.cc:304] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:38.852288 22974 tablet_bootstrap.cc:492] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:38.860272 22975 raft_consensus.cc:493] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.841028 23020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ced150f7b0b41c5a9a55795474c3eed" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:38.860615 23017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92f72a0e3ac48d480bb25e4f8f64c43" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:38.860803 22975 raft_consensus.cc:515] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.861518 23020 raft_consensus.cc:2468] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:38.860594 22974 tablet_bootstrap.cc:492] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
W20260709 13:10:38.862195 22201 leader_election.cc:343] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.849186 22940 raft_consensus.cc:493] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.863004 22201 leader_election.cc:304] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 
I20260709 13:10:38.863025 22974 ts_tablet_manager.cc:1403] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.000s
I20260709 13:10:38.868360 22979 raft_consensus.cc:2804] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:38.869251 22979 raft_consensus.cc:493] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.870890 22979 raft_consensus.cc:3060] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.863273 22975 leader_election.cc:290] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:38.872045 23064 raft_consensus.cc:2749] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.868813 22940 raft_consensus.cc:515] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.881232 22955 raft_consensus.cc:493] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.881933 23064 raft_consensus.cc:493] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.881901 22940 leader_election.cc:290] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:38.870750 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:38.857851 22861 leader_election.cc:290] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
W20260709 13:10:38.885499 22201 leader_election.cc:343] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.881896 22955 raft_consensus.cc:515] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.890154 22955 leader_election.cc:290] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:38.891587 23064 raft_consensus.cc:515] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.893631 23064 leader_election.cc:290] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:38.894102 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3c95d8e81a462283bc0799ade2104b" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:38.893729 22979 raft_consensus.cc:515] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.895040 22974 raft_consensus.cc:359] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:38.897127 23020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:38.897121 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92f72a0e3ac48d480bb25e4f8f64c43" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:38.897771 23065 raft_consensus.cc:493] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.898242 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3c95d8e81a462283bc0799ade2104b" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:38.898762 22309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:38.900662 23017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92f72a0e3ac48d480bb25e4f8f64c43" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
W20260709 13:10:38.904737 22275 leader_election.cc:343] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.904847 22306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ced150f7b0b41c5a9a55795474c3eed" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:38.905707 22309 raft_consensus.cc:2468] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 2.
I20260709 13:10:38.906522 23018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ced150f7b0b41c5a9a55795474c3eed" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:38.907083 22979 leader_election.cc:290] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:38.905221 22310 raft_consensus.cc:2468] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:38.906185 22236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:38.906708 22233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92f72a0e3ac48d480bb25e4f8f64c43" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:38.908233 22236 raft_consensus.cc:2468] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 2.
I20260709 13:10:38.908315 22233 raft_consensus.cc:2468] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 1.
I20260709 13:10:38.906334 23065 raft_consensus.cc:515] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.907254 23018 raft_consensus.cc:3060] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.905880 22058 catalog_manager.cc:5697] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 reported cstate change: term changed from 1 to 2, leader changed from 5d515385609945e5837e85b77de385e2 (127.12.76.129) to 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131). New cstate: current_term: 2 leader_uuid: "66d3606ce30b4661b5d62d403d7abca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.910202 22276 leader_election.cc:304] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: 5d515385609945e5837e85b77de385e2
W20260709 13:10:38.906375 22275 leader_election.cc:343] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.911557 22977 raft_consensus.cc:2804] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:38.911973 22977 raft_consensus.cc:493] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.912338 22977 raft_consensus.cc:3060] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.912715 22203 leader_election.cc:304] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:38.913822 22978 raft_consensus.cc:2804] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:38.914187 22978 raft_consensus.cc:493] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.914593 22978 raft_consensus.cc:3060] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.906675 22974 raft_consensus.cc:740] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.916865 22974 consensus_queue.cc:260] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:38.918220 23018 raft_consensus.cc:2468] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 2.
I20260709 13:10:38.919682 22201 leader_election.cc:304] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:38.918078 22061 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48528
I20260709 13:10:38.920290 22276 leader_election.cc:304] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:38.920742 22861 raft_consensus.cc:2804] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:38.921267 22861 raft_consensus.cc:697] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [term 2 LEADER]: Becoming Leader. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:38.921706 22974 ts_tablet_manager.cc:1434] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.058s	user 0.003s	sys 0.003s
I20260709 13:10:38.922600 22974 tablet_bootstrap.cc:492] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:38.922102 22861 consensus_queue.cc:237] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.925717 23051 heartbeater.cc:499] Master 127.12.76.190:33127 was elected leader, sending a full tablet report...
I20260709 13:10:38.926549 22203 leader_election.cc:304] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:38.928596 23017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4e00f55ac949c2a073e99cf9bc9290" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:38.911306 23065 leader_election.cc:290] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:38.930147 22836 raft_consensus.cc:493] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.930716 22836 raft_consensus.cc:515] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.931555 23066 raft_consensus.cc:2804] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:10:38.931705 22275 leader_election.cc:343] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.932008 23066 raft_consensus.cc:493] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.932394 22275 leader_election.cc:304] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b
I20260709 13:10:38.932811 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4e00f55ac949c2a073e99cf9bc9290" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:38.938277 22385 raft_consensus.cc:2468] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 1.
I20260709 13:10:38.938393 22975 raft_consensus.cc:2804] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:10:38.938683 22275 leader_election.cc:343] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.938860 22975 raft_consensus.cc:493] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.939278 22975 raft_consensus.cc:3060] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.939700 22275 leader_election.cc:304] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:38.941061 23067 raft_consensus.cc:2749] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:38.941712 23067 raft_consensus.cc:2804] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:38.942034 23067 raft_consensus.cc:493] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.942385 23067 raft_consensus.cc:3060] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.933458 22836 leader_election.cc:290] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:38.934542 23017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b3204b820c4446bb957d44063ecbe0" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:38.944840 23017 raft_consensus.cc:2393] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edd63b54133d4c8d9149d57a2886916b in current term 2: Already voted for candidate 66d3606ce30b4661b5d62d403d7abca0 in this term.
I20260709 13:10:38.932415 23066 raft_consensus.cc:3060] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.939060 22977 raft_consensus.cc:515] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.943588 22978 raft_consensus.cc:515] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.957801 23017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:38.955839 23067 raft_consensus.cc:515] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:38.963016 23067 leader_election.cc:290] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:38.964111 22975 raft_consensus.cc:515] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.955617 22306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b3204b820c4446bb957d44063ecbe0" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:38.966765 23018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92f72a0e3ac48d480bb25e4f8f64c43" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:38.966437 22058 catalog_manager.cc:5697] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 reported cstate change: term changed from 1 to 2, leader changed from 5d515385609945e5837e85b77de385e2 (127.12.76.129) to 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130). New cstate: current_term: 2 leader_uuid: "371d38ec3c7f493e9aea62dae121e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:38.968022 22201 leader_election.cc:343] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.973364 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4e00f55ac949c2a073e99cf9bc9290" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:38.974246 22385 raft_consensus.cc:3060] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.975826 23067 raft_consensus.cc:493] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:38.976394 23067 raft_consensus.cc:515] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.978425 23067 leader_election.cc:290] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:38.975824 23017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:38.980559 22351 leader_election.cc:304] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:38.981204 22233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f91956634f346fbaed9bc3d2785f528" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:38.981961 22232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:38.982765 22232 raft_consensus.cc:2393] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 66d3606ce30b4661b5d62d403d7abca0 in current term 3: Already voted for candidate 371d38ec3c7f493e9aea62dae121e565 in this term.
I20260709 13:10:38.983296 22836 raft_consensus.cc:3060] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:38.984452 22201 leader_election.cc:343] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.986649 22977 leader_election.cc:290] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 3 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
W20260709 13:10:38.986975 22275 leader_election.cc:343] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.987797 22276 leader_election.cc:304] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:38.988425 23017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f91956634f346fbaed9bc3d2785f528" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:38.988873 22977 raft_consensus.cc:2749] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:38.990293 22978 leader_election.cc:290] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 3 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
W20260709 13:10:38.991238 22275 leader_election.cc:343] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.992072 22275 leader_election.cc:304] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:38.993527 22977 raft_consensus.cc:2749] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.992080 22975 leader_election.cc:290] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:38.995590 23066 raft_consensus.cc:515] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:38.996248 22836 raft_consensus.cc:2749] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.973523 23018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4e00f55ac949c2a073e99cf9bc9290" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
W20260709 13:10:38.997812 22275 leader_election.cc:343] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.999101 22309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92f72a0e3ac48d480bb25e4f8f64c43" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:38.999341 22306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:38.999856 22309 raft_consensus.cc:2393] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 371d38ec3c7f493e9aea62dae121e565 in current term 2: Already voted for candidate 66d3606ce30b4661b5d62d403d7abca0 in this term.
I20260709 13:10:39.000752 22306 raft_consensus.cc:2393] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 371d38ec3c7f493e9aea62dae121e565 in current term 3: Already voted for candidate 66d3606ce30b4661b5d62d403d7abca0 in this term.
I20260709 13:10:39.004034 22927 raft_consensus.cc:493] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:39.004899 22927 raft_consensus.cc:515] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:39.005475 22385 raft_consensus.cc:2468] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 2.
I20260709 13:10:39.007261 23018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92f72a0e3ac48d480bb25e4f8f64c43" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:39.007859 23072 raft_consensus.cc:493] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:39.008396 23072 raft_consensus.cc:515] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
W20260709 13:10:39.009636 22275 leader_election.cc:343] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.010360 22306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28d9c95ac3d49219dc6a5d5739f6ead" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:39.010666 22275 leader_election.cc:304] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:39.011142 22203 leader_election.cc:304] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565; no voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:39.011606 23018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28d9c95ac3d49219dc6a5d5739f6ead" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:39.011976 22978 raft_consensus.cc:2749] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.012297 22203 leader_election.cc:304] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565; no voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:39.010459 23072 leader_election.cc:290] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
W20260709 13:10:39.012811 22349 leader_election.cc:343] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.013739 22977 raft_consensus.cc:2804] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.013530 22927 leader_election.cc:290] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:39.014330 22977 raft_consensus.cc:697] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 LEADER]: Becoming Leader. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Running, Role: LEADER
I20260709 13:10:39.016698 23017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f91956634f346fbaed9bc3d2785f528" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:39.037233 22977 consensus_queue.cc:237] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:39.017426 22978 raft_consensus.cc:2749] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:39.020861 22232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92f72a0e3ac48d480bb25e4f8f64c43" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:39.039994 22232 raft_consensus.cc:2393] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 66d3606ce30b4661b5d62d403d7abca0 in current term 2: Already voted for candidate 371d38ec3c7f493e9aea62dae121e565 in this term.
I20260709 13:10:39.021404 23072 raft_consensus.cc:493] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:39.040728 23072 raft_consensus.cc:515] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:39.042922 23072 leader_election.cc:290] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:39.025624 22974 tablet_bootstrap.cc:492] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.027447 22975 raft_consensus.cc:493] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:39.043818 22975 raft_consensus.cc:515] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:39.044373 22974 tablet_bootstrap.cc:492] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:39.045831 22975 leader_election.cc:290] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:39.045104 22974 ts_tablet_manager.cc:1403] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.123s	user 0.038s	sys 0.029s
I20260709 13:10:39.031742 23067 raft_consensus.cc:493] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:39.035233 23065 raft_consensus.cc:493] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:39.047659 23065 raft_consensus.cc:515] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:39.048966 22974 raft_consensus.cc:359] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:39.049665 22974 raft_consensus.cc:740] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.049723 23065 leader_election.cc:290] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:39.050498 22309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f0ec01ac814561a087cb72983b73de" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:39.051155 22309 raft_consensus.cc:2468] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:39.023574 22306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f91956634f346fbaed9bc3d2785f528" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
W20260709 13:10:39.037617 22201 leader_election.cc:343] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.046924 23067 raft_consensus.cc:515] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:39.051884 22306 raft_consensus.cc:2468] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:39.053565 23067 leader_election.cc:290] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:39.053614 22232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5f23465fe44a799f3521c814b38d55" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:39.018219 22351 leader_election.cc:304] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:39.054363 22232 raft_consensus.cc:2468] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 1.
I20260709 13:10:39.055364 22203 leader_election.cc:304] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:39.055708 23018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f0ec01ac814561a087cb72983b73de" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:39.056157 22838 raft_consensus.cc:2749] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.056536 22975 raft_consensus.cc:2804] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:39.055375 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5f23465fe44a799f3521c814b38d55" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
W20260709 13:10:39.057016 22201 leader_election.cc:343] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.057127 22975 raft_consensus.cc:493] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:39.057641 22975 raft_consensus.cc:3060] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.057977 22276 leader_election.cc:304] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:39.058784 22276 leader_election.cc:304] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:39.059458 23067 raft_consensus.cc:2749] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.059522 23064 raft_consensus.cc:2804] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:39.059989 23064 raft_consensus.cc:493] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:39.060375 23064 raft_consensus.cc:3060] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.059728 23017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4179392a8cb048c1982df1ea690bb4b9" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:39.060778 22232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b118b701f94b3bacbbca2df47fe5bd" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:39.061456 22232 raft_consensus.cc:2468] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 1.
W20260709 13:10:39.061898 22201 leader_election.cc:343] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.062083 22058 catalog_manager.cc:5697] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 reported cstate change: term changed from 1 to 2, leader changed from 5d515385609945e5837e85b77de385e2 (127.12.76.129) to 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131). New cstate: current_term: 2 leader_uuid: "66d3606ce30b4661b5d62d403d7abca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.050442 22974 consensus_queue.cc:260] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:39.062865 22276 leader_election.cc:304] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:39.063640 22977 raft_consensus.cc:2804] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:39.063742 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4179392a8cb048c1982df1ea690bb4b9" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:39.064029 22977 raft_consensus.cc:493] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:39.064380 22385 raft_consensus.cc:2468] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:39.064440 22977 raft_consensus.cc:3060] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.064829 22974 ts_tablet_manager.cc:1434] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:10:39.065623 22974 tablet_bootstrap.cc:492] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:39.065564 22201 leader_election.cc:304] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:39.071817 23072 raft_consensus.cc:2804] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:39.072219 23072 raft_consensus.cc:493] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:39.072584 23072 raft_consensus.cc:3060] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.004117 23066 leader_election.cc:290] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:39.076198 22977 raft_consensus.cc:515] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:39.078994 22977 leader_election.cc:290] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:39.079319 22233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b118b701f94b3bacbbca2df47fe5bd" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:39.081159 22233 raft_consensus.cc:3060] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.087929 22203 leader_election.cc:304] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:39.089380 22979 raft_consensus.cc:2804] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:39.089772 22979 raft_consensus.cc:493] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:39.090147 22979 raft_consensus.cc:3060] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.090022 23017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b118b701f94b3bacbbca2df47fe5bd" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:39.095566 23017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b118b701f94b3bacbbca2df47fe5bd" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:39.099216 22979 raft_consensus.cc:515] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
W20260709 13:10:39.102073 22275 leader_election.cc:343] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:39.103996 22275 leader_election.cc:343] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.106242 23064 raft_consensus.cc:515] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:39.107101 22977 raft_consensus.cc:493] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:39.108773 22977 raft_consensus.cc:515] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:39.110749 22977 leader_election.cc:290] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
W20260709 13:10:39.108192 22275 leader_election.cc:343] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.112037 22975 raft_consensus.cc:515] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:39.114707 23017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f0ec01ac814561a087cb72983b73de" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
W20260709 13:10:39.116029 22201 leader_election.cc:343] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.116780 22979 leader_election.cc:290] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:39.117651 23017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f91956634f346fbaed9bc3d2785f528" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
W20260709 13:10:39.118974 22201 leader_election.cc:343] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.119637 22977 raft_consensus.cc:493] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:39.130316 22977 raft_consensus.cc:515] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:39.131280 22836 raft_consensus.cc:493] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:39.131870 22836 raft_consensus.cc:515] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:39.132722 22977 leader_election.cc:290] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:39.133323 22232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ced150f7b0b41c5a9a55795474c3eed" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:39.133881 22836 leader_election.cc:290] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:39.124677 22233 raft_consensus.cc:2468] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 2.
I20260709 13:10:39.126106 22975 leader_election.cc:290] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:39.122161 23072 raft_consensus.cc:515] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:39.135546 23017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3c95d8e81a462283bc0799ade2104b" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:39.136420 22974 tablet_bootstrap.cc:492] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:10:39.136776 22349 leader_election.cc:343] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.136933 23072 leader_election.cc:290] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:39.137375 22974 tablet_bootstrap.cc:492] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:39.138072 22974 ts_tablet_manager.cc:1403] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.073s	user 0.017s	sys 0.033s
I20260709 13:10:39.140594 22974 raft_consensus.cc:359] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:39.141259 22974 raft_consensus.cc:740] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.140858 23064 leader_election.cc:290] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:39.143213 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28d9c95ac3d49219dc6a5d5739f6ead" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:39.141978 22974 consensus_queue.cc:260] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:39.143714 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ced150f7b0b41c5a9a55795474c3eed" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:39.143921 22385 raft_consensus.cc:2468] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 1.
I20260709 13:10:39.144508 23023 raft_consensus.cc:2393] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66d3606ce30b4661b5d62d403d7abca0 in current term 2: Already voted for candidate 371d38ec3c7f493e9aea62dae121e565 in this term.
I20260709 13:10:39.145082 23018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5f23465fe44a799f3521c814b38d55" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:39.146831 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f91956634f346fbaed9bc3d2785f528" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:39.147358 22310 raft_consensus.cc:3060] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.145256 22974 ts_tablet_manager.cc:1434] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:10:39.148371 22309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f0ec01ac814561a087cb72983b73de" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:39.148911 22309 raft_consensus.cc:3060] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.151021 22276 leader_election.cc:304] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:39.151324 22233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5f23465fe44a799f3521c814b38d55" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:39.151968 22233 raft_consensus.cc:3060] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.152033 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4179392a8cb048c1982df1ea690bb4b9" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:39.152210 22977 raft_consensus.cc:2804] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.143955 23017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28d9c95ac3d49219dc6a5d5739f6ead" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:39.152618 22385 raft_consensus.cc:3060] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.153061 23018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4179392a8cb048c1982df1ea690bb4b9" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:39.151132 22275 leader_election.cc:304] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:39.153772 22977 raft_consensus.cc:697] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [term 2 LEADER]: Becoming Leader. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Running, Role: LEADER
I20260709 13:10:39.155601 23064 raft_consensus.cc:2804] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:39.155376 22977 consensus_queue.cc:237] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:39.156026 23064 raft_consensus.cc:493] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:39.156450 23064 raft_consensus.cc:3060] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.158839 22306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3c95d8e81a462283bc0799ade2104b" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:39.159518 22306 raft_consensus.cc:2468] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 2.
W20260709 13:10:39.160729 22201 leader_election.cc:343] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.161355 22275 leader_election.cc:304] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:39.161645 22974 tablet_bootstrap.cc:492] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:39.165201 22310 raft_consensus.cc:2468] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 2.
I20260709 13:10:39.171844 23066 raft_consensus.cc:3060] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.175719 22233 raft_consensus.cc:2468] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 2.
I20260709 13:10:39.178227 23064 raft_consensus.cc:515] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
W20260709 13:10:39.172986 22275 leader_election.cc:343] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.180575 22276 leader_election.cc:304] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:39.181756 23067 raft_consensus.cc:2804] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.182397 23067 raft_consensus.cc:697] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 LEADER]: Becoming Leader. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Running, Role: LEADER
I20260709 13:10:39.179178 22309 raft_consensus.cc:2468] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 2.
I20260709 13:10:39.183523 23067 consensus_queue.cc:237] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:39.187781 23066 raft_consensus.cc:2749] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:39.188855 22275 leader_election.cc:343] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.190599 22351 leader_election.cc:304] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:39.191964 22927 raft_consensus.cc:2804] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:39.192425 22927 raft_consensus.cc:493] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:39.192898 22927 raft_consensus.cc:3060] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.201803 22927 raft_consensus.cc:515] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:39.206604 22385 raft_consensus.cc:2468] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 2.
I20260709 13:10:39.207829 22201 leader_election.cc:304] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:39.208822 22203 leader_election.cc:304] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:39.210057 22203 leader_election.cc:304] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:39.210793 22927 leader_election.cc:290] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 3 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:39.210908 22978 raft_consensus.cc:2804] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.211584 22978 raft_consensus.cc:697] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [term 2 LEADER]: Becoming Leader. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:39.212394 22978 consensus_queue.cc:237] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:39.212872 23018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3c95d8e81a462283bc0799ade2104b" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:39.213496 23072 raft_consensus.cc:2804] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.215428 23072 raft_consensus.cc:697] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [term 2 LEADER]: Becoming Leader. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:39.211033 22975 raft_consensus.cc:2804] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.217455 22975 raft_consensus.cc:697] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [term 2 LEADER]: Becoming Leader. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:39.217587 23072 consensus_queue.cc:237] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:39.218339 22975 consensus_queue.cc:237] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
W20260709 13:10:39.214522 22349 leader_election.cc:343] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.224962 23064 leader_election.cc:290] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:39.225021 22310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3c95d8e81a462283bc0799ade2104b" candidate_uuid: "edd63b54133d4c8d9149d57a2886916b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:39.226613 22310 raft_consensus.cc:3060] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.228238 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28d9c95ac3d49219dc6a5d5739f6ead" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:39.228799 22385 raft_consensus.cc:3060] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.230566 22233 raft_consensus.cc:1275] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 3 FOLLOWER]: Refusing update from remote peer edd63b54133d4c8d9149d57a2886916b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:39.232262 22838 consensus_queue.cc:1048] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.236666 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28d9c95ac3d49219dc6a5d5739f6ead" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
W20260709 13:10:39.239231 22275 leader_election.cc:343] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:39.244417 23023 raft_consensus.cc:1275] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Refusing update from remote peer 66d3606ce30b4661b5d62d403d7abca0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.249904 23066 consensus_queue.cc:1048] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.249207 22058 catalog_manager.cc:5697] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 reported cstate change: term changed from 1 to 2, leader changed from 5d515385609945e5837e85b77de385e2 (127.12.76.129) to 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131). New cstate: current_term: 2 leader_uuid: "66d3606ce30b4661b5d62d403d7abca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.250273 22310 raft_consensus.cc:2468] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd63b54133d4c8d9149d57a2886916b in term 3.
I20260709 13:10:39.263127 22974 tablet_bootstrap.cc:492] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.266315 22351 leader_election.cc:304] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:39.270752 22927 raft_consensus.cc:2804] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:39.271255 22927 raft_consensus.cc:697] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 3 LEADER]: Becoming Leader. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:39.272208 22927 consensus_queue.cc:237] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:39.277225 22380 raft_consensus.cc:1275] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Refusing update from remote peer 66d3606ce30b4661b5d62d403d7abca0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.282351 22385 raft_consensus.cc:2468] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 2.
I20260709 13:10:39.283142 22974 tablet_bootstrap.cc:492] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:39.285928 22974 ts_tablet_manager.cc:1403] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.124s	user 0.019s	sys 0.000s
I20260709 13:10:39.301347 22060 catalog_manager.cc:5697] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b reported cstate change: term changed from 2 to 3, leader changed from 5d515385609945e5837e85b77de385e2 (127.12.76.129) to edd63b54133d4c8d9149d57a2886916b (127.12.76.132). New cstate: current_term: 3 leader_uuid: "edd63b54133d4c8d9149d57a2886916b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.302604 23066 consensus_queue.cc:1048] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:39.312990 22061 catalog_manager.cc:5697] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 reported cstate change: term changed from 1 to 2, leader changed from 5d515385609945e5837e85b77de385e2 (127.12.76.129) to 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130). New cstate: current_term: 2 leader_uuid: "371d38ec3c7f493e9aea62dae121e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.314992 22061 catalog_manager.cc:5697] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 reported cstate change: term changed from 1 to 2, leader changed from 5d515385609945e5837e85b77de385e2 (127.12.76.129) to 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130). New cstate: current_term: 2 leader_uuid: "371d38ec3c7f493e9aea62dae121e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.317692 23018 raft_consensus.cc:1275] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Refusing update from remote peer 371d38ec3c7f493e9aea62dae121e565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.319240 22975 consensus_queue.cc:1048] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.319518 22061 catalog_manager.cc:5697] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 reported cstate change: term changed from 1 to 2, leader changed from 5d515385609945e5837e85b77de385e2 (127.12.76.129) to 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130). New cstate: current_term: 2 leader_uuid: "371d38ec3c7f493e9aea62dae121e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.322350 23018 raft_consensus.cc:1275] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Refusing update from remote peer edd63b54133d4c8d9149d57a2886916b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:39.324137 22838 consensus_queue.cc:1048] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.301168 22275 leader_election.cc:304] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2
I20260709 13:10:39.352221 23064 raft_consensus.cc:2804] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.352811 23064 raft_consensus.cc:697] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [term 2 LEADER]: Becoming Leader. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Running, Role: LEADER
I20260709 13:10:39.353663 23064 consensus_queue.cc:237] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:39.355968 22061 catalog_manager.cc:5697] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 reported cstate change: term changed from 1 to 2, leader changed from 5d515385609945e5837e85b77de385e2 (127.12.76.129) to 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131). New cstate: current_term: 2 leader_uuid: "66d3606ce30b4661b5d62d403d7abca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:39.348527 22275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.76.132:45017, user_credentials={real_user=slave}} blocked reactor thread for 47473.2us
I20260709 13:10:39.306099 22974 raft_consensus.cc:359] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:39.379565 22974 raft_consensus.cc:740] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.380399 22974 consensus_queue.cc:260] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:39.382824 22974 ts_tablet_manager.cc:1434] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.092s	user 0.002s	sys 0.004s
I20260709 13:10:39.383661 22974 tablet_bootstrap.cc:492] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:39.393610 22306 raft_consensus.cc:1275] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Refusing update from remote peer 371d38ec3c7f493e9aea62dae121e565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.394929 23085 consensus_queue.cc:1048] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.402062 22061 catalog_manager.cc:5697] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 reported cstate change: term changed from 1 to 2, leader changed from 5d515385609945e5837e85b77de385e2 (127.12.76.129) to 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131). New cstate: current_term: 2 leader_uuid: "66d3606ce30b4661b5d62d403d7abca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:39.508404 22203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:46871, user_credentials={real_user=slave}} blocked reactor thread for 98698.2us
I20260709 13:10:39.512764 22974 tablet_bootstrap.cc:492] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.513757 22974 tablet_bootstrap.cc:492] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:39.514400 22974 ts_tablet_manager.cc:1403] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.131s	user 0.017s	sys 0.001s
I20260709 13:10:39.516881 22974 raft_consensus.cc:359] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:39.517509 22974 raft_consensus.cc:740] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.519681 22974 consensus_queue.cc:260] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:39.522497 22974 ts_tablet_manager.cc:1434] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:39.523315 22974 tablet_bootstrap.cc:492] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
W20260709 13:10:39.534073 22275 consensus_peers.cc:597] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:39.551857 22974 tablet_bootstrap.cc:492] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.552788 22974 tablet_bootstrap.cc:492] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:39.553632 22974 ts_tablet_manager.cc:1403] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.008s
I20260709 13:10:39.556268 22974 raft_consensus.cc:359] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:39.556926 22974 raft_consensus.cc:740] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.558218 22974 consensus_queue.cc:260] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:39.560315 22974 ts_tablet_manager.cc:1434] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:39.563637 22974 tablet_bootstrap.cc:492] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:39.582046 22974 tablet_bootstrap.cc:492] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.582953 22974 tablet_bootstrap.cc:492] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:39.583600 22974 ts_tablet_manager.cc:1403] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:10:39.586006 22974 raft_consensus.cc:359] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:39.586694 22974 raft_consensus.cc:740] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.587333 22974 consensus_queue.cc:260] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:39.589376 22974 ts_tablet_manager.cc:1434] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:39.590356 22974 tablet_bootstrap.cc:492] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
W20260709 13:10:39.601027 22275 consensus_peers.cc:597] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:39.603700 22974 tablet_bootstrap.cc:492] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.604622 22974 tablet_bootstrap.cc:492] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:39.605234 22974 ts_tablet_manager.cc:1403] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.007s
I20260709 13:10:39.606393 22385 raft_consensus.cc:1275] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Refusing update from remote peer 371d38ec3c7f493e9aea62dae121e565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.607676 22974 raft_consensus.cc:359] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:39.608068 22861 consensus_queue.cc:1048] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.608425 22974 raft_consensus.cc:740] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.609112 22974 consensus_queue.cc:260] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:39.611313 22974 ts_tablet_manager.cc:1434] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:39.612592 22974 tablet_bootstrap.cc:492] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:39.628078 22309 raft_consensus.cc:1275] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Refusing update from remote peer 371d38ec3c7f493e9aea62dae121e565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.630841 22978 consensus_queue.cc:1048] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:39.648346 22201 consensus_peers.cc:597] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:39.648808 22974 tablet_bootstrap.cc:492] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.648792 22385 raft_consensus.cc:1275] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Refusing update from remote peer 66d3606ce30b4661b5d62d403d7abca0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.649919 22974 tablet_bootstrap.cc:492] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:39.650442 23064 consensus_queue.cc:1048] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.652140 22974 ts_tablet_manager.cc:1403] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.004s
I20260709 13:10:39.655507 22974 raft_consensus.cc:359] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:39.656297 22974 raft_consensus.cc:740] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.657815 22974 consensus_queue.cc:260] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:39.659508 22974 ts_tablet_manager.cc:1434] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:39.660369 22974 tablet_bootstrap.cc:492] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:39.660614 23017 raft_consensus.cc:3060] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:39.696777 22201 consensus_peers.cc:597] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:39.704248 22306 raft_consensus.cc:1275] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Refusing update from remote peer 371d38ec3c7f493e9aea62dae121e565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.704758 22974 tablet_bootstrap.cc:492] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.705672 22974 tablet_bootstrap.cc:492] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:39.705936 22978 consensus_queue.cc:1048] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.706287 22974 ts_tablet_manager.cc:1403] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.012s
I20260709 13:10:39.709046 22974 raft_consensus.cc:359] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:39.709753 22974 raft_consensus.cc:740] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.710412 23017 raft_consensus.cc:1275] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Refusing update from remote peer 371d38ec3c7f493e9aea62dae121e565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.710584 22974 consensus_queue.cc:260] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:39.713419 22974 ts_tablet_manager.cc:1434] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:39.714541 22974 tablet_bootstrap.cc:492] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:39.715962 22861 consensus_queue.cc:1048] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.722174 22232 raft_consensus.cc:1275] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Refusing update from remote peer 66d3606ce30b4661b5d62d403d7abca0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.725522 23064 consensus_queue.cc:1048] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.742795 23020 raft_consensus.cc:3060] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.745048 22385 raft_consensus.cc:1275] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Refusing update from remote peer 66d3606ce30b4661b5d62d403d7abca0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.748935 22233 raft_consensus.cc:1275] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Refusing update from remote peer 66d3606ce30b4661b5d62d403d7abca0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.749917 23067 consensus_queue.cc:1048] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.755892 22940 consensus_queue.cc:1048] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.766566 22974 tablet_bootstrap.cc:492] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.767551 22974 tablet_bootstrap.cc:492] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:39.768537 22974 ts_tablet_manager.cc:1403] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.002s
I20260709 13:10:39.772130 23020 raft_consensus.cc:1275] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Refusing update from remote peer 66d3606ce30b4661b5d62d403d7abca0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.771003 22974 raft_consensus.cc:359] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:39.774353 22974 raft_consensus.cc:740] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.775043 22974 consensus_queue.cc:260] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:39.776319 22977 consensus_queue.cc:1048] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.786634 22974 ts_tablet_manager.cc:1434] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:10:39.788587 22974 tablet_bootstrap.cc:492] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
W20260709 13:10:39.789108 22275 consensus_peers.cc:597] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:39.828809 22974 tablet_bootstrap.cc:492] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.829859 22974 tablet_bootstrap.cc:492] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:39.830497 22974 ts_tablet_manager.cc:1403] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.009s
I20260709 13:10:39.832883 22974 raft_consensus.cc:359] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:39.833535 22974 raft_consensus.cc:740] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.834156 22974 consensus_queue.cc:260] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:39.836370 22974 ts_tablet_manager.cc:1434] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:10:39.837128 22974 tablet_bootstrap.cc:492] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
W20260709 13:10:39.839486 22349 consensus_peers.cc:597] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:39.840197 22349 consensus_peers.cc:597] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:39.860357 22974 tablet_bootstrap.cc:492] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.861392 22974 tablet_bootstrap.cc:492] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:39.862375 22974 ts_tablet_manager.cc:1403] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.012s
I20260709 13:10:39.864799 22309 raft_consensus.cc:1275] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Refusing update from remote peer edd63b54133d4c8d9149d57a2886916b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:39.866034 23100 consensus_queue.cc:1048] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.866124 22974 raft_consensus.cc:359] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:39.866698 22974 raft_consensus.cc:740] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.867249 22974 consensus_queue.cc:260] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:39.879047 22974 ts_tablet_manager.cc:1434] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:10:39.881825 22974 tablet_bootstrap.cc:492] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:39.919472 22974 tablet_bootstrap.cc:492] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.920228 22974 tablet_bootstrap.cc:492] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:39.920843 22974 ts_tablet_manager.cc:1403] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.003s
I20260709 13:10:39.923270 22974 raft_consensus.cc:359] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:39.923957 22974 raft_consensus.cc:740] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.924606 22974 consensus_queue.cc:260] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:39.926028 22974 ts_tablet_manager.cc:1434] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:39.926962 22974 tablet_bootstrap.cc:492] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:39.952169 22974 tablet_bootstrap.cc:492] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.953059 22974 tablet_bootstrap.cc:492] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:39.954269 22974 ts_tablet_manager.cc:1403] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.007s
I20260709 13:10:39.956288 22974 raft_consensus.cc:359] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:39.957154 22974 raft_consensus.cc:740] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.957789 22974 consensus_queue.cc:260] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:39.960011 22974 ts_tablet_manager.cc:1434] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:10:39.960851 22974 tablet_bootstrap.cc:492] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:39.972589 22974 tablet_bootstrap.cc:492] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.973376 22974 tablet_bootstrap.cc:492] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:39.973973 22974 ts_tablet_manager.cc:1403] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:10:39.976316 22974 raft_consensus.cc:359] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:39.977130 22974 raft_consensus.cc:740] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.977851 22974 consensus_queue.cc:260] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:39.980191 22974 ts_tablet_manager.cc:1434] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:10:39.981125 22974 tablet_bootstrap.cc:492] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:39.994244 22974 tablet_bootstrap.cc:492] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.995187 22974 tablet_bootstrap.cc:492] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:39.995826 22974 ts_tablet_manager.cc:1403] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:10:39.998291 22974 raft_consensus.cc:359] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:39.998809 22974 raft_consensus.cc:740] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:39.999395 22974 consensus_queue.cc:260] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:40.001000 22974 ts_tablet_manager.cc:1434] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:10:40.001982 22974 tablet_bootstrap.cc:492] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:40.017094 22974 tablet_bootstrap.cc:492] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:40.018184 22974 tablet_bootstrap.cc:492] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:40.018843 22974 ts_tablet_manager.cc:1403] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:10:40.021786 22974 raft_consensus.cc:359] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:40.022457 22974 raft_consensus.cc:740] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.023029 22974 consensus_queue.cc:260] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:40.024983 22974 ts_tablet_manager.cc:1434] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:10:40.026189 22974 tablet_bootstrap.cc:492] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:40.040220 22974 tablet_bootstrap.cc:492] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:40.041275 22974 tablet_bootstrap.cc:492] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:40.042025 22974 ts_tablet_manager.cc:1403] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:10:40.045217 22974 raft_consensus.cc:359] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:40.046039 22974 raft_consensus.cc:740] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.046593 22974 consensus_queue.cc:260] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:40.048121 22974 ts_tablet_manager.cc:1434] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:10:40.049517 22974 tablet_bootstrap.cc:492] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:40.067294 22974 tablet_bootstrap.cc:492] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:40.068235 22974 tablet_bootstrap.cc:492] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:40.068885 22974 ts_tablet_manager.cc:1403] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:10:40.071126 22974 raft_consensus.cc:359] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:40.071703 22974 raft_consensus.cc:740] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.072255 22974 consensus_queue.cc:260] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:40.073982 22974 ts_tablet_manager.cc:1434] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:40.075356 22974 tablet_bootstrap.cc:492] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:40.092437 22974 tablet_bootstrap.cc:492] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:40.093243 22974 tablet_bootstrap.cc:492] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:40.093852 22974 ts_tablet_manager.cc:1403] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.002s
I20260709 13:10:40.096717 22974 raft_consensus.cc:359] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:40.097399 22974 raft_consensus.cc:740] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.098057 22974 consensus_queue.cc:260] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:40.100207 22974 ts_tablet_manager.cc:1434] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:10:40.101073 23020 raft_consensus.cc:3060] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:40.101513 22974 tablet_bootstrap.cc:492] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:40.131325 22974 tablet_bootstrap.cc:492] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:40.132611 22974 tablet_bootstrap.cc:492] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:40.133317 22974 ts_tablet_manager.cc:1403] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.008s
I20260709 13:10:40.135972 22974 raft_consensus.cc:359] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:40.136685 22974 raft_consensus.cc:740] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.137430 22974 consensus_queue.cc:260] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:40.139549 22974 ts_tablet_manager.cc:1434] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:40.140599 22974 tablet_bootstrap.cc:492] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:40.166903 22974 tablet_bootstrap.cc:492] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:40.167831 22974 tablet_bootstrap.cc:492] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:40.168457 22974 ts_tablet_manager.cc:1403] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.011s
I20260709 13:10:40.170816 22974 raft_consensus.cc:359] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:40.171332 22974 raft_consensus.cc:740] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.171909 22974 consensus_queue.cc:260] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:40.173930 22974 ts_tablet_manager.cc:1434] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:40.175698 22974 tablet_bootstrap.cc:492] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:40.181596 23020 raft_consensus.cc:3060] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:40.192137 22974 tablet_bootstrap.cc:492] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:40.193070 22974 tablet_bootstrap.cc:492] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:40.193743 22974 ts_tablet_manager.cc:1403] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.001s
I20260709 13:10:40.196187 22974 raft_consensus.cc:359] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:40.196831 22974 raft_consensus.cc:740] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.197520 22974 consensus_queue.cc:260] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:40.198968 22974 ts_tablet_manager.cc:1434] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:40.199731 22974 tablet_bootstrap.cc:492] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
W20260709 13:10:40.205605 22349 consensus_peers.cc:597] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:40.210595 22275 consensus_peers.cc:597] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:40.220055 22201 consensus_peers.cc:597] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:40.222441 23017 raft_consensus.cc:3060] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:40.220268 22974 tablet_bootstrap.cc:492] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:40.223593 22974 tablet_bootstrap.cc:492] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:40.224889 23023 raft_consensus.cc:3060] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:40.236269 22977 raft_consensus.cc:493] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.236856 22977 raft_consensus.cc:515] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:40.241765 23020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535cc40e1cc04f16a78d6fbd34a69f3f" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:40.242451 23020 raft_consensus.cc:2468] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 1.
I20260709 13:10:40.242795 22974 ts_tablet_manager.cc:1403] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.008s
I20260709 13:10:40.243760 22275 leader_election.cc:304] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:40.244498 22940 raft_consensus.cc:2804] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:40.244889 22940 raft_consensus.cc:493] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.245217 22940 raft_consensus.cc:3060] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.245471 22974 raft_consensus.cc:359] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:40.246189 22974 raft_consensus.cc:740] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.246860 22974 consensus_queue.cc:260] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:40.250249 22977 leader_election.cc:290] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:40.251129 22974 ts_tablet_manager.cc:1434] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:10:40.252054 22974 tablet_bootstrap.cc:492] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:40.252406 22233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535cc40e1cc04f16a78d6fbd34a69f3f" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:40.253082 22233 raft_consensus.cc:2468] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 2.
I20260709 13:10:40.254624 22940 raft_consensus.cc:515] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:40.265065 22940 leader_election.cc:290] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 3 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:40.271286 22233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535cc40e1cc04f16a78d6fbd34a69f3f" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:40.271961 22233 raft_consensus.cc:3060] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.273538 23020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535cc40e1cc04f16a78d6fbd34a69f3f" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:40.274194 23020 raft_consensus.cc:3060] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.279575 22233 raft_consensus.cc:2468] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 3.
I20260709 13:10:40.282137 22276 leader_election.cc:304] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:40.282943 23067 raft_consensus.cc:2804] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:40.283497 23067 raft_consensus.cc:697] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 3 LEADER]: Becoming Leader. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Running, Role: LEADER
I20260709 13:10:40.284484 23067 consensus_queue.cc:237] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:40.293157 23020 raft_consensus.cc:2468] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 3.
I20260709 13:10:40.296504 22974 tablet_bootstrap.cc:492] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:40.297516 22974 tablet_bootstrap.cc:492] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:40.298148 22974 ts_tablet_manager.cc:1403] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.007s
I20260709 13:10:40.300987 22974 raft_consensus.cc:359] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:40.301703 22974 raft_consensus.cc:740] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.302434 22974 consensus_queue.cc:260] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:40.304807 22974 ts_tablet_manager.cc:1434] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:10:40.308291 22974 tablet_bootstrap.cc:492] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:40.312112 22057 catalog_manager.cc:5697] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 reported cstate change: term changed from 1 to 3, leader changed from 5d515385609945e5837e85b77de385e2 (127.12.76.129) to 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131). New cstate: current_term: 3 leader_uuid: "66d3606ce30b4661b5d62d403d7abca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.328203 22974 tablet_bootstrap.cc:492] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:40.329161 22974 tablet_bootstrap.cc:492] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:40.329787 22974 ts_tablet_manager.cc:1403] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.000s
I20260709 13:10:40.332446 22974 raft_consensus.cc:359] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:40.333071 22974 raft_consensus.cc:740] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.333663 22974 consensus_queue.cc:260] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:40.335599 22974 ts_tablet_manager.cc:1434] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:10:40.336882 22974 tablet_bootstrap.cc:492] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:40.350409 22974 tablet_bootstrap.cc:492] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:40.351330 22974 tablet_bootstrap.cc:492] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:40.352022 22974 ts_tablet_manager.cc:1403] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.003s
I20260709 13:10:40.354504 22974 raft_consensus.cc:359] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:40.355183 22974 raft_consensus.cc:740] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.355808 22974 consensus_queue.cc:260] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:40.357364 22974 ts_tablet_manager.cc:1434] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:40.358146 22974 tablet_bootstrap.cc:492] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2: Bootstrap starting.
I20260709 13:10:40.373306 22974 tablet_bootstrap.cc:492] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:40.374210 22974 tablet_bootstrap.cc:492] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2: Bootstrap complete.
I20260709 13:10:40.374878 22974 ts_tablet_manager.cc:1403] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 13:10:40.377645 22974 raft_consensus.cc:359] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:40.378386 22974 raft_consensus.cc:740] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d515385609945e5837e85b77de385e2, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.379153 22974 consensus_queue.cc:260] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:40.381371 22974 ts_tablet_manager.cc:1434] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2: Time spent starting tablet: real 0.006s	user 0.009s	sys 0.000s
I20260709 13:10:40.393285 23020 raft_consensus.cc:3060] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.563446 23064 raft_consensus.cc:493] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.563982 23064 raft_consensus.cc:515] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:40.566756 23064 leader_election.cc:290] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:40.566854 23020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:40.566964 22233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565" is_pre_election: true
I20260709 13:10:40.567828 23020 raft_consensus.cc:2468] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 2.
I20260709 13:10:40.567881 22233 raft_consensus.cc:2468] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 3.
I20260709 13:10:40.568928 22275 leader_election.cc:304] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:40.569625 23064 raft_consensus.cc:2804] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:40.570441 23064 raft_consensus.cc:493] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.570789 23064 raft_consensus.cc:3060] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.572182 23081 raft_consensus.cc:493] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.572865 23081 raft_consensus.cc:515] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:40.575163 23081 leader_election.cc:290] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:40.576921 23023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92f72a0e3ac48d480bb25e4f8f64c43" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:40.577700 23023 raft_consensus.cc:2468] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 1.
I20260709 13:10:40.579130 22306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92f72a0e3ac48d480bb25e4f8f64c43" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0" is_pre_election: true
I20260709 13:10:40.579841 22306 raft_consensus.cc:2468] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 2.
I20260709 13:10:40.580327 23064 raft_consensus.cc:515] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:40.580731 22201 leader_election.cc:304] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 
I20260709 13:10:40.582924 23064 leader_election.cc:290] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 4 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:40.583062 23081 raft_consensus.cc:2804] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:40.583571 23081 raft_consensus.cc:493] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.584798 23081 raft_consensus.cc:3060] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.590700 23020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:40.591370 23020 raft_consensus.cc:3060] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.593487 23081 raft_consensus.cc:515] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:40.596267 23081 leader_election.cc:290] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 3 election: Requested vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:40.597301 22233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2434ada128f843908123ae8965e66222" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:40.597944 22233 raft_consensus.cc:3060] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.604903 22306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92f72a0e3ac48d480bb25e4f8f64c43" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:40.605645 22306 raft_consensus.cc:3060] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.607682 23020 raft_consensus.cc:2468] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 4.
I20260709 13:10:40.609318 22275 leader_election.cc:304] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:40.610172 22940 raft_consensus.cc:2804] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:40.610649 22940 raft_consensus.cc:697] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 4 LEADER]: Becoming Leader. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Running, Role: LEADER
I20260709 13:10:40.611459 22940 consensus_queue.cc:237] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:40.612000 22233 raft_consensus.cc:2468] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 4.
I20260709 13:10:40.624449 23017 raft_consensus.cc:3060] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:40.630475 22061 catalog_manager.cc:5697] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 reported cstate change: term changed from 2 to 4, leader changed from 5d515385609945e5837e85b77de385e2 (127.12.76.129) to 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131). New cstate: current_term: 4 leader_uuid: "66d3606ce30b4661b5d62d403d7abca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.632686 23020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92f72a0e3ac48d480bb25e4f8f64c43" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:40.633613 23020 raft_consensus.cc:3060] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.656176 23020 raft_consensus.cc:2468] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 3.
I20260709 13:10:40.664844 22306 raft_consensus.cc:2468] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 3.
I20260709 13:10:40.665902 22201 leader_election.cc:304] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 
I20260709 13:10:40.667016 23150 raft_consensus.cc:2804] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:40.668671 23150 raft_consensus.cc:697] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 3 LEADER]: Becoming Leader. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:40.670570 23150 consensus_queue.cc:237] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:40.696569 22057 catalog_manager.cc:5697] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 reported cstate change: term changed from 1 to 3, leader changed from 5d515385609945e5837e85b77de385e2 (127.12.76.129) to 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130). New cstate: current_term: 3 leader_uuid: "371d38ec3c7f493e9aea62dae121e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:40.713122 23017 raft_consensus.cc:1275] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Refusing update from remote peer 66d3606ce30b4661b5d62d403d7abca0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:40.714589 23067 consensus_queue.cc:1048] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:40.726208 22233 raft_consensus.cc:1275] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [term 3 FOLLOWER]: Refusing update from remote peer 66d3606ce30b4661b5d62d403d7abca0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:40.729435 22940 consensus_queue.cc:1048] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:40.734961 22940 raft_consensus.cc:493] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.735513 22940 raft_consensus.cc:515] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:40.737787 22940 leader_election.cc:290] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:40.738315 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b501417270f5431da901577c6e5da05f" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b" is_pre_election: true
I20260709 13:10:40.738756 23020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b501417270f5431da901577c6e5da05f" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2" is_pre_election: true
I20260709 13:10:40.738977 22385 raft_consensus.cc:2468] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 2.
I20260709 13:10:40.739539 23020 raft_consensus.cc:2468] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 1.
I20260709 13:10:40.740437 22275 leader_election.cc:304] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66d3606ce30b4661b5d62d403d7abca0, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:40.741128 22940 raft_consensus.cc:2804] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:40.741567 22940 raft_consensus.cc:493] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.742014 22940 raft_consensus.cc:3060] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.751147 22940 raft_consensus.cc:515] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:40.753472 22940 leader_election.cc:290] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 3 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:40.754472 23020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b501417270f5431da901577c6e5da05f" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d515385609945e5837e85b77de385e2"
I20260709 13:10:40.755201 23020 raft_consensus.cc:3060] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.756145 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b501417270f5431da901577c6e5da05f" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:40.756690 22385 raft_consensus.cc:3060] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.763368 22385 raft_consensus.cc:2468] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 3.
I20260709 13:10:40.765451 23020 raft_consensus.cc:2468] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 3.
I20260709 13:10:40.768570 22275 leader_election.cc:304] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:40.769320 22940 raft_consensus.cc:2804] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:40.769841 22940 raft_consensus.cc:697] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 3 LEADER]: Becoming Leader. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Running, Role: LEADER
I20260709 13:10:40.771854 22940 consensus_queue.cc:237] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:40.782963 22057 catalog_manager.cc:5697] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 reported cstate change: term changed from 1 to 3, leader changed from 5d515385609945e5837e85b77de385e2 (127.12.76.129) to 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131). New cstate: current_term: 3 leader_uuid: "66d3606ce30b4661b5d62d403d7abca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:41.125442 23020 raft_consensus.cc:1275] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 4 FOLLOWER]: Refusing update from remote peer 66d3606ce30b4661b5d62d403d7abca0: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:10:41.126601 23064 consensus_queue.cc:1048] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:41.130378 23023 raft_consensus.cc:1275] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Refusing update from remote peer 371d38ec3c7f493e9aea62dae121e565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:41.131773 23072 consensus_queue.cc:1048] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:41.135699 22233 raft_consensus.cc:1275] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 4 FOLLOWER]: Refusing update from remote peer 66d3606ce30b4661b5d62d403d7abca0: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:10:41.141701 22940 consensus_queue.cc:1048] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:41.146492 22310 raft_consensus.cc:1275] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Refusing update from remote peer 371d38ec3c7f493e9aea62dae121e565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:41.149025 23150 consensus_queue.cc:1048] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:41.156289 22385 raft_consensus.cc:1275] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [term 3 FOLLOWER]: Refusing update from remote peer 66d3606ce30b4661b5d62d403d7abca0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:41.168021 23067 consensus_queue.cc:1048] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:41.183792 23023 raft_consensus.cc:1275] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Refusing update from remote peer 66d3606ce30b4661b5d62d403d7abca0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:41.186981 22940 consensus_queue.cc:1048] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:46.054171 22276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:43835, user_credentials={real_user=slave}} blocked reactor thread for 45907us
I20260709 13:10:48.563669 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:48.622738 22232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4179392a8cb048c1982df1ea690bb4b9"
dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
mode: GRACEFUL
new_leader_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:34972
I20260709 13:10:48.624241 22232 raft_consensus.cc:606] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [term 2 LEADER]: Received request to transfer leadership to TS 5d515385609945e5837e85b77de385e2
I20260709 13:10:48.636683 22386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45d6ad58386642cd897d5378d8b9bc58"
dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
mode: GRACEFUL
new_leader_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:38488
I20260709 13:10:48.637130 22386 raft_consensus.cc:606] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Received request to transfer leadership to TS 5d515385609945e5837e85b77de385e2
I20260709 13:10:48.639755 22233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63af5dcbd69043a6a704a5fdedd3d371"
dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
mode: GRACEFUL
new_leader_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:34972
I20260709 13:10:48.640232 22233 raft_consensus.cc:606] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Received request to transfer leadership to TS 5d515385609945e5837e85b77de385e2
I20260709 13:10:48.652281 22306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69ff2881b0ad428984068a6150870c61"
dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
mode: GRACEFUL
new_leader_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:38288
I20260709 13:10:48.652776 22306 raft_consensus.cc:606] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 LEADER]: Received request to transfer leadership to TS 5d515385609945e5837e85b77de385e2
I20260709 13:10:48.655257 22233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97e1c9af3eb64e7dbff4f9df54341806"
dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
mode: GRACEFUL
new_leader_uuid: "66d3606ce30b4661b5d62d403d7abca0"
 from {username='slave'} at 127.0.0.1:34972
I20260709 13:10:48.655857 22233 raft_consensus.cc:606] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Received request to transfer leadership to TS 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:48.657964 22233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dee9596873a4f1da4230b8f9b4467fc"
dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
mode: GRACEFUL
new_leader_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:34972
I20260709 13:10:48.658360 22233 raft_consensus.cc:606] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Received request to transfer leadership to TS 5d515385609945e5837e85b77de385e2
I20260709 13:10:48.660550 22233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2c563b0b9ff42638139dc08d9fd2e23"
dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
mode: GRACEFUL
new_leader_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:34972
I20260709 13:10:48.661082 22233 raft_consensus.cc:606] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Received request to transfer leadership to TS 5d515385609945e5837e85b77de385e2
I20260709 13:10:48.662220 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:10:48.663734 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:48.678140 23184 raft_consensus.cc:993] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565: : Instructing follower 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:48.678782 23184 raft_consensus.cc:1081] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Signalling peer 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:48.680616 23017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2c563b0b9ff42638139dc08d9fd2e23"
dest_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:45468
I20260709 13:10:48.681239 23017 raft_consensus.cc:493] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:48.681742 23017 raft_consensus.cc:3060] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.688536 23017 raft_consensus.cc:515] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:48.695215 23017 leader_election.cc:290] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:48.702826 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c563b0b9ff42638139dc08d9fd2e23" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:48.703639 22386 raft_consensus.cc:3060] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.706177 22233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c563b0b9ff42638139dc08d9fd2e23" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:48.706707 22233 raft_consensus.cc:3055] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:48.706895 22233 raft_consensus.cc:740] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:48.707789 22233 consensus_queue.cc:260] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:48.708806 22233 raft_consensus.cc:3060] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.709857 22386 raft_consensus.cc:2468] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
I20260709 13:10:48.711103 22968 leader_election.cc:304] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:48.713096 23193 raft_consensus.cc:2804] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:48.714233 23193 raft_consensus.cc:697] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:48.714510 22233 raft_consensus.cc:2468] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
I20260709 13:10:48.715546 23193 consensus_queue.cc:237] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:48.728550 22060 catalog_manager.cc:5697] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 1 to 2, leader changed from 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130) to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:48.744827 23186 raft_consensus.cc:993] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565: : Instructing follower 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:48.745301 23184 raft_consensus.cc:1081] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Signalling peer 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:48.746637 23017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63af5dcbd69043a6a704a5fdedd3d371"
dest_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:45468
I20260709 13:10:48.747007 23017 raft_consensus.cc:493] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:48.747215 23017 raft_consensus.cc:3060] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.752038 23017 raft_consensus.cc:515] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:48.754288 23017 leader_election.cc:290] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:48.754873 22233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63af5dcbd69043a6a704a5fdedd3d371" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:48.755044 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63af5dcbd69043a6a704a5fdedd3d371" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:48.755635 22233 raft_consensus.cc:3055] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:48.755700 22386 raft_consensus.cc:3060] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.755947 22233 raft_consensus.cc:740] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:48.756779 22233 consensus_queue.cc:260] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:48.757725 22233 raft_consensus.cc:3060] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.761439 22386 raft_consensus.cc:2468] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
I20260709 13:10:48.762418 22968 leader_election.cc:304] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:48.763106 23193 raft_consensus.cc:2804] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:48.763342 22233 raft_consensus.cc:2468] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
I20260709 13:10:48.763522 23193 raft_consensus.cc:697] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:48.764599 23193 consensus_queue.cc:237] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:48.777981 22060 catalog_manager.cc:5697] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 1 to 2, leader changed from 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130) to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:48.818662 23174 raft_consensus.cc:993] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0: : Instructing follower 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:48.819314 23172 raft_consensus.cc:1081] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 LEADER]: Signalling peer 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:48.821019 23017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69ff2881b0ad428984068a6150870c61"
dest_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:45482
I20260709 13:10:48.821527 23017 raft_consensus.cc:493] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:48.821800 23017 raft_consensus.cc:3060] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.826339 23017 raft_consensus.cc:515] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:48.828292 23017 leader_election.cc:290] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:48.830365 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ff2881b0ad428984068a6150870c61" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:48.830873 22386 raft_consensus.cc:3060] T 69ff2881b0ad428984068a6150870c61 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.834995 22386 raft_consensus.cc:2468] T 69ff2881b0ad428984068a6150870c61 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
I20260709 13:10:48.836261 22968 leader_election.cc:304] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:48.836779 22306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ff2881b0ad428984068a6150870c61" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:48.837097 23193 raft_consensus.cc:2804] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:48.837460 22306 raft_consensus.cc:3055] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:48.837706 23193 raft_consensus.cc:697] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:48.837800 22306 raft_consensus.cc:740] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Running, Role: LEADER
I20260709 13:10:48.838861 23193 consensus_queue.cc:237] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:48.839141 22306 consensus_queue.cc:260] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:48.840525 22306 raft_consensus.cc:3060] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.847325 22306 raft_consensus.cc:2468] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
I20260709 13:10:48.854370 22060 catalog_manager.cc:5697] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 1 to 2, leader changed from 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131) to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:48.983731 23184 raft_consensus.cc:993] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565: : Instructing follower 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:48.984236 23184 raft_consensus.cc:1081] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Signalling peer 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:48.985780 23017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dee9596873a4f1da4230b8f9b4467fc"
dest_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:45468
I20260709 13:10:48.986303 23017 raft_consensus.cc:493] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:48.986644 23017 raft_consensus.cc:3060] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.993498 23017 raft_consensus.cc:515] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:48.996073 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dee9596873a4f1da4230b8f9b4467fc" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:48.996392 23017 leader_election.cc:290] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:48.996649 22386 raft_consensus.cc:3060] T 9dee9596873a4f1da4230b8f9b4467fc P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.996584 22232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dee9596873a4f1da4230b8f9b4467fc" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:48.999782 22232 raft_consensus.cc:3055] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:49.000110 22232 raft_consensus.cc:740] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:49.000869 22232 consensus_queue.cc:260] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:49.002159 22232 raft_consensus.cc:3060] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.003291 22386 raft_consensus.cc:2468] T 9dee9596873a4f1da4230b8f9b4467fc P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
I20260709 13:10:49.004426 22968 leader_election.cc:304] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:49.005363 23193 raft_consensus.cc:2804] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:49.005815 23193 raft_consensus.cc:697] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:49.006772 23193 consensus_queue.cc:237] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:49.009588 22232 raft_consensus.cc:2468] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
I20260709 13:10:49.018098 22060 catalog_manager.cc:5697] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 1 to 2, leader changed from 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130) to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:49.062072 23179 raft_consensus.cc:993] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b: : Instructing follower 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:49.062680 23204 raft_consensus.cc:1081] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Signalling peer 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:49.064152 23017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45d6ad58386642cd897d5378d8b9bc58"
dest_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:45454
I20260709 13:10:49.064601 23017 raft_consensus.cc:493] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:49.064854 23017 raft_consensus.cc:3060] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.070205 23017 raft_consensus.cc:515] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:49.072155 23017 leader_election.cc:290] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:49.076565 23184 raft_consensus.cc:993] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565: : Instructing follower 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:49.076390 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d6ad58386642cd897d5378d8b9bc58" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:49.077077 23184 raft_consensus.cc:1081] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [term 2 LEADER]: Signalling peer 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:49.077386 22386 raft_consensus.cc:3055] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:49.078275 22306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d6ad58386642cd897d5378d8b9bc58" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:49.077749 22386 raft_consensus.cc:740] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:49.078871 22306 raft_consensus.cc:3060] T 45d6ad58386642cd897d5378d8b9bc58 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.078778 23017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4179392a8cb048c1982df1ea690bb4b9"
dest_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:45468
I20260709 13:10:49.079823 23017 raft_consensus.cc:493] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:49.079609 22386 consensus_queue.cc:260] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:49.080238 23017 raft_consensus.cc:3060] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:49.081246 22386 raft_consensus.cc:3060] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.084825 22306 raft_consensus.cc:2468] T 45d6ad58386642cd897d5378d8b9bc58 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
I20260709 13:10:49.085983 22970 leader_election.cc:304] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:49.086656 23193 raft_consensus.cc:2804] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:49.087083 23193 raft_consensus.cc:697] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:49.087728 23017 raft_consensus.cc:515] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:49.087954 23193 consensus_queue.cc:237] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:49.088464 22386 raft_consensus.cc:2468] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
I20260709 13:10:49.089819 23017 leader_election.cc:290] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 3 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:49.090499 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4179392a8cb048c1982df1ea690bb4b9" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:49.091144 22386 raft_consensus.cc:3060] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:49.092100 22232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4179392a8cb048c1982df1ea690bb4b9" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:49.092703 22232 raft_consensus.cc:3055] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:49.093029 22232 raft_consensus.cc:740] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:49.093829 22232 consensus_queue.cc:260] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:49.094817 22232 raft_consensus.cc:3060] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:49.099596 22386 raft_consensus.cc:2468] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 3.
I20260709 13:10:49.100965 22968 leader_election.cc:304] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:49.101845 23193 raft_consensus.cc:2804] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:49.103669 23193 raft_consensus.cc:697] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [term 3 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:49.103958 23184 raft_consensus.cc:993] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565: : Instructing follower 66d3606ce30b4661b5d62d403d7abca0 to start an election
I20260709 13:10:49.104547 23186 raft_consensus.cc:1081] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Signalling peer 66d3606ce30b4661b5d62d403d7abca0 to start an election
I20260709 13:10:49.104619 23193 consensus_queue.cc:237] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:49.105180 22233 raft_consensus.cc:1275] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.107143 22306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97e1c9af3eb64e7dbff4f9df54341806"
dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
 from {username='slave'} at 127.0.0.1:42766
I20260709 13:10:49.105680 22060 catalog_manager.cc:5697] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 1 to 2, leader changed from edd63b54133d4c8d9149d57a2886916b (127.12.76.132) to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:49.107779 22306 raft_consensus.cc:493] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:49.108345 22306 raft_consensus.cc:3060] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.108132 23206 consensus_queue.cc:1048] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:10:49.108388 22232 raft_consensus.cc:2468] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 3.
I20260709 13:10:49.116220 22306 raft_consensus.cc:515] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:49.127537 22306 leader_election.cc:290] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:49.128259 22233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e1c9af3eb64e7dbff4f9df54341806" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:49.128854 22233 raft_consensus.cc:3055] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:49.129129 22233 raft_consensus.cc:740] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:49.129834 22233 consensus_queue.cc:260] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:49.130898 22233 raft_consensus.cc:3060] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.137146 22385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e1c9af3eb64e7dbff4f9df54341806" candidate_uuid: "66d3606ce30b4661b5d62d403d7abca0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:49.137787 22386 raft_consensus.cc:1275] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.137797 22385 raft_consensus.cc:3060] T 97e1c9af3eb64e7dbff4f9df54341806 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.141342 22233 raft_consensus.cc:2468] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 2.
I20260709 13:10:49.143354 22276 leader_election.cc:304] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:49.142246 23206 consensus_queue.cc:1048] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:49.144953 23201 raft_consensus.cc:2804] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:49.145421 23201 raft_consensus.cc:697] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 LEADER]: Becoming Leader. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Running, Role: LEADER
I20260709 13:10:49.146240 23201 consensus_queue.cc:237] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:49.164011 22385 raft_consensus.cc:2468] T 97e1c9af3eb64e7dbff4f9df54341806 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66d3606ce30b4661b5d62d403d7abca0 in term 2.
I20260709 13:10:49.172791 22057 catalog_manager.cc:5697] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 2 to 3, leader changed from 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130) to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 3 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:49.193460 22060 catalog_manager.cc:5697] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0 reported cstate change: term changed from 1 to 2, leader changed from 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130) to 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131). New cstate: current_term: 2 leader_uuid: "66d3606ce30b4661b5d62d403d7abca0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:49.233930 22386 raft_consensus.cc:1275] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.235217 23206 consensus_queue.cc:1048] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:49.245393 22233 raft_consensus.cc:1275] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.246978 23194 consensus_queue.cc:1048] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:49.409425 22306 raft_consensus.cc:1275] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.410856 23194 consensus_queue.cc:1048] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:49.420719 22386 raft_consensus.cc:1275] T 69ff2881b0ad428984068a6150870c61 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.422570 23206 consensus_queue.cc:1048] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:49.480063 22386 raft_consensus.cc:1275] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.481389 23206 consensus_queue.cc:1048] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:49.485184 22306 raft_consensus.cc:1275] T 45d6ad58386642cd897d5378d8b9bc58 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.488144 23194 consensus_queue.cc:1048] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:49.557837 22233 raft_consensus.cc:1275] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Refusing update from remote peer 66d3606ce30b4661b5d62d403d7abca0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.559113 23201 consensus_queue.cc:1048] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:49.571202 22386 raft_consensus.cc:1275] T 97e1c9af3eb64e7dbff4f9df54341806 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Refusing update from remote peer 66d3606ce30b4661b5d62d403d7abca0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.575836 23201 consensus_queue.cc:1048] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:49.583882 22384 raft_consensus.cc:1275] T 9dee9596873a4f1da4230b8f9b4467fc P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.585429 23206 consensus_queue.cc:1048] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:49.595043 22232 raft_consensus.cc:1275] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:49.598037 23194 consensus_queue.cc:1048] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:49.652113 22232 raft_consensus.cc:1275] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [term 3 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:49.653492 23194 consensus_queue.cc:1048] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:49.664325 22386 raft_consensus.cc:1275] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [term 3 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:49.664705 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:49.667662 23206 consensus_queue.cc:1048] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:49.719322 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:49.753465 22233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44bb47d9fadc476296b95dba1bf4d037"
dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
mode: GRACEFUL
new_leader_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:34972
I20260709 13:10:49.754206 22233 raft_consensus.cc:606] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Received request to transfer leadership to TS 5d515385609945e5837e85b77de385e2
I20260709 13:10:49.757280 22307 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "535cc40e1cc04f16a78d6fbd34a69f3f"
dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
mode: GRACEFUL
new_leader_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:38288
I20260709 13:10:49.757784 22307 raft_consensus.cc:606] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 3 LEADER]: Received request to transfer leadership to TS 5d515385609945e5837e85b77de385e2
I20260709 13:10:49.760251 22307 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94b3204b820c4446bb957d44063ecbe0"
dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
mode: GRACEFUL
new_leader_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:38288
I20260709 13:10:49.760720 22307 raft_consensus.cc:606] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 LEADER]: Received request to transfer leadership to TS 5d515385609945e5837e85b77de385e2
I20260709 13:10:49.763368 22386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7b7f9ed1b11429d98f831e122707ae2"
dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
mode: GRACEFUL
new_leader_uuid: "371d38ec3c7f493e9aea62dae121e565"
 from {username='slave'} at 127.0.0.1:38488
I20260709 13:10:49.763922 22386 raft_consensus.cc:606] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Received request to transfer leadership to TS 371d38ec3c7f493e9aea62dae121e565
I20260709 13:10:49.766322 22386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9fb0f415f654f798baa3cccc149e8a3"
dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
mode: GRACEFUL
new_leader_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:38488
I20260709 13:10:49.766918 22386 raft_consensus.cc:606] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Received request to transfer leadership to TS 5d515385609945e5837e85b77de385e2
I20260709 13:10:49.768070 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:49.769306 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:49.914839 23186 raft_consensus.cc:993] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565: : Instructing follower 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:49.915489 23184 raft_consensus.cc:1081] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Signalling peer 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:49.917842 23018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44bb47d9fadc476296b95dba1bf4d037"
dest_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:45468
I20260709 13:10:49.918522 23018 raft_consensus.cc:493] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:49.919173 23018 raft_consensus.cc:3060] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.925101 23018 raft_consensus.cc:515] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:49.926795 23018 leader_election.cc:290] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:49.927538 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bb47d9fadc476296b95dba1bf4d037" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:49.927750 22232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bb47d9fadc476296b95dba1bf4d037" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:49.928301 22386 raft_consensus.cc:3060] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.928553 22232 raft_consensus.cc:3055] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:49.928951 22232 raft_consensus.cc:740] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:49.929800 22232 consensus_queue.cc:260] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:49.931084 22232 raft_consensus.cc:3060] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.934768 22386 raft_consensus.cc:2468] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
I20260709 13:10:49.935878 22968 leader_election.cc:304] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:49.937008 23227 raft_consensus.cc:2804] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:49.937506 23227 raft_consensus.cc:697] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:49.938273 22232 raft_consensus.cc:2468] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
I20260709 13:10:49.938491 23227 consensus_queue.cc:237] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:49.947957 22057 catalog_manager.cc:5697] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 1 to 2, leader changed from 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130) to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:49.976002 23201 raft_consensus.cc:993] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0: : Instructing follower 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:49.976569 23172 raft_consensus.cc:1081] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 LEADER]: Signalling peer 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:49.978229 23018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94b3204b820c4446bb957d44063ecbe0"
dest_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:45482
I20260709 13:10:49.978825 23018 raft_consensus.cc:493] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:49.979257 23018 raft_consensus.cc:3060] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:49.986562 23018 raft_consensus.cc:515] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:49.989435 22306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b3204b820c4446bb957d44063ecbe0" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:49.989557 23018 leader_election.cc:290] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 3 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:49.990070 22306 raft_consensus.cc:3055] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:49.990448 22306 raft_consensus.cc:740] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Running, Role: LEADER
I20260709 13:10:49.990622 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b3204b820c4446bb957d44063ecbe0" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:49.991262 22386 raft_consensus.cc:3060] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:49.991299 22306 consensus_queue.cc:260] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:49.997593 22306 raft_consensus.cc:3060] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:49.998723 22386 raft_consensus.cc:2468] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 3.
I20260709 13:10:49.999915 22968 leader_election.cc:304] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:50.000854 23227 raft_consensus.cc:2804] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:50.001343 23227 raft_consensus.cc:697] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 3 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:50.002185 23227 consensus_queue.cc:237] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:50.003715 22306 raft_consensus.cc:2468] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 3.
I20260709 13:10:50.012604 22057 catalog_manager.cc:5697] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 2 to 3, leader changed from 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131) to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 3 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:50.149597 23172 raft_consensus.cc:993] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0: : Instructing follower 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:50.150058 23234 raft_consensus.cc:1081] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 3 LEADER]: Signalling peer 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:50.151348 23017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "535cc40e1cc04f16a78d6fbd34a69f3f"
dest_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:45482
I20260709 13:10:50.152076 23017 raft_consensus.cc:493] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:50.152408 23017 raft_consensus.cc:3060] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.158608 23017 raft_consensus.cc:515] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:50.160038 23017 leader_election.cc:290] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 4 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:50.160743 22233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535cc40e1cc04f16a78d6fbd34a69f3f" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:50.161190 22306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535cc40e1cc04f16a78d6fbd34a69f3f" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:50.161454 22233 raft_consensus.cc:3060] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.161859 22306 raft_consensus.cc:3055] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:50.162637 22306 raft_consensus.cc:740] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66d3606ce30b4661b5d62d403d7abca0, State: Running, Role: LEADER
I20260709 13:10:50.164070 22306 consensus_queue.cc:260] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:50.165504 22306 raft_consensus.cc:3060] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.171154 22233 raft_consensus.cc:2468] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 4.
I20260709 13:10:50.172434 22969 leader_election.cc:304] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 
I20260709 13:10:50.172860 22306 raft_consensus.cc:2468] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 4.
I20260709 13:10:50.173334 23227 raft_consensus.cc:2804] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:50.173914 23227 raft_consensus.cc:697] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 4 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:50.174692 23227 consensus_queue.cc:237] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:50.184300 23179 raft_consensus.cc:993] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b: : Instructing follower 371d38ec3c7f493e9aea62dae121e565 to start an election
I20260709 13:10:50.184867 23204 raft_consensus.cc:1081] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Signalling peer 371d38ec3c7f493e9aea62dae121e565 to start an election
I20260709 13:10:50.184381 22057 catalog_manager.cc:5697] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 3 to 4, leader changed from 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131) to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 4 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.186519 22233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7b7f9ed1b11429d98f831e122707ae2"
dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
 from {username='slave'} at 127.0.0.1:58354
I20260709 13:10:50.187027 22233 raft_consensus.cc:493] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:50.187354 22233 raft_consensus.cc:3060] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.193879 22233 raft_consensus.cc:515] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:50.196293 22233 leader_election.cc:290] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:50.196786 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b7f9ed1b11429d98f831e122707ae2" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:50.197360 22386 raft_consensus.cc:3055] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:50.197578 22386 raft_consensus.cc:740] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:50.198120 22386 consensus_queue.cc:260] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:50.198936 22386 raft_consensus.cc:3060] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.199460 22306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b7f9ed1b11429d98f831e122707ae2" candidate_uuid: "371d38ec3c7f493e9aea62dae121e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:50.200002 22306 raft_consensus.cc:3060] T c7b7f9ed1b11429d98f831e122707ae2 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.204658 22386 raft_consensus.cc:2468] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 2.
I20260709 13:10:50.205416 22306 raft_consensus.cc:2468] T c7b7f9ed1b11429d98f831e122707ae2 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371d38ec3c7f493e9aea62dae121e565 in term 2.
I20260709 13:10:50.206216 22201 leader_election.cc:304] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:50.206936 23186 raft_consensus.cc:2804] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:50.207401 23186 raft_consensus.cc:697] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565 [term 2 LEADER]: Becoming Leader. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:50.208246 23186 consensus_queue.cc:237] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } }
I20260709 13:10:50.216933 22057 catalog_manager.cc:5697] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565 reported cstate change: term changed from 1 to 2, leader changed from edd63b54133d4c8d9149d57a2886916b (127.12.76.132) to 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130). New cstate: current_term: 2 leader_uuid: "371d38ec3c7f493e9aea62dae121e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.344743 23179 raft_consensus.cc:993] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b: : Instructing follower 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:50.345206 23204 raft_consensus.cc:1081] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Signalling peer 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:50.346712 23018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9fb0f415f654f798baa3cccc149e8a3"
dest_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:45454
I20260709 13:10:50.347231 23018 raft_consensus.cc:493] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:50.347675 23018 raft_consensus.cc:3060] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.352524 23018 raft_consensus.cc:515] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:50.354003 23018 leader_election.cc:290] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:50.354519 22233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9fb0f415f654f798baa3cccc149e8a3" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:50.354986 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9fb0f415f654f798baa3cccc149e8a3" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:50.355201 22233 raft_consensus.cc:3060] T c9fb0f415f654f798baa3cccc149e8a3 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.355544 22386 raft_consensus.cc:3055] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:50.355845 22386 raft_consensus.cc:740] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:50.356446 22386 consensus_queue.cc:260] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:50.357374 22386 raft_consensus.cc:3060] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.360337 22233 raft_consensus.cc:2468] T c9fb0f415f654f798baa3cccc149e8a3 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
I20260709 13:10:50.361559 22969 leader_election.cc:304] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 
I20260709 13:10:50.362304 23227 raft_consensus.cc:2804] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:50.362741 23227 raft_consensus.cc:697] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:50.362949 22386 raft_consensus.cc:2468] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
I20260709 13:10:50.363662 23227 consensus_queue.cc:237] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:50.374598 22057 catalog_manager.cc:5697] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 1 to 2, leader changed from edd63b54133d4c8d9149d57a2886916b (127.12.76.132) to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:50.449685 22386 raft_consensus.cc:1275] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [term 3 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:50.450892 23227 consensus_queue.cc:1048] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:50.462080 22306 raft_consensus.cc:1275] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:50.463752 23194 consensus_queue.cc:1048] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:50.480989 22384 raft_consensus.cc:1275] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.482661 23227 consensus_queue.cc:1048] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.508116 22233 raft_consensus.cc:1275] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.511620 23227 consensus_queue.cc:1048] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.604630 22307 raft_consensus.cc:1275] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 4 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:50.605808 23227 consensus_queue.cc:1048] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:50.611549 22306 raft_consensus.cc:1275] T c7b7f9ed1b11429d98f831e122707ae2 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Refusing update from remote peer 371d38ec3c7f493e9aea62dae121e565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.612907 23186 consensus_queue.cc:1048] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.624614 22235 raft_consensus.cc:1275] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [term 4 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:50.627308 23194 consensus_queue.cc:1048] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:50.630815 22386 raft_consensus.cc:1275] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Refusing update from remote peer 371d38ec3c7f493e9aea62dae121e565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.632241 23184 consensus_queue.cc:1048] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.770157 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:50.815323 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:50.852128 22384 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3559a60bb91946b988a872f1f28f20f8"
dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
mode: GRACEFUL
new_leader_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:38488
I20260709 13:10:50.852681 22384 raft_consensus.cc:606] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Received request to transfer leadership to TS 5d515385609945e5837e85b77de385e2
I20260709 13:10:50.855273 22384 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39c5c419abe445e9ba439d1a0792991e"
dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
mode: GRACEFUL
new_leader_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:38488
I20260709 13:10:50.855868 22384 raft_consensus.cc:606] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Received request to transfer leadership to TS 5d515385609945e5837e85b77de385e2
I20260709 13:10:50.858286 22384 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa3c95d8e81a462283bc0799ade2104b"
dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
mode: GRACEFUL
new_leader_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:38488
I20260709 13:10:50.858673 22384 raft_consensus.cc:606] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 3 LEADER]: Received request to transfer leadership to TS 5d515385609945e5837e85b77de385e2
I20260709 13:10:50.860951 22232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1d8b26b38b341878e580b51c9014cec"
dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
mode: GRACEFUL
new_leader_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:34972
I20260709 13:10:50.861383 22232 raft_consensus.cc:606] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Received request to transfer leadership to TS 5d515385609945e5837e85b77de385e2
I20260709 13:10:50.862576 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:10:50.864094 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:50.879062 22232 raft_consensus.cc:1275] T c9fb0f415f654f798baa3cccc149e8a3 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.880573 23194 consensus_queue.cc:1048] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:50.884756 22384 raft_consensus.cc:1275] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.887218 23194 consensus_queue.cc:1048] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.898746 23204 raft_consensus.cc:993] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b: : Instructing follower 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:50.899220 23204 raft_consensus.cc:1081] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Signalling peer 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:50.903218 23017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39c5c419abe445e9ba439d1a0792991e"
dest_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:45454
I20260709 13:10:50.903843 23017 raft_consensus.cc:493] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:50.905383 23017 raft_consensus.cc:3060] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.915918 23017 raft_consensus.cc:515] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:50.917734 23017 leader_election.cc:290] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Requested vote from peers edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
I20260709 13:10:50.918403 22384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c5c419abe445e9ba439d1a0792991e" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:50.919078 22384 raft_consensus.cc:3055] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:50.920666 22384 raft_consensus.cc:740] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:50.920225 22232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c5c419abe445e9ba439d1a0792991e" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:50.921830 22232 raft_consensus.cc:3060] T 39c5c419abe445e9ba439d1a0792991e P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.921411 22384 consensus_queue.cc:260] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:50.924043 22384 raft_consensus.cc:3060] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.926795 22232 raft_consensus.cc:2468] T 39c5c419abe445e9ba439d1a0792991e P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
I20260709 13:10:50.927767 22969 leader_election.cc:304] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2; no voters: 
I20260709 13:10:50.928493 23194 raft_consensus.cc:2804] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:50.928946 23194 raft_consensus.cc:697] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:50.929688 23194 consensus_queue.cc:237] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:50.930397 22384 raft_consensus.cc:2468] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
I20260709 13:10:50.940793 22061 catalog_manager.cc:5697] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 1 to 2, leader changed from edd63b54133d4c8d9149d57a2886916b (127.12.76.132) to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.967530 23214 raft_consensus.cc:993] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565: : Instructing follower 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:50.968094 23184 raft_consensus.cc:1081] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Signalling peer 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:50.969671 23017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1d8b26b38b341878e580b51c9014cec"
dest_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:45468
I20260709 13:10:50.970181 23017 raft_consensus.cc:493] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:50.970479 23017 raft_consensus.cc:3060] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.976107 23017 raft_consensus.cc:515] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:50.977656 23017 leader_election.cc:290] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Requested vote from peers 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835), 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871)
I20260709 13:10:50.978320 22232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d8b26b38b341878e580b51c9014cec" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "371d38ec3c7f493e9aea62dae121e565"
I20260709 13:10:50.978857 22307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d8b26b38b341878e580b51c9014cec" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:50.979036 22232 raft_consensus.cc:3055] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:50.979452 22307 raft_consensus.cc:3060] T d1d8b26b38b341878e580b51c9014cec P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.979473 22232 raft_consensus.cc:740] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 371d38ec3c7f493e9aea62dae121e565, State: Running, Role: LEADER
I20260709 13:10:50.980545 22232 consensus_queue.cc:260] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:50.981878 22232 raft_consensus.cc:3060] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.986866 22307 raft_consensus.cc:2468] T d1d8b26b38b341878e580b51c9014cec P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
I20260709 13:10:50.987924 22970 leader_election.cc:304] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:50.988790 23194 raft_consensus.cc:2804] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:50.989319 23194 raft_consensus.cc:697] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:50.989646 22232 raft_consensus.cc:2468] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
I20260709 13:10:50.990258 23194 consensus_queue.cc:237] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } }
I20260709 13:10:51.001436 22061 catalog_manager.cc:5697] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 1 to 2, leader changed from 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130) to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:51.044484 23179 raft_consensus.cc:993] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b: : Instructing follower 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:51.045013 23179 raft_consensus.cc:1081] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 3 LEADER]: Signalling peer 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:51.046631 23017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa3c95d8e81a462283bc0799ade2104b"
dest_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:45454
I20260709 13:10:51.047179 23017 raft_consensus.cc:493] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:51.047928 23017 raft_consensus.cc:3060] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:51.054708 23017 raft_consensus.cc:515] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:51.058243 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3c95d8e81a462283bc0799ade2104b" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:51.058880 22386 raft_consensus.cc:3055] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:51.059216 22386 raft_consensus.cc:740] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:51.060139 22386 consensus_queue.cc:260] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:51.060683 22307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3c95d8e81a462283bc0799ade2104b" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:51.061234 22386 raft_consensus.cc:3060] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:51.061388 22307 raft_consensus.cc:3060] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:51.067770 22386 raft_consensus.cc:2468] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 4.
I20260709 13:10:51.069034 22968 leader_election.cc:304] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, edd63b54133d4c8d9149d57a2886916b; no voters: 
I20260709 13:10:51.069787 23017 leader_election.cc:290] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 4 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:51.070538 23227 raft_consensus.cc:2804] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:51.071082 23227 raft_consensus.cc:697] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 4 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:51.071987 23227 consensus_queue.cc:237] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:51.067953 22307 raft_consensus.cc:2468] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 4.
I20260709 13:10:51.083061 22061 catalog_manager.cc:5697] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 3 to 4, leader changed from edd63b54133d4c8d9149d57a2886916b (127.12.76.132) to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 4 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:51.194438 23179 raft_consensus.cc:993] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b: : Instructing follower 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:51.195001 23243 raft_consensus.cc:1081] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Signalling peer 5d515385609945e5837e85b77de385e2 to start an election
I20260709 13:10:51.196491 23018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3559a60bb91946b988a872f1f28f20f8"
dest_uuid: "5d515385609945e5837e85b77de385e2"
 from {username='slave'} at 127.0.0.1:45454
I20260709 13:10:51.197029 23018 raft_consensus.cc:493] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:51.197311 23018 raft_consensus.cc:3060] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:51.202092 23018 raft_consensus.cc:515] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:51.203526 23018 leader_election.cc:290] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Requested vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), edd63b54133d4c8d9149d57a2886916b (127.12.76.132:45017)
I20260709 13:10:51.204185 22307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3559a60bb91946b988a872f1f28f20f8" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66d3606ce30b4661b5d62d403d7abca0"
I20260709 13:10:51.204443 22386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3559a60bb91946b988a872f1f28f20f8" candidate_uuid: "5d515385609945e5837e85b77de385e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edd63b54133d4c8d9149d57a2886916b"
I20260709 13:10:51.204834 22307 raft_consensus.cc:3060] T 3559a60bb91946b988a872f1f28f20f8 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:51.205066 22386 raft_consensus.cc:3055] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:51.205415 22386 raft_consensus.cc:740] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edd63b54133d4c8d9149d57a2886916b, State: Running, Role: LEADER
I20260709 13:10:51.206038 22386 consensus_queue.cc:260] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:51.206982 22386 raft_consensus.cc:3060] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:51.209698 22307 raft_consensus.cc:2468] T 3559a60bb91946b988a872f1f28f20f8 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
I20260709 13:10:51.210785 22970 leader_election.cc:304] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0; no voters: 
I20260709 13:10:51.211805 22386 raft_consensus.cc:2468] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d515385609945e5837e85b77de385e2 in term 2.
I20260709 13:10:51.211956 23194 raft_consensus.cc:2804] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:51.214468 23194 raft_consensus.cc:697] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Becoming Leader. State: Replica: 5d515385609945e5837e85b77de385e2, State: Running, Role: LEADER
I20260709 13:10:51.215291 23194 consensus_queue.cc:237] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:51.225741 22061 catalog_manager.cc:5697] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 reported cstate change: term changed from 1 to 2, leader changed from edd63b54133d4c8d9149d57a2886916b (127.12.76.132) to 5d515385609945e5837e85b77de385e2 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "5d515385609945e5837e85b77de385e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:51.344354 22384 raft_consensus.cc:1275] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:51.345731 23194 consensus_queue.cc:1048] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:51.356364 22232 raft_consensus.cc:1275] T 39c5c419abe445e9ba439d1a0792991e P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:51.358629 23194 consensus_queue.cc:1048] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:51.471421 22307 raft_consensus.cc:1275] T d1d8b26b38b341878e580b51c9014cec P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:51.472664 23194 consensus_queue.cc:1048] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:51.473223 22307 raft_consensus.cc:1275] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [term 4 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:51.474788 23206 consensus_queue.cc:1048] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:51.486172 22232 raft_consensus.cc:1275] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:51.489614 23227 consensus_queue.cc:1048] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:51.504410 22386 raft_consensus.cc:1275] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 4 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:51.505642 23194 consensus_queue.cc:1048] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:51.627486 22386 raft_consensus.cc:1275] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:51.628778 23194 consensus_queue.cc:1048] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:51.644450 22307 raft_consensus.cc:1275] T 3559a60bb91946b988a872f1f28f20f8 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Refusing update from remote peer 5d515385609945e5837e85b77de385e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:51.645735 23227 consensus_queue.cc:1048] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:51.864845 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:51.904233 12594 tablet_server.cc:179] TabletServer@127.12.76.129:33591 shutting down...
W20260709 13:10:51.923243 22275 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 62 similar messages]
W20260709 13:10:51.930099 22275 consensus_peers.cc:597] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:51.960801 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:51.961732 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:51.962383 12594 raft_consensus.cc:2243] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:51.962756 12594 raft_consensus.cc:2272] T 3a23c35530d84893bfc638fe35760483 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:51.965596 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:51.966524 12594 raft_consensus.cc:2243] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:51.967578 12594 raft_consensus.cc:2272] T aa3c95d8e81a462283bc0799ade2104b P 5d515385609945e5837e85b77de385e2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:51.971750 12594 tablet_replica.cc:333] stopping tablet replica
W20260709 13:10:51.972554 22349 consensus_peers.cc:597] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:51.972678 12594 raft_consensus.cc:2243] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:51.973390 12594 raft_consensus.cc:2272] T c6f0ec01ac814561a087cb72983b73de P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:51.973578 22201 consensus_peers.cc:597] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:51.975957 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:51.976712 12594 raft_consensus.cc:2243] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:51.977136 12594 raft_consensus.cc:2272] T b14e4aeab76f42f7a5a63d191494a79c P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:51.978765 22201 consensus_peers.cc:597] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:51.979723 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:51.980386 12594 raft_consensus.cc:2243] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:51.980794 12594 raft_consensus.cc:2272] T 2959be4ebd674047ba6d57a27b8b5865 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:51.983173 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:51.983822 12594 raft_consensus.cc:2243] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:51.984237 12594 raft_consensus.cc:2272] T ecb5c885975e4259a69644775bb930f1 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:51.987011 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:51.987854 12594 raft_consensus.cc:2243] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:51.988325 12594 raft_consensus.cc:2272] T 90ecf0583df84abeae688412d6870da7 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:51.990518 22201 consensus_peers.cc:597] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:51.991127 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:51.992112 12594 raft_consensus.cc:2243] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:51.992947 12594 raft_consensus.cc:2272] T 535cc40e1cc04f16a78d6fbd34a69f3f P 5d515385609945e5837e85b77de385e2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:51.995311 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:51.995895 12594 raft_consensus.cc:2243] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:51.996399 12594 raft_consensus.cc:2272] T f92f72a0e3ac48d480bb25e4f8f64c43 P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:51.999436 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.000289 12594 raft_consensus.cc:2243] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.000931 12594 raft_consensus.cc:2272] T b28d9c95ac3d49219dc6a5d5739f6ead P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.003400 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.004074 12594 raft_consensus.cc:2243] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.004503 12594 raft_consensus.cc:2272] T bb5f23465fe44a799f3521c814b38d55 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.006740 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.007316 12594 raft_consensus.cc:2243] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.008090 12594 raft_consensus.cc:2272] T d1d8b26b38b341878e580b51c9014cec P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.012425 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.013244 12594 raft_consensus.cc:2243] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.013988 12594 raft_consensus.cc:2272] T 4179392a8cb048c1982df1ea690bb4b9 P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.016075 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.016773 12594 raft_consensus.cc:2243] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.017212 12594 raft_consensus.cc:2272] T dbec8a84225648c28ea36cf425bc09d2 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.019932 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.020422 12594 raft_consensus.cc:2243] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.020869 12594 raft_consensus.cc:2272] T af8b0a3da29749fdb5bffa995ff8ac1e P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.023367 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.024055 12594 raft_consensus.cc:2243] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:10:52.024716 22275 consensus_peers.cc:597] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.024804 12594 raft_consensus.cc:2272] T 94b3204b820c4446bb957d44063ecbe0 P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.027096 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.027724 12594 raft_consensus.cc:2243] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.028123 12594 raft_consensus.cc:2272] T 5634eebf5657424c9f136d8f08e8e8f6 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.030510 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.031289 12594 raft_consensus.cc:2243] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.031852 12594 raft_consensus.cc:2272] T 8f1e603414db46e7bf2cdd620118e39d P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.034883 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.035778 12594 raft_consensus.cc:2243] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.036281 12594 raft_consensus.cc:2272] T 172a5324a0f04ae9b78b1bc0b106dbea P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.039129 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.039909 12594 raft_consensus.cc:2243] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.040598 12594 raft_consensus.cc:2272] T 45d6ad58386642cd897d5378d8b9bc58 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.042527 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.043162 12594 raft_consensus.cc:2243] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.043665 12594 raft_consensus.cc:2272] T 6f91956634f346fbaed9bc3d2785f528 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.046443 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.047000 12594 raft_consensus.cc:2243] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.047501 12594 raft_consensus.cc:2272] T 40b118b701f94b3bacbbca2df47fe5bd P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.049655 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.050372 12594 raft_consensus.cc:2243] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.050863 12594 raft_consensus.cc:2272] T 2434ada128f843908123ae8965e66222 P 5d515385609945e5837e85b77de385e2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.053115 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.055649 12594 raft_consensus.cc:2243] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.056710 12594 raft_consensus.cc:2272] T 44bb47d9fadc476296b95dba1bf4d037 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.059732 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.060611 12594 raft_consensus.cc:2243] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.061215 12594 raft_consensus.cc:2272] T da53827c80a54c43a6cdcb57b857f7a3 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:52.063947 22201 consensus_peers.cc:597] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.064452 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.065550 12594 raft_consensus.cc:2243] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.066080 12594 raft_consensus.cc:2272] T 9c9023b52992475a8b8ad4949867582a P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:52.068742 22349 consensus_peers.cc:597] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.069135 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.069988 12594 raft_consensus.cc:2243] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.070495 12594 raft_consensus.cc:2272] T 56d963b71e2742f3a74e1bed72d29186 P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.073552 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.074554 12594 raft_consensus.cc:2243] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.075155 12594 raft_consensus.cc:2272] T e56649a39ed04a1682d5f0473dbb791e P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.078568 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.079569 12594 raft_consensus.cc:2243] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.080663 12594 raft_consensus.cc:2272] T 39c5c419abe445e9ba439d1a0792991e P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.085000 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.085776 12594 raft_consensus.cc:2243] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.086704 12594 raft_consensus.cc:2272] T 69ff2881b0ad428984068a6150870c61 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.089411 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.090108 12594 raft_consensus.cc:2243] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.091164 12594 raft_consensus.cc:2272] T 63af5dcbd69043a6a704a5fdedd3d371 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:52.092854 22201 consensus_peers.cc:597] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.094000 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.094997 12594 raft_consensus.cc:2243] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.095572 12594 raft_consensus.cc:2272] T b501417270f5431da901577c6e5da05f P 5d515385609945e5837e85b77de385e2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.098541 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.099354 12594 raft_consensus.cc:2243] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.099853 12594 raft_consensus.cc:2272] T 5ced150f7b0b41c5a9a55795474c3eed P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.102393 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.103190 12594 raft_consensus.cc:2243] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.103669 12594 raft_consensus.cc:2272] T c7698abde6404f019732b30297ad5923 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:52.105077 22349 consensus_peers.cc:597] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.106954 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.107721 12594 raft_consensus.cc:2243] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.108695 12594 raft_consensus.cc:2272] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.111742 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.112583 12594 raft_consensus.cc:2243] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.114078 12594 raft_consensus.cc:2272] T b570b00ae75a47cda3fcb47ad5f0f97c P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.117360 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.118151 12594 raft_consensus.cc:2243] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:10:52.118758 22201 consensus_peers.cc:597] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.119242 12594 raft_consensus.cc:2272] T 3559a60bb91946b988a872f1f28f20f8 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.123588 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.124372 12594 raft_consensus.cc:2243] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.124831 12594 raft_consensus.cc:2272] T a4695de4c0534d2d8d2a4c79aab3654d P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.127004 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.127636 12594 raft_consensus.cc:2243] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.128072 12594 raft_consensus.cc:2272] T 3a808c750d4749df9579874d7371e2e9 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.130184 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.130900 12594 raft_consensus.cc:2243] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.131891 12594 raft_consensus.cc:2272] T 9dee9596873a4f1da4230b8f9b4467fc P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:52.134693 22275 consensus_peers.cc:597] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.134822 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.135684 12594 raft_consensus.cc:2243] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.136138 12594 raft_consensus.cc:2272] T 339b03c27dab449090201492ec507025 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.139178 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.139909 12594 raft_consensus.cc:2243] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.140811 12594 raft_consensus.cc:2272] T c9fb0f415f654f798baa3cccc149e8a3 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.143893 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.144465 12594 raft_consensus.cc:2243] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.144908 12594 raft_consensus.cc:2272] T 8e4e00f55ac949c2a073e99cf9bc9290 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.147665 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.148331 12594 raft_consensus.cc:2243] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.149320 12594 raft_consensus.cc:2272] T b2c563b0b9ff42638139dc08d9fd2e23 P 5d515385609945e5837e85b77de385e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.151774 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:52.152309 12594 raft_consensus.cc:2243] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.152808 12594 raft_consensus.cc:2272] T 12df2e627ea748c5908bd073b917bf29 P 5d515385609945e5837e85b77de385e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:52.155089 22349 consensus_peers.cc:597] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:52.169365 22201 consensus_peers.cc:597] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:52.176474 22349 consensus_peers.cc:597] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:52.186331 22275 consensus_peers.cc:597] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.222990 12594 tablet_server.cc:196] TabletServer@127.12.76.129:33591 shutdown complete.
W20260709 13:10:52.240104 22275 consensus_peers.cc:597] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:52.247696 22275 consensus_peers.cc:597] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:52.263382 22201 consensus_peers.cc:597] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:52.277364 22201 consensus_peers.cc:597] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:52.297072 22275 consensus_peers.cc:597] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:52.309514 22349 consensus_peers.cc:597] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.311983 12594 tablet_server.cc:179] TabletServer@127.12.76.130:0 shutting down...
W20260709 13:10:52.332077 22349 consensus_peers.cc:597] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.352028 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:52.353037 12594 tablet_replica.cc:333] T ecb5c885975e4259a69644775bb930f1 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.353787 12594 raft_consensus.cc:2243] T ecb5c885975e4259a69644775bb930f1 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.354321 12594 raft_consensus.cc:2272] T ecb5c885975e4259a69644775bb930f1 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.356753 12594 tablet_replica.cc:333] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.357718 12594 raft_consensus.cc:2243] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.358739 12594 raft_consensus.cc:2272] T f92f72a0e3ac48d480bb25e4f8f64c43 P 371d38ec3c7f493e9aea62dae121e565 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.360769 12594 tablet_replica.cc:333] T 3a23c35530d84893bfc638fe35760483 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.361361 12594 raft_consensus.cc:2243] T 3a23c35530d84893bfc638fe35760483 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.361797 12594 raft_consensus.cc:2272] T 3a23c35530d84893bfc638fe35760483 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.364015 12594 tablet_replica.cc:333] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.364547 12594 raft_consensus.cc:2243] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.364988 12594 raft_consensus.cc:2272] T 255341bbdc0147aca3a664fdaa81ebf5 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.367586 12594 tablet_replica.cc:333] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.368301 12594 raft_consensus.cc:2243] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.369251 12594 raft_consensus.cc:2272] T dbec8a84225648c28ea36cf425bc09d2 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:52.370087 22349 consensus_peers.cc:597] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.371532 12594 tablet_replica.cc:333] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.372299 12594 raft_consensus.cc:2243] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.373250 12594 raft_consensus.cc:2272] T a4695de4c0534d2d8d2a4c79aab3654d P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.376117 12594 tablet_replica.cc:333] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.376888 12594 raft_consensus.cc:2243] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.377697 12594 raft_consensus.cc:2272] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.380017 12594 tablet_replica.cc:333] T bb2e1e35ba2d4732a195046335a7af7c P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.380752 12594 raft_consensus.cc:2243] T bb2e1e35ba2d4732a195046335a7af7c P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.381395 12594 raft_consensus.cc:2272] T bb2e1e35ba2d4732a195046335a7af7c P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.384606 12594 tablet_replica.cc:333] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.385362 12594 raft_consensus.cc:2243] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.385876 12594 raft_consensus.cc:2272] T 535cc40e1cc04f16a78d6fbd34a69f3f P 371d38ec3c7f493e9aea62dae121e565 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:52.387037 22275 consensus_peers.cc:597] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.388536 12594 tablet_replica.cc:333] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.389194 12594 raft_consensus.cc:2243] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.389616 12594 raft_consensus.cc:2272] T d1d8b26b38b341878e580b51c9014cec P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.392405 12594 tablet_replica.cc:333] T c144955449774c3c90f8e0ed28cc5155 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.393174 12594 raft_consensus.cc:2243] T c144955449774c3c90f8e0ed28cc5155 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.393738 12594 raft_consensus.cc:2272] T c144955449774c3c90f8e0ed28cc5155 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:52.396008 22276 consensus_peers.cc:597] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Couldn't send request to peer 371d38ec3c7f493e9aea62dae121e565. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.396466 12594 tablet_replica.cc:333] T 486fbb450f854f00af3362b34a0ef614 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.397315 12594 raft_consensus.cc:2243] T 486fbb450f854f00af3362b34a0ef614 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.397768 12594 raft_consensus.cc:2272] T 486fbb450f854f00af3362b34a0ef614 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.399825 12594 tablet_replica.cc:333] T 394fa17836c34b6d8e074e7ec63d4387 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.400622 12594 raft_consensus.cc:2243] T 394fa17836c34b6d8e074e7ec63d4387 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.401127 12594 raft_consensus.cc:2272] T 394fa17836c34b6d8e074e7ec63d4387 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.403712 12594 tablet_replica.cc:333] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
W20260709 13:10:52.403817 22350 consensus_peers.cc:597] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b -> Peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Couldn't send request to peer 371d38ec3c7f493e9aea62dae121e565. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.404320 12594 raft_consensus.cc:2243] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.404809 12594 raft_consensus.cc:2272] T 97e1c9af3eb64e7dbff4f9df54341806 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.407097 12594 tablet_replica.cc:333] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.407757 12594 raft_consensus.cc:2243] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.408277 12594 raft_consensus.cc:2272] T 40b118b701f94b3bacbbca2df47fe5bd P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:52.410470 22275 consensus_peers.cc:597] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.410935 12594 tablet_replica.cc:333] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.411676 12594 raft_consensus.cc:2243] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.412525 12594 raft_consensus.cc:2272] T 6f91956634f346fbaed9bc3d2785f528 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:52.414867 22275 consensus_peers.cc:597] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.415300 12594 tablet_replica.cc:333] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.415999 12594 raft_consensus.cc:2243] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.416446 12594 raft_consensus.cc:2272] T 4179392a8cb048c1982df1ea690bb4b9 P 371d38ec3c7f493e9aea62dae121e565 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.418841 12594 tablet_replica.cc:333] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.419660 12594 raft_consensus.cc:2243] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.420687 12594 raft_consensus.cc:2272] T 4805089364594284ba715cf71e92f20c P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.423527 12594 tablet_replica.cc:333] T 39c5c419abe445e9ba439d1a0792991e P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.424288 12594 raft_consensus.cc:2243] T 39c5c419abe445e9ba439d1a0792991e P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.424834 12594 raft_consensus.cc:2272] T 39c5c419abe445e9ba439d1a0792991e P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:52.425398 22350 consensus_peers.cc:597] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b -> Peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Couldn't send request to peer 371d38ec3c7f493e9aea62dae121e565. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.427371 12594 tablet_replica.cc:333] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.428283 12594 raft_consensus.cc:2243] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.428784 12594 raft_consensus.cc:2272] T b2c563b0b9ff42638139dc08d9fd2e23 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:52.430200 22350 consensus_peers.cc:597] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b -> Peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Couldn't send request to peer 371d38ec3c7f493e9aea62dae121e565. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.431671 12594 tablet_replica.cc:333] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.432332 12594 raft_consensus.cc:2243] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:10:52.432896 22275 consensus_peers.cc:597] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.433209 12594 raft_consensus.cc:2272] T 12df2e627ea748c5908bd073b917bf29 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.435843 12594 tablet_replica.cc:333] T acf09c0982fd493caaf8c31bc1964c22 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.436410 12594 raft_consensus.cc:2243] T acf09c0982fd493caaf8c31bc1964c22 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.436890 12594 raft_consensus.cc:2272] T acf09c0982fd493caaf8c31bc1964c22 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.438796 12594 tablet_replica.cc:333] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.439257 12594 raft_consensus.cc:2243] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.439990 12594 raft_consensus.cc:2272] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.441833 12594 tablet_replica.cc:333] T 3a808c750d4749df9579874d7371e2e9 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.442341 12594 raft_consensus.cc:2243] T 3a808c750d4749df9579874d7371e2e9 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.442893 12594 raft_consensus.cc:2272] T 3a808c750d4749df9579874d7371e2e9 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.445111 12594 tablet_replica.cc:333] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.445896 12594 raft_consensus.cc:2243] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.446376 12594 raft_consensus.cc:2272] T 9dee9596873a4f1da4230b8f9b4467fc P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.449404 12594 tablet_replica.cc:333] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.449973 12594 raft_consensus.cc:2243] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.450755 12594 raft_consensus.cc:2272] T 339b03c27dab449090201492ec507025 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.453197 12594 tablet_replica.cc:333] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.453866 12594 raft_consensus.cc:2243] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.454743 12594 raft_consensus.cc:2272] T 9de1c7b16c2347058e4b97f057c06690 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.457144 12594 tablet_replica.cc:333] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.457991 12594 raft_consensus.cc:2243] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.458567 12594 raft_consensus.cc:2272] T bb5f23465fe44a799f3521c814b38d55 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.461287 12594 tablet_replica.cc:333] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.462106 12594 raft_consensus.cc:2243] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:10:52.462615 22349 consensus_peers.cc:597] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b -> Peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Couldn't send request to peer 5d515385609945e5837e85b77de385e2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.463167 12594 raft_consensus.cc:2272] T c6f0ec01ac814561a087cb72983b73de P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.465380 12594 tablet_replica.cc:333] T 3a65572e11044c94ba6e4bf799385437 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.465919 12594 raft_consensus.cc:2243] T 3a65572e11044c94ba6e4bf799385437 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.466287 12594 raft_consensus.cc:2272] T 3a65572e11044c94ba6e4bf799385437 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.468338 12594 tablet_replica.cc:333] T 90ecf0583df84abeae688412d6870da7 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.468918 12594 raft_consensus.cc:2243] T 90ecf0583df84abeae688412d6870da7 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.469313 12594 raft_consensus.cc:2272] T 90ecf0583df84abeae688412d6870da7 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.471617 12594 tablet_replica.cc:333] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.472218 12594 raft_consensus.cc:2243] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.473090 12594 raft_consensus.cc:2272] T 5ced150f7b0b41c5a9a55795474c3eed P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:52.475549 22350 consensus_peers.cc:597] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b -> Peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Couldn't send request to peer 371d38ec3c7f493e9aea62dae121e565. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.475821 12594 tablet_replica.cc:333] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.476521 12594 raft_consensus.cc:2243] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.476990 12594 raft_consensus.cc:2272] T 63af5dcbd69043a6a704a5fdedd3d371 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.479596 12594 tablet_replica.cc:333] T c9fb0f415f654f798baa3cccc149e8a3 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.480309 12594 raft_consensus.cc:2243] T c9fb0f415f654f798baa3cccc149e8a3 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.480810 12594 raft_consensus.cc:2272] T c9fb0f415f654f798baa3cccc149e8a3 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.483534 12594 tablet_replica.cc:333] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
W20260709 13:10:52.483731 22276 consensus_peers.cc:597] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Couldn't send request to peer 371d38ec3c7f493e9aea62dae121e565. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.484261 12594 raft_consensus.cc:2243] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.485456 12594 raft_consensus.cc:2272] T 9c9023b52992475a8b8ad4949867582a P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.488201 12594 tablet_replica.cc:333] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.488873 12594 raft_consensus.cc:2243] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.489388 12594 raft_consensus.cc:2272] T 56d963b71e2742f3a74e1bed72d29186 P 371d38ec3c7f493e9aea62dae121e565 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.492229 12594 tablet_replica.cc:333] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.492913 12594 raft_consensus.cc:2243] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.493508 12594 raft_consensus.cc:2272] T 2434ada128f843908123ae8965e66222 P 371d38ec3c7f493e9aea62dae121e565 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.495975 12594 tablet_replica.cc:333] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.496555 12594 raft_consensus.cc:2243] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.496889 12594 raft_consensus.cc:2272] T 44bb47d9fadc476296b95dba1bf4d037 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.498835 12594 tablet_replica.cc:333] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.499313 12594 raft_consensus.cc:2243] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.500063 12594 raft_consensus.cc:2272] T 5634eebf5657424c9f136d8f08e8e8f6 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.501894 12594 tablet_replica.cc:333] T ebca88391e7141659bba4fdc89e8a954 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.502351 12594 raft_consensus.cc:2243] T ebca88391e7141659bba4fdc89e8a954 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.502704 12594 raft_consensus.cc:2272] T ebca88391e7141659bba4fdc89e8a954 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.504539 12594 tablet_replica.cc:333] T 181a60684715425284af6a13cc16242f P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.505013 12594 raft_consensus.cc:2243] T 181a60684715425284af6a13cc16242f P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.505345 12594 raft_consensus.cc:2272] T 181a60684715425284af6a13cc16242f P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.507146 12594 tablet_replica.cc:333] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.507654 12594 raft_consensus.cc:2243] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.508303 12594 raft_consensus.cc:2272] T c7b7f9ed1b11429d98f831e122707ae2 P 371d38ec3c7f493e9aea62dae121e565 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.510056 12594 tablet_replica.cc:333] T 2959be4ebd674047ba6d57a27b8b5865 P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.510545 12594 raft_consensus.cc:2243] T 2959be4ebd674047ba6d57a27b8b5865 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.510939 12594 raft_consensus.cc:2272] T 2959be4ebd674047ba6d57a27b8b5865 P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.512873 12594 tablet_replica.cc:333] T 8f1e603414db46e7bf2cdd620118e39d P 371d38ec3c7f493e9aea62dae121e565: stopping tablet replica
I20260709 13:10:52.513396 12594 raft_consensus.cc:2243] T 8f1e603414db46e7bf2cdd620118e39d P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.513788 12594 raft_consensus.cc:2272] T 8f1e603414db46e7bf2cdd620118e39d P 371d38ec3c7f493e9aea62dae121e565 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:52.532989 22276 consensus_peers.cc:597] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Couldn't send request to peer 371d38ec3c7f493e9aea62dae121e565. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:52.569933 22276 consensus_peers.cc:597] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Couldn't send request to peer 371d38ec3c7f493e9aea62dae121e565. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:52.571669 22350 consensus_peers.cc:597] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b -> Peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Couldn't send request to peer 371d38ec3c7f493e9aea62dae121e565. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.594005 12594 tablet_server.cc:196] TabletServer@127.12.76.130:0 shutdown complete.
W20260709 13:10:52.625109 22350 consensus_peers.cc:597] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b -> Peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Couldn't send request to peer 371d38ec3c7f493e9aea62dae121e565. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:43835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:52.625645 22350 consensus_peers.cc:597] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b -> Peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Couldn't send request to peer 371d38ec3c7f493e9aea62dae121e565. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:43835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:52.667711 22350 consensus_peers.cc:597] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b -> Peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Couldn't send request to peer 371d38ec3c7f493e9aea62dae121e565. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:43835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.675241 12594 tablet_server.cc:179] TabletServer@127.12.76.131:0 shutting down...
W20260709 13:10:52.682008 22276 consensus_peers.cc:597] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Couldn't send request to peer 371d38ec3c7f493e9aea62dae121e565. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:43835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:52.690779 22350 consensus_peers.cc:597] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b -> Peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Couldn't send request to peer 371d38ec3c7f493e9aea62dae121e565. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:43835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:52.699479 22351 consensus_peers.cc:597] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b -> Peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Couldn't send request to peer 66d3606ce30b4661b5d62d403d7abca0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:52.704746 22350 consensus_peers.cc:597] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b -> Peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Couldn't send request to peer 371d38ec3c7f493e9aea62dae121e565. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:43835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:52.756608 22276 consensus_peers.cc:597] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Couldn't send request to peer 371d38ec3c7f493e9aea62dae121e565. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:43835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:52.758117 22351 consensus_peers.cc:597] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b -> Peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Couldn't send request to peer 66d3606ce30b4661b5d62d403d7abca0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:52.758905 22276 consensus_peers.cc:597] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Couldn't send request to peer 371d38ec3c7f493e9aea62dae121e565. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:43835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.759742 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:52.760692 12594 tablet_replica.cc:333] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.761373 12594 raft_consensus.cc:2243] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.761860 12594 raft_consensus.cc:2272] T f92f72a0e3ac48d480bb25e4f8f64c43 P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.764760 12594 tablet_replica.cc:333] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.765568 12594 raft_consensus.cc:2243] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 4 LEADER]: Raft consensus shutting down.
W20260709 13:10:52.766196 22276 consensus_peers.cc:597] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 -> Peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Couldn't send request to peer 371d38ec3c7f493e9aea62dae121e565. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:43835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.766511 12594 raft_consensus.cc:2272] T 2434ada128f843908123ae8965e66222 P 66d3606ce30b4661b5d62d403d7abca0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.769234 12594 tablet_replica.cc:333] T a4695de4c0534d2d8d2a4c79aab3654d P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.770042 12594 raft_consensus.cc:2243] T a4695de4c0534d2d8d2a4c79aab3654d P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.770459 12594 raft_consensus.cc:2272] T a4695de4c0534d2d8d2a4c79aab3654d P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.772351 12594 tablet_replica.cc:333] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.772967 12594 raft_consensus.cc:2243] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.773488 12594 raft_consensus.cc:2272] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.776206 12594 tablet_replica.cc:333] T e56649a39ed04a1682d5f0473dbb791e P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.776937 12594 raft_consensus.cc:2243] T e56649a39ed04a1682d5f0473dbb791e P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.777387 12594 raft_consensus.cc:2272] T e56649a39ed04a1682d5f0473dbb791e P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:52.779282 22350 consensus_peers.cc:597] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b -> Peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Couldn't send request to peer 371d38ec3c7f493e9aea62dae121e565. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:43835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.780346 12594 tablet_replica.cc:333] T 45d6ad58386642cd897d5378d8b9bc58 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.781154 12594 raft_consensus.cc:2243] T 45d6ad58386642cd897d5378d8b9bc58 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.781638 12594 raft_consensus.cc:2272] T 45d6ad58386642cd897d5378d8b9bc58 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.783655 12594 tablet_replica.cc:333] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.784227 12594 raft_consensus.cc:2243] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.785270 12594 raft_consensus.cc:2272] T bb2e1e35ba2d4732a195046335a7af7c P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.787206 12594 tablet_replica.cc:333] T 172a5324a0f04ae9b78b1bc0b106dbea P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.787765 12594 raft_consensus.cc:2243] T 172a5324a0f04ae9b78b1bc0b106dbea P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.788151 12594 raft_consensus.cc:2272] T 172a5324a0f04ae9b78b1bc0b106dbea P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.790053 12594 tablet_replica.cc:333] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.790683 12594 raft_consensus.cc:2243] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.791078 12594 raft_consensus.cc:2272] T 535cc40e1cc04f16a78d6fbd34a69f3f P 66d3606ce30b4661b5d62d403d7abca0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.793011 12594 tablet_replica.cc:333] T d1d8b26b38b341878e580b51c9014cec P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.793545 12594 raft_consensus.cc:2243] T d1d8b26b38b341878e580b51c9014cec P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.793974 12594 raft_consensus.cc:2272] T d1d8b26b38b341878e580b51c9014cec P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.795755 12594 tablet_replica.cc:333] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.796469 12594 raft_consensus.cc:2243] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.797305 12594 raft_consensus.cc:2272] T 97e1c9af3eb64e7dbff4f9df54341806 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.799787 12594 tablet_replica.cc:333] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
W20260709 13:10:52.800590 22351 consensus_peers.cc:597] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b -> Peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Couldn't send request to peer 66d3606ce30b4661b5d62d403d7abca0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.800669 12594 raft_consensus.cc:2243] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.801852 12594 raft_consensus.cc:2272] T 40b118b701f94b3bacbbca2df47fe5bd P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.804735 12594 tablet_replica.cc:333] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.805315 12594 raft_consensus.cc:2243] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.805837 12594 raft_consensus.cc:2272] T 6f91956634f346fbaed9bc3d2785f528 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.808185 12594 tablet_replica.cc:333] T c7b7f9ed1b11429d98f831e122707ae2 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.808780 12594 raft_consensus.cc:2243] T c7b7f9ed1b11429d98f831e122707ae2 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.809249 12594 raft_consensus.cc:2272] T c7b7f9ed1b11429d98f831e122707ae2 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.810935 12594 tablet_replica.cc:333] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.811511 12594 raft_consensus.cc:2243] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.812211 12594 raft_consensus.cc:2272] T b14e4aeab76f42f7a5a63d191494a79c P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.814057 12594 tablet_replica.cc:333] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.814543 12594 raft_consensus.cc:2243] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.815311 12594 raft_consensus.cc:2272] T 8e4e00f55ac949c2a073e99cf9bc9290 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.817238 12594 tablet_replica.cc:333] T 12df2e627ea748c5908bd073b917bf29 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.817793 12594 raft_consensus.cc:2243] T 12df2e627ea748c5908bd073b917bf29 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.818207 12594 raft_consensus.cc:2272] T 12df2e627ea748c5908bd073b917bf29 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.820123 12594 tablet_replica.cc:333] T b570b00ae75a47cda3fcb47ad5f0f97c P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.820688 12594 raft_consensus.cc:2243] T b570b00ae75a47cda3fcb47ad5f0f97c P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.821084 12594 raft_consensus.cc:2272] T b570b00ae75a47cda3fcb47ad5f0f97c P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.822861 12594 tablet_replica.cc:333] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.823378 12594 raft_consensus.cc:2243] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.823939 12594 raft_consensus.cc:2272] T b9c1ffecc5b948bd8f3f48d9a7a40a96 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.825898 12594 tablet_replica.cc:333] T 3559a60bb91946b988a872f1f28f20f8 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.826769 12594 raft_consensus.cc:2243] T 3559a60bb91946b988a872f1f28f20f8 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.827201 12594 raft_consensus.cc:2272] T 3559a60bb91946b988a872f1f28f20f8 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.829844 12594 tablet_replica.cc:333] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.830600 12594 raft_consensus.cc:2243] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.831482 12594 raft_consensus.cc:2272] T 3a808c750d4749df9579874d7371e2e9 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.833379 12594 tablet_replica.cc:333] T 339b03c27dab449090201492ec507025 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.833886 12594 raft_consensus.cc:2243] T 339b03c27dab449090201492ec507025 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.834291 12594 raft_consensus.cc:2272] T 339b03c27dab449090201492ec507025 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.836088 12594 tablet_replica.cc:333] T acf09c0982fd493caaf8c31bc1964c22 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.836594 12594 raft_consensus.cc:2243] T acf09c0982fd493caaf8c31bc1964c22 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.836988 12594 raft_consensus.cc:2272] T acf09c0982fd493caaf8c31bc1964c22 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.838737 12594 tablet_replica.cc:333] T ebca88391e7141659bba4fdc89e8a954 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.839247 12594 raft_consensus.cc:2243] T ebca88391e7141659bba4fdc89e8a954 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.839655 12594 raft_consensus.cc:2272] T ebca88391e7141659bba4fdc89e8a954 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.841463 12594 tablet_replica.cc:333] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.841986 12594 raft_consensus.cc:2243] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.842371 12594 raft_consensus.cc:2272] T 94b3204b820c4446bb957d44063ecbe0 P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.844110 12594 tablet_replica.cc:333] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.844615 12594 raft_consensus.cc:2243] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.845363 12594 raft_consensus.cc:2272] T b501417270f5431da901577c6e5da05f P 66d3606ce30b4661b5d62d403d7abca0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.847153 12594 tablet_replica.cc:333] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.847733 12594 raft_consensus.cc:2243] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.848155 12594 raft_consensus.cc:2272] T 5ced150f7b0b41c5a9a55795474c3eed P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.850466 12594 tablet_replica.cc:333] T 4805089364594284ba715cf71e92f20c P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.851118 12594 raft_consensus.cc:2243] T 4805089364594284ba715cf71e92f20c P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.851624 12594 raft_consensus.cc:2272] T 4805089364594284ba715cf71e92f20c P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:52.852056 22351 consensus_peers.cc:597] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b -> Peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Couldn't send request to peer 66d3606ce30b4661b5d62d403d7abca0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.853631 12594 tablet_replica.cc:333] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.854245 12594 raft_consensus.cc:2243] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.854665 12594 raft_consensus.cc:2272] T 69ff2881b0ad428984068a6150870c61 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.856659 12594 tablet_replica.cc:333] T da53827c80a54c43a6cdcb57b857f7a3 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.857316 12594 raft_consensus.cc:2243] T da53827c80a54c43a6cdcb57b857f7a3 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.857741 12594 raft_consensus.cc:2272] T da53827c80a54c43a6cdcb57b857f7a3 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:52.858950 22351 consensus_peers.cc:597] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b -> Peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Couldn't send request to peer 66d3606ce30b4661b5d62d403d7abca0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.859989 12594 tablet_replica.cc:333] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.860636 12594 raft_consensus.cc:2243] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.861366 12594 raft_consensus.cc:2272] T c7698abde6404f019732b30297ad5923 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.863370 12594 tablet_replica.cc:333] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.863972 12594 raft_consensus.cc:2243] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.864682 12594 raft_consensus.cc:2272] T 181a60684715425284af6a13cc16242f P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.866490 12594 tablet_replica.cc:333] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.867252 12594 raft_consensus.cc:2243] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.867707 12594 raft_consensus.cc:2272] T aa3c95d8e81a462283bc0799ade2104b P 66d3606ce30b4661b5d62d403d7abca0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.869616 12594 tablet_replica.cc:333] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.870147 12594 raft_consensus.cc:2243] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.870911 12594 raft_consensus.cc:2272] T b28d9c95ac3d49219dc6a5d5739f6ead P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.872864 12594 tablet_replica.cc:333] T 9de1c7b16c2347058e4b97f057c06690 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.873370 12594 raft_consensus.cc:2243] T 9de1c7b16c2347058e4b97f057c06690 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.873785 12594 raft_consensus.cc:2272] T 9de1c7b16c2347058e4b97f057c06690 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.876338 12594 tablet_replica.cc:333] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.877023 12594 raft_consensus.cc:2243] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.877910 12594 raft_consensus.cc:2272] T bb5f23465fe44a799f3521c814b38d55 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.880210 12594 tablet_replica.cc:333] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.880831 12594 raft_consensus.cc:2243] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.881333 12594 raft_consensus.cc:2272] T c6f0ec01ac814561a087cb72983b73de P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.883244 12594 tablet_replica.cc:333] T 3a65572e11044c94ba6e4bf799385437 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.883939 12594 raft_consensus.cc:2243] T 3a65572e11044c94ba6e4bf799385437 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.884315 12594 raft_consensus.cc:2272] T 3a65572e11044c94ba6e4bf799385437 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.886065 12594 tablet_replica.cc:333] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.886581 12594 raft_consensus.cc:2243] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.887336 12594 raft_consensus.cc:2272] T 90ecf0583df84abeae688412d6870da7 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.889236 12594 tablet_replica.cc:333] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.889731 12594 raft_consensus.cc:2243] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.890472 12594 raft_consensus.cc:2272] T c144955449774c3c90f8e0ed28cc5155 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.892493 12594 tablet_replica.cc:333] T 486fbb450f854f00af3362b34a0ef614 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.892993 12594 raft_consensus.cc:2243] T 486fbb450f854f00af3362b34a0ef614 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.893392 12594 raft_consensus.cc:2272] T 486fbb450f854f00af3362b34a0ef614 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.895821 12594 tablet_replica.cc:333] T 394fa17836c34b6d8e074e7ec63d4387 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.896430 12594 raft_consensus.cc:2243] T 394fa17836c34b6d8e074e7ec63d4387 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.896920 12594 raft_consensus.cc:2272] T 394fa17836c34b6d8e074e7ec63d4387 P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.899626 12594 tablet_replica.cc:333] T 255341bbdc0147aca3a664fdaa81ebf5 P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.900278 12594 raft_consensus.cc:2243] T 255341bbdc0147aca3a664fdaa81ebf5 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.900818 12594 raft_consensus.cc:2272] T 255341bbdc0147aca3a664fdaa81ebf5 P 66d3606ce30b4661b5d62d403d7abca0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.903398 12594 tablet_replica.cc:333] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0: stopping tablet replica
I20260709 13:10:52.903906 12594 raft_consensus.cc:2243] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.904678 12594 raft_consensus.cc:2272] T af8b0a3da29749fdb5bffa995ff8ac1e P 66d3606ce30b4661b5d62d403d7abca0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.978170 12594 tablet_server.cc:196] TabletServer@127.12.76.131:0 shutdown complete.
I20260709 13:10:53.015348 23282 raft_consensus.cc:493] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:53.016028 23282 raft_consensus.cc:515] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:53.018404 23282 leader_election.cc:290] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
W20260709 13:10:53.019886 22351 consensus_peers.cc:597] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b -> Peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Couldn't send request to peer 66d3606ce30b4661b5d62d403d7abca0. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.131:46871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:53.022240 22351 consensus_peers.cc:597] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b -> Peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Couldn't send request to peer 66d3606ce30b4661b5d62d403d7abca0. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.131:46871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:53.022742 22351 leader_election.cc:336] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Network error: Client connection negotiation failed: client connection to 127.12.76.131:46871: connect: Connection refused (error 111)
W20260709 13:10:53.023279 22349 leader_election.cc:336] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111)
I20260709 13:10:53.023878 22349 leader_election.cc:304] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:53.024677 23272 raft_consensus.cc:2749] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:53.032470 22351 consensus_peers.cc:597] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b -> Peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Couldn't send request to peer 66d3606ce30b4661b5d62d403d7abca0. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.131:46871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:53.045253 22351 consensus_peers.cc:597] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b -> Peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Couldn't send request to peer 66d3606ce30b4661b5d62d403d7abca0. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.131:46871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:53.054664 23282 raft_consensus.cc:493] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:53.054857 12594 tablet_server.cc:179] TabletServer@127.12.76.132:0 shutting down...
I20260709 13:10:53.055284 23282 raft_consensus.cc:515] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } } peers { permanent_uuid: "371d38ec3c7f493e9aea62dae121e565" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43835 } }
I20260709 13:10:53.062055 23282 leader_election.cc:290] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591), 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835)
W20260709 13:10:53.065594 22350 leader_election.cc:336] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 371d38ec3c7f493e9aea62dae121e565 (127.12.76.130:43835): Network error: Client connection negotiation failed: client connection to 127.12.76.130:43835: connect: Connection refused (error 111)
W20260709 13:10:53.066211 22349 leader_election.cc:336] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111)
I20260709 13:10:53.066601 22349 leader_election.cc:304] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 371d38ec3c7f493e9aea62dae121e565, 5d515385609945e5837e85b77de385e2
I20260709 13:10:53.067232 23282 raft_consensus.cc:2749] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:53.088254 22351 consensus_peers.cc:597] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b -> Peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Couldn't send request to peer 66d3606ce30b4661b5d62d403d7abca0. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.131:46871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:53.105060 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:53.105911 12594 tablet_replica.cc:333] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.106598 12594 raft_consensus.cc:2243] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.107522 12594 raft_consensus.cc:2272] T ecb5c885975e4259a69644775bb930f1 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.110167 12594 tablet_replica.cc:333] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.111023 12594 raft_consensus.cc:2243] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.111943 12594 raft_consensus.cc:2272] T 172a5324a0f04ae9b78b1bc0b106dbea P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.114452 12594 tablet_replica.cc:333] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.115043 12594 raft_consensus.cc:2243] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.115497 12594 raft_consensus.cc:2272] T b28d9c95ac3d49219dc6a5d5739f6ead P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.117267 12594 tablet_replica.cc:333] T 9de1c7b16c2347058e4b97f057c06690 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.117838 12594 raft_consensus.cc:2243] T 9de1c7b16c2347058e4b97f057c06690 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.118299 12594 raft_consensus.cc:2272] T 9de1c7b16c2347058e4b97f057c06690 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.119516 23282 raft_consensus.cc:493] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:53.119953 23282 raft_consensus.cc:515] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:53.120505 12594 tablet_replica.cc:333] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.121150 12594 raft_consensus.cc:2243] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.121722 23282 leader_election.cc:290] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:53.122088 12594 raft_consensus.cc:2272] T e56649a39ed04a1682d5f0473dbb791e P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.124812 12594 tablet_replica.cc:333] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.125540 12594 raft_consensus.cc:2243] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:53.125818 22349 leader_election.cc:336] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111)
I20260709 13:10:53.125941 12594 raft_consensus.cc:2272] T 45d6ad58386642cd897d5378d8b9bc58 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:53.126369 22351 leader_election.cc:336] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Network error: Client connection negotiation failed: client connection to 127.12.76.131:46871: connect: Connection refused (error 111)
I20260709 13:10:53.126758 22351 leader_election.cc:304] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:53.127532 23282 raft_consensus.cc:2749] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:53.128381 12594 tablet_replica.cc:333] T bb2e1e35ba2d4732a195046335a7af7c P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.129004 12594 raft_consensus.cc:2243] T bb2e1e35ba2d4732a195046335a7af7c P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.129431 12594 raft_consensus.cc:2272] T bb2e1e35ba2d4732a195046335a7af7c P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.131219 12594 tablet_replica.cc:333] T 9dee9596873a4f1da4230b8f9b4467fc P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.131798 12594 raft_consensus.cc:2243] T 9dee9596873a4f1da4230b8f9b4467fc P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.132210 12594 raft_consensus.cc:2272] T 9dee9596873a4f1da4230b8f9b4467fc P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.133881 12594 tablet_replica.cc:333] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.134405 12594 raft_consensus.cc:2243] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.135124 12594 raft_consensus.cc:2272] T 3a23c35530d84893bfc638fe35760483 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.137053 12594 tablet_replica.cc:333] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.137574 12594 raft_consensus.cc:2243] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.137971 12594 raft_consensus.cc:2272] T 0368f9bb9bc94a05bcbf9cfdcb7eac4e P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.139832 12594 tablet_replica.cc:333] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.140378 12594 raft_consensus.cc:2243] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.140841 12594 raft_consensus.cc:2272] T 8e4e00f55ac949c2a073e99cf9bc9290 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.142830 12594 tablet_replica.cc:333] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.143383 12594 raft_consensus.cc:2243] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.143836 12594 raft_consensus.cc:2272] T b2c563b0b9ff42638139dc08d9fd2e23 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.145814 12594 tablet_replica.cc:333] T c144955449774c3c90f8e0ed28cc5155 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.146328 12594 raft_consensus.cc:2243] T c144955449774c3c90f8e0ed28cc5155 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.146727 12594 raft_consensus.cc:2272] T c144955449774c3c90f8e0ed28cc5155 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.148592 12594 tablet_replica.cc:333] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.149242 12594 raft_consensus.cc:2243] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.150359 12594 raft_consensus.cc:2272] T 486fbb450f854f00af3362b34a0ef614 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.152437 12594 tablet_replica.cc:333] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.152952 12594 raft_consensus.cc:2243] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.153746 12594 raft_consensus.cc:2272] T 394fa17836c34b6d8e074e7ec63d4387 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.155730 12594 tablet_replica.cc:333] T 97e1c9af3eb64e7dbff4f9df54341806 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.156278 12594 raft_consensus.cc:2243] T 97e1c9af3eb64e7dbff4f9df54341806 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.156669 12594 raft_consensus.cc:2272] T 97e1c9af3eb64e7dbff4f9df54341806 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.157948 23282 raft_consensus.cc:493] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d515385609945e5837e85b77de385e2)
I20260709 13:10:53.158555 12594 tablet_replica.cc:333] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.158409 23282 raft_consensus.cc:515] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66d3606ce30b4661b5d62d403d7abca0" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 46871 } } peers { permanent_uuid: "edd63b54133d4c8d9149d57a2886916b" member_type: VOTER last_known_addr { host: "127.12.76.132" port: 45017 } } peers { permanent_uuid: "5d515385609945e5837e85b77de385e2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33591 } }
I20260709 13:10:53.159224 12594 raft_consensus.cc:2243] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.159672 12594 raft_consensus.cc:2272] T c7b7f9ed1b11429d98f831e122707ae2 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.160333 23282 leader_election.cc:290] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871), 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591)
I20260709 13:10:53.162176 12594 tablet_replica.cc:333] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.162899 12594 raft_consensus.cc:2243] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.163484 12594 raft_consensus.cc:2272] T b14e4aeab76f42f7a5a63d191494a79c P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:53.164027 22351 leader_election.cc:336] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 66d3606ce30b4661b5d62d403d7abca0 (127.12.76.131:46871): Network error: Client connection negotiation failed: client connection to 127.12.76.131:46871: connect: Connection refused (error 111)
W20260709 13:10:53.165549 22349 leader_election.cc:336] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5d515385609945e5837e85b77de385e2 (127.12.76.129:33591): Network error: Client connection negotiation failed: client connection to 127.12.76.129:33591: connect: Connection refused (error 111)
I20260709 13:10:53.165926 12594 tablet_replica.cc:333] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.165923 22349 leader_election.cc:304] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edd63b54133d4c8d9149d57a2886916b; no voters: 5d515385609945e5837e85b77de385e2, 66d3606ce30b4661b5d62d403d7abca0
I20260709 13:10:53.166774 12594 raft_consensus.cc:2243] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.166921 23283 raft_consensus.cc:2749] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:53.167340 12594 raft_consensus.cc:2272] T 4179392a8cb048c1982df1ea690bb4b9 P edd63b54133d4c8d9149d57a2886916b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.169304 12594 tablet_replica.cc:333] T 4805089364594284ba715cf71e92f20c P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.169859 12594 raft_consensus.cc:2243] T 4805089364594284ba715cf71e92f20c P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.170281 12594 raft_consensus.cc:2272] T 4805089364594284ba715cf71e92f20c P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.172235 12594 tablet_replica.cc:333] T 69ff2881b0ad428984068a6150870c61 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.172737 12594 raft_consensus.cc:2243] T 69ff2881b0ad428984068a6150870c61 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.173142 12594 raft_consensus.cc:2272] T 69ff2881b0ad428984068a6150870c61 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.174861 12594 tablet_replica.cc:333] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.175369 12594 raft_consensus.cc:2243] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.175800 12594 raft_consensus.cc:2272] T 39c5c419abe445e9ba439d1a0792991e P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.177466 12594 tablet_replica.cc:333] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.178000 12594 raft_consensus.cc:2243] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.178386 12594 raft_consensus.cc:2272] T 3559a60bb91946b988a872f1f28f20f8 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.180107 12594 tablet_replica.cc:333] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.180667 12594 raft_consensus.cc:2243] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.181414 12594 raft_consensus.cc:2272] T acf09c0982fd493caaf8c31bc1964c22 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.183238 12594 tablet_replica.cc:333] T 5634eebf5657424c9f136d8f08e8e8f6 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.183794 12594 raft_consensus.cc:2243] T 5634eebf5657424c9f136d8f08e8e8f6 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.184190 12594 raft_consensus.cc:2272] T 5634eebf5657424c9f136d8f08e8e8f6 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.185935 12594 tablet_replica.cc:333] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.186455 12594 raft_consensus.cc:2243] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.187157 12594 raft_consensus.cc:2272] T ebca88391e7141659bba4fdc89e8a954 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.189211 12594 tablet_replica.cc:333] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.189860 12594 raft_consensus.cc:2243] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.190215 12594 raft_consensus.cc:2272] T 94b3204b820c4446bb957d44063ecbe0 P edd63b54133d4c8d9149d57a2886916b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.192073 12594 tablet_replica.cc:333] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.192561 12594 raft_consensus.cc:2243] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.193248 12594 raft_consensus.cc:2272] T b570b00ae75a47cda3fcb47ad5f0f97c P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.194942 12594 tablet_replica.cc:333] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.195376 12594 raft_consensus.cc:2243] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.195781 12594 raft_consensus.cc:2272] T aa3c95d8e81a462283bc0799ade2104b P edd63b54133d4c8d9149d57a2886916b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.197377 12594 tablet_replica.cc:333] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.197830 12594 raft_consensus.cc:2243] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.198540 12594 raft_consensus.cc:2272] T 2959be4ebd674047ba6d57a27b8b5865 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.200314 12594 tablet_replica.cc:333] T 9c9023b52992475a8b8ad4949867582a P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.200762 12594 raft_consensus.cc:2243] T 9c9023b52992475a8b8ad4949867582a P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.201086 12594 raft_consensus.cc:2272] T 9c9023b52992475a8b8ad4949867582a P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.202939 12594 tablet_replica.cc:333] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.203373 12594 raft_consensus.cc:2243] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.204092 12594 raft_consensus.cc:2272] T 56d963b71e2742f3a74e1bed72d29186 P edd63b54133d4c8d9149d57a2886916b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.205749 12594 tablet_replica.cc:333] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.206244 12594 raft_consensus.cc:2243] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.206872 12594 raft_consensus.cc:2272] T da53827c80a54c43a6cdcb57b857f7a3 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.208519 12594 tablet_replica.cc:333] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.208933 12594 raft_consensus.cc:2243] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.209280 12594 raft_consensus.cc:2272] T b501417270f5431da901577c6e5da05f P edd63b54133d4c8d9149d57a2886916b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.210893 12594 tablet_replica.cc:333] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.211318 12594 raft_consensus.cc:2243] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.211678 12594 raft_consensus.cc:2272] T 63af5dcbd69043a6a704a5fdedd3d371 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.213348 12594 tablet_replica.cc:333] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.213881 12594 raft_consensus.cc:2243] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.214601 12594 raft_consensus.cc:2272] T 3a65572e11044c94ba6e4bf799385437 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.216284 12594 tablet_replica.cc:333] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.216787 12594 raft_consensus.cc:2243] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.217173 12594 raft_consensus.cc:2272] T c9fb0f415f654f798baa3cccc149e8a3 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.218945 12594 tablet_replica.cc:333] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.219456 12594 raft_consensus.cc:2243] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.220189 12594 raft_consensus.cc:2272] T 8f1e603414db46e7bf2cdd620118e39d P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.221967 12594 tablet_replica.cc:333] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.222482 12594 raft_consensus.cc:2243] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.223208 12594 raft_consensus.cc:2272] T 255341bbdc0147aca3a664fdaa81ebf5 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.225144 12594 tablet_replica.cc:333] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.225639 12594 raft_consensus.cc:2243] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.226042 12594 raft_consensus.cc:2272] T dbec8a84225648c28ea36cf425bc09d2 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.227748 12594 tablet_replica.cc:333] T af8b0a3da29749fdb5bffa995ff8ac1e P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.228225 12594 raft_consensus.cc:2243] T af8b0a3da29749fdb5bffa995ff8ac1e P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.228616 12594 raft_consensus.cc:2272] T af8b0a3da29749fdb5bffa995ff8ac1e P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.230288 12594 tablet_replica.cc:333] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.230811 12594 raft_consensus.cc:2243] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.231192 12594 raft_consensus.cc:2272] T 44bb47d9fadc476296b95dba1bf4d037 P edd63b54133d4c8d9149d57a2886916b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.232903 12594 tablet_replica.cc:333] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.233362 12594 raft_consensus.cc:2243] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.233747 12594 raft_consensus.cc:2272] T c7698abde6404f019732b30297ad5923 P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.235585 12594 tablet_replica.cc:333] T 181a60684715425284af6a13cc16242f P edd63b54133d4c8d9149d57a2886916b: stopping tablet replica
I20260709 13:10:53.236011 12594 raft_consensus.cc:2243] T 181a60684715425284af6a13cc16242f P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.236405 12594 raft_consensus.cc:2272] T 181a60684715425284af6a13cc16242f P edd63b54133d4c8d9149d57a2886916b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.310468 12594 tablet_server.cc:196] TabletServer@127.12.76.132:0 shutdown complete.
I20260709 13:10:53.369709 12594 master.cc:562] Master@127.12.76.190:33127 shutting down...
I20260709 13:10:53.398877 12594 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:53.399521 12594 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.399868 12594 tablet_replica.cc:333] T 00000000000000000000000000000000 P c24ffb121ed349ad832a6c8110c109ff: stopping tablet replica
I20260709 13:10:53.421120 12594 master.cc:584] Master@127.12.76.190:33127 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (29063 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:10:53.516722 12594 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.76.190:44103
I20260709 13:10:53.517938 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:53.524279 23286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:53.524665 23287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:53.524880 23289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:53.525305 12594 server_base.cc:1061] running on GCE node
I20260709 13:10:53.526376 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:53.526602 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:53.526772 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602653526755 us; error 0 us; skew 500 ppm
I20260709 13:10:53.527328 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:53.529745 12594 webserver.cc:533] Webserver started at http://127.12.76.190:45531/ using document root <none> and password file <none>
I20260709 13:10:53.530248 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:53.530453 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:53.530740 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:53.531935 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602303087285-12594-0/minicluster-data/master-0-root/instance:
uuid: "6c7e35851ca24db9a2a73c2a439eedfd"
format_stamp: "Formatted at 2026-07-09 13:10:53 on dist-test-slave-th5x"
I20260709 13:10:53.536274 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:53.539573 23294 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:53.540450 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:53.540686 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602303087285-12594-0/minicluster-data/master-0-root
uuid: "6c7e35851ca24db9a2a73c2a439eedfd"
format_stamp: "Formatted at 2026-07-09 13:10:53 on dist-test-slave-th5x"
I20260709 13:10:53.540910 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602303087285-12594-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602303087285-12594-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602303087285-12594-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:53.557331 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:53.558475 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:53.598680 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.190:44103
I20260709 13:10:53.598796 23345 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.190:44103 every 8 connection(s)
I20260709 13:10:53.602867 23346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:53.613762 23346 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd: Bootstrap starting.
I20260709 13:10:53.618820 23346 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:53.623257 23346 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd: No bootstrap required, opened a new log
I20260709 13:10:53.625618 23346 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c7e35851ca24db9a2a73c2a439eedfd" member_type: VOTER }
I20260709 13:10:53.626137 23346 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:53.626430 23346 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c7e35851ca24db9a2a73c2a439eedfd, State: Initialized, Role: FOLLOWER
I20260709 13:10:53.627149 23346 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c7e35851ca24db9a2a73c2a439eedfd" member_type: VOTER }
I20260709 13:10:53.627736 23346 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:53.628042 23346 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:53.628358 23346 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:53.633786 23346 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c7e35851ca24db9a2a73c2a439eedfd" member_type: VOTER }
I20260709 13:10:53.634380 23346 leader_election.cc:304] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c7e35851ca24db9a2a73c2a439eedfd; no voters: 
I20260709 13:10:53.635692 23346 leader_election.cc:290] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:53.636003 23349 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:53.637563 23349 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd [term 1 LEADER]: Becoming Leader. State: Replica: 6c7e35851ca24db9a2a73c2a439eedfd, State: Running, Role: LEADER
I20260709 13:10:53.638262 23349 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c7e35851ca24db9a2a73c2a439eedfd" member_type: VOTER }
I20260709 13:10:53.638998 23346 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:53.642690 23350 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c7e35851ca24db9a2a73c2a439eedfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c7e35851ca24db9a2a73c2a439eedfd" member_type: VOTER } }
I20260709 13:10:53.642717 23351 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c7e35851ca24db9a2a73c2a439eedfd. Latest consensus state: current_term: 1 leader_uuid: "6c7e35851ca24db9a2a73c2a439eedfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c7e35851ca24db9a2a73c2a439eedfd" member_type: VOTER } }
I20260709 13:10:53.643626 23350 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:53.643734 23351 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:53.651571 23355 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:53.657405 23355 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:53.658337 12594 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:53.665895 23355 catalog_manager.cc:1383] Generated new cluster ID: 2c6042e4d8444bf4b2e9e7986c9291c8
I20260709 13:10:53.666180 23355 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:53.682736 23355 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:53.684118 23355 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:53.706702 23355 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd: Generated new TSK 0
I20260709 13:10:53.707361 23355 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:53.725165 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:53.731542 23367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:53.732223 23368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:53.736814 12594 server_base.cc:1061] running on GCE node
W20260709 13:10:53.738829 23370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:53.739929 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:53.740186 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:53.740365 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602653740345 us; error 0 us; skew 500 ppm
I20260709 13:10:53.740901 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:53.743260 12594 webserver.cc:533] Webserver started at http://127.12.76.129:36095/ using document root <none> and password file <none>
I20260709 13:10:53.743837 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:53.744040 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:53.744316 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:53.745397 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602303087285-12594-0/minicluster-data/ts-0-root/instance:
uuid: "61eb6de5f0454198905b91cbde0b9cc1"
format_stamp: "Formatted at 2026-07-09 13:10:53 on dist-test-slave-th5x"
I20260709 13:10:53.749766 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:53.753360 23375 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:53.754141 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:10:53.754451 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602303087285-12594-0/minicluster-data/ts-0-root
uuid: "61eb6de5f0454198905b91cbde0b9cc1"
format_stamp: "Formatted at 2026-07-09 13:10:53 on dist-test-slave-th5x"
I20260709 13:10:53.754746 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602303087285-12594-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602303087285-12594-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602303087285-12594-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:53.763163 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:53.764390 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:53.765846 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:53.768126 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:53.768344 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:53.768589 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:53.768775 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:53.808898 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.129:35437
I20260709 13:10:53.809011 23437 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.129:35437 every 8 connection(s)
I20260709 13:10:53.813660 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:53.821383 23442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:53.822145 23443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:53.827371 12594 server_base.cc:1061] running on GCE node
W20260709 13:10:53.828229 23446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:53.829159 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:53.829429 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:53.829659 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602653829620 us; error 0 us; skew 500 ppm
I20260709 13:10:53.830443 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:53.833308 12594 webserver.cc:533] Webserver started at http://127.12.76.130:42923/ using document root <none> and password file <none>
I20260709 13:10:53.833864 23438 heartbeater.cc:344] Connected to a master server at 127.12.76.190:44103
I20260709 13:10:53.833951 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:53.834472 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:53.834489 23438 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:53.834908 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:53.835470 23438 heartbeater.cc:507] Master 127.12.76.190:44103 requested a full tablet report, sending...
I20260709 13:10:53.836308 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602303087285-12594-0/minicluster-data/ts-1-root/instance:
uuid: "0566c730fa6243e4b7506f8124eae074"
format_stamp: "Formatted at 2026-07-09 13:10:53 on dist-test-slave-th5x"
I20260709 13:10:53.837808 23311 ts_manager.cc:194] Registered new tserver with Master: 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437)
I20260709 13:10:53.840549 23311 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49724
I20260709 13:10:53.843135 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:53.846690 23450 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:53.847501 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:53.847785 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602303087285-12594-0/minicluster-data/ts-1-root
uuid: "0566c730fa6243e4b7506f8124eae074"
format_stamp: "Formatted at 2026-07-09 13:10:53 on dist-test-slave-th5x"
I20260709 13:10:53.848065 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602303087285-12594-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602303087285-12594-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602303087285-12594-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:53.859921 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:53.861068 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:53.862489 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:53.864817 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:53.864986 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:53.865278 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:53.865432 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:53.904646 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.130:37331
I20260709 13:10:53.904825 23512 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.130:37331 every 8 connection(s)
I20260709 13:10:53.909363 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:53.916396 23516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:53.917116 23517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:53.921123 12594 server_base.cc:1061] running on GCE node
W20260709 13:10:53.921478 23519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:53.922441 23513 heartbeater.cc:344] Connected to a master server at 127.12.76.190:44103
I20260709 13:10:53.922662 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:10:53.922904 23513 heartbeater.cc:461] Registering TS with master...
W20260709 13:10:53.922996 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:53.923269 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602653923249 us; error 0 us; skew 500 ppm
I20260709 13:10:53.923838 23513 heartbeater.cc:507] Master 127.12.76.190:44103 requested a full tablet report, sending...
I20260709 13:10:53.924122 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:53.926103 23311 ts_manager.cc:194] Registered new tserver with Master: 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331)
I20260709 13:10:53.927394 23311 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49736
I20260709 13:10:53.928629 12594 webserver.cc:533] Webserver started at http://127.12.76.131:33897/ using document root <none> and password file <none>
I20260709 13:10:53.929229 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:53.929414 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:53.929728 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:53.930871 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602303087285-12594-0/minicluster-data/ts-2-root/instance:
uuid: "406c1f3c281548c8aed4d223f57716ea"
format_stamp: "Formatted at 2026-07-09 13:10:53 on dist-test-slave-th5x"
I20260709 13:10:53.935274 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:53.938632 23524 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:53.939612 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:10:53.939880 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602303087285-12594-0/minicluster-data/ts-2-root
uuid: "406c1f3c281548c8aed4d223f57716ea"
format_stamp: "Formatted at 2026-07-09 13:10:53 on dist-test-slave-th5x"
I20260709 13:10:53.940126 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602303087285-12594-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602303087285-12594-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602303087285-12594-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:53.960069 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:53.961174 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:53.962613 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:53.964916 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:53.965157 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:53.965408 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:53.965585 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:54.005383 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.131:38707
I20260709 13:10:54.005538 23586 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.131:38707 every 8 connection(s)
I20260709 13:10:54.019310 23587 heartbeater.cc:344] Connected to a master server at 127.12.76.190:44103
I20260709 13:10:54.019843 23587 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:54.020691 23587 heartbeater.cc:507] Master 127.12.76.190:44103 requested a full tablet report, sending...
I20260709 13:10:54.022765 23311 ts_manager.cc:194] Registered new tserver with Master: 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:10:54.023185 12594 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014632942s
I20260709 13:10:54.024273 23311 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49744
I20260709 13:10:54.049710 23311 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49754:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:54.052834 23311 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:54.145007 23478 tablet_service.cc:1511] Processing CreateTablet for tablet c5ba72b6f6dd4e6aa70f76ce35926172 (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:54.146521 23478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5ba72b6f6dd4e6aa70f76ce35926172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.146229 23551 tablet_service.cc:1511] Processing CreateTablet for tablet 54ab7e6addc2428d9c507042be9c6826 (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:54.147779 23551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54ab7e6addc2428d9c507042be9c6826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.147636 23402 tablet_service.cc:1511] Processing CreateTablet for tablet 54ab7e6addc2428d9c507042be9c6826 (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:54.146556 23403 tablet_service.cc:1511] Processing CreateTablet for tablet c5ba72b6f6dd4e6aa70f76ce35926172 (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:54.149081 23402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54ab7e6addc2428d9c507042be9c6826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.149951 23403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5ba72b6f6dd4e6aa70f76ce35926172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.150611 23550 tablet_service.cc:1511] Processing CreateTablet for tablet e966b1a3927f41f28f706bcc1e6de3a2 (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:54.151158 23401 tablet_service.cc:1511] Processing CreateTablet for tablet e966b1a3927f41f28f706bcc1e6de3a2 (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:54.151996 23550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e966b1a3927f41f28f706bcc1e6de3a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.152474 23401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e966b1a3927f41f28f706bcc1e6de3a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.145051 23552 tablet_service.cc:1511] Processing CreateTablet for tablet c5ba72b6f6dd4e6aa70f76ce35926172 (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:54.154867 23477 tablet_service.cc:1511] Processing CreateTablet for tablet 54ab7e6addc2428d9c507042be9c6826 (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:54.155531 23552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5ba72b6f6dd4e6aa70f76ce35926172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.156219 23477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54ab7e6addc2428d9c507042be9c6826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.157467 23400 tablet_service.cc:1511] Processing CreateTablet for tablet 3564c9e881c54f11a82c0a5012e3ceb9 (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:54.158830 23400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3564c9e881c54f11a82c0a5012e3ceb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.160487 23475 tablet_service.cc:1511] Processing CreateTablet for tablet 3564c9e881c54f11a82c0a5012e3ceb9 (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:54.160670 23399 tablet_service.cc:1511] Processing CreateTablet for tablet 524cd1c347354d3a9ecf13e1089ad7de (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:54.161903 23475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3564c9e881c54f11a82c0a5012e3ceb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.162149 23399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 524cd1c347354d3a9ecf13e1089ad7de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.164794 23476 tablet_service.cc:1511] Processing CreateTablet for tablet e966b1a3927f41f28f706bcc1e6de3a2 (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:54.166561 23476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e966b1a3927f41f28f706bcc1e6de3a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.174782 23549 tablet_service.cc:1511] Processing CreateTablet for tablet 3564c9e881c54f11a82c0a5012e3ceb9 (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:54.176450 23549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3564c9e881c54f11a82c0a5012e3ceb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.208693 23602 tablet_bootstrap.cc:492] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap starting.
I20260709 13:10:54.214401 23474 tablet_service.cc:1511] Processing CreateTablet for tablet 524cd1c347354d3a9ecf13e1089ad7de (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:54.215832 23474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 524cd1c347354d3a9ecf13e1089ad7de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.215934 23548 tablet_service.cc:1511] Processing CreateTablet for tablet 524cd1c347354d3a9ecf13e1089ad7de (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:54.217351 23548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 524cd1c347354d3a9ecf13e1089ad7de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.219781 23473 tablet_service.cc:1511] Processing CreateTablet for tablet 6f000dae80a849a28f3f5151891d8e17 (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:54.222025 23547 tablet_service.cc:1511] Processing CreateTablet for tablet 6f000dae80a849a28f3f5151891d8e17 (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:54.226912 23547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f000dae80a849a28f3f5151891d8e17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.229234 23473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f000dae80a849a28f3f5151891d8e17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.242595 23604 tablet_bootstrap.cc:492] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074: Bootstrap starting.
I20260709 13:10:54.243372 23403 tablet_service.cc:1511] Processing CreateTablet for tablet 6f000dae80a849a28f3f5151891d8e17 (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:54.248843 23403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f000dae80a849a28f3f5151891d8e17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.260643 23602 tablet_bootstrap.cc:654] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.266844 23604 tablet_bootstrap.cc:654] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.266490 23400 tablet_service.cc:1511] Processing CreateTablet for tablet 21a20395358b414e9c05ccd833dc9ae8 (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:54.268383 23400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a20395358b414e9c05ccd833dc9ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.267876 23473 tablet_service.cc:1511] Processing CreateTablet for tablet 21a20395358b414e9c05ccd833dc9ae8 (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:54.270023 23473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a20395358b414e9c05ccd833dc9ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.277341 23603 tablet_bootstrap.cc:492] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea: Bootstrap starting.
I20260709 13:10:54.279003 23474 tablet_service.cc:1511] Processing CreateTablet for tablet c25600b8c5804b40a113d63912f38530 (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:54.280313 23474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c25600b8c5804b40a113d63912f38530. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.288757 23552 tablet_service.cc:1511] Processing CreateTablet for tablet 21a20395358b414e9c05ccd833dc9ae8 (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:54.293139 23399 tablet_service.cc:1511] Processing CreateTablet for tablet c25600b8c5804b40a113d63912f38530 (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:54.294652 23399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c25600b8c5804b40a113d63912f38530. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.296618 23603 tablet_bootstrap.cc:654] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.293694 23602 tablet_bootstrap.cc:492] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1: No bootstrap required, opened a new log
I20260709 13:10:54.297227 23602 ts_tablet_manager.cc:1403] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.000s
I20260709 13:10:54.298365 23550 tablet_service.cc:1511] Processing CreateTablet for tablet c25600b8c5804b40a113d63912f38530 (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:54.299584 23552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a20395358b414e9c05ccd833dc9ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.300324 23550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c25600b8c5804b40a113d63912f38530. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.307193 23604 tablet_bootstrap.cc:492] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074: No bootstrap required, opened a new log
I20260709 13:10:54.307739 23604 ts_tablet_manager.cc:1403] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.000s
I20260709 13:10:54.308159 23473 tablet_service.cc:1511] Processing CreateTablet for tablet 6595a05f3ee646e290107a904450fdb4 (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:54.309494 23473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6595a05f3ee646e290107a904450fdb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.310825 23604 raft_consensus.cc:359] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.311596 23604 raft_consensus.cc:385] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.311910 23604 raft_consensus.cc:740] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.312673 23604 consensus_queue.cc:260] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.314821 23602 raft_consensus.cc:359] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.315914 23602 raft_consensus.cc:385] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.316345 23602 raft_consensus.cc:740] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61eb6de5f0454198905b91cbde0b9cc1, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.318516 23548 tablet_service.cc:1511] Processing CreateTablet for tablet 6595a05f3ee646e290107a904450fdb4 (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:54.324643 23548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6595a05f3ee646e290107a904450fdb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.311673 23401 tablet_service.cc:1511] Processing CreateTablet for tablet 6595a05f3ee646e290107a904450fdb4 (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:54.327765 23401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6595a05f3ee646e290107a904450fdb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.330791 23400 tablet_service.cc:1511] Processing CreateTablet for tablet 031e3cbadd274f30b727bb838177869b (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:54.332170 23400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031e3cbadd274f30b727bb838177869b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.339819 23602 consensus_queue.cc:260] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.343461 23474 tablet_service.cc:1511] Processing CreateTablet for tablet 031e3cbadd274f30b727bb838177869b (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:54.344722 23474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031e3cbadd274f30b727bb838177869b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.348827 23438 heartbeater.cc:499] Master 127.12.76.190:44103 was elected leader, sending a full tablet report...
I20260709 13:10:54.360479 23552 tablet_service.cc:1511] Processing CreateTablet for tablet 031e3cbadd274f30b727bb838177869b (DEFAULT_TABLE table=test-workload [id=c54d02c07fb243f888d28865bddfa7c4]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:54.361795 23552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031e3cbadd274f30b727bb838177869b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.396490 23602 ts_tablet_manager.cc:1434] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent starting tablet: real 0.099s	user 0.008s	sys 0.000s
I20260709 13:10:54.398039 23602 tablet_bootstrap.cc:492] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap starting.
I20260709 13:10:54.412624 23513 heartbeater.cc:499] Master 127.12.76.190:44103 was elected leader, sending a full tablet report...
I20260709 13:10:54.418802 23604 ts_tablet_manager.cc:1434] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074: Time spent starting tablet: real 0.111s	user 0.028s	sys 0.031s
I20260709 13:10:54.419252 23602 tablet_bootstrap.cc:654] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.419898 23604 tablet_bootstrap.cc:492] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074: Bootstrap starting.
I20260709 13:10:54.420240 23603 tablet_bootstrap.cc:492] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea: No bootstrap required, opened a new log
I20260709 13:10:54.420801 23603 ts_tablet_manager.cc:1403] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea: Time spent bootstrapping tablet: real 0.144s	user 0.066s	sys 0.058s
I20260709 13:10:54.423748 23603 raft_consensus.cc:359] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.424571 23603 raft_consensus.cc:385] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.424870 23603 raft_consensus.cc:740] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406c1f3c281548c8aed4d223f57716ea, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.425808 23603 consensus_queue.cc:260] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.427469 23604 tablet_bootstrap.cc:654] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.444479 23602 tablet_bootstrap.cc:492] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1: No bootstrap required, opened a new log
I20260709 13:10:54.447027 23603 ts_tablet_manager.cc:1434] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea: Time spent starting tablet: real 0.026s	user 0.014s	sys 0.011s
I20260709 13:10:54.447824 23587 heartbeater.cc:499] Master 127.12.76.190:44103 was elected leader, sending a full tablet report...
I20260709 13:10:54.448238 23603 tablet_bootstrap.cc:492] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea: Bootstrap starting.
I20260709 13:10:54.449101 23604 tablet_bootstrap.cc:492] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074: No bootstrap required, opened a new log
I20260709 13:10:54.449600 23604 ts_tablet_manager.cc:1403] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.012s
I20260709 13:10:54.453413 23602 ts_tablet_manager.cc:1403] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.012s
I20260709 13:10:54.454995 23603 tablet_bootstrap.cc:654] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.452610 23604 raft_consensus.cc:359] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.456151 23604 raft_consensus.cc:385] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.456604 23604 raft_consensus.cc:740] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.457034 23602 raft_consensus.cc:359] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.457881 23602 raft_consensus.cc:385] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.457438 23604 consensus_queue.cc:260] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.460355 23604 ts_tablet_manager.cc:1434] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:10:54.461639 23604 tablet_bootstrap.cc:492] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074: Bootstrap starting.
I20260709 13:10:54.458250 23602 raft_consensus.cc:740] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61eb6de5f0454198905b91cbde0b9cc1, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.463107 23602 consensus_queue.cc:260] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.470678 23602 ts_tablet_manager.cc:1434] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 13:10:54.471879 23602 tablet_bootstrap.cc:492] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap starting.
I20260709 13:10:54.470731 23604 tablet_bootstrap.cc:654] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.473836 23603 tablet_bootstrap.cc:492] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea: No bootstrap required, opened a new log
I20260709 13:10:54.474484 23603 ts_tablet_manager.cc:1403] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea: Time spent bootstrapping tablet: real 0.026s	user 0.021s	sys 0.004s
I20260709 13:10:54.478402 23602 tablet_bootstrap.cc:654] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.478406 23603 raft_consensus.cc:359] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.479611 23603 raft_consensus.cc:385] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.480108 23603 raft_consensus.cc:740] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406c1f3c281548c8aed4d223f57716ea, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.481153 23603 consensus_queue.cc:260] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.483268 23603 ts_tablet_manager.cc:1434] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:10:54.484272 23603 tablet_bootstrap.cc:492] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea: Bootstrap starting.
I20260709 13:10:54.484804 23604 tablet_bootstrap.cc:492] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074: No bootstrap required, opened a new log
I20260709 13:10:54.485317 23604 ts_tablet_manager.cc:1403] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.005s
I20260709 13:10:54.488533 23604 raft_consensus.cc:359] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.489274 23604 raft_consensus.cc:385] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.489580 23604 raft_consensus.cc:740] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.490273 23604 consensus_queue.cc:260] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.491195 23603 tablet_bootstrap.cc:654] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.492563 23604 ts_tablet_manager.cc:1434] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:10:54.493670 23604 tablet_bootstrap.cc:492] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074: Bootstrap starting.
I20260709 13:10:54.494478 23609 raft_consensus.cc:493] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.494975 23609 raft_consensus.cc:515] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.499795 23609 leader_election.cc:290] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:10:54.502581 23604 tablet_bootstrap.cc:654] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.521065 23602 tablet_bootstrap.cc:492] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1: No bootstrap required, opened a new log
I20260709 13:10:54.521590 23602 ts_tablet_manager.cc:1403] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.013s
I20260709 13:10:54.525499 23602 raft_consensus.cc:359] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.526229 23602 raft_consensus.cc:385] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.526523 23602 raft_consensus.cc:740] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61eb6de5f0454198905b91cbde0b9cc1, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.527396 23602 consensus_queue.cc:260] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.529567 23602 ts_tablet_manager.cc:1434] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 13:10:54.531378 23602 tablet_bootstrap.cc:492] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap starting.
I20260709 13:10:54.531224 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3564c9e881c54f11a82c0a5012e3ceb9" candidate_uuid: "61eb6de5f0454198905b91cbde0b9cc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406c1f3c281548c8aed4d223f57716ea" is_pre_election: true
I20260709 13:10:54.531988 23562 raft_consensus.cc:2468] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61eb6de5f0454198905b91cbde0b9cc1 in term 0.
I20260709 13:10:54.532135 23604 tablet_bootstrap.cc:492] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074: No bootstrap required, opened a new log
I20260709 13:10:54.533143 23604 ts_tablet_manager.cc:1403] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.016s
I20260709 13:10:54.533428 23378 leader_election.cc:304] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406c1f3c281548c8aed4d223f57716ea, 61eb6de5f0454198905b91cbde0b9cc1; no voters: 
I20260709 13:10:54.533718 23488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3564c9e881c54f11a82c0a5012e3ceb9" candidate_uuid: "61eb6de5f0454198905b91cbde0b9cc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0566c730fa6243e4b7506f8124eae074" is_pre_election: true
I20260709 13:10:54.534402 23609 raft_consensus.cc:2804] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:54.534808 23609 raft_consensus.cc:493] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.535164 23609 raft_consensus.cc:3060] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:54.536247 23603 tablet_bootstrap.cc:492] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea: No bootstrap required, opened a new log
I20260709 13:10:54.536271 23604 raft_consensus.cc:359] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.536960 23603 ts_tablet_manager.cc:1403] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.023s
I20260709 13:10:54.537262 23604 raft_consensus.cc:385] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.537611 23604 raft_consensus.cc:740] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.538373 23604 consensus_queue.cc:260] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.534443 23488 raft_consensus.cc:2468] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61eb6de5f0454198905b91cbde0b9cc1 in term 0.
I20260709 13:10:54.540616 23604 ts_tablet_manager.cc:1434] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:54.540287 23603 raft_consensus.cc:359] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.541539 23603 raft_consensus.cc:385] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.541854 23604 tablet_bootstrap.cc:492] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074: Bootstrap starting.
I20260709 13:10:54.541851 23603 raft_consensus.cc:740] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406c1f3c281548c8aed4d223f57716ea, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.543087 23603 consensus_queue.cc:260] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.545285 23603 ts_tablet_manager.cc:1434] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:10:54.546236 23603 tablet_bootstrap.cc:492] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea: Bootstrap starting.
I20260709 13:10:54.548810 23604 tablet_bootstrap.cc:654] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.552956 23603 tablet_bootstrap.cc:654] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.559700 23609 raft_consensus.cc:515] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.562748 23604 tablet_bootstrap.cc:492] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074: No bootstrap required, opened a new log
I20260709 13:10:54.562634 23488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3564c9e881c54f11a82c0a5012e3ceb9" candidate_uuid: "61eb6de5f0454198905b91cbde0b9cc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0566c730fa6243e4b7506f8124eae074"
I20260709 13:10:54.563360 23488 raft_consensus.cc:3060] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:54.563439 23604 ts_tablet_manager.cc:1403] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074: Time spent bootstrapping tablet: real 0.022s	user 0.021s	sys 0.000s
I20260709 13:10:54.563738 23603 tablet_bootstrap.cc:492] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea: No bootstrap required, opened a new log
I20260709 13:10:54.564267 23603 ts_tablet_manager.cc:1403] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.009s
I20260709 13:10:54.566926 23604 raft_consensus.cc:359] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.567749 23604 raft_consensus.cc:385] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.568106 23604 raft_consensus.cc:740] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.567919 23603 raft_consensus.cc:359] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.568578 23602 tablet_bootstrap.cc:654] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.568732 23603 raft_consensus.cc:385] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.569137 23603 raft_consensus.cc:740] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406c1f3c281548c8aed4d223f57716ea, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.569190 23604 consensus_queue.cc:260] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.569953 23603 consensus_queue.cc:260] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.571095 23488 raft_consensus.cc:2468] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61eb6de5f0454198905b91cbde0b9cc1 in term 1.
I20260709 13:10:54.572468 23379 leader_election.cc:304] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 61eb6de5f0454198905b91cbde0b9cc1; no voters: 
I20260709 13:10:54.572700 23609 leader_election.cc:290] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [CANDIDATE]: Term 1 election: Requested vote from peers 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:10:54.572894 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3564c9e881c54f11a82c0a5012e3ceb9" candidate_uuid: "61eb6de5f0454198905b91cbde0b9cc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
I20260709 13:10:54.573325 23609 raft_consensus.cc:2804] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:54.573516 23562 raft_consensus.cc:3060] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:54.575618 23603 ts_tablet_manager.cc:1434] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:10:54.577097 23603 tablet_bootstrap.cc:492] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea: Bootstrap starting.
I20260709 13:10:54.582789 23609 raft_consensus.cc:697] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 LEADER]: Becoming Leader. State: Replica: 61eb6de5f0454198905b91cbde0b9cc1, State: Running, Role: LEADER
I20260709 13:10:54.583707 23611 raft_consensus.cc:493] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.583814 23609 consensus_queue.cc:237] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.584290 23611 raft_consensus.cc:515] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.586809 23611 leader_election.cc:290] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331)
I20260709 13:10:54.587513 23562 raft_consensus.cc:2468] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61eb6de5f0454198905b91cbde0b9cc1 in term 1.
I20260709 13:10:54.588838 23603 tablet_bootstrap.cc:654] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.589983 23604 ts_tablet_manager.cc:1434] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:10:54.596091 23604 tablet_bootstrap.cc:492] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074: Bootstrap starting.
I20260709 13:10:54.604569 23603 tablet_bootstrap.cc:492] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea: No bootstrap required, opened a new log
I20260709 13:10:54.605202 23603 ts_tablet_manager.cc:1403] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.002s
I20260709 13:10:54.605332 23602 tablet_bootstrap.cc:492] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1: No bootstrap required, opened a new log
I20260709 13:10:54.605924 23602 ts_tablet_manager.cc:1403] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.000s
I20260709 13:10:54.607847 23308 catalog_manager.cc:5697] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "61eb6de5f0454198905b91cbde0b9cc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:54.609098 23603 raft_consensus.cc:359] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.610085 23603 raft_consensus.cc:385] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.605924 23604 tablet_bootstrap.cc:654] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.610455 23603 raft_consensus.cc:740] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406c1f3c281548c8aed4d223f57716ea, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.610832 23602 raft_consensus.cc:359] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.611671 23602 raft_consensus.cc:385] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.611999 23602 raft_consensus.cc:740] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61eb6de5f0454198905b91cbde0b9cc1, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.612157 23603 consensus_queue.cc:260] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.612808 23602 consensus_queue.cc:260] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.615931 23602 ts_tablet_manager.cc:1434] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:10:54.619725 23602 tablet_bootstrap.cc:492] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap starting.
I20260709 13:10:54.621570 23603 ts_tablet_manager.cc:1434] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:10:54.622622 23603 tablet_bootstrap.cc:492] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea: Bootstrap starting.
I20260709 13:10:54.624302 23413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e966b1a3927f41f28f706bcc1e6de3a2" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61eb6de5f0454198905b91cbde0b9cc1" is_pre_election: true
I20260709 13:10:54.625046 23413 raft_consensus.cc:2468] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 406c1f3c281548c8aed4d223f57716ea in term 0.
I20260709 13:10:54.626662 23525 leader_election.cc:304] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406c1f3c281548c8aed4d223f57716ea, 61eb6de5f0454198905b91cbde0b9cc1; no voters: 
I20260709 13:10:54.627590 23611 raft_consensus.cc:2804] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:54.627961 23611 raft_consensus.cc:493] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.628288 23611 raft_consensus.cc:3060] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:54.629156 23603 tablet_bootstrap.cc:654] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.635777 23604 tablet_bootstrap.cc:492] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074: No bootstrap required, opened a new log
I20260709 13:10:54.636445 23604 ts_tablet_manager.cc:1403] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.006s
I20260709 13:10:54.637805 23611 raft_consensus.cc:515] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.639468 23602 tablet_bootstrap.cc:654] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.641871 23413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e966b1a3927f41f28f706bcc1e6de3a2" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61eb6de5f0454198905b91cbde0b9cc1"
I20260709 13:10:54.642706 23413 raft_consensus.cc:3060] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:54.645311 23604 raft_consensus.cc:359] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.646328 23604 raft_consensus.cc:385] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.646694 23604 raft_consensus.cc:740] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.647629 23604 consensus_queue.cc:260] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.650103 23604 ts_tablet_manager.cc:1434] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:10:54.651099 23604 tablet_bootstrap.cc:492] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074: Bootstrap starting.
I20260709 13:10:54.654469 23413 raft_consensus.cc:2468] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406c1f3c281548c8aed4d223f57716ea in term 1.
I20260709 13:10:54.666446 23487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e966b1a3927f41f28f706bcc1e6de3a2" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0566c730fa6243e4b7506f8124eae074"
I20260709 13:10:54.658294 23604 tablet_bootstrap.cc:654] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.662882 23602 tablet_bootstrap.cc:492] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1: No bootstrap required, opened a new log
I20260709 13:10:54.667212 23487 raft_consensus.cc:3060] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:54.667567 23609 raft_consensus.cc:493] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.667738 23602 ts_tablet_manager.cc:1403] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.002s
I20260709 13:10:54.668112 23609 raft_consensus.cc:515] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.670254 23609 leader_election.cc:290] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:10:54.670822 23602 raft_consensus.cc:359] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.671583 23602 raft_consensus.cc:385] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.671864 23602 raft_consensus.cc:740] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61eb6de5f0454198905b91cbde0b9cc1, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.672360 23486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ba72b6f6dd4e6aa70f76ce35926172" candidate_uuid: "61eb6de5f0454198905b91cbde0b9cc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0566c730fa6243e4b7506f8124eae074" is_pre_election: true
I20260709 13:10:54.672569 23602 consensus_queue.cc:260] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.673065 23486 raft_consensus.cc:2468] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61eb6de5f0454198905b91cbde0b9cc1 in term 0.
I20260709 13:10:54.674844 23602 ts_tablet_manager.cc:1434] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:10:54.674961 23379 leader_election.cc:304] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 61eb6de5f0454198905b91cbde0b9cc1; no voters: 
I20260709 13:10:54.672394 23525 leader_election.cc:304] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406c1f3c281548c8aed4d223f57716ea, 61eb6de5f0454198905b91cbde0b9cc1; no voters: 
I20260709 13:10:54.677531 23609 raft_consensus.cc:2804] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:54.677938 23609 raft_consensus.cc:493] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.663980 23611 leader_election.cc:290] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 1 election: Requested vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331)
I20260709 13:10:54.664791 23488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e966b1a3927f41f28f706bcc1e6de3a2" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0566c730fa6243e4b7506f8124eae074" is_pre_election: true
I20260709 13:10:54.678328 23609 raft_consensus.cc:3060] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:54.678594 23611 raft_consensus.cc:2804] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:54.679075 23611 raft_consensus.cc:697] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 1 LEADER]: Becoming Leader. State: Replica: 406c1f3c281548c8aed4d223f57716ea, State: Running, Role: LEADER
W20260709 13:10:54.666260 23359 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:54.679898 23611 consensus_queue.cc:237] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.681078 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ba72b6f6dd4e6aa70f76ce35926172" candidate_uuid: "61eb6de5f0454198905b91cbde0b9cc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406c1f3c281548c8aed4d223f57716ea" is_pre_election: true
I20260709 13:10:54.681731 23562 raft_consensus.cc:2468] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61eb6de5f0454198905b91cbde0b9cc1 in term 0.
I20260709 13:10:54.682345 23487 raft_consensus.cc:2468] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406c1f3c281548c8aed4d223f57716ea in term 1.
I20260709 13:10:54.683682 23602 tablet_bootstrap.cc:492] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap starting.
I20260709 13:10:54.690721 23602 tablet_bootstrap.cc:654] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.691823 23609 raft_consensus.cc:515] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.694550 23604 tablet_bootstrap.cc:492] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074: No bootstrap required, opened a new log
I20260709 13:10:54.695137 23604 ts_tablet_manager.cc:1403] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.005s
I20260709 13:10:54.695222 23487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ba72b6f6dd4e6aa70f76ce35926172" candidate_uuid: "61eb6de5f0454198905b91cbde0b9cc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0566c730fa6243e4b7506f8124eae074"
I20260709 13:10:54.696106 23487 raft_consensus.cc:3060] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:54.697336 23311 catalog_manager.cc:5697] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 406c1f3c281548c8aed4d223f57716ea (127.12.76.131). New cstate: current_term: 1 leader_uuid: "406c1f3c281548c8aed4d223f57716ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:54.700357 23604 raft_consensus.cc:359] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.701617 23604 raft_consensus.cc:385] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.701972 23604 raft_consensus.cc:740] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.702801 23604 consensus_queue.cc:260] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.701270 23603 tablet_bootstrap.cc:492] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea: No bootstrap required, opened a new log
I20260709 13:10:54.704596 23603 ts_tablet_manager.cc:1403] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea: Time spent bootstrapping tablet: real 0.082s	user 0.041s	sys 0.025s
I20260709 13:10:54.706601 23487 raft_consensus.cc:2468] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61eb6de5f0454198905b91cbde0b9cc1 in term 1.
I20260709 13:10:54.708827 23603 raft_consensus.cc:359] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.712555 23603 raft_consensus.cc:385] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.713068 23603 raft_consensus.cc:740] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406c1f3c281548c8aed4d223f57716ea, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.714203 23603 consensus_queue.cc:260] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.712033 23604 ts_tablet_manager.cc:1434] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:10:54.716779 23604 tablet_bootstrap.cc:492] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074: Bootstrap starting.
I20260709 13:10:54.721199 23603 ts_tablet_manager.cc:1434] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:10:54.722003 23608 raft_consensus.cc:493] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.728797 23608 raft_consensus.cc:515] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.729504 23603 tablet_bootstrap.cc:492] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea: Bootstrap starting.
I20260709 13:10:54.733522 23639 raft_consensus.cc:493] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.734031 23639 raft_consensus.cc:515] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.735494 23608 leader_election.cc:290] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:10:54.736317 23639 leader_election.cc:290] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:10:54.738813 23379 leader_election.cc:304] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 61eb6de5f0454198905b91cbde0b9cc1; no voters: 
I20260709 13:10:54.739828 23623 raft_consensus.cc:2804] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:54.741276 23609 leader_election.cc:290] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [CANDIDATE]: Term 1 election: Requested vote from peers 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:10:54.741813 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ba72b6f6dd4e6aa70f76ce35926172" candidate_uuid: "61eb6de5f0454198905b91cbde0b9cc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
I20260709 13:10:54.742465 23562 raft_consensus.cc:3060] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:54.727972 23604 tablet_bootstrap.cc:654] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.748616 23602 tablet_bootstrap.cc:492] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1: No bootstrap required, opened a new log
I20260709 13:10:54.749131 23602 ts_tablet_manager.cc:1403] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1: Time spent bootstrapping tablet: real 0.066s	user 0.024s	sys 0.038s
I20260709 13:10:54.755576 23562 raft_consensus.cc:2468] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61eb6de5f0454198905b91cbde0b9cc1 in term 1.
I20260709 13:10:54.752131 23602 raft_consensus.cc:359] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.758225 23602 raft_consensus.cc:385] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.758520 23602 raft_consensus.cc:740] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61eb6de5f0454198905b91cbde0b9cc1, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.759265 23602 consensus_queue.cc:260] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.759856 23413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ab7e6addc2428d9c507042be9c6826" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61eb6de5f0454198905b91cbde0b9cc1" is_pre_election: true
I20260709 13:10:54.760525 23413 raft_consensus.cc:2468] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 0.
I20260709 13:10:54.761523 23602 ts_tablet_manager.cc:1434] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:10:54.761657 23412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a20395358b414e9c05ccd833dc9ae8" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61eb6de5f0454198905b91cbde0b9cc1" is_pre_election: true
I20260709 13:10:54.762634 23602 tablet_bootstrap.cc:492] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap starting.
I20260709 13:10:54.763911 23451 leader_election.cc:304] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 61eb6de5f0454198905b91cbde0b9cc1; no voters: 
W20260709 13:10:54.764904 23451 leader_election.cc:343] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:54.765331 23608 raft_consensus.cc:2804] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:54.761976 23603 tablet_bootstrap.cc:654] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.765811 23608 raft_consensus.cc:493] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.766234 23608 raft_consensus.cc:3060] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:54.765570 23639 raft_consensus.cc:493] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.767951 23639 raft_consensus.cc:515] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.768951 23602 tablet_bootstrap.cc:654] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.763871 23623 raft_consensus.cc:697] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 LEADER]: Becoming Leader. State: Replica: 61eb6de5f0454198905b91cbde0b9cc1, State: Running, Role: LEADER
I20260709 13:10:54.772100 23412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524cd1c347354d3a9ecf13e1089ad7de" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61eb6de5f0454198905b91cbde0b9cc1" is_pre_election: true
I20260709 13:10:54.773069 23412 raft_consensus.cc:2468] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 0.
I20260709 13:10:54.774888 23451 leader_election.cc:304] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 61eb6de5f0454198905b91cbde0b9cc1; no voters: 
I20260709 13:10:54.777227 23623 consensus_queue.cc:237] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.782248 23639 leader_election.cc:290] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:10:54.784665 23639 raft_consensus.cc:2804] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:54.785856 23639 raft_consensus.cc:493] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.786798 23639 raft_consensus.cc:3060] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:54.790560 23608 raft_consensus.cc:515] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.793479 23604 tablet_bootstrap.cc:492] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074: No bootstrap required, opened a new log
I20260709 13:10:54.793761 23608 leader_election.cc:290] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 1 election: Requested vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:10:54.794029 23604 ts_tablet_manager.cc:1403] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.001s
I20260709 13:10:54.796775 23604 raft_consensus.cc:359] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.797413 23604 raft_consensus.cc:385] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.797421 23602 tablet_bootstrap.cc:492] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1: No bootstrap required, opened a new log
I20260709 13:10:54.797745 23604 raft_consensus.cc:740] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.798017 23602 ts_tablet_manager.cc:1403] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.015s
I20260709 13:10:54.797848 23561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a20395358b414e9c05ccd833dc9ae8" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406c1f3c281548c8aed4d223f57716ea" is_pre_election: true
I20260709 13:10:54.798426 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ab7e6addc2428d9c507042be9c6826" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406c1f3c281548c8aed4d223f57716ea" is_pre_election: true
I20260709 13:10:54.798592 23604 consensus_queue.cc:260] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.799041 23562 raft_consensus.cc:2468] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 0.
I20260709 13:10:54.799276 23560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524cd1c347354d3a9ecf13e1089ad7de" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406c1f3c281548c8aed4d223f57716ea" is_pre_election: true
I20260709 13:10:54.800021 23560 raft_consensus.cc:2468] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 0.
I20260709 13:10:54.801158 23559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ab7e6addc2428d9c507042be9c6826" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
I20260709 13:10:54.801348 23602 raft_consensus.cc:359] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.801819 23559 raft_consensus.cc:3060] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:54.802099 23602 raft_consensus.cc:385] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.802467 23602 raft_consensus.cc:740] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61eb6de5f0454198905b91cbde0b9cc1, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.803211 23602 consensus_queue.cc:260] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.804631 23642 raft_consensus.cc:493] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.805476 23602 ts_tablet_manager.cc:1434] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:54.805186 23642 raft_consensus.cc:515] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.806838 23602 tablet_bootstrap.cc:492] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap starting.
I20260709 13:10:54.807557 23642 leader_election.cc:290] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:10:54.807945 23604 ts_tablet_manager.cc:1434] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:10:54.809170 23487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f000dae80a849a28f3f5151891d8e17" candidate_uuid: "61eb6de5f0454198905b91cbde0b9cc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0566c730fa6243e4b7506f8124eae074" is_pre_election: true
I20260709 13:10:54.809751 23487 raft_consensus.cc:2468] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61eb6de5f0454198905b91cbde0b9cc1 in term 0.
I20260709 13:10:54.810842 23379 leader_election.cc:304] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 61eb6de5f0454198905b91cbde0b9cc1; no voters: 
W20260709 13:10:54.811838 23453 leader_election.cc:343] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:54.812362 23453 leader_election.cc:304] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074; no voters: 406c1f3c281548c8aed4d223f57716ea, 61eb6de5f0454198905b91cbde0b9cc1
I20260709 13:10:54.813885 23602 tablet_bootstrap.cc:654] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.815493 23412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ab7e6addc2428d9c507042be9c6826" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61eb6de5f0454198905b91cbde0b9cc1"
I20260709 13:10:54.816160 23412 raft_consensus.cc:3060] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:54.817102 23560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f000dae80a849a28f3f5151891d8e17" candidate_uuid: "61eb6de5f0454198905b91cbde0b9cc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406c1f3c281548c8aed4d223f57716ea" is_pre_election: true
I20260709 13:10:54.817740 23560 raft_consensus.cc:2468] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61eb6de5f0454198905b91cbde0b9cc1 in term 0.
I20260709 13:10:54.824003 23412 raft_consensus.cc:2468] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 1.
I20260709 13:10:54.824352 23559 raft_consensus.cc:2468] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 1.
I20260709 13:10:54.812521 23623 raft_consensus.cc:2804] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:54.825380 23602 tablet_bootstrap.cc:492] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1: No bootstrap required, opened a new log
I20260709 13:10:54.826894 23623 raft_consensus.cc:493] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.824754 23309 catalog_manager.cc:5697] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "61eb6de5f0454198905b91cbde0b9cc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:54.826264 23604 tablet_bootstrap.cc:492] T 6595a05f3ee646e290107a904450fdb4 P 0566c730fa6243e4b7506f8124eae074: Bootstrap starting.
I20260709 13:10:54.827572 23453 leader_election.cc:304] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 406c1f3c281548c8aed4d223f57716ea; no voters: 
I20260709 13:10:54.828642 23608 raft_consensus.cc:2804] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:54.813879 23646 raft_consensus.cc:2749] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:54.827316 23602 ts_tablet_manager.cc:1403] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 13:10:54.831563 23639 raft_consensus.cc:515] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.834245 23602 raft_consensus.cc:359] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.835093 23602 raft_consensus.cc:385] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.835160 23559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524cd1c347354d3a9ecf13e1089ad7de" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
I20260709 13:10:54.836102 23559 raft_consensus.cc:3060] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:54.836956 23412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524cd1c347354d3a9ecf13e1089ad7de" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61eb6de5f0454198905b91cbde0b9cc1"
I20260709 13:10:54.827289 23623 raft_consensus.cc:3060] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:54.843714 23603 tablet_bootstrap.cc:492] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea: No bootstrap required, opened a new log
I20260709 13:10:54.844244 23603 ts_tablet_manager.cc:1403] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea: Time spent bootstrapping tablet: real 0.115s	user 0.022s	sys 0.022s
I20260709 13:10:54.845654 23559 raft_consensus.cc:2468] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 1.
I20260709 13:10:54.846856 23453 leader_election.cc:304] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 406c1f3c281548c8aed4d223f57716ea; no voters: 
I20260709 13:10:54.847684 23646 raft_consensus.cc:2804] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:54.841219 23639 leader_election.cc:290] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 1 election: Requested vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:10:54.835444 23602 raft_consensus.cc:740] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61eb6de5f0454198905b91cbde0b9cc1, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.848292 23646 raft_consensus.cc:697] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 1 LEADER]: Becoming Leader. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Running, Role: LEADER
I20260709 13:10:54.848922 23602 consensus_queue.cc:260] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.849202 23646 consensus_queue.cc:237] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.851054 23602 ts_tablet_manager.cc:1434] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:10:54.848297 23608 raft_consensus.cc:697] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [term 1 LEADER]: Becoming Leader. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Running, Role: LEADER
I20260709 13:10:54.851884 23623 raft_consensus.cc:515] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.852847 23602 tablet_bootstrap.cc:492] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap starting.
I20260709 13:10:54.852591 23608 consensus_queue.cc:237] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.854291 23623 leader_election.cc:290] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [CANDIDATE]: Term 1 election: Requested vote from peers 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:10:54.841318 23604 tablet_bootstrap.cc:654] T 6595a05f3ee646e290107a904450fdb4 P 0566c730fa6243e4b7506f8124eae074: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.855401 23487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f000dae80a849a28f3f5151891d8e17" candidate_uuid: "61eb6de5f0454198905b91cbde0b9cc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0566c730fa6243e4b7506f8124eae074"
I20260709 13:10:54.856048 23487 raft_consensus.cc:3060] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:54.847246 23603 raft_consensus.cc:359] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.857069 23603 raft_consensus.cc:385] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.856663 23412 raft_consensus.cc:3060] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:54.857380 23603 raft_consensus.cc:740] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406c1f3c281548c8aed4d223f57716ea, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.858217 23603 consensus_queue.cc:260] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.859274 23559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f000dae80a849a28f3f5151891d8e17" candidate_uuid: "61eb6de5f0454198905b91cbde0b9cc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
I20260709 13:10:54.860136 23559 raft_consensus.cc:3060] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:54.869827 23412 raft_consensus.cc:2468] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 1.
I20260709 13:10:54.870918 23602 tablet_bootstrap.cc:654] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.872651 23487 raft_consensus.cc:2468] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61eb6de5f0454198905b91cbde0b9cc1 in term 1.
I20260709 13:10:54.873896 23379 leader_election.cc:304] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 61eb6de5f0454198905b91cbde0b9cc1; no voters: 
I20260709 13:10:54.874796 23623 raft_consensus.cc:2804] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:54.875592 23623 raft_consensus.cc:697] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 LEADER]: Becoming Leader. State: Replica: 61eb6de5f0454198905b91cbde0b9cc1, State: Running, Role: LEADER
I20260709 13:10:54.876879 23559 raft_consensus.cc:2468] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61eb6de5f0454198905b91cbde0b9cc1 in term 1.
I20260709 13:10:54.877305 23308 catalog_manager.cc:5697] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0566c730fa6243e4b7506f8124eae074 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "0566c730fa6243e4b7506f8124eae074" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:54.878886 23623 consensus_queue.cc:237] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.881916 23603 ts_tablet_manager.cc:1434] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:10:54.884876 23603 tablet_bootstrap.cc:492] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea: Bootstrap starting.
I20260709 13:10:54.891196 23603 tablet_bootstrap.cc:654] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.895110 23604 tablet_bootstrap.cc:492] T 6595a05f3ee646e290107a904450fdb4 P 0566c730fa6243e4b7506f8124eae074: No bootstrap required, opened a new log
I20260709 13:10:54.895694 23604 ts_tablet_manager.cc:1403] T 6595a05f3ee646e290107a904450fdb4 P 0566c730fa6243e4b7506f8124eae074: Time spent bootstrapping tablet: real 0.070s	user 0.008s	sys 0.017s
I20260709 13:10:54.897030 23311 catalog_manager.cc:5697] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0566c730fa6243e4b7506f8124eae074 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "0566c730fa6243e4b7506f8124eae074" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:54.898761 23604 raft_consensus.cc:359] T 6595a05f3ee646e290107a904450fdb4 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.900444 23604 raft_consensus.cc:385] T 6595a05f3ee646e290107a904450fdb4 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.900769 23604 raft_consensus.cc:740] T 6595a05f3ee646e290107a904450fdb4 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.901496 23604 consensus_queue.cc:260] T 6595a05f3ee646e290107a904450fdb4 P 0566c730fa6243e4b7506f8124eae074 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.903586 23604 ts_tablet_manager.cc:1434] T 6595a05f3ee646e290107a904450fdb4 P 0566c730fa6243e4b7506f8124eae074: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:10:54.903872 23602 tablet_bootstrap.cc:492] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1: No bootstrap required, opened a new log
I20260709 13:10:54.904362 23602 ts_tablet_manager.cc:1403] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.010s
I20260709 13:10:54.905463 23604 tablet_bootstrap.cc:492] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074: Bootstrap starting.
I20260709 13:10:54.906872 23602 raft_consensus.cc:359] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.907572 23602 raft_consensus.cc:385] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.907830 23602 raft_consensus.cc:740] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61eb6de5f0454198905b91cbde0b9cc1, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.908464 23602 consensus_queue.cc:260] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.911028 23602 ts_tablet_manager.cc:1434] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:54.911912 23602 tablet_bootstrap.cc:492] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap starting.
I20260709 13:10:54.912434 23604 tablet_bootstrap.cc:654] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.906114 23309 catalog_manager.cc:5697] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "61eb6de5f0454198905b91cbde0b9cc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:54.918340 23602 tablet_bootstrap.cc:654] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.924460 23602 tablet_bootstrap.cc:492] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1: No bootstrap required, opened a new log
I20260709 13:10:54.924721 23604 tablet_bootstrap.cc:492] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074: No bootstrap required, opened a new log
I20260709 13:10:54.924901 23602 ts_tablet_manager.cc:1403] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 13:10:54.925287 23604 ts_tablet_manager.cc:1403] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 13:10:54.927731 23602 raft_consensus.cc:359] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.928452 23602 raft_consensus.cc:385] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.928110 23604 raft_consensus.cc:359] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.928735 23602 raft_consensus.cc:740] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61eb6de5f0454198905b91cbde0b9cc1, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.928946 23604 raft_consensus.cc:385] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.929337 23604 raft_consensus.cc:740] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.929567 23602 consensus_queue.cc:260] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.930119 23604 consensus_queue.cc:260] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.932138 23604 ts_tablet_manager.cc:1434] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:54.932246 23602 ts_tablet_manager.cc:1434] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:10:54.936468 23603 tablet_bootstrap.cc:492] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea: No bootstrap required, opened a new log
I20260709 13:10:54.936962 23603 ts_tablet_manager.cc:1403] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.032s
I20260709 13:10:54.939752 23603 raft_consensus.cc:359] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.940395 23603 raft_consensus.cc:385] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.940671 23603 raft_consensus.cc:740] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406c1f3c281548c8aed4d223f57716ea, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.941294 23603 consensus_queue.cc:260] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.943585 23603 ts_tablet_manager.cc:1434] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:10:54.944455 23603 tablet_bootstrap.cc:492] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea: Bootstrap starting.
I20260709 13:10:54.949674 23603 tablet_bootstrap.cc:654] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.953918 23603 tablet_bootstrap.cc:492] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea: No bootstrap required, opened a new log
I20260709 13:10:54.954372 23603 ts_tablet_manager.cc:1403] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:10:54.956708 23603 raft_consensus.cc:359] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.957332 23603 raft_consensus.cc:385] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.957581 23603 raft_consensus.cc:740] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406c1f3c281548c8aed4d223f57716ea, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.958177 23603 consensus_queue.cc:260] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.960067 23603 ts_tablet_manager.cc:1434] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:10:54.961140 23603 tablet_bootstrap.cc:492] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea: Bootstrap starting.
I20260709 13:10:54.965819 23603 tablet_bootstrap.cc:654] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:54.970196 23603 tablet_bootstrap.cc:492] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea: No bootstrap required, opened a new log
I20260709 13:10:54.970697 23603 ts_tablet_manager.cc:1403] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea: Time spent bootstrapping tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:10:54.972841 23623 raft_consensus.cc:493] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.973029 23603 raft_consensus.cc:359] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.973376 23623 raft_consensus.cc:515] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.973716 23603 raft_consensus.cc:385] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:54.974058 23603 raft_consensus.cc:740] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 406c1f3c281548c8aed4d223f57716ea, State: Initialized, Role: FOLLOWER
I20260709 13:10:54.974665 23603 consensus_queue.cc:260] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.975390 23623 leader_election.cc:290] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:10:54.976241 23487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a20395358b414e9c05ccd833dc9ae8" candidate_uuid: "61eb6de5f0454198905b91cbde0b9cc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0566c730fa6243e4b7506f8124eae074" is_pre_election: true
I20260709 13:10:54.976641 23603 ts_tablet_manager.cc:1434] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:54.976969 23487 raft_consensus.cc:2468] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61eb6de5f0454198905b91cbde0b9cc1 in term 0.
I20260709 13:10:54.976995 23559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a20395358b414e9c05ccd833dc9ae8" candidate_uuid: "61eb6de5f0454198905b91cbde0b9cc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406c1f3c281548c8aed4d223f57716ea" is_pre_election: true
I20260709 13:10:54.977811 23559 raft_consensus.cc:2468] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61eb6de5f0454198905b91cbde0b9cc1 in term 0.
I20260709 13:10:54.978191 23379 leader_election.cc:304] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 61eb6de5f0454198905b91cbde0b9cc1; no voters: 
I20260709 13:10:54.979096 23623 raft_consensus.cc:2804] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:54.979423 23623 raft_consensus.cc:493] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.979746 23623 raft_consensus.cc:3060] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:54.985414 23623 raft_consensus.cc:515] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:54.987323 23623 leader_election.cc:290] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [CANDIDATE]: Term 1 election: Requested vote from peers 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:10:54.988049 23487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a20395358b414e9c05ccd833dc9ae8" candidate_uuid: "61eb6de5f0454198905b91cbde0b9cc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0566c730fa6243e4b7506f8124eae074"
I20260709 13:10:54.988591 23487 raft_consensus.cc:3060] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:54.988519 23559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a20395358b414e9c05ccd833dc9ae8" candidate_uuid: "61eb6de5f0454198905b91cbde0b9cc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
I20260709 13:10:54.989122 23559 raft_consensus.cc:3060] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:54.993449 23487 raft_consensus.cc:2468] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61eb6de5f0454198905b91cbde0b9cc1 in term 1.
I20260709 13:10:54.994376 23559 raft_consensus.cc:2468] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61eb6de5f0454198905b91cbde0b9cc1 in term 1.
I20260709 13:10:54.994515 23379 leader_election.cc:304] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 61eb6de5f0454198905b91cbde0b9cc1; no voters: 
I20260709 13:10:54.995395 23623 raft_consensus.cc:2804] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:54.995965 23623 raft_consensus.cc:697] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 LEADER]: Becoming Leader. State: Replica: 61eb6de5f0454198905b91cbde0b9cc1, State: Running, Role: LEADER
I20260709 13:10:54.996829 23623 consensus_queue.cc:237] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:55.003856 23309 catalog_manager.cc:5697] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "61eb6de5f0454198905b91cbde0b9cc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:55.029547 23623 consensus_queue.cc:1048] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:55.041260 23623 consensus_queue.cc:1048] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:55.063777 23611 consensus_queue.cc:1048] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:55.075223 23611 consensus_queue.cc:1048] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:55.120110 23646 raft_consensus.cc:493] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.120611 23646 raft_consensus.cc:515] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:55.122337 23646 leader_election.cc:290] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:10:55.123173 23412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031e3cbadd274f30b727bb838177869b" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61eb6de5f0454198905b91cbde0b9cc1" is_pre_election: true
I20260709 13:10:55.123314 23559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031e3cbadd274f30b727bb838177869b" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406c1f3c281548c8aed4d223f57716ea" is_pre_election: true
I20260709 13:10:55.123847 23412 raft_consensus.cc:2468] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 0.
I20260709 13:10:55.124051 23559 raft_consensus.cc:2468] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 0.
I20260709 13:10:55.124807 23451 leader_election.cc:304] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 61eb6de5f0454198905b91cbde0b9cc1; no voters: 
I20260709 13:10:55.125463 23646 raft_consensus.cc:2804] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:55.125788 23646 raft_consensus.cc:493] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:55.126022 23646 raft_consensus.cc:3060] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:55.130954 23646 raft_consensus.cc:515] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:55.132483 23646 leader_election.cc:290] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 1 election: Requested vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:10:55.133342 23412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031e3cbadd274f30b727bb838177869b" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61eb6de5f0454198905b91cbde0b9cc1"
I20260709 13:10:55.133596 23559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031e3cbadd274f30b727bb838177869b" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
I20260709 13:10:55.133950 23412 raft_consensus.cc:3060] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:55.134215 23559 raft_consensus.cc:3060] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:55.136293 23611 raft_consensus.cc:493] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.136783 23611 raft_consensus.cc:515] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:55.138877 23611 leader_election.cc:290] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331)
I20260709 13:10:55.139798 23559 raft_consensus.cc:2468] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 1.
I20260709 13:10:55.140169 23412 raft_consensus.cc:2468] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 1.
I20260709 13:10:55.139669 23413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595a05f3ee646e290107a904450fdb4" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61eb6de5f0454198905b91cbde0b9cc1" is_pre_election: true
I20260709 13:10:55.141093 23413 raft_consensus.cc:2468] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 406c1f3c281548c8aed4d223f57716ea in term 0.
I20260709 13:10:55.141108 23453 leader_election.cc:304] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 406c1f3c281548c8aed4d223f57716ea; no voters: 
I20260709 13:10:55.141183 23487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595a05f3ee646e290107a904450fdb4" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0566c730fa6243e4b7506f8124eae074" is_pre_election: true
I20260709 13:10:55.142161 23487 raft_consensus.cc:2468] T 6595a05f3ee646e290107a904450fdb4 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 406c1f3c281548c8aed4d223f57716ea in term 0.
I20260709 13:10:55.142329 23646 raft_consensus.cc:2804] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:55.142261 23525 leader_election.cc:304] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406c1f3c281548c8aed4d223f57716ea, 61eb6de5f0454198905b91cbde0b9cc1; no voters: 
I20260709 13:10:55.143015 23646 raft_consensus.cc:697] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [term 1 LEADER]: Becoming Leader. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Running, Role: LEADER
I20260709 13:10:55.143455 23611 raft_consensus.cc:2804] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:55.143843 23611 raft_consensus.cc:493] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:55.144255 23611 raft_consensus.cc:3060] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:55.143903 23646 consensus_queue.cc:237] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:55.150712 23611 raft_consensus.cc:515] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:55.153440 23611 leader_election.cc:290] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 1 election: Requested vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331)
I20260709 13:10:55.153640 23413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595a05f3ee646e290107a904450fdb4" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61eb6de5f0454198905b91cbde0b9cc1"
I20260709 13:10:55.153170 23309 catalog_manager.cc:5697] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0566c730fa6243e4b7506f8124eae074 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "0566c730fa6243e4b7506f8124eae074" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:55.154369 23413 raft_consensus.cc:3060] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:55.154107 23487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6595a05f3ee646e290107a904450fdb4" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0566c730fa6243e4b7506f8124eae074"
I20260709 13:10:55.154910 23487 raft_consensus.cc:3060] T 6595a05f3ee646e290107a904450fdb4 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:55.154943 23646 raft_consensus.cc:493] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.155735 23646 raft_consensus.cc:515] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:55.158390 23646 leader_election.cc:290] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:10:55.161125 23412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25600b8c5804b40a113d63912f38530" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61eb6de5f0454198905b91cbde0b9cc1" is_pre_election: true
I20260709 13:10:55.161811 23412 raft_consensus.cc:2468] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 0.
I20260709 13:10:55.162793 23559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25600b8c5804b40a113d63912f38530" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406c1f3c281548c8aed4d223f57716ea" is_pre_election: true
I20260709 13:10:55.163091 23487 raft_consensus.cc:2468] T 6595a05f3ee646e290107a904450fdb4 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406c1f3c281548c8aed4d223f57716ea in term 1.
I20260709 13:10:55.163148 23451 leader_election.cc:304] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 61eb6de5f0454198905b91cbde0b9cc1; no voters: 
I20260709 13:10:55.163538 23559 raft_consensus.cc:2468] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 0.
I20260709 13:10:55.164608 23646 raft_consensus.cc:2804] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:55.164501 23528 leader_election.cc:304] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 406c1f3c281548c8aed4d223f57716ea; no voters: 
I20260709 13:10:55.165098 23646 raft_consensus.cc:493] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:55.165472 23646 raft_consensus.cc:3060] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:55.165531 23611 raft_consensus.cc:2804] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:55.165727 23413 raft_consensus.cc:2468] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406c1f3c281548c8aed4d223f57716ea in term 1.
I20260709 13:10:55.166123 23611 raft_consensus.cc:697] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea [term 1 LEADER]: Becoming Leader. State: Replica: 406c1f3c281548c8aed4d223f57716ea, State: Running, Role: LEADER
I20260709 13:10:55.167045 23611 consensus_queue.cc:237] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:55.172240 23646 raft_consensus.cc:515] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:55.174970 23413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25600b8c5804b40a113d63912f38530" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61eb6de5f0454198905b91cbde0b9cc1"
I20260709 13:10:55.175211 23559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25600b8c5804b40a113d63912f38530" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
I20260709 13:10:55.175593 23413 raft_consensus.cc:3060] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:55.175798 23559 raft_consensus.cc:3060] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:55.175652 23309 catalog_manager.cc:5697] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 406c1f3c281548c8aed4d223f57716ea (127.12.76.131). New cstate: current_term: 1 leader_uuid: "406c1f3c281548c8aed4d223f57716ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:55.182138 23646 leader_election.cc:290] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 1 election: Requested vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:10:55.183611 23413 raft_consensus.cc:2468] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 1.
I20260709 13:10:55.183714 23559 raft_consensus.cc:2468] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 1.
I20260709 13:10:55.184765 23453 leader_election.cc:304] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 406c1f3c281548c8aed4d223f57716ea; no voters: 
I20260709 13:10:55.185822 23646 raft_consensus.cc:2804] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:55.186268 23646 raft_consensus.cc:697] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [term 1 LEADER]: Becoming Leader. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Running, Role: LEADER
I20260709 13:10:55.187032 23646 consensus_queue.cc:237] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:55.193847 23309 catalog_manager.cc:5697] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0566c730fa6243e4b7506f8124eae074 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "0566c730fa6243e4b7506f8124eae074" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:55.294006 23623 consensus_queue.cc:1048] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:55.306013 12594 ts_manager.cc:295] Set tserver state for 61eb6de5f0454198905b91cbde0b9cc1 to MAINTENANCE_MODE
I20260709 13:10:55.306048 23609 consensus_queue.cc:1048] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:55.306932 12594 tablet_server.cc:179] TabletServer@127.12.76.129:0 shutting down...
I20260709 13:10:55.336705 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:55.337546 12594 tablet_replica.cc:333] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1: stopping tablet replica
I20260709 13:10:55.338130 12594 raft_consensus.cc:2243] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.338531 12594 raft_consensus.cc:2272] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.340504 12594 tablet_replica.cc:333] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1: stopping tablet replica
I20260709 13:10:55.341109 12594 raft_consensus.cc:2243] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.341491 12594 raft_consensus.cc:2272] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.343670 12594 tablet_replica.cc:333] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1: stopping tablet replica
I20260709 13:10:55.344197 12594 raft_consensus.cc:2243] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.344944 12594 raft_consensus.cc:2272] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.346954 12594 tablet_replica.cc:333] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1: stopping tablet replica
I20260709 13:10:55.347517 12594 raft_consensus.cc:2243] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.347873 12594 raft_consensus.cc:2272] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.350014 12594 tablet_replica.cc:333] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1: stopping tablet replica
I20260709 13:10:55.350538 12594 raft_consensus.cc:2243] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.351099 12594 pending_rounds.cc:70] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1: Trying to abort 1 pending ops.
I20260709 13:10:55.351300 12594 pending_rounds.cc:77] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636474874363904 op_type: NO_OP noop_request { }
I20260709 13:10:55.351660 12594 raft_consensus.cc:2889] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:55.351940 12594 raft_consensus.cc:2272] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.353924 12594 tablet_replica.cc:333] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1: stopping tablet replica
I20260709 13:10:55.354530 12594 raft_consensus.cc:2243] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.355290 12594 raft_consensus.cc:2272] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.357463 12594 tablet_replica.cc:333] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1: stopping tablet replica
I20260709 13:10:55.357980 12594 raft_consensus.cc:2243] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.358539 12594 pending_rounds.cc:70] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1: Trying to abort 1 pending ops.
I20260709 13:10:55.358747 12594 pending_rounds.cc:77] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636474437812224 op_type: NO_OP noop_request { }
I20260709 13:10:55.359014 12594 raft_consensus.cc:2889] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:55.359279 12594 raft_consensus.cc:2272] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.361348 12594 tablet_replica.cc:333] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1: stopping tablet replica
I20260709 13:10:55.361853 12594 raft_consensus.cc:2243] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.362253 12594 raft_consensus.cc:2272] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.365078 12594 tablet_replica.cc:333] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1: stopping tablet replica
I20260709 13:10:55.365801 12594 raft_consensus.cc:2243] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.366173 12594 raft_consensus.cc:2272] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.367403 23451 consensus_peers.cc:597] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.368314 12594 tablet_replica.cc:333] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1: stopping tablet replica
I20260709 13:10:55.368963 12594 raft_consensus.cc:2243] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.369388 12594 raft_consensus.cc:2272] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.369972 23451 consensus_peers.cc:597] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.374523 23646 consensus_queue.cc:1048] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:55.394999 12594 tablet_server.cc:196] TabletServer@127.12.76.129:0 shutdown complete.
I20260709 13:10:55.444514 23608 consensus_queue.cc:1048] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:55.545250 23451 consensus_peers.cc:597] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.564782 23525 consensus_peers.cc:597] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.628902 23608 consensus_queue.cc:1048] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:55.662727 23676 consensus_queue.cc:1048] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:55.674985 23451 consensus_peers.cc:597] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.681100 23359 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:55.695302 23681 consensus_queue.cc:1048] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:55.708288 23525 consensus_peers.cc:597] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:56.539461 23646 raft_consensus.cc:493] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61eb6de5f0454198905b91cbde0b9cc1)
I20260709 13:10:56.540469 23646 raft_consensus.cc:515] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:56.542826 23646 leader_election.cc:290] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:10:56.544226 23559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3564c9e881c54f11a82c0a5012e3ceb9" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "406c1f3c281548c8aed4d223f57716ea" is_pre_election: true
I20260709 13:10:56.545156 23611 raft_consensus.cc:493] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61eb6de5f0454198905b91cbde0b9cc1)
I20260709 13:10:56.546015 23611 raft_consensus.cc:515] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:56.547081 23559 raft_consensus.cc:2468] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 1.
W20260709 13:10:56.547489 23451 leader_election.cc:336] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111)
I20260709 13:10:56.549106 23611 leader_election.cc:290] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331)
I20260709 13:10:56.551198 23487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3564c9e881c54f11a82c0a5012e3ceb9" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0566c730fa6243e4b7506f8124eae074" is_pre_election: true
I20260709 13:10:56.552142 23487 raft_consensus.cc:2468] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 406c1f3c281548c8aed4d223f57716ea in term 1.
W20260709 13:10:56.552987 23525 leader_election.cc:336] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111)
I20260709 13:10:56.553762 23528 leader_election.cc:304] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 406c1f3c281548c8aed4d223f57716ea; no voters: 61eb6de5f0454198905b91cbde0b9cc1
I20260709 13:10:56.554078 23453 leader_election.cc:304] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 406c1f3c281548c8aed4d223f57716ea; no voters: 61eb6de5f0454198905b91cbde0b9cc1
I20260709 13:10:56.554667 23611 raft_consensus.cc:2804] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:56.554980 23646 raft_consensus.cc:2804] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:56.555024 23611 raft_consensus.cc:493] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61eb6de5f0454198905b91cbde0b9cc1)
I20260709 13:10:56.555559 23646 raft_consensus.cc:493] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61eb6de5f0454198905b91cbde0b9cc1)
I20260709 13:10:56.555635 23611 raft_consensus.cc:3060] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.555958 23646 raft_consensus.cc:3060] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.563901 23611 raft_consensus.cc:515] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:56.564013 23646 raft_consensus.cc:515] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:56.565750 23611 leader_election.cc:290] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 election: Requested vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331)
I20260709 13:10:56.565979 23646 leader_election.cc:290] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 2 election: Requested vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:10:56.568017 23559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3564c9e881c54f11a82c0a5012e3ceb9" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
I20260709 13:10:56.568578 23487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3564c9e881c54f11a82c0a5012e3ceb9" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0566c730fa6243e4b7506f8124eae074"
I20260709 13:10:56.568835 23559 raft_consensus.cc:2393] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0566c730fa6243e4b7506f8124eae074 in current term 2: Already voted for candidate 406c1f3c281548c8aed4d223f57716ea in this term.
I20260709 13:10:56.569453 23487 raft_consensus.cc:2393] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 406c1f3c281548c8aed4d223f57716ea in current term 2: Already voted for candidate 0566c730fa6243e4b7506f8124eae074 in this term.
W20260709 13:10:56.570676 23451 leader_election.cc:336] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111)
W20260709 13:10:56.571031 23525 leader_election.cc:336] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111)
I20260709 13:10:56.571339 23453 leader_election.cc:304] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074; no voters: 406c1f3c281548c8aed4d223f57716ea, 61eb6de5f0454198905b91cbde0b9cc1
I20260709 13:10:56.572122 23646 raft_consensus.cc:2749] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:56.572785 23528 leader_election.cc:304] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 406c1f3c281548c8aed4d223f57716ea; no voters: 0566c730fa6243e4b7506f8124eae074, 61eb6de5f0454198905b91cbde0b9cc1
I20260709 13:10:56.573412 23611 raft_consensus.cc:2749] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:56.620357 23611 raft_consensus.cc:493] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.621065 23611 raft_consensus.cc:515] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:56.623150 23611 leader_election.cc:290] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331)
I20260709 13:10:56.624468 23487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f000dae80a849a28f3f5151891d8e17" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0566c730fa6243e4b7506f8124eae074" is_pre_election: true
I20260709 13:10:56.625350 23487 raft_consensus.cc:2468] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 406c1f3c281548c8aed4d223f57716ea in term 1.
I20260709 13:10:56.626351 23528 leader_election.cc:304] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 406c1f3c281548c8aed4d223f57716ea; no voters: 
W20260709 13:10:56.626930 23525 leader_election.cc:336] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111)
I20260709 13:10:56.627106 23611 raft_consensus.cc:2804] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:56.627573 23611 raft_consensus.cc:493] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.627830 23611 raft_consensus.cc:3060] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.633003 23611 raft_consensus.cc:515] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:56.634943 23611 leader_election.cc:290] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 election: Requested vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331)
I20260709 13:10:56.636116 23487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f000dae80a849a28f3f5151891d8e17" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0566c730fa6243e4b7506f8124eae074"
I20260709 13:10:56.636775 23487 raft_consensus.cc:3060] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:56.639474 23525 leader_election.cc:336] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111)
I20260709 13:10:56.644584 23487 raft_consensus.cc:2468] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406c1f3c281548c8aed4d223f57716ea in term 2.
I20260709 13:10:56.645542 23528 leader_election.cc:304] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 406c1f3c281548c8aed4d223f57716ea; no voters: 61eb6de5f0454198905b91cbde0b9cc1
I20260709 13:10:56.646373 23686 raft_consensus.cc:2804] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:56.646816 23686 raft_consensus.cc:697] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [term 2 LEADER]: Becoming Leader. State: Replica: 406c1f3c281548c8aed4d223f57716ea, State: Running, Role: LEADER
I20260709 13:10:56.648048 23686 consensus_queue.cc:237] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:56.656555 23309 catalog_manager.cc:5697] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea reported cstate change: term changed from 1 to 2, leader changed from 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129) to 406c1f3c281548c8aed4d223f57716ea (127.12.76.131). New cstate: current_term: 2 leader_uuid: "406c1f3c281548c8aed4d223f57716ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:56.682297 23359 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:56.805094 23686 raft_consensus.cc:493] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61eb6de5f0454198905b91cbde0b9cc1)
I20260709 13:10:56.805773 23686 raft_consensus.cc:515] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:56.807577 23686 leader_election.cc:290] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331), 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437)
I20260709 13:10:56.808341 23487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ba72b6f6dd4e6aa70f76ce35926172" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0566c730fa6243e4b7506f8124eae074" is_pre_election: true
I20260709 13:10:56.811131 23646 raft_consensus.cc:493] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61eb6de5f0454198905b91cbde0b9cc1)
W20260709 13:10:56.811851 23525 leader_election.cc:336] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111)
I20260709 13:10:56.811875 23646 raft_consensus.cc:515] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:56.812439 23525 leader_election.cc:304] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 406c1f3c281548c8aed4d223f57716ea; no voters: 0566c730fa6243e4b7506f8124eae074, 61eb6de5f0454198905b91cbde0b9cc1
I20260709 13:10:56.813221 23686 raft_consensus.cc:2749] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:56.814206 23646 leader_election.cc:290] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:10:56.815156 23559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ba72b6f6dd4e6aa70f76ce35926172" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "406c1f3c281548c8aed4d223f57716ea" is_pre_election: true
I20260709 13:10:56.815825 23559 raft_consensus.cc:2468] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 1.
I20260709 13:10:56.816905 23453 leader_election.cc:304] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 406c1f3c281548c8aed4d223f57716ea; no voters: 
W20260709 13:10:56.817411 23451 leader_election.cc:336] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111)
I20260709 13:10:56.817592 23646 raft_consensus.cc:2804] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:56.818004 23646 raft_consensus.cc:493] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61eb6de5f0454198905b91cbde0b9cc1)
I20260709 13:10:56.818292 23646 raft_consensus.cc:3060] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.823882 23646 raft_consensus.cc:515] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:56.825753 23646 leader_election.cc:290] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 2 election: Requested vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:10:56.827107 23559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5ba72b6f6dd4e6aa70f76ce35926172" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
I20260709 13:10:56.827760 23559 raft_consensus.cc:3060] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:56.829703 23451 leader_election.cc:336] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111)
I20260709 13:10:56.834251 23559 raft_consensus.cc:2468] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 2.
I20260709 13:10:56.835299 23453 leader_election.cc:304] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 406c1f3c281548c8aed4d223f57716ea; no voters: 61eb6de5f0454198905b91cbde0b9cc1
I20260709 13:10:56.836107 23646 raft_consensus.cc:2804] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:56.836553 23646 raft_consensus.cc:697] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [term 2 LEADER]: Becoming Leader. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Running, Role: LEADER
I20260709 13:10:56.837359 23646 consensus_queue.cc:237] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:56.845090 23309 catalog_manager.cc:5697] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 reported cstate change: term changed from 1 to 2, leader changed from 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129) to 0566c730fa6243e4b7506f8124eae074 (127.12.76.130). New cstate: current_term: 2 leader_uuid: "0566c730fa6243e4b7506f8124eae074" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:56.928185 23686 raft_consensus.cc:493] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.928839 23686 raft_consensus.cc:515] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:56.930523 23686 leader_election.cc:290] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331)
I20260709 13:10:56.931706 23487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a20395358b414e9c05ccd833dc9ae8" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0566c730fa6243e4b7506f8124eae074" is_pre_election: true
W20260709 13:10:56.932009 23525 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111) [suppressed 130 similar messages]
I20260709 13:10:56.932523 23487 raft_consensus.cc:2468] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 406c1f3c281548c8aed4d223f57716ea in term 1.
I20260709 13:10:56.933718 23528 leader_election.cc:304] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 406c1f3c281548c8aed4d223f57716ea; no voters: 
I20260709 13:10:56.934553 23686 raft_consensus.cc:2804] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:56.934937 23686 raft_consensus.cc:493] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.935253 23686 raft_consensus.cc:3060] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:56.935245 23525 leader_election.cc:336] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111)
I20260709 13:10:56.941439 23686 raft_consensus.cc:515] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:56.943149 23686 leader_election.cc:290] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 election: Requested vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331)
I20260709 13:10:56.944542 23487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a20395358b414e9c05ccd833dc9ae8" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0566c730fa6243e4b7506f8124eae074"
I20260709 13:10:56.945165 23487 raft_consensus.cc:3060] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:56.946818 23525 leader_election.cc:336] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111)
I20260709 13:10:56.950971 23487 raft_consensus.cc:2468] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406c1f3c281548c8aed4d223f57716ea in term 2.
I20260709 13:10:56.952070 23528 leader_election.cc:304] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 406c1f3c281548c8aed4d223f57716ea; no voters: 61eb6de5f0454198905b91cbde0b9cc1
I20260709 13:10:56.952822 23686 raft_consensus.cc:2804] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:56.953318 23686 raft_consensus.cc:697] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [term 2 LEADER]: Becoming Leader. State: Replica: 406c1f3c281548c8aed4d223f57716ea, State: Running, Role: LEADER
I20260709 13:10:56.954169 23686 consensus_queue.cc:237] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:56.961370 23309 catalog_manager.cc:5697] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea reported cstate change: term changed from 1 to 2, leader changed from 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129) to 406c1f3c281548c8aed4d223f57716ea (127.12.76.131). New cstate: current_term: 2 leader_uuid: "406c1f3c281548c8aed4d223f57716ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:57.043501 23525 consensus_peers.cc:597] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.066727 23487 raft_consensus.cc:1275] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Refusing update from remote peer 406c1f3c281548c8aed4d223f57716ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:57.068099 23686 consensus_queue.cc:1048] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:57.275477 23559 raft_consensus.cc:1275] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Refusing update from remote peer 0566c730fa6243e4b7506f8124eae074: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:57.276717 23646 consensus_queue.cc:1048] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:57.289633 23451 consensus_peers.cc:597] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.470336 23487 raft_consensus.cc:1275] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Refusing update from remote peer 406c1f3c281548c8aed4d223f57716ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:57.471794 23611 consensus_queue.cc:1048] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:57.485545 23525 consensus_peers.cc:597] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:57.683296 23359 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:57.797986 23451 consensus_peers.cc:597] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.948446 23451 consensus_peers.cc:597] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.970304 23451 consensus_peers.cc:597] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.986624 23525 consensus_peers.cc:597] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.043591 23451 consensus_peers.cc:597] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:58.080726 23699 raft_consensus.cc:493] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.081310 23699 raft_consensus.cc:515] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:58.083678 23699 leader_election.cc:290] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:10:58.084966 23559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3564c9e881c54f11a82c0a5012e3ceb9" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "406c1f3c281548c8aed4d223f57716ea" is_pre_election: true
I20260709 13:10:58.085681 23559 raft_consensus.cc:2468] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 2.
I20260709 13:10:58.086822 23453 leader_election.cc:304] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 406c1f3c281548c8aed4d223f57716ea; no voters: 
I20260709 13:10:58.087584 23699 raft_consensus.cc:2804] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:58.087810 23451 leader_election.cc:336] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111)
I20260709 13:10:58.087944 23699 raft_consensus.cc:493] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.088377 23699 raft_consensus.cc:3060] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:58.093776 23699 raft_consensus.cc:515] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:58.095264 23699 leader_election.cc:290] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 3 election: Requested vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:10:58.096441 23559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3564c9e881c54f11a82c0a5012e3ceb9" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
I20260709 13:10:58.097090 23559 raft_consensus.cc:3060] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:58.098875 23451 leader_election.cc:336] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111)
I20260709 13:10:58.103065 23559 raft_consensus.cc:2468] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 3.
I20260709 13:10:58.104079 23453 leader_election.cc:304] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 406c1f3c281548c8aed4d223f57716ea; no voters: 61eb6de5f0454198905b91cbde0b9cc1
I20260709 13:10:58.104722 23699 raft_consensus.cc:2804] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:58.105576 23699 raft_consensus.cc:697] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 3 LEADER]: Becoming Leader. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Running, Role: LEADER
I20260709 13:10:58.106570 23699 consensus_queue.cc:237] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:10:58.113566 23309 catalog_manager.cc:5697] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 reported cstate change: term changed from 1 to 3, leader changed from 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129) to 0566c730fa6243e4b7506f8124eae074 (127.12.76.130). New cstate: current_term: 3 leader_uuid: "0566c730fa6243e4b7506f8124eae074" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:58.247790 23525 consensus_peers.cc:597] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.570196 23451 consensus_peers.cc:597] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:58.671794 23559 raft_consensus.cc:1275] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 3 FOLLOWER]: Refusing update from remote peer 0566c730fa6243e4b7506f8124eae074: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:58.673069 23702 consensus_queue.cc:1048] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:58.684532 23359 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:59.273458 23525 consensus_peers.cc:597] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:59.685562 23359 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:59.694202 23451 consensus_peers.cc:597] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:00.003080 23525 consensus_peers.cc:597] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:00.336680 23451 consensus_peers.cc:597] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.363723 23451 consensus_peers.cc:597] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:00.392359 23451 consensus_peers.cc:597] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:00.413596 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:00.421406 23712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:00.421800 23713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:00.423609 23715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:00.426796 12594 server_base.cc:1061] running on GCE node
I20260709 13:11:00.429296 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:00.429586 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:00.429808 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602660429791 us; error 0 us; skew 500 ppm
I20260709 13:11:00.430430 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:00.442309 12594 webserver.cc:533] Webserver started at http://127.12.76.129:36095/ using document root <none> and password file <none>
I20260709 13:11:00.443653 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:00.443959 12594 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:11:00.452546 12594 fs_manager.cc:714] Time spent opening directory manager: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:11:00.459348 23720 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:00.460594 12594 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:11:00.461165 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602303087285-12594-0/minicluster-data/ts-0-root
uuid: "61eb6de5f0454198905b91cbde0b9cc1"
format_stamp: "Formatted at 2026-07-09 13:10:53 on dist-test-slave-th5x"
I20260709 13:11:00.461763 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602303087285-12594-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602303087285-12594-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602303087285-12594-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:11:00.469306 23525 consensus_peers.cc:597] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:00.494455 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:00.496091 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:00.500139 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:00.506117 23727 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:11:00.553144 23451 consensus_peers.cc:597] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:00.563674 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:11:00.564024 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.059s	user 0.001s	sys 0.002s
I20260709 13:11:00.564272 12594 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:11:00.569484 23727 tablet_bootstrap.cc:492] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap starting.
I20260709 13:11:00.582798 23727 tablet_bootstrap.cc:492] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:00.583685 23727 tablet_bootstrap.cc:492] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap complete.
I20260709 13:11:00.584240 23727 ts_tablet_manager.cc:1403] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.008s
I20260709 13:11:00.587141 23727 raft_consensus.cc:359] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.587924 23727 raft_consensus.cc:740] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61eb6de5f0454198905b91cbde0b9cc1, State: Initialized, Role: FOLLOWER
I20260709 13:11:00.588673 23727 consensus_queue.cc:260] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.590938 23727 ts_tablet_manager.cc:1434] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:11:00.591688 23727 tablet_bootstrap.cc:492] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap starting.
I20260709 13:11:00.602586 12594 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:11:00.602896 23727 tablet_bootstrap.cc:492] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:00.603011 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.039s	user 0.036s	sys 0.000s
I20260709 13:11:00.603827 23727 tablet_bootstrap.cc:492] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap complete.
I20260709 13:11:00.604621 23727 ts_tablet_manager.cc:1403] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 13:11:00.606786 23727 raft_consensus.cc:359] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.607344 23727 raft_consensus.cc:740] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61eb6de5f0454198905b91cbde0b9cc1, State: Initialized, Role: FOLLOWER
I20260709 13:11:00.608121 23727 consensus_queue.cc:260] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.609812 23727 ts_tablet_manager.cc:1434] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:11:00.610661 23727 tablet_bootstrap.cc:492] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap starting.
I20260709 13:11:00.623402 23727 tablet_bootstrap.cc:492] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:00.624434 23727 tablet_bootstrap.cc:492] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap complete.
I20260709 13:11:00.625131 23727 ts_tablet_manager.cc:1403] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:11:00.627839 23727 raft_consensus.cc:359] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.628386 23727 raft_consensus.cc:740] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61eb6de5f0454198905b91cbde0b9cc1, State: Initialized, Role: FOLLOWER
I20260709 13:11:00.629009 23727 consensus_queue.cc:260] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.630715 23727 ts_tablet_manager.cc:1434] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.002s
I20260709 13:11:00.631460 23727 tablet_bootstrap.cc:492] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap starting.
I20260709 13:11:00.643260 23727 tablet_bootstrap.cc:492] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:11:00.644135 23727 tablet_bootstrap.cc:492] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap complete.
I20260709 13:11:00.644670 23727 ts_tablet_manager.cc:1403] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 13:11:00.646546 23727 raft_consensus.cc:359] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.647158 23727 raft_consensus.cc:740] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61eb6de5f0454198905b91cbde0b9cc1, State: Initialized, Role: FOLLOWER
I20260709 13:11:00.647801 23727 consensus_queue.cc:260] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.649292 23727 ts_tablet_manager.cc:1434] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:11:00.650187 23727 tablet_bootstrap.cc:492] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap starting.
I20260709 13:11:00.660895 23727 tablet_bootstrap.cc:492] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:00.661672 23727 tablet_bootstrap.cc:492] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap complete.
I20260709 13:11:00.662351 23727 ts_tablet_manager.cc:1403] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:11:00.664942 23727 raft_consensus.cc:359] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.665510 23727 raft_consensus.cc:740] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61eb6de5f0454198905b91cbde0b9cc1, State: Initialized, Role: FOLLOWER
I20260709 13:11:00.666195 23727 consensus_queue.cc:260] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
W20260709 13:11:00.667502 23525 consensus_peers.cc:597] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:00.668028 23727 ts_tablet_manager.cc:1434] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:11:00.668663 23727 tablet_bootstrap.cc:492] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap starting.
I20260709 13:11:00.678526 23727 tablet_bootstrap.cc:492] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:00.679154 23727 tablet_bootstrap.cc:492] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap complete.
I20260709 13:11:00.679762 23727 ts_tablet_manager.cc:1403] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1: Time spent bootstrapping tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 13:11:00.680619 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.129:35437
I20260709 13:11:00.680768 23790 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.129:35437 every 8 connection(s)
I20260709 13:11:00.682063 23727 raft_consensus.cc:359] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.682538 23727 raft_consensus.cc:740] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61eb6de5f0454198905b91cbde0b9cc1, State: Initialized, Role: FOLLOWER
I20260709 13:11:00.683056 23727 consensus_queue.cc:260] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.684544 23727 ts_tablet_manager.cc:1434] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:00.685557 23727 tablet_bootstrap.cc:492] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap starting.
W20260709 13:11:00.685570 23792 tablet.cc:2406] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260709 13:11:00.686618 23359 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:00.687620 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:00.703466 23727 tablet_bootstrap.cc:492] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:00.704392 23727 tablet_bootstrap.cc:492] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap complete.
I20260709 13:11:00.704981 23727 ts_tablet_manager.cc:1403] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:11:00.707302 23727 raft_consensus.cc:359] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.708078 23727 raft_consensus.cc:740] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61eb6de5f0454198905b91cbde0b9cc1, State: Initialized, Role: FOLLOWER
I20260709 13:11:00.708959 23727 consensus_queue.cc:260] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.711282 23727 ts_tablet_manager.cc:1434] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:11:00.712209 23727 tablet_bootstrap.cc:492] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap starting.
I20260709 13:11:00.714097 23488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "031e3cbadd274f30b727bb838177869b"
dest_uuid: "0566c730fa6243e4b7506f8124eae074"
mode: GRACEFUL
new_leader_uuid: "406c1f3c281548c8aed4d223f57716ea"
 from {username='slave'} at 127.0.0.1:38480
I20260709 13:11:00.714897 23488 raft_consensus.cc:606] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [term 1 LEADER]: Received request to transfer leadership to TS 406c1f3c281548c8aed4d223f57716ea
I20260709 13:11:00.715973 23791 heartbeater.cc:344] Connected to a master server at 127.12.76.190:44103
I20260709 13:11:00.716444 23791 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:00.717195 23791 heartbeater.cc:507] Master 127.12.76.190:44103 requested a full tablet report, sending...
I20260709 13:11:00.717981 23488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c25600b8c5804b40a113d63912f38530"
dest_uuid: "0566c730fa6243e4b7506f8124eae074"
mode: GRACEFUL
new_leader_uuid: "406c1f3c281548c8aed4d223f57716ea"
 from {username='slave'} at 127.0.0.1:38480
I20260709 13:11:00.718614 23488 raft_consensus.cc:606] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [term 1 LEADER]: Received request to transfer leadership to TS 406c1f3c281548c8aed4d223f57716ea
I20260709 13:11:00.719944 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:00.720599 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:00.721433 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:00.723014 23311 ts_manager.cc:194] Re-registered known tserver with Master: 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437)
I20260709 13:11:00.729384 23727 tablet_bootstrap.cc:492] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:00.730418 23727 tablet_bootstrap.cc:492] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap complete.
I20260709 13:11:00.731088 23727 ts_tablet_manager.cc:1403] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:11:00.731266 23311 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41018
I20260709 13:11:00.733681 23727 raft_consensus.cc:359] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.734368 23727 raft_consensus.cc:740] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61eb6de5f0454198905b91cbde0b9cc1, State: Initialized, Role: FOLLOWER
I20260709 13:11:00.734481 23791 heartbeater.cc:499] Master 127.12.76.190:44103 was elected leader, sending a full tablet report...
I20260709 13:11:00.735147 23727 consensus_queue.cc:260] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.737538 23727 ts_tablet_manager.cc:1434] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:11:00.738431 23727 tablet_bootstrap.cc:492] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap starting.
I20260709 13:11:00.750541 23711 raft_consensus.cc:993] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074: : Instructing follower 406c1f3c281548c8aed4d223f57716ea to start an election
I20260709 13:11:00.751160 23711 raft_consensus.cc:1081] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [term 1 LEADER]: Signalling peer 406c1f3c281548c8aed4d223f57716ea to start an election
I20260709 13:11:00.753240 23559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "031e3cbadd274f30b727bb838177869b"
dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
 from {username='slave'} at 127.0.0.1:60786
I20260709 13:11:00.753881 23559 raft_consensus.cc:493] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:00.754246 23559 raft_consensus.cc:3060] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.757050 23800 raft_consensus.cc:993] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074: : Instructing follower 406c1f3c281548c8aed4d223f57716ea to start an election
I20260709 13:11:00.757611 23711 raft_consensus.cc:1081] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [term 1 LEADER]: Signalling peer 406c1f3c281548c8aed4d223f57716ea to start an election
I20260709 13:11:00.759588 23560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c25600b8c5804b40a113d63912f38530"
dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
 from {username='slave'} at 127.0.0.1:60786
I20260709 13:11:00.760123 23560 raft_consensus.cc:493] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:00.760481 23560 raft_consensus.cc:3060] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.760566 23727 tablet_bootstrap.cc:492] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:11:00.761781 23727 tablet_bootstrap.cc:492] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap complete.
I20260709 13:11:00.762454 23727 ts_tablet_manager.cc:1403] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.006s
I20260709 13:11:00.762971 23559 raft_consensus.cc:515] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.765709 23559 leader_election.cc:290] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 election: Requested vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331)
I20260709 13:11:00.765321 23727 raft_consensus.cc:359] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.766494 23727 raft_consensus.cc:740] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61eb6de5f0454198905b91cbde0b9cc1, State: Initialized, Role: FOLLOWER
I20260709 13:11:00.767242 23727 consensus_queue.cc:260] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.768498 23488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031e3cbadd274f30b727bb838177869b" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0566c730fa6243e4b7506f8124eae074"
I20260709 13:11:00.769191 23488 raft_consensus.cc:3055] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:00.769321 23727 ts_tablet_manager.cc:1434] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:00.769616 23488 raft_consensus.cc:740] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Running, Role: LEADER
I20260709 13:11:00.770285 23727 tablet_bootstrap.cc:492] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap starting.
I20260709 13:11:00.770704 23488 consensus_queue.cc:260] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.771245 23764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031e3cbadd274f30b727bb838177869b" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61eb6de5f0454198905b91cbde0b9cc1"
I20260709 13:11:00.771901 23764 raft_consensus.cc:3060] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.772140 23488 raft_consensus.cc:3060] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.769683 23560 raft_consensus.cc:515] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.775935 23560 leader_election.cc:290] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 election: Requested vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331)
I20260709 13:11:00.777186 23487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25600b8c5804b40a113d63912f38530" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0566c730fa6243e4b7506f8124eae074"
I20260709 13:11:00.777803 23487 raft_consensus.cc:3055] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:00.778108 23487 raft_consensus.cc:740] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Running, Role: LEADER
I20260709 13:11:00.778911 23487 consensus_queue.cc:260] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.780256 23487 raft_consensus.cc:3060] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.782645 23488 raft_consensus.cc:2468] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406c1f3c281548c8aed4d223f57716ea in term 2.
I20260709 13:11:00.784580 23763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25600b8c5804b40a113d63912f38530" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61eb6de5f0454198905b91cbde0b9cc1"
I20260709 13:11:00.784734 23528 leader_election.cc:304] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 406c1f3c281548c8aed4d223f57716ea; no voters: 
I20260709 13:11:00.785374 23763 raft_consensus.cc:3060] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.785952 23701 raft_consensus.cc:2804] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:00.808410 23761 raft_consensus.cc:3060] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.810393 23487 raft_consensus.cc:2468] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406c1f3c281548c8aed4d223f57716ea in term 2.
I20260709 13:11:00.812155 23528 leader_election.cc:304] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 406c1f3c281548c8aed4d223f57716ea; no voters: 
I20260709 13:11:00.826048 23803 raft_consensus.cc:2804] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:00.825414 23701 raft_consensus.cc:697] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea [term 2 LEADER]: Becoming Leader. State: Replica: 406c1f3c281548c8aed4d223f57716ea, State: Running, Role: LEADER
I20260709 13:11:00.826714 23803 raft_consensus.cc:697] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea [term 2 LEADER]: Becoming Leader. State: Replica: 406c1f3c281548c8aed4d223f57716ea, State: Running, Role: LEADER
I20260709 13:11:00.827630 23701 consensus_queue.cc:237] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.827795 23803 consensus_queue.cc:237] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.832669 23764 raft_consensus.cc:2468] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406c1f3c281548c8aed4d223f57716ea in term 2.
I20260709 13:11:00.837067 23727 tablet_bootstrap.cc:492] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:00.838246 23727 tablet_bootstrap.cc:492] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1: Bootstrap complete.
I20260709 13:11:00.840749 23763 raft_consensus.cc:2468] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406c1f3c281548c8aed4d223f57716ea in term 2.
I20260709 13:11:00.843813 23727 ts_tablet_manager.cc:1403] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent bootstrapping tablet: real 0.074s	user 0.036s	sys 0.032s
I20260709 13:11:00.846797 23727 raft_consensus.cc:359] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.847633 23727 raft_consensus.cc:740] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61eb6de5f0454198905b91cbde0b9cc1, State: Initialized, Role: FOLLOWER
I20260709 13:11:00.848649 23727 consensus_queue.cc:260] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:00.851034 23727 ts_tablet_manager.cc:1434] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:00.856155 23309 catalog_manager.cc:5697] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea reported cstate change: term changed from 1 to 2, leader changed from 0566c730fa6243e4b7506f8124eae074 (127.12.76.130) to 406c1f3c281548c8aed4d223f57716ea (127.12.76.131). New cstate: current_term: 2 leader_uuid: "406c1f3c281548c8aed4d223f57716ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:00.873951 23309 catalog_manager.cc:5697] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea reported cstate change: term changed from 1 to 2, leader changed from 0566c730fa6243e4b7506f8124eae074 (127.12.76.130) to 406c1f3c281548c8aed4d223f57716ea (127.12.76.131). New cstate: current_term: 2 leader_uuid: "406c1f3c281548c8aed4d223f57716ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:01.000990 23761 raft_consensus.cc:3060] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.006291 23761 pending_rounds.cc:85] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1: Aborting all ops after (but not including) 0
I20260709 13:11:01.006557 23761 pending_rounds.cc:107] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:11:01.006831 23761 raft_consensus.cc:2889] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:01.140190 23761 raft_consensus.cc:3060] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.323647 23761 raft_consensus.cc:3060] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.329334 23761 pending_rounds.cc:85] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1: Aborting all ops after (but not including) 0
I20260709 13:11:01.329560 23761 pending_rounds.cc:107] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:11:01.329747 23761 raft_consensus.cc:2889] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:01.366600 23761 raft_consensus.cc:1275] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: Refusing update from remote peer 406c1f3c281548c8aed4d223f57716ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:01.367769 23805 consensus_queue.cc:1048] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:01.377986 23487 raft_consensus.cc:1275] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Refusing update from remote peer 406c1f3c281548c8aed4d223f57716ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:01.379899 23822 consensus_queue.cc:1048] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:01.394894 23761 raft_consensus.cc:1275] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: Refusing update from remote peer 406c1f3c281548c8aed4d223f57716ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:01.396143 23822 consensus_queue.cc:1048] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:01.406137 23487 raft_consensus.cc:1275] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Refusing update from remote peer 406c1f3c281548c8aed4d223f57716ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:01.408555 23822 consensus_queue.cc:1048] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:01.687777 23359 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:01.733670 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:01.751009 23560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f000dae80a849a28f3f5151891d8e17"
dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
mode: GRACEFUL
new_leader_uuid: "0566c730fa6243e4b7506f8124eae074"
 from {username='slave'} at 127.0.0.1:46738
I20260709 13:11:01.751634 23560 raft_consensus.cc:606] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [term 2 LEADER]: Received request to transfer leadership to TS 0566c730fa6243e4b7506f8124eae074
I20260709 13:11:01.754118 23560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e966b1a3927f41f28f706bcc1e6de3a2"
dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
mode: GRACEFUL
new_leader_uuid: "0566c730fa6243e4b7506f8124eae074"
 from {username='slave'} at 127.0.0.1:46738
I20260709 13:11:01.754639 23560 raft_consensus.cc:606] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 1 LEADER]: Received request to transfer leadership to TS 0566c730fa6243e4b7506f8124eae074
I20260709 13:11:01.755949 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:01.756520 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:01.757156 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:01.766521 23822 raft_consensus.cc:993] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea: : Instructing follower 0566c730fa6243e4b7506f8124eae074 to start an election
I20260709 13:11:01.767059 23805 raft_consensus.cc:1081] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 1 LEADER]: Signalling peer 0566c730fa6243e4b7506f8124eae074 to start an election
I20260709 13:11:01.768489 23487 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e966b1a3927f41f28f706bcc1e6de3a2"
dest_uuid: "0566c730fa6243e4b7506f8124eae074"
 from {username='slave'} at 127.0.0.1:59016
I20260709 13:11:01.768908 23487 raft_consensus.cc:493] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:01.769244 23487 raft_consensus.cc:3060] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.774461 23487 raft_consensus.cc:515] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:01.776140 23487 leader_election.cc:290] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 2 election: Requested vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:11:01.776789 23761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e966b1a3927f41f28f706bcc1e6de3a2" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61eb6de5f0454198905b91cbde0b9cc1"
I20260709 13:11:01.777186 23560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e966b1a3927f41f28f706bcc1e6de3a2" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
I20260709 13:11:01.777463 23761 raft_consensus.cc:3060] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.777803 23560 raft_consensus.cc:3055] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:01.778131 23560 raft_consensus.cc:740] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 406c1f3c281548c8aed4d223f57716ea, State: Running, Role: LEADER
I20260709 13:11:01.779007 23560 consensus_queue.cc:260] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:01.780349 23560 raft_consensus.cc:3060] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.784870 23761 raft_consensus.cc:2468] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 2.
I20260709 13:11:01.786182 23451 leader_election.cc:304] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 61eb6de5f0454198905b91cbde0b9cc1; no voters: 
I20260709 13:11:01.787004 23711 raft_consensus.cc:2804] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:01.787457 23711 raft_consensus.cc:697] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [term 2 LEADER]: Becoming Leader. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Running, Role: LEADER
I20260709 13:11:01.787642 23560 raft_consensus.cc:2468] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 2.
I20260709 13:11:01.788425 23711 consensus_queue.cc:237] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:01.795948 23309 catalog_manager.cc:5697] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 reported cstate change: term changed from 1 to 2, leader changed from 406c1f3c281548c8aed4d223f57716ea (127.12.76.131) to 0566c730fa6243e4b7506f8124eae074 (127.12.76.130). New cstate: current_term: 2 leader_uuid: "0566c730fa6243e4b7506f8124eae074" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.169286 23701 raft_consensus.cc:993] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea: : Instructing follower 0566c730fa6243e4b7506f8124eae074 to start an election
I20260709 13:11:02.169790 23805 raft_consensus.cc:1081] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [term 2 LEADER]: Signalling peer 0566c730fa6243e4b7506f8124eae074 to start an election
I20260709 13:11:02.171252 23487 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f000dae80a849a28f3f5151891d8e17"
dest_uuid: "0566c730fa6243e4b7506f8124eae074"
 from {username='slave'} at 127.0.0.1:59016
I20260709 13:11:02.171846 23487 raft_consensus.cc:493] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:02.172156 23487 raft_consensus.cc:3060] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:02.176755 23487 raft_consensus.cc:515] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:02.178144 23487 leader_election.cc:290] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 3 election: Requested vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:11:02.179109 23761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f000dae80a849a28f3f5151891d8e17" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "61eb6de5f0454198905b91cbde0b9cc1"
I20260709 13:11:02.179246 23560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f000dae80a849a28f3f5151891d8e17" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
I20260709 13:11:02.179718 23761 raft_consensus.cc:3060] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:02.179903 23560 raft_consensus.cc:3055] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:02.180277 23560 raft_consensus.cc:740] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 406c1f3c281548c8aed4d223f57716ea, State: Running, Role: LEADER
I20260709 13:11:02.180950 23560 consensus_queue.cc:260] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:02.181887 23560 raft_consensus.cc:3060] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:02.184733 23761 raft_consensus.cc:2468] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 3.
I20260709 13:11:02.185801 23451 leader_election.cc:304] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 61eb6de5f0454198905b91cbde0b9cc1; no voters: 
I20260709 13:11:02.186568 23711 raft_consensus.cc:2804] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:02.186976 23711 raft_consensus.cc:697] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074 [term 3 LEADER]: Becoming Leader. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Running, Role: LEADER
I20260709 13:11:02.187161 23560 raft_consensus.cc:2468] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 3.
I20260709 13:11:02.187880 23711 consensus_queue.cc:237] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:02.194895 23309 catalog_manager.cc:5697] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074 reported cstate change: term changed from 2 to 3, leader changed from 406c1f3c281548c8aed4d223f57716ea (127.12.76.131) to 0566c730fa6243e4b7506f8124eae074 (127.12.76.130). New cstate: current_term: 3 leader_uuid: "0566c730fa6243e4b7506f8124eae074" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.311105 23761 raft_consensus.cc:1275] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: Refusing update from remote peer 0566c730fa6243e4b7506f8124eae074: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:02.312216 23711 consensus_queue.cc:1048] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:02.322144 23560 raft_consensus.cc:1275] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Refusing update from remote peer 0566c730fa6243e4b7506f8124eae074: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:02.323726 23711 consensus_queue.cc:1048] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:02.592034 23560 raft_consensus.cc:1275] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [term 3 FOLLOWER]: Refusing update from remote peer 0566c730fa6243e4b7506f8124eae074: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:02.593413 23711 consensus_queue.cc:1048] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:02.602033 23761 raft_consensus.cc:1275] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [term 3 FOLLOWER]: Refusing update from remote peer 0566c730fa6243e4b7506f8124eae074: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:02.603585 23837 consensus_queue.cc:1048] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:02.688711 23359 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:02.764468 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:02.772455 23487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3564c9e881c54f11a82c0a5012e3ceb9"
dest_uuid: "0566c730fa6243e4b7506f8124eae074"
mode: GRACEFUL
new_leader_uuid: "406c1f3c281548c8aed4d223f57716ea"
 from {username='slave'} at 127.0.0.1:38480
I20260709 13:11:02.772974 23487 raft_consensus.cc:606] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 3 LEADER]: Received request to transfer leadership to TS 406c1f3c281548c8aed4d223f57716ea
I20260709 13:11:02.775274 23487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "524cd1c347354d3a9ecf13e1089ad7de"
dest_uuid: "0566c730fa6243e4b7506f8124eae074"
mode: GRACEFUL
new_leader_uuid: "406c1f3c281548c8aed4d223f57716ea"
 from {username='slave'} at 127.0.0.1:38480
I20260709 13:11:02.775770 23487 raft_consensus.cc:606] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 1 LEADER]: Received request to transfer leadership to TS 406c1f3c281548c8aed4d223f57716ea
I20260709 13:11:02.776847 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:02.777437 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:02.778110 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:02.798741 23702 raft_consensus.cc:993] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074: : Instructing follower 406c1f3c281548c8aed4d223f57716ea to start an election
I20260709 13:11:02.799361 23837 raft_consensus.cc:1081] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 1 LEADER]: Signalling peer 406c1f3c281548c8aed4d223f57716ea to start an election
I20260709 13:11:02.800899 23560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "524cd1c347354d3a9ecf13e1089ad7de"
dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
 from {username='slave'} at 127.0.0.1:60786
I20260709 13:11:02.801384 23560 raft_consensus.cc:493] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:02.801739 23560 raft_consensus.cc:3060] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.806800 23560 raft_consensus.cc:515] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:02.808413 23560 leader_election.cc:290] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 election: Requested vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331)
I20260709 13:11:02.809449 23761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524cd1c347354d3a9ecf13e1089ad7de" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61eb6de5f0454198905b91cbde0b9cc1"
I20260709 13:11:02.809484 23487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524cd1c347354d3a9ecf13e1089ad7de" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0566c730fa6243e4b7506f8124eae074"
I20260709 13:11:02.810437 23761 raft_consensus.cc:3060] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.810536 23487 raft_consensus.cc:3055] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:02.811120 23487 raft_consensus.cc:740] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Running, Role: LEADER
I20260709 13:11:02.812094 23487 consensus_queue.cc:260] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:02.813144 23487 raft_consensus.cc:3060] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.817446 23761 raft_consensus.cc:2468] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406c1f3c281548c8aed4d223f57716ea in term 2.
I20260709 13:11:02.818953 23525 leader_election.cc:304] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406c1f3c281548c8aed4d223f57716ea, 61eb6de5f0454198905b91cbde0b9cc1; no voters: 
I20260709 13:11:02.819793 23805 raft_consensus.cc:2804] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:02.819907 23487 raft_consensus.cc:2468] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406c1f3c281548c8aed4d223f57716ea in term 2.
I20260709 13:11:02.820807 23805 raft_consensus.cc:697] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [term 2 LEADER]: Becoming Leader. State: Replica: 406c1f3c281548c8aed4d223f57716ea, State: Running, Role: LEADER
I20260709 13:11:02.821740 23805 consensus_queue.cc:237] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:02.829052 23309 catalog_manager.cc:5697] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea reported cstate change: term changed from 1 to 2, leader changed from 0566c730fa6243e4b7506f8124eae074 (127.12.76.130) to 406c1f3c281548c8aed4d223f57716ea (127.12.76.131). New cstate: current_term: 2 leader_uuid: "406c1f3c281548c8aed4d223f57716ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:03.064188 23711 raft_consensus.cc:993] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074: : Instructing follower 406c1f3c281548c8aed4d223f57716ea to start an election
I20260709 13:11:03.064683 23837 raft_consensus.cc:1081] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 3 LEADER]: Signalling peer 406c1f3c281548c8aed4d223f57716ea to start an election
I20260709 13:11:03.066399 23560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3564c9e881c54f11a82c0a5012e3ceb9"
dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
 from {username='slave'} at 127.0.0.1:60786
I20260709 13:11:03.066901 23560 raft_consensus.cc:493] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:03.067191 23560 raft_consensus.cc:3060] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:03.072247 23560 raft_consensus.cc:515] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:03.073966 23560 leader_election.cc:290] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 4 election: Requested vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331)
I20260709 13:11:03.074930 23761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3564c9e881c54f11a82c0a5012e3ceb9" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "61eb6de5f0454198905b91cbde0b9cc1"
I20260709 13:11:03.075193 23487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3564c9e881c54f11a82c0a5012e3ceb9" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0566c730fa6243e4b7506f8124eae074"
I20260709 13:11:03.075569 23761 raft_consensus.cc:3060] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:03.075793 23487 raft_consensus.cc:3055] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:03.076126 23487 raft_consensus.cc:740] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Running, Role: LEADER
I20260709 13:11:03.076692 23487 consensus_queue.cc:260] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:03.077544 23487 raft_consensus.cc:3060] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:03.080735 23761 raft_consensus.cc:2468] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406c1f3c281548c8aed4d223f57716ea in term 4.
I20260709 13:11:03.081779 23525 leader_election.cc:304] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406c1f3c281548c8aed4d223f57716ea, 61eb6de5f0454198905b91cbde0b9cc1; no voters: 
I20260709 13:11:03.081838 23487 raft_consensus.cc:2468] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406c1f3c281548c8aed4d223f57716ea in term 4.
I20260709 13:11:03.082597 23805 raft_consensus.cc:2804] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:03.083031 23805 raft_consensus.cc:697] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 4 LEADER]: Becoming Leader. State: Replica: 406c1f3c281548c8aed4d223f57716ea, State: Running, Role: LEADER
I20260709 13:11:03.083830 23805 consensus_queue.cc:237] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:03.089944 23309 catalog_manager.cc:5697] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea reported cstate change: term changed from 3 to 4, leader changed from 0566c730fa6243e4b7506f8124eae074 (127.12.76.130) to 406c1f3c281548c8aed4d223f57716ea (127.12.76.131). New cstate: current_term: 4 leader_uuid: "406c1f3c281548c8aed4d223f57716ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:03.287263 23761 raft_consensus.cc:1275] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: Refusing update from remote peer 406c1f3c281548c8aed4d223f57716ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:03.288594 23843 consensus_queue.cc:1048] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:03.298239 23487 raft_consensus.cc:1275] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Refusing update from remote peer 406c1f3c281548c8aed4d223f57716ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:03.300674 23843 consensus_queue.cc:1048] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:03.485495 23487 raft_consensus.cc:1275] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 4 FOLLOWER]: Refusing update from remote peer 406c1f3c281548c8aed4d223f57716ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:03.486713 23843 consensus_queue.cc:1048] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:03.494896 23761 raft_consensus.cc:1275] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [term 4 FOLLOWER]: Refusing update from remote peer 406c1f3c281548c8aed4d223f57716ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:03.496419 23805 consensus_queue.cc:1048] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:11:03.689673 23359 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:03.784658 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:03.793227 23560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3564c9e881c54f11a82c0a5012e3ceb9"
dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
mode: GRACEFUL
new_leader_uuid: "0566c730fa6243e4b7506f8124eae074"
 from {username='slave'} at 127.0.0.1:46738
I20260709 13:11:03.793896 23560 raft_consensus.cc:606] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 4 LEADER]: Received request to transfer leadership to TS 0566c730fa6243e4b7506f8124eae074
I20260709 13:11:03.796595 23560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "524cd1c347354d3a9ecf13e1089ad7de"
dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
mode: GRACEFUL
new_leader_uuid: "0566c730fa6243e4b7506f8124eae074"
 from {username='slave'} at 127.0.0.1:46738
I20260709 13:11:03.797087 23560 raft_consensus.cc:606] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [term 2 LEADER]: Received request to transfer leadership to TS 0566c730fa6243e4b7506f8124eae074
I20260709 13:11:03.798103 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:03.798607 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:03.799098 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:03.895036 23856 raft_consensus.cc:993] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea: : Instructing follower 0566c730fa6243e4b7506f8124eae074 to start an election
I20260709 13:11:03.895653 23843 raft_consensus.cc:1081] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 4 LEADER]: Signalling peer 0566c730fa6243e4b7506f8124eae074 to start an election
I20260709 13:11:03.896991 23487 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3564c9e881c54f11a82c0a5012e3ceb9"
dest_uuid: "0566c730fa6243e4b7506f8124eae074"
 from {username='slave'} at 127.0.0.1:59016
I20260709 13:11:03.897460 23487 raft_consensus.cc:493] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:03.897742 23487 raft_consensus.cc:3060] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:03.902027 23487 raft_consensus.cc:515] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:03.903381 23487 leader_election.cc:290] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 5 election: Requested vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:11:03.904275 23763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3564c9e881c54f11a82c0a5012e3ceb9" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "61eb6de5f0454198905b91cbde0b9cc1"
I20260709 13:11:03.904441 23560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3564c9e881c54f11a82c0a5012e3ceb9" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
I20260709 13:11:03.904911 23763 raft_consensus.cc:3060] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:03.904983 23560 raft_consensus.cc:3055] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:03.905392 23560 raft_consensus.cc:740] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 406c1f3c281548c8aed4d223f57716ea, State: Running, Role: LEADER
I20260709 13:11:03.906023 23560 consensus_queue.cc:260] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:03.906942 23560 raft_consensus.cc:3060] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:03.910029 23763 raft_consensus.cc:2468] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 5.
I20260709 13:11:03.911233 23451 leader_election.cc:304] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 61eb6de5f0454198905b91cbde0b9cc1; no voters: 
I20260709 13:11:03.911918 23837 raft_consensus.cc:2804] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:03.911928 23560 raft_consensus.cc:2468] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 5.
I20260709 13:11:03.913085 23837 raft_consensus.cc:697] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 5 LEADER]: Becoming Leader. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Running, Role: LEADER
I20260709 13:11:03.913841 23837 consensus_queue.cc:237] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:03.920133 23309 catalog_manager.cc:5697] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 reported cstate change: term changed from 4 to 5, leader changed from 406c1f3c281548c8aed4d223f57716ea (127.12.76.131) to 0566c730fa6243e4b7506f8124eae074 (127.12.76.130). New cstate: current_term: 5 leader_uuid: "0566c730fa6243e4b7506f8124eae074" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:04.226486 23843 raft_consensus.cc:993] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea: : Instructing follower 0566c730fa6243e4b7506f8124eae074 to start an election
I20260709 13:11:04.226984 23856 raft_consensus.cc:1081] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [term 2 LEADER]: Signalling peer 0566c730fa6243e4b7506f8124eae074 to start an election
I20260709 13:11:04.228490 23488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "524cd1c347354d3a9ecf13e1089ad7de"
dest_uuid: "0566c730fa6243e4b7506f8124eae074"
 from {username='slave'} at 127.0.0.1:59016
I20260709 13:11:04.228897 23488 raft_consensus.cc:493] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:04.229136 23488 raft_consensus.cc:3060] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:04.234777 23488 raft_consensus.cc:515] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:04.236423 23488 leader_election.cc:290] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 3 election: Requested vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 406c1f3c281548c8aed4d223f57716ea (127.12.76.131:38707)
I20260709 13:11:04.237349 23763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524cd1c347354d3a9ecf13e1089ad7de" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "61eb6de5f0454198905b91cbde0b9cc1"
I20260709 13:11:04.237442 23560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524cd1c347354d3a9ecf13e1089ad7de" candidate_uuid: "0566c730fa6243e4b7506f8124eae074" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
I20260709 13:11:04.238116 23763 raft_consensus.cc:3060] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:04.238227 23560 raft_consensus.cc:3055] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:04.238632 23560 raft_consensus.cc:740] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 406c1f3c281548c8aed4d223f57716ea, State: Running, Role: LEADER
I20260709 13:11:04.239275 23560 consensus_queue.cc:260] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:04.240227 23560 raft_consensus.cc:3060] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:04.243546 23763 raft_consensus.cc:2468] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 3.
I20260709 13:11:04.244529 23451 leader_election.cc:304] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0566c730fa6243e4b7506f8124eae074, 61eb6de5f0454198905b91cbde0b9cc1; no voters: 
I20260709 13:11:04.245182 23837 raft_consensus.cc:2804] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:04.245498 23560 raft_consensus.cc:2468] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0566c730fa6243e4b7506f8124eae074 in term 3.
I20260709 13:11:04.245680 23837 raft_consensus.cc:697] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 3 LEADER]: Becoming Leader. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Running, Role: LEADER
I20260709 13:11:04.246593 23837 consensus_queue.cc:237] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:04.252959 23309 catalog_manager.cc:5697] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 reported cstate change: term changed from 2 to 3, leader changed from 406c1f3c281548c8aed4d223f57716ea (127.12.76.131) to 0566c730fa6243e4b7506f8124eae074 (127.12.76.130). New cstate: current_term: 3 leader_uuid: "0566c730fa6243e4b7506f8124eae074" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:04.502333 23763 raft_consensus.cc:1275] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [term 5 FOLLOWER]: Refusing update from remote peer 0566c730fa6243e4b7506f8124eae074: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:04.503635 23858 consensus_queue.cc:1048] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:04.511730 23560 raft_consensus.cc:1275] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 5 FOLLOWER]: Refusing update from remote peer 0566c730fa6243e4b7506f8124eae074: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:04.514943 23864 consensus_queue.cc:1048] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:11:04.690666 23359 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:04.762195 23763 raft_consensus.cc:1275] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1 [term 3 FOLLOWER]: Refusing update from remote peer 0566c730fa6243e4b7506f8124eae074: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:04.763471 23866 consensus_queue.cc:1048] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:04.773486 23560 raft_consensus.cc:1275] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [term 3 FOLLOWER]: Refusing update from remote peer 0566c730fa6243e4b7506f8124eae074: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:04.774922 23858 consensus_queue.cc:1048] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [LEADER]: Connected to new peer: Peer: permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:04.806257 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:04.813997 23488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54ab7e6addc2428d9c507042be9c6826"
dest_uuid: "0566c730fa6243e4b7506f8124eae074"
mode: GRACEFUL
new_leader_uuid: "406c1f3c281548c8aed4d223f57716ea"
 from {username='slave'} at 127.0.0.1:38480
I20260709 13:11:04.814561 23488 raft_consensus.cc:606] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [term 1 LEADER]: Received request to transfer leadership to TS 406c1f3c281548c8aed4d223f57716ea
I20260709 13:11:04.817020 23488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e966b1a3927f41f28f706bcc1e6de3a2"
dest_uuid: "0566c730fa6243e4b7506f8124eae074"
mode: GRACEFUL
new_leader_uuid: "406c1f3c281548c8aed4d223f57716ea"
 from {username='slave'} at 127.0.0.1:38480
I20260709 13:11:04.817487 23488 raft_consensus.cc:606] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [term 2 LEADER]: Received request to transfer leadership to TS 406c1f3c281548c8aed4d223f57716ea
I20260709 13:11:04.818569 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:04.819015 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:04.819686 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:04.822403 23866 raft_consensus.cc:993] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074: : Instructing follower 406c1f3c281548c8aed4d223f57716ea to start an election
I20260709 13:11:04.822950 23858 raft_consensus.cc:1081] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [term 2 LEADER]: Signalling peer 406c1f3c281548c8aed4d223f57716ea to start an election
I20260709 13:11:04.824385 23560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e966b1a3927f41f28f706bcc1e6de3a2"
dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
 from {username='slave'} at 127.0.0.1:60786
I20260709 13:11:04.824862 23560 raft_consensus.cc:493] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:04.825222 23560 raft_consensus.cc:3060] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:04.833200 23560 raft_consensus.cc:515] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:04.835235 23560 leader_election.cc:290] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 3 election: Requested vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331)
I20260709 13:11:04.835803 23763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e966b1a3927f41f28f706bcc1e6de3a2" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "61eb6de5f0454198905b91cbde0b9cc1"
I20260709 13:11:04.835881 23488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e966b1a3927f41f28f706bcc1e6de3a2" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0566c730fa6243e4b7506f8124eae074"
I20260709 13:11:04.836570 23763 raft_consensus.cc:3060] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:04.836676 23488 raft_consensus.cc:3055] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:04.837139 23488 raft_consensus.cc:740] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Running, Role: LEADER
I20260709 13:11:04.837832 23488 consensus_queue.cc:260] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:04.838773 23488 raft_consensus.cc:3060] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:04.841897 23763 raft_consensus.cc:2468] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406c1f3c281548c8aed4d223f57716ea in term 3.
I20260709 13:11:04.843004 23525 leader_election.cc:304] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406c1f3c281548c8aed4d223f57716ea, 61eb6de5f0454198905b91cbde0b9cc1; no voters: 
I20260709 13:11:04.843698 23856 raft_consensus.cc:2804] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:04.844345 23488 raft_consensus.cc:2468] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406c1f3c281548c8aed4d223f57716ea in term 3.
I20260709 13:11:04.844806 23856 raft_consensus.cc:697] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 3 LEADER]: Becoming Leader. State: Replica: 406c1f3c281548c8aed4d223f57716ea, State: Running, Role: LEADER
I20260709 13:11:04.845709 23856 consensus_queue.cc:237] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:04.852124 23309 catalog_manager.cc:5697] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea reported cstate change: term changed from 2 to 3, leader changed from 0566c730fa6243e4b7506f8124eae074 (127.12.76.130) to 406c1f3c281548c8aed4d223f57716ea (127.12.76.131). New cstate: current_term: 3 leader_uuid: "406c1f3c281548c8aed4d223f57716ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.020546 23866 raft_consensus.cc:993] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074: : Instructing follower 406c1f3c281548c8aed4d223f57716ea to start an election
I20260709 13:11:05.021095 23858 raft_consensus.cc:1081] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [term 1 LEADER]: Signalling peer 406c1f3c281548c8aed4d223f57716ea to start an election
I20260709 13:11:05.022516 23560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54ab7e6addc2428d9c507042be9c6826"
dest_uuid: "406c1f3c281548c8aed4d223f57716ea"
 from {username='slave'} at 127.0.0.1:60786
I20260709 13:11:05.022967 23560 raft_consensus.cc:493] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:05.023213 23560 raft_consensus.cc:3060] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.028200 23560 raft_consensus.cc:515] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:05.029865 23560 leader_election.cc:290] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 election: Requested vote from peers 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437), 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331)
I20260709 13:11:05.030589 23763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ab7e6addc2428d9c507042be9c6826" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61eb6de5f0454198905b91cbde0b9cc1"
I20260709 13:11:05.030874 23488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ab7e6addc2428d9c507042be9c6826" candidate_uuid: "406c1f3c281548c8aed4d223f57716ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0566c730fa6243e4b7506f8124eae074"
I20260709 13:11:05.031257 23763 raft_consensus.cc:3060] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.031566 23488 raft_consensus.cc:3055] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:05.031925 23488 raft_consensus.cc:740] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0566c730fa6243e4b7506f8124eae074, State: Running, Role: LEADER
I20260709 13:11:05.032660 23488 consensus_queue.cc:260] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:05.033645 23488 raft_consensus.cc:3060] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.036484 23763 raft_consensus.cc:2468] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406c1f3c281548c8aed4d223f57716ea in term 2.
I20260709 13:11:05.037640 23525 leader_election.cc:304] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 406c1f3c281548c8aed4d223f57716ea, 61eb6de5f0454198905b91cbde0b9cc1; no voters: 
I20260709 13:11:05.038471 23856 raft_consensus.cc:2804] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:05.038920 23856 raft_consensus.cc:697] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea [term 2 LEADER]: Becoming Leader. State: Replica: 406c1f3c281548c8aed4d223f57716ea, State: Running, Role: LEADER
I20260709 13:11:05.039124 23488 raft_consensus.cc:2468] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 406c1f3c281548c8aed4d223f57716ea in term 2.
I20260709 13:11:05.039974 23856 consensus_queue.cc:237] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } }
I20260709 13:11:05.047727 23309 catalog_manager.cc:5697] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea reported cstate change: term changed from 1 to 2, leader changed from 0566c730fa6243e4b7506f8124eae074 (127.12.76.130) to 406c1f3c281548c8aed4d223f57716ea (127.12.76.131). New cstate: current_term: 2 leader_uuid: "406c1f3c281548c8aed4d223f57716ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "406c1f3c281548c8aed4d223f57716ea" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 38707 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.343770 23763 raft_consensus.cc:1275] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1 [term 3 FOLLOWER]: Refusing update from remote peer 406c1f3c281548c8aed4d223f57716ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:05.345237 23856 consensus_queue.cc:1048] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:05.346367 23488 raft_consensus.cc:1275] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [term 3 FOLLOWER]: Refusing update from remote peer 406c1f3c281548c8aed4d223f57716ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:05.347801 23856 consensus_queue.cc:1048] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:05.469058 23763 raft_consensus.cc:1275] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: Refusing update from remote peer 406c1f3c281548c8aed4d223f57716ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:05.470335 23872 consensus_queue.cc:1048] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "61eb6de5f0454198905b91cbde0b9cc1" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 35437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:05.480613 23488 raft_consensus.cc:1275] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Refusing update from remote peer 406c1f3c281548c8aed4d223f57716ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:05.482059 23872 consensus_queue.cc:1048] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0566c730fa6243e4b7506f8124eae074" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 37331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:05.691668 23359 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:05.827345 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:05.856281 12594 tablet_server.cc:179] TabletServer@127.12.76.129:35437 shutting down...
W20260709 13:11:05.870862 23451 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 77 similar messages]
W20260709 13:11:05.874773 23451 consensus_peers.cc:597] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:05.881480 23525 consensus_peers.cc:597] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:05.882319 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:05.883071 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:05.883740 12594 raft_consensus.cc:2243] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:05.884229 12594 raft_consensus.cc:2272] T e966b1a3927f41f28f706bcc1e6de3a2 P 61eb6de5f0454198905b91cbde0b9cc1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:05.886544 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:05.887240 12594 raft_consensus.cc:2243] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:05.887730 12594 raft_consensus.cc:2272] T 524cd1c347354d3a9ecf13e1089ad7de P 61eb6de5f0454198905b91cbde0b9cc1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:05.890028 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:05.890748 12594 raft_consensus.cc:2243] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:05.891151 12594 raft_consensus.cc:2272] T 54ab7e6addc2428d9c507042be9c6826 P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:05.893235 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:05.893780 12594 raft_consensus.cc:2243] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:05.894196 12594 raft_consensus.cc:2272] T 031e3cbadd274f30b727bb838177869b P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:05.895998 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:05.896502 12594 raft_consensus.cc:2243] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:05.896883 12594 raft_consensus.cc:2272] T 6595a05f3ee646e290107a904450fdb4 P 61eb6de5f0454198905b91cbde0b9cc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:05.898573 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:05.899219 12594 raft_consensus.cc:2243] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:05.899712 12594 raft_consensus.cc:2272] T 6f000dae80a849a28f3f5151891d8e17 P 61eb6de5f0454198905b91cbde0b9cc1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:05.901942 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:05.902387 12594 raft_consensus.cc:2243] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:05.902729 12594 raft_consensus.cc:2272] T c5ba72b6f6dd4e6aa70f76ce35926172 P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:05.904348 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:05.904781 12594 raft_consensus.cc:2243] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:05.905170 12594 raft_consensus.cc:2272] T 21a20395358b414e9c05ccd833dc9ae8 P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:05.906805 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:05.907208 12594 raft_consensus.cc:2243] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:05.907624 12594 raft_consensus.cc:2272] T 3564c9e881c54f11a82c0a5012e3ceb9 P 61eb6de5f0454198905b91cbde0b9cc1 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:05.909193 12594 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:05.909593 12594 raft_consensus.cc:2243] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:05.909921 12594 raft_consensus.cc:2272] T c25600b8c5804b40a113d63912f38530 P 61eb6de5f0454198905b91cbde0b9cc1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:05.927506 23525 consensus_peers.cc:597] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:05.927939 23525 consensus_peers.cc:597] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:05.938862 12594 tablet_server.cc:196] TabletServer@127.12.76.129:35437 shutdown complete.
I20260709 13:11:05.959695 12594 tablet_server.cc:179] TabletServer@127.12.76.130:0 shutting down...
W20260709 13:11:05.978688 23451 consensus_peers.cc:597] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 -> Peer 61eb6de5f0454198905b91cbde0b9cc1 (127.12.76.129:35437): Couldn't send request to peer 61eb6de5f0454198905b91cbde0b9cc1. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:35437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:05.983899 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:05.984724 12594 tablet_replica.cc:333] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074: stopping tablet replica
I20260709 13:11:05.985792 12594 raft_consensus.cc:2243] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:05.986809 12594 raft_consensus.cc:2272] T 524cd1c347354d3a9ecf13e1089ad7de P 0566c730fa6243e4b7506f8124eae074 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:05.989756 12594 tablet_replica.cc:333] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074: stopping tablet replica
I20260709 13:11:05.990307 12594 raft_consensus.cc:2243] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:05.990690 12594 raft_consensus.cc:2272] T c25600b8c5804b40a113d63912f38530 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:05.992727 12594 tablet_replica.cc:333] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074: stopping tablet replica
I20260709 13:11:05.993268 12594 raft_consensus.cc:2243] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:11:05.993971 12594 raft_consensus.cc:2272] T 3564c9e881c54f11a82c0a5012e3ceb9 P 0566c730fa6243e4b7506f8124eae074 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:05.996047 12594 tablet_replica.cc:333] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074: stopping tablet replica
I20260709 13:11:05.996537 12594 raft_consensus.cc:2243] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:05.996886 12594 raft_consensus.cc:2272] T e966b1a3927f41f28f706bcc1e6de3a2 P 0566c730fa6243e4b7506f8124eae074 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:05.999200 12594 tablet_replica.cc:333] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074: stopping tablet replica
I20260709 13:11:05.999770 12594 raft_consensus.cc:2243] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:06.000133 12594 raft_consensus.cc:2272] T 031e3cbadd274f30b727bb838177869b P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:06.002112 12594 tablet_replica.cc:333] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074: stopping tablet replica
I20260709 13:11:06.002602 12594 raft_consensus.cc:2243] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:06.002943 12594 raft_consensus.cc:2272] T 54ab7e6addc2428d9c507042be9c6826 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:06.005576 12594 tablet_replica.cc:333] T 6595a05f3ee646e290107a904450fdb4 P 0566c730fa6243e4b7506f8124eae074: stopping tablet replica
I20260709 13:11:06.006206 12594 raft_consensus.cc:2243] T 6595a05f3ee646e290107a904450fdb4 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:06.006618 12594 raft_consensus.cc:2272] T 6595a05f3ee646e290107a904450fdb4 P 0566c730fa6243e4b7506f8124eae074 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:06.008672 12594 tablet_replica.cc:333] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074: stopping tablet replica
I20260709 13:11:06.009117 12594 raft_consensus.cc:2243] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:06.009478 12594 raft_consensus.cc:2272] T 21a20395358b414e9c05ccd833dc9ae8 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:06.011310 12594 tablet_replica.cc:333] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074: stopping tablet replica
I20260709 13:11:06.011826 12594 raft_consensus.cc:2243] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:06.012542 12594 raft_consensus.cc:2272] T 6f000dae80a849a28f3f5151891d8e17 P 0566c730fa6243e4b7506f8124eae074 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:06.014833 12594 tablet_replica.cc:333] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074: stopping tablet replica
I20260709 13:11:06.015458 12594 raft_consensus.cc:2243] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:06.016121 12594 raft_consensus.cc:2272] T c5ba72b6f6dd4e6aa70f76ce35926172 P 0566c730fa6243e4b7506f8124eae074 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:06.050338 12594 tablet_server.cc:196] TabletServer@127.12.76.130:0 shutdown complete.
W20260709 13:11:06.074793 23528 consensus_peers.cc:597] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea -> Peer 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331): Couldn't send request to peer 0566c730fa6243e4b7506f8124eae074. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:37331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:06.080785 12594 tablet_server.cc:179] TabletServer@127.12.76.131:0 shutting down...
W20260709 13:11:06.090683 23528 consensus_peers.cc:597] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea -> Peer 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331): Couldn't send request to peer 0566c730fa6243e4b7506f8124eae074. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:37331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:06.115336 23528 consensus_peers.cc:597] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea -> Peer 0566c730fa6243e4b7506f8124eae074 (127.12.76.130:37331): Couldn't send request to peer 0566c730fa6243e4b7506f8124eae074. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:37331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:06.115875 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:06.116623 12594 tablet_replica.cc:333] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea: stopping tablet replica
I20260709 13:11:06.117292 12594 raft_consensus.cc:2243] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:06.117745 12594 raft_consensus.cc:2272] T 524cd1c347354d3a9ecf13e1089ad7de P 406c1f3c281548c8aed4d223f57716ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:06.119935 12594 tablet_replica.cc:333] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea: stopping tablet replica
I20260709 13:11:06.120451 12594 raft_consensus.cc:2243] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:06.121196 12594 raft_consensus.cc:2272] T 6595a05f3ee646e290107a904450fdb4 P 406c1f3c281548c8aed4d223f57716ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:06.123111 12594 tablet_replica.cc:333] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea: stopping tablet replica
I20260709 13:11:06.123744 12594 raft_consensus.cc:2243] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:06.124490 12594 raft_consensus.cc:2272] T 21a20395358b414e9c05ccd833dc9ae8 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:06.146078 12594 tablet_replica.cc:333] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea: stopping tablet replica
I20260709 13:11:06.147768 12594 raft_consensus.cc:2243] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:06.148619 12594 raft_consensus.cc:2272] T 6f000dae80a849a28f3f5151891d8e17 P 406c1f3c281548c8aed4d223f57716ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:06.151957 12594 tablet_replica.cc:333] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea: stopping tablet replica
I20260709 13:11:06.152827 12594 raft_consensus.cc:2243] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:06.153499 12594 raft_consensus.cc:2272] T c5ba72b6f6dd4e6aa70f76ce35926172 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:06.156401 12594 tablet_replica.cc:333] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea: stopping tablet replica
I20260709 13:11:06.157087 12594 raft_consensus.cc:2243] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:06.158727 12594 raft_consensus.cc:2272] T e966b1a3927f41f28f706bcc1e6de3a2 P 406c1f3c281548c8aed4d223f57716ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:06.162245 12594 tablet_replica.cc:333] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea: stopping tablet replica
I20260709 13:11:06.163007 12594 raft_consensus.cc:2243] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:06.164598 12594 raft_consensus.cc:2272] T 031e3cbadd274f30b727bb838177869b P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:06.167347 12594 tablet_replica.cc:333] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea: stopping tablet replica
I20260709 13:11:06.167982 12594 raft_consensus.cc:2243] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:06.169459 12594 raft_consensus.cc:2272] T 54ab7e6addc2428d9c507042be9c6826 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:06.172775 12594 tablet_replica.cc:333] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea: stopping tablet replica
I20260709 13:11:06.173393 12594 raft_consensus.cc:2243] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:06.174945 12594 raft_consensus.cc:2272] T c25600b8c5804b40a113d63912f38530 P 406c1f3c281548c8aed4d223f57716ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:06.177671 12594 tablet_replica.cc:333] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea: stopping tablet replica
I20260709 13:11:06.178229 12594 raft_consensus.cc:2243] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:06.178932 12594 raft_consensus.cc:2272] T 3564c9e881c54f11a82c0a5012e3ceb9 P 406c1f3c281548c8aed4d223f57716ea [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:06.220242 12594 tablet_server.cc:196] TabletServer@127.12.76.131:0 shutdown complete.
I20260709 13:11:06.257339 12594 master.cc:562] Master@127.12.76.190:44103 shutting down...
I20260709 13:11:06.286477 12594 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:06.287282 12594 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:06.287714 12594 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6c7e35851ca24db9a2a73c2a439eedfd: stopping tablet replica
I20260709 13:11:06.309243 12594 master.cc:584] Master@127.12.76.190:44103 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12842 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:11:06.360397 12594 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.76.190:45373
I20260709 13:11:06.361588 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:06.367967 23894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:06.368173 23895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:06.368397 23897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:06.370852 12594 server_base.cc:1061] running on GCE node
I20260709 13:11:06.371960 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:06.372157 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:06.372282 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602666372269 us; error 0 us; skew 500 ppm
I20260709 13:11:06.372772 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:06.375324 12594 webserver.cc:533] Webserver started at http://127.12.76.190:35277/ using document root <none> and password file <none>
I20260709 13:11:06.376148 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:06.376318 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:06.376559 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:06.377884 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602303087285-12594-0/minicluster-data/master-0-root/instance:
uuid: "216be0b430054a23a9a851c455c60fa4"
format_stamp: "Formatted at 2026-07-09 13:11:06 on dist-test-slave-th5x"
I20260709 13:11:06.382961 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:11:06.386613 23902 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:06.387398 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:06.387758 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602303087285-12594-0/minicluster-data/master-0-root
uuid: "216be0b430054a23a9a851c455c60fa4"
format_stamp: "Formatted at 2026-07-09 13:11:06 on dist-test-slave-th5x"
I20260709 13:11:06.388034 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602303087285-12594-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602303087285-12594-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602303087285-12594-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:06.404479 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:06.405718 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:06.445689 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.190:45373
I20260709 13:11:06.445824 23953 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.190:45373 every 8 connection(s)
I20260709 13:11:06.449916 23954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.462337 23954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4: Bootstrap starting.
I20260709 13:11:06.467104 23954 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.471329 23954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4: No bootstrap required, opened a new log
I20260709 13:11:06.473608 23954 raft_consensus.cc:359] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "216be0b430054a23a9a851c455c60fa4" member_type: VOTER }
I20260709 13:11:06.474027 23954 raft_consensus.cc:385] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.474524 23954 raft_consensus.cc:740] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216be0b430054a23a9a851c455c60fa4, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.475263 23954 consensus_queue.cc:260] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "216be0b430054a23a9a851c455c60fa4" member_type: VOTER }
I20260709 13:11:06.475870 23954 raft_consensus.cc:399] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:06.476140 23954 raft_consensus.cc:493] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:06.476428 23954 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:06.482991 23954 raft_consensus.cc:515] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "216be0b430054a23a9a851c455c60fa4" member_type: VOTER }
I20260709 13:11:06.483574 23954 leader_election.cc:304] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 216be0b430054a23a9a851c455c60fa4; no voters: 
I20260709 13:11:06.484695 23954 leader_election.cc:290] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:06.485044 23957 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:06.486485 23957 raft_consensus.cc:697] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4 [term 1 LEADER]: Becoming Leader. State: Replica: 216be0b430054a23a9a851c455c60fa4, State: Running, Role: LEADER
I20260709 13:11:06.487114 23957 consensus_queue.cc:237] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "216be0b430054a23a9a851c455c60fa4" member_type: VOTER }
I20260709 13:11:06.487668 23954 sys_catalog.cc:565] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:06.493659 23958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "216be0b430054a23a9a851c455c60fa4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "216be0b430054a23a9a851c455c60fa4" member_type: VOTER } }
I20260709 13:11:06.494539 23958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:06.494462 23959 sys_catalog.cc:455] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 216be0b430054a23a9a851c455c60fa4. Latest consensus state: current_term: 1 leader_uuid: "216be0b430054a23a9a851c455c60fa4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "216be0b430054a23a9a851c455c60fa4" member_type: VOTER } }
I20260709 13:11:06.495296 23959 sys_catalog.cc:458] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:06.497320 23966 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:06.502247 23966 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:06.504266 12594 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:06.511162 23966 catalog_manager.cc:1383] Generated new cluster ID: 47f83da13aef40ada6f2dcaf08cc89d5
I20260709 13:11:06.511474 23966 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:06.542347 23966 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:06.543664 23966 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:06.563617 23966 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4: Generated new TSK 0
I20260709 13:11:06.564237 23966 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:06.570508 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:06.576716 23975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:06.577829 23976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:06.579509 23978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:06.579869 12594 server_base.cc:1061] running on GCE node
I20260709 13:11:06.580906 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:06.581142 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:06.581319 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602666581305 us; error 0 us; skew 500 ppm
I20260709 13:11:06.581987 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:06.584525 12594 webserver.cc:533] Webserver started at http://127.12.76.129:44613/ using document root <none> and password file <none>
I20260709 13:11:06.585009 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:06.585193 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:06.585475 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:06.586659 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602303087285-12594-0/minicluster-data/ts-0-root/instance:
uuid: "7c072a3b27ec4b5285d2ced1997af00e"
format_stamp: "Formatted at 2026-07-09 13:11:06 on dist-test-slave-th5x"
I20260709 13:11:06.591717 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:11:06.595120 23983 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:06.596029 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:11:06.596329 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602303087285-12594-0/minicluster-data/ts-0-root
uuid: "7c072a3b27ec4b5285d2ced1997af00e"
format_stamp: "Formatted at 2026-07-09 13:11:06 on dist-test-slave-th5x"
I20260709 13:11:06.596649 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602303087285-12594-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602303087285-12594-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602303087285-12594-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:06.606316 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:06.607596 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:06.609100 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:06.611318 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:06.611601 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:06.611837 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:06.612020 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:06.652845 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.129:46283
I20260709 13:11:06.652977 24045 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.129:46283 every 8 connection(s)
I20260709 13:11:06.657927 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:06.666066 24050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:06.669376 24051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:06.669833 24053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:06.671590 12594 server_base.cc:1061] running on GCE node
I20260709 13:11:06.672549 24046 heartbeater.cc:344] Connected to a master server at 127.12.76.190:45373
I20260709 13:11:06.672953 24046 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:06.673007 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:06.673349 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:06.673534 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602666673517 us; error 0 us; skew 500 ppm
I20260709 13:11:06.673816 24046 heartbeater.cc:507] Master 127.12.76.190:45373 requested a full tablet report, sending...
I20260709 13:11:06.674222 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:06.676170 23919 ts_manager.cc:194] Registered new tserver with Master: 7c072a3b27ec4b5285d2ced1997af00e (127.12.76.129:46283)
I20260709 13:11:06.677172 12594 webserver.cc:533] Webserver started at http://127.12.76.130:36391/ using document root <none> and password file <none>
I20260709 13:11:06.677923 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:06.678167 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:06.678457 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:06.678802 23919 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34604
I20260709 13:11:06.680182 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602303087285-12594-0/minicluster-data/ts-1-root/instance:
uuid: "123d785ea56446948699edd0e9f8985f"
format_stamp: "Formatted at 2026-07-09 13:11:06 on dist-test-slave-th5x"
I20260709 13:11:06.684648 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:11:06.688062 24058 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:06.688949 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:06.689194 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602303087285-12594-0/minicluster-data/ts-1-root
uuid: "123d785ea56446948699edd0e9f8985f"
format_stamp: "Formatted at 2026-07-09 13:11:06 on dist-test-slave-th5x"
I20260709 13:11:06.689613 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602303087285-12594-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602303087285-12594-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602303087285-12594-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:06.714092 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:06.715234 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:06.716748 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:06.718994 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:06.719162 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:06.719537 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:06.719715 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:06.761001 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.130:42137
I20260709 13:11:06.761130 24120 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.130:42137 every 8 connection(s)
I20260709 13:11:06.766137 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:06.772928 24124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:06.774600 24125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:06.777652 24127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:06.777865 12594 server_base.cc:1061] running on GCE node
I20260709 13:11:06.778988 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:06.779235 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:06.779466 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602666779424 us; error 0 us; skew 500 ppm
I20260709 13:11:06.779474 24121 heartbeater.cc:344] Connected to a master server at 127.12.76.190:45373
I20260709 13:11:06.780002 24121 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:06.780269 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:06.780817 24121 heartbeater.cc:507] Master 127.12.76.190:45373 requested a full tablet report, sending...
I20260709 13:11:06.783179 12594 webserver.cc:533] Webserver started at http://127.12.76.131:36725/ using document root <none> and password file <none>
I20260709 13:11:06.783350 23919 ts_manager.cc:194] Registered new tserver with Master: 123d785ea56446948699edd0e9f8985f (127.12.76.130:42137)
I20260709 13:11:06.783815 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:06.784128 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:06.784421 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:06.785429 23919 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34606
I20260709 13:11:06.785727 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602303087285-12594-0/minicluster-data/ts-2-root/instance:
uuid: "8b3d1c81b87544beb318de4ab922d447"
format_stamp: "Formatted at 2026-07-09 13:11:06 on dist-test-slave-th5x"
I20260709 13:11:06.790784 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:11:06.794188 24132 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:06.794970 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:11:06.795293 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602303087285-12594-0/minicluster-data/ts-2-root
uuid: "8b3d1c81b87544beb318de4ab922d447"
format_stamp: "Formatted at 2026-07-09 13:11:06 on dist-test-slave-th5x"
I20260709 13:11:06.795650 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602303087285-12594-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602303087285-12594-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602303087285-12594-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:06.821698 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:06.823151 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:06.824643 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:06.826830 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:06.827049 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:06.827296 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:06.827497 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:11:06.869184 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.131:45741
I20260709 13:11:06.869306 24194 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.131:45741 every 8 connection(s)
I20260709 13:11:06.883468 24195 heartbeater.cc:344] Connected to a master server at 127.12.76.190:45373
I20260709 13:11:06.883939 24195 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:06.884677 24195 heartbeater.cc:507] Master 127.12.76.190:45373 requested a full tablet report, sending...
I20260709 13:11:06.886715 23919 ts_manager.cc:194] Registered new tserver with Master: 8b3d1c81b87544beb318de4ab922d447 (127.12.76.131:45741)
I20260709 13:11:06.887317 12594 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014808509s
I20260709 13:11:06.888160 23919 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34608
I20260709 13:11:06.913472 23919 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34614:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:06.915731 23919 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:06.967819 24011 tablet_service.cc:1511] Processing CreateTablet for tablet e722da73b1c146c588652fb3ea28d755 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f5778fa24adc451794b1619a22f25ac6]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:06.968828 24160 tablet_service.cc:1511] Processing CreateTablet for tablet e722da73b1c146c588652fb3ea28d755 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f5778fa24adc451794b1619a22f25ac6]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:06.969468 24011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e722da73b1c146c588652fb3ea28d755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.970399 24160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e722da73b1c146c588652fb3ea28d755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.970633 24159 tablet_service.cc:1511] Processing CreateTablet for tablet 5b53c40bb6af4d8eb108f10fb5c4d2ff (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f5778fa24adc451794b1619a22f25ac6]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:06.972064 24159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b53c40bb6af4d8eb108f10fb5c4d2ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.973026 24010 tablet_service.cc:1511] Processing CreateTablet for tablet 5b53c40bb6af4d8eb108f10fb5c4d2ff (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f5778fa24adc451794b1619a22f25ac6]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:06.974661 24010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b53c40bb6af4d8eb108f10fb5c4d2ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.993737 24086 tablet_service.cc:1511] Processing CreateTablet for tablet e722da73b1c146c588652fb3ea28d755 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f5778fa24adc451794b1619a22f25ac6]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:06.995240 24086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e722da73b1c146c588652fb3ea28d755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:06.997860 24085 tablet_service.cc:1511] Processing CreateTablet for tablet 5b53c40bb6af4d8eb108f10fb5c4d2ff (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f5778fa24adc451794b1619a22f25ac6]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:07.000599 24085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b53c40bb6af4d8eb108f10fb5c4d2ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.005019 24211 tablet_bootstrap.cc:492] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e: Bootstrap starting.
I20260709 13:11:07.011929 24210 tablet_bootstrap.cc:492] T e722da73b1c146c588652fb3ea28d755 P 8b3d1c81b87544beb318de4ab922d447: Bootstrap starting.
I20260709 13:11:07.013381 24211 tablet_bootstrap.cc:654] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.019495 24210 tablet_bootstrap.cc:654] T e722da73b1c146c588652fb3ea28d755 P 8b3d1c81b87544beb318de4ab922d447: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.026081 24213 tablet_bootstrap.cc:492] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f: Bootstrap starting.
I20260709 13:11:07.026311 24211 tablet_bootstrap.cc:492] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e: No bootstrap required, opened a new log
I20260709 13:11:07.026875 24211 ts_tablet_manager.cc:1403] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.000s
I20260709 13:11:07.027554 24210 tablet_bootstrap.cc:492] T e722da73b1c146c588652fb3ea28d755 P 8b3d1c81b87544beb318de4ab922d447: No bootstrap required, opened a new log
I20260709 13:11:07.028126 24210 ts_tablet_manager.cc:1403] T e722da73b1c146c588652fb3ea28d755 P 8b3d1c81b87544beb318de4ab922d447: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:11:07.029927 24211 raft_consensus.cc:359] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.030545 24211 raft_consensus.cc:385] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.030792 24211 raft_consensus.cc:740] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c072a3b27ec4b5285d2ced1997af00e, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.031489 24211 consensus_queue.cc:260] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.031586 24210 raft_consensus.cc:359] T e722da73b1c146c588652fb3ea28d755 P 8b3d1c81b87544beb318de4ab922d447 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } }
I20260709 13:11:07.032518 24210 raft_consensus.cc:385] T e722da73b1c146c588652fb3ea28d755 P 8b3d1c81b87544beb318de4ab922d447 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.032886 24210 raft_consensus.cc:740] T e722da73b1c146c588652fb3ea28d755 P 8b3d1c81b87544beb318de4ab922d447 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b3d1c81b87544beb318de4ab922d447, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.033934 24046 heartbeater.cc:499] Master 127.12.76.190:45373 was elected leader, sending a full tablet report...
I20260709 13:11:07.034198 24211 ts_tablet_manager.cc:1434] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:11:07.035091 24213 tablet_bootstrap.cc:654] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.035151 24211 tablet_bootstrap.cc:492] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e: Bootstrap starting.
I20260709 13:11:07.035830 24210 consensus_queue.cc:260] T e722da73b1c146c588652fb3ea28d755 P 8b3d1c81b87544beb318de4ab922d447 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } }
I20260709 13:11:07.044380 24211 tablet_bootstrap.cc:654] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.057587 24211 tablet_bootstrap.cc:492] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e: No bootstrap required, opened a new log
I20260709 13:11:07.058415 24211 ts_tablet_manager.cc:1403] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.012s
I20260709 13:11:07.061132 24215 raft_consensus.cc:493] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.061286 24210 ts_tablet_manager.cc:1434] T e722da73b1c146c588652fb3ea28d755 P 8b3d1c81b87544beb318de4ab922d447: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.021s
I20260709 13:11:07.061892 24215 raft_consensus.cc:515] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.062187 24211 raft_consensus.cc:359] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } }
I20260709 13:11:07.062976 24211 raft_consensus.cc:385] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.063242 24211 raft_consensus.cc:740] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c072a3b27ec4b5285d2ced1997af00e, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.064040 24211 consensus_queue.cc:260] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } }
I20260709 13:11:07.069157 24215 leader_election.cc:290] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 123d785ea56446948699edd0e9f8985f (127.12.76.130:42137), 8b3d1c81b87544beb318de4ab922d447 (127.12.76.131:45741)
I20260709 13:11:07.074436 24213 tablet_bootstrap.cc:492] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f: No bootstrap required, opened a new log
I20260709 13:11:07.075001 24213 ts_tablet_manager.cc:1403] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f: Time spent bootstrapping tablet: real 0.049s	user 0.019s	sys 0.020s
I20260709 13:11:07.076082 24195 heartbeater.cc:499] Master 127.12.76.190:45373 was elected leader, sending a full tablet report...
I20260709 13:11:07.077996 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b53c40bb6af4d8eb108f10fb5c4d2ff" candidate_uuid: "7c072a3b27ec4b5285d2ced1997af00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "123d785ea56446948699edd0e9f8985f" is_pre_election: true
I20260709 13:11:07.078570 24210 tablet_bootstrap.cc:492] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 8b3d1c81b87544beb318de4ab922d447: Bootstrap starting.
I20260709 13:11:07.078330 24213 raft_consensus.cc:359] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } }
I20260709 13:11:07.079162 24213 raft_consensus.cc:385] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.079499 24213 raft_consensus.cc:740] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 123d785ea56446948699edd0e9f8985f, State: Initialized, Role: FOLLOWER
W20260709 13:11:07.079950 23984 leader_election.cc:343] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 123d785ea56446948699edd0e9f8985f (127.12.76.130:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.080312 24213 consensus_queue.cc:260] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } }
I20260709 13:11:07.085523 24210 tablet_bootstrap.cc:654] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 8b3d1c81b87544beb318de4ab922d447: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.085616 24211 ts_tablet_manager.cc:1434] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e: Time spent starting tablet: real 0.027s	user 0.002s	sys 0.005s
I20260709 13:11:07.094817 24210 tablet_bootstrap.cc:492] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 8b3d1c81b87544beb318de4ab922d447: No bootstrap required, opened a new log
I20260709 13:11:07.094867 24121 heartbeater.cc:499] Master 127.12.76.190:45373 was elected leader, sending a full tablet report...
I20260709 13:11:07.095459 24210 ts_tablet_manager.cc:1403] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 8b3d1c81b87544beb318de4ab922d447: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.003s
I20260709 13:11:07.096232 24213 ts_tablet_manager.cc:1434] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f: Time spent starting tablet: real 0.021s	user 0.013s	sys 0.009s
I20260709 13:11:07.097357 24213 tablet_bootstrap.cc:492] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f: Bootstrap starting.
I20260709 13:11:07.098953 24210 raft_consensus.cc:359] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 8b3d1c81b87544beb318de4ab922d447 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.099757 24210 raft_consensus.cc:385] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 8b3d1c81b87544beb318de4ab922d447 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.100054 24210 raft_consensus.cc:740] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 8b3d1c81b87544beb318de4ab922d447 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b3d1c81b87544beb318de4ab922d447, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.100808 24210 consensus_queue.cc:260] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 8b3d1c81b87544beb318de4ab922d447 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.103323 24210 ts_tablet_manager.cc:1434] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 8b3d1c81b87544beb318de4ab922d447: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:11:07.107590 24213 tablet_bootstrap.cc:654] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.109478 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b53c40bb6af4d8eb108f10fb5c4d2ff" candidate_uuid: "7c072a3b27ec4b5285d2ced1997af00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b3d1c81b87544beb318de4ab922d447" is_pre_election: true
I20260709 13:11:07.110255 24170 raft_consensus.cc:2468] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 8b3d1c81b87544beb318de4ab922d447 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c072a3b27ec4b5285d2ced1997af00e in term 0.
I20260709 13:11:07.111868 23986 leader_election.cc:304] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c072a3b27ec4b5285d2ced1997af00e, 8b3d1c81b87544beb318de4ab922d447; no voters: 123d785ea56446948699edd0e9f8985f
I20260709 13:11:07.113618 24220 raft_consensus.cc:2804] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:07.114058 24220 raft_consensus.cc:493] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.114450 24220 raft_consensus.cc:3060] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.119973 24213 tablet_bootstrap.cc:492] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f: No bootstrap required, opened a new log
I20260709 13:11:07.120579 24213 ts_tablet_manager.cc:1403] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.006s
I20260709 13:11:07.122853 24213 raft_consensus.cc:359] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.123529 24213 raft_consensus.cc:385] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.123812 24213 raft_consensus.cc:740] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 123d785ea56446948699edd0e9f8985f, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.124208 24220 raft_consensus.cc:515] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.124645 24213 consensus_queue.cc:260] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.126760 24213 ts_tablet_manager.cc:1434] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:11:07.126794 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b53c40bb6af4d8eb108f10fb5c4d2ff" candidate_uuid: "7c072a3b27ec4b5285d2ced1997af00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "123d785ea56446948699edd0e9f8985f"
I20260709 13:11:07.127102 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b53c40bb6af4d8eb108f10fb5c4d2ff" candidate_uuid: "7c072a3b27ec4b5285d2ced1997af00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b3d1c81b87544beb318de4ab922d447"
I20260709 13:11:07.127532 24096 raft_consensus.cc:3060] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.127642 24170 raft_consensus.cc:3060] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 8b3d1c81b87544beb318de4ab922d447 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.131548 24220 leader_election.cc:290] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [CANDIDATE]: Term 1 election: Requested vote from peers 123d785ea56446948699edd0e9f8985f (127.12.76.130:42137), 8b3d1c81b87544beb318de4ab922d447 (127.12.76.131:45741)
I20260709 13:11:07.135897 24096 raft_consensus.cc:2468] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c072a3b27ec4b5285d2ced1997af00e in term 1.
I20260709 13:11:07.136642 24170 raft_consensus.cc:2468] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 8b3d1c81b87544beb318de4ab922d447 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c072a3b27ec4b5285d2ced1997af00e in term 1.
I20260709 13:11:07.137928 23986 leader_election.cc:304] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c072a3b27ec4b5285d2ced1997af00e, 8b3d1c81b87544beb318de4ab922d447; no voters: 
I20260709 13:11:07.138731 24220 raft_consensus.cc:2804] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:07.139142 24220 raft_consensus.cc:697] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [term 1 LEADER]: Becoming Leader. State: Replica: 7c072a3b27ec4b5285d2ced1997af00e, State: Running, Role: LEADER
I20260709 13:11:07.139997 24220 consensus_queue.cc:237] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.148363 23918 catalog_manager.cc:5697] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c072a3b27ec4b5285d2ced1997af00e (127.12.76.129). New cstate: current_term: 1 leader_uuid: "7c072a3b27ec4b5285d2ced1997af00e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:07.192596 24221 raft_consensus.cc:493] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.193154 24221 raft_consensus.cc:515] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } }
I20260709 13:11:07.195271 24221 leader_election.cc:290] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c072a3b27ec4b5285d2ced1997af00e (127.12.76.129:46283), 8b3d1c81b87544beb318de4ab922d447 (127.12.76.131:45741)
I20260709 13:11:07.204643 24021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e722da73b1c146c588652fb3ea28d755" candidate_uuid: "123d785ea56446948699edd0e9f8985f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c072a3b27ec4b5285d2ced1997af00e" is_pre_election: true
I20260709 13:11:07.205456 24021 raft_consensus.cc:2468] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 123d785ea56446948699edd0e9f8985f in term 0.
I20260709 13:11:07.206596 24060 leader_election.cc:304] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 123d785ea56446948699edd0e9f8985f, 7c072a3b27ec4b5285d2ced1997af00e; no voters: 
I20260709 13:11:07.206856 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e722da73b1c146c588652fb3ea28d755" candidate_uuid: "123d785ea56446948699edd0e9f8985f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b3d1c81b87544beb318de4ab922d447" is_pre_election: true
I20260709 13:11:07.207316 24221 raft_consensus.cc:2804] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:07.207541 24170 raft_consensus.cc:2468] T e722da73b1c146c588652fb3ea28d755 P 8b3d1c81b87544beb318de4ab922d447 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 123d785ea56446948699edd0e9f8985f in term 0.
I20260709 13:11:07.207679 24221 raft_consensus.cc:493] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.208133 24221 raft_consensus.cc:3060] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.213608 24221 raft_consensus.cc:515] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } }
I20260709 13:11:07.215236 24221 leader_election.cc:290] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [CANDIDATE]: Term 1 election: Requested vote from peers 7c072a3b27ec4b5285d2ced1997af00e (127.12.76.129:46283), 8b3d1c81b87544beb318de4ab922d447 (127.12.76.131:45741)
I20260709 13:11:07.216085 24021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e722da73b1c146c588652fb3ea28d755" candidate_uuid: "123d785ea56446948699edd0e9f8985f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c072a3b27ec4b5285d2ced1997af00e"
I20260709 13:11:07.216329 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e722da73b1c146c588652fb3ea28d755" candidate_uuid: "123d785ea56446948699edd0e9f8985f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b3d1c81b87544beb318de4ab922d447"
I20260709 13:11:07.216778 24021 raft_consensus.cc:3060] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.216943 24170 raft_consensus.cc:3060] T e722da73b1c146c588652fb3ea28d755 P 8b3d1c81b87544beb318de4ab922d447 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.221949 24170 raft_consensus.cc:2468] T e722da73b1c146c588652fb3ea28d755 P 8b3d1c81b87544beb318de4ab922d447 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 123d785ea56446948699edd0e9f8985f in term 1.
I20260709 13:11:07.222937 24061 leader_election.cc:304] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 123d785ea56446948699edd0e9f8985f, 8b3d1c81b87544beb318de4ab922d447; no voters: 
I20260709 13:11:07.223026 24021 raft_consensus.cc:2468] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 123d785ea56446948699edd0e9f8985f in term 1.
I20260709 13:11:07.223724 24221 raft_consensus.cc:2804] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:07.224884 24221 raft_consensus.cc:697] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [term 1 LEADER]: Becoming Leader. State: Replica: 123d785ea56446948699edd0e9f8985f, State: Running, Role: LEADER
I20260709 13:11:07.225677 24221 consensus_queue.cc:237] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } }
I20260709 13:11:07.232429 23918 catalog_manager.cc:5697] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f reported cstate change: term changed from 0 to 1, leader changed from <none> to 123d785ea56446948699edd0e9f8985f (127.12.76.130). New cstate: current_term: 1 leader_uuid: "123d785ea56446948699edd0e9f8985f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:07.299405 23918 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34626:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:07.301388 23918 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:07.323491 24010 tablet_service.cc:1511] Processing CreateTablet for tablet 9cbce43850304034b64d789decab4956 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=b85aeabc6db74c65b00eca64ca85ab4e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:07.324762 24010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cbce43850304034b64d789decab4956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.325016 24086 tablet_service.cc:1511] Processing CreateTablet for tablet 9cbce43850304034b64d789decab4956 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=b85aeabc6db74c65b00eca64ca85ab4e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:07.326280 24086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cbce43850304034b64d789decab4956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.326375 24159 tablet_service.cc:1511] Processing CreateTablet for tablet 9cbce43850304034b64d789decab4956 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=b85aeabc6db74c65b00eca64ca85ab4e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:11:07.327625 24159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cbce43850304034b64d789decab4956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.329460 24011 tablet_service.cc:1511] Processing CreateTablet for tablet 6e32b6c1b463410c8b6125035a211994 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=b85aeabc6db74c65b00eca64ca85ab4e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:07.330680 24011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e32b6c1b463410c8b6125035a211994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.331349 24160 tablet_service.cc:1511] Processing CreateTablet for tablet 6e32b6c1b463410c8b6125035a211994 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=b85aeabc6db74c65b00eca64ca85ab4e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:07.332564 24160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e32b6c1b463410c8b6125035a211994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.337249 24085 tablet_service.cc:1511] Processing CreateTablet for tablet 6e32b6c1b463410c8b6125035a211994 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=b85aeabc6db74c65b00eca64ca85ab4e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:11:07.338521 24085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e32b6c1b463410c8b6125035a211994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:07.345232 24210 tablet_bootstrap.cc:492] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447: Bootstrap starting.
I20260709 13:11:07.350766 24211 tablet_bootstrap.cc:492] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e: Bootstrap starting.
I20260709 13:11:07.352634 24210 tablet_bootstrap.cc:654] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.353612 24213 tablet_bootstrap.cc:492] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f: Bootstrap starting.
I20260709 13:11:07.358485 24211 tablet_bootstrap.cc:654] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.360740 24213 tablet_bootstrap.cc:654] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.365904 24210 tablet_bootstrap.cc:492] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447: No bootstrap required, opened a new log
I20260709 13:11:07.366397 24210 ts_tablet_manager.cc:1403] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:11:07.369369 24210 raft_consensus.cc:359] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.370086 24210 raft_consensus.cc:385] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.370369 24210 raft_consensus.cc:740] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b3d1c81b87544beb318de4ab922d447, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.371073 24210 consensus_queue.cc:260] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.373677 24210 ts_tablet_manager.cc:1434] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:11:07.374687 24210 tablet_bootstrap.cc:492] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447: Bootstrap starting.
I20260709 13:11:07.381016 24211 tablet_bootstrap.cc:492] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e: No bootstrap required, opened a new log
I20260709 13:11:07.381609 24211 ts_tablet_manager.cc:1403] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.019s
I20260709 13:11:07.384301 24213 tablet_bootstrap.cc:492] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f: No bootstrap required, opened a new log
I20260709 13:11:07.385075 24210 tablet_bootstrap.cc:654] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.384809 24211 raft_consensus.cc:359] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.385661 24211 raft_consensus.cc:385] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.385998 24211 raft_consensus.cc:740] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c072a3b27ec4b5285d2ced1997af00e, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.384989 24213 ts_tablet_manager.cc:1403] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.009s
I20260709 13:11:07.386703 24211 consensus_queue.cc:260] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.389030 24211 ts_tablet_manager.cc:1434] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:07.390301 24213 raft_consensus.cc:359] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.391292 24211 tablet_bootstrap.cc:492] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e: Bootstrap starting.
I20260709 13:11:07.391309 24213 raft_consensus.cc:385] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.391970 24213 raft_consensus.cc:740] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 123d785ea56446948699edd0e9f8985f, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.392983 24213 consensus_queue.cc:260] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.395936 24213 ts_tablet_manager.cc:1434] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:11:07.397368 24213 tablet_bootstrap.cc:492] T 9cbce43850304034b64d789decab4956 P 123d785ea56446948699edd0e9f8985f: Bootstrap starting.
I20260709 13:11:07.400698 24211 tablet_bootstrap.cc:654] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.406387 24213 tablet_bootstrap.cc:654] T 9cbce43850304034b64d789decab4956 P 123d785ea56446948699edd0e9f8985f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.410188 24210 tablet_bootstrap.cc:492] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447: No bootstrap required, opened a new log
I20260709 13:11:07.410825 24210 ts_tablet_manager.cc:1403] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.016s
I20260709 13:11:07.414511 24210 raft_consensus.cc:359] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.415583 24210 raft_consensus.cc:385] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.415947 24210 raft_consensus.cc:740] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b3d1c81b87544beb318de4ab922d447, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.417026 24210 consensus_queue.cc:260] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.419070 24213 tablet_bootstrap.cc:492] T 9cbce43850304034b64d789decab4956 P 123d785ea56446948699edd0e9f8985f: No bootstrap required, opened a new log
I20260709 13:11:07.419203 24211 tablet_bootstrap.cc:492] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e: No bootstrap required, opened a new log
I20260709 13:11:07.419387 24210 ts_tablet_manager.cc:1434] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:11:07.419708 24213 ts_tablet_manager.cc:1403] T 9cbce43850304034b64d789decab4956 P 123d785ea56446948699edd0e9f8985f: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.011s
I20260709 13:11:07.419817 24211 ts_tablet_manager.cc:1403] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.007s
I20260709 13:11:07.422920 24213 raft_consensus.cc:359] T 9cbce43850304034b64d789decab4956 P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.423135 24211 raft_consensus.cc:359] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.423677 24213 raft_consensus.cc:385] T 9cbce43850304034b64d789decab4956 P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.423914 24211 raft_consensus.cc:385] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.424018 24213 raft_consensus.cc:740] T 9cbce43850304034b64d789decab4956 P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 123d785ea56446948699edd0e9f8985f, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.424317 24211 raft_consensus.cc:740] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c072a3b27ec4b5285d2ced1997af00e, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.425031 24211 consensus_queue.cc:260] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.425012 24213 consensus_queue.cc:260] T 9cbce43850304034b64d789decab4956 P 123d785ea56446948699edd0e9f8985f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.427649 24213 ts_tablet_manager.cc:1434] T 9cbce43850304034b64d789decab4956 P 123d785ea56446948699edd0e9f8985f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:11:07.430018 24211 ts_tablet_manager.cc:1434] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:11:07.463738 24216 raft_consensus.cc:493] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.464318 24216 raft_consensus.cc:515] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.467732 24216 leader_election.cc:290] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c072a3b27ec4b5285d2ced1997af00e (127.12.76.129:46283), 123d785ea56446948699edd0e9f8985f (127.12.76.130:42137)
I20260709 13:11:07.478856 24021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cbce43850304034b64d789decab4956" candidate_uuid: "8b3d1c81b87544beb318de4ab922d447" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c072a3b27ec4b5285d2ced1997af00e" is_pre_election: true
I20260709 13:11:07.478837 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cbce43850304034b64d789decab4956" candidate_uuid: "8b3d1c81b87544beb318de4ab922d447" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "123d785ea56446948699edd0e9f8985f" is_pre_election: true
I20260709 13:11:07.479936 24021 raft_consensus.cc:2468] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b3d1c81b87544beb318de4ab922d447 in term 0.
I20260709 13:11:07.479962 24096 raft_consensus.cc:2468] T 9cbce43850304034b64d789decab4956 P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b3d1c81b87544beb318de4ab922d447 in term 0.
I20260709 13:11:07.481518 24134 leader_election.cc:304] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c072a3b27ec4b5285d2ced1997af00e, 8b3d1c81b87544beb318de4ab922d447; no voters: 
I20260709 13:11:07.482447 24216 raft_consensus.cc:2804] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:07.482882 24216 raft_consensus.cc:493] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.483237 24216 raft_consensus.cc:3060] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.489437 24216 raft_consensus.cc:515] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.491324 24216 leader_election.cc:290] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [CANDIDATE]: Term 1 election: Requested vote from peers 7c072a3b27ec4b5285d2ced1997af00e (127.12.76.129:46283), 123d785ea56446948699edd0e9f8985f (127.12.76.130:42137)
I20260709 13:11:07.492143 24021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cbce43850304034b64d789decab4956" candidate_uuid: "8b3d1c81b87544beb318de4ab922d447" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c072a3b27ec4b5285d2ced1997af00e"
I20260709 13:11:07.492311 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cbce43850304034b64d789decab4956" candidate_uuid: "8b3d1c81b87544beb318de4ab922d447" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "123d785ea56446948699edd0e9f8985f"
I20260709 13:11:07.492702 24021 raft_consensus.cc:3060] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.493021 24096 raft_consensus.cc:3060] T 9cbce43850304034b64d789decab4956 P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.498804 24021 raft_consensus.cc:2468] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b3d1c81b87544beb318de4ab922d447 in term 1.
W20260709 13:11:07.499058 23967 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:07.499367 24096 raft_consensus.cc:2468] T 9cbce43850304034b64d789decab4956 P 123d785ea56446948699edd0e9f8985f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b3d1c81b87544beb318de4ab922d447 in term 1.
I20260709 13:11:07.500229 24134 leader_election.cc:304] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c072a3b27ec4b5285d2ced1997af00e, 8b3d1c81b87544beb318de4ab922d447; no voters: 
I20260709 13:11:07.501081 24216 raft_consensus.cc:2804] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:07.502056 24216 raft_consensus.cc:697] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [term 1 LEADER]: Becoming Leader. State: Replica: 8b3d1c81b87544beb318de4ab922d447, State: Running, Role: LEADER
I20260709 13:11:07.502923 24216 consensus_queue.cc:237] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.510159 23916 catalog_manager.cc:5697] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b3d1c81b87544beb318de4ab922d447 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "8b3d1c81b87544beb318de4ab922d447" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:07.632706 24221 consensus_queue.cc:1048] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:07.635742 24220 consensus_queue.cc:1048] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:07.661093 24248 consensus_queue.cc:1048] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:07.681036 24220 consensus_queue.cc:1048] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:07.713505 24248 raft_consensus.cc:493] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.713986 24248 raft_consensus.cc:515] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.715768 24248 leader_election.cc:290] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c072a3b27ec4b5285d2ced1997af00e (127.12.76.129:46283), 8b3d1c81b87544beb318de4ab922d447 (127.12.76.131:45741)
I20260709 13:11:07.716492 24021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e32b6c1b463410c8b6125035a211994" candidate_uuid: "123d785ea56446948699edd0e9f8985f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c072a3b27ec4b5285d2ced1997af00e" is_pre_election: true
I20260709 13:11:07.716773 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e32b6c1b463410c8b6125035a211994" candidate_uuid: "123d785ea56446948699edd0e9f8985f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b3d1c81b87544beb318de4ab922d447" is_pre_election: true
I20260709 13:11:07.717093 24021 raft_consensus.cc:2468] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 123d785ea56446948699edd0e9f8985f in term 0.
I20260709 13:11:07.717396 24170 raft_consensus.cc:2468] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 123d785ea56446948699edd0e9f8985f in term 0.
I20260709 13:11:07.718132 24060 leader_election.cc:304] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 123d785ea56446948699edd0e9f8985f, 7c072a3b27ec4b5285d2ced1997af00e; no voters: 
I20260709 13:11:07.718851 24248 raft_consensus.cc:2804] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:07.719149 24248 raft_consensus.cc:493] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.719521 24248 raft_consensus.cc:3060] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.724586 24248 raft_consensus.cc:515] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.726053 24248 leader_election.cc:290] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [CANDIDATE]: Term 1 election: Requested vote from peers 7c072a3b27ec4b5285d2ced1997af00e (127.12.76.129:46283), 8b3d1c81b87544beb318de4ab922d447 (127.12.76.131:45741)
I20260709 13:11:07.726930 24021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e32b6c1b463410c8b6125035a211994" candidate_uuid: "123d785ea56446948699edd0e9f8985f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c072a3b27ec4b5285d2ced1997af00e"
I20260709 13:11:07.727012 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e32b6c1b463410c8b6125035a211994" candidate_uuid: "123d785ea56446948699edd0e9f8985f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b3d1c81b87544beb318de4ab922d447"
I20260709 13:11:07.727530 24021 raft_consensus.cc:3060] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.727626 24170 raft_consensus.cc:3060] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.732478 24170 raft_consensus.cc:2468] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 123d785ea56446948699edd0e9f8985f in term 1.
I20260709 13:11:07.732662 24021 raft_consensus.cc:2468] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 123d785ea56446948699edd0e9f8985f in term 1.
I20260709 13:11:07.733496 24061 leader_election.cc:304] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 123d785ea56446948699edd0e9f8985f, 8b3d1c81b87544beb318de4ab922d447; no voters: 
I20260709 13:11:07.734319 24248 raft_consensus.cc:2804] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:07.734690 24248 raft_consensus.cc:697] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [term 1 LEADER]: Becoming Leader. State: Replica: 123d785ea56446948699edd0e9f8985f, State: Running, Role: LEADER
I20260709 13:11:07.735389 24248 consensus_queue.cc:237] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:07.742224 23918 catalog_manager.cc:5697] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f reported cstate change: term changed from 0 to 1, leader changed from <none> to 123d785ea56446948699edd0e9f8985f (127.12.76.130). New cstate: current_term: 1 leader_uuid: "123d785ea56446948699edd0e9f8985f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:07.852699 24096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e722da73b1c146c588652fb3ea28d755"
dest_uuid: "123d785ea56446948699edd0e9f8985f"
mode: GRACEFUL
new_leader_uuid: "7c072a3b27ec4b5285d2ced1997af00e"
 from {username='slave'} at 127.0.0.1:34564
I20260709 13:11:07.853314 24096 raft_consensus.cc:606] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [term 1 LEADER]: Received request to transfer leadership to TS 7c072a3b27ec4b5285d2ced1997af00e
I20260709 13:11:07.866964 24021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b53c40bb6af4d8eb108f10fb5c4d2ff"
dest_uuid: "7c072a3b27ec4b5285d2ced1997af00e"
mode: GRACEFUL
new_leader_uuid: "123d785ea56446948699edd0e9f8985f"
 from {username='slave'} at 127.0.0.1:54074
I20260709 13:11:07.867539 24021 raft_consensus.cc:606] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [term 1 LEADER]: Received request to transfer leadership to TS 123d785ea56446948699edd0e9f8985f
I20260709 13:11:07.881582 24170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cbce43850304034b64d789decab4956"
dest_uuid: "8b3d1c81b87544beb318de4ab922d447"
mode: GRACEFUL
new_leader_uuid: "7c072a3b27ec4b5285d2ced1997af00e"
 from {username='slave'} at 127.0.0.1:42252
I20260709 13:11:07.882267 24170 raft_consensus.cc:606] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [term 1 LEADER]: Received request to transfer leadership to TS 7c072a3b27ec4b5285d2ced1997af00e
I20260709 13:11:07.887641 24096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e32b6c1b463410c8b6125035a211994"
dest_uuid: "123d785ea56446948699edd0e9f8985f"
mode: GRACEFUL
new_leader_uuid: "7c072a3b27ec4b5285d2ced1997af00e"
 from {username='slave'} at 127.0.0.1:34564
I20260709 13:11:07.888124 24096 raft_consensus.cc:606] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [term 1 LEADER]: Received request to transfer leadership to TS 7c072a3b27ec4b5285d2ced1997af00e
I20260709 13:11:08.004078 24216 consensus_queue.cc:1048] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [LEADER]: Connected to new peer: Peer: permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:08.015312 24262 consensus_queue.cc:1048] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:08.025754 24261 raft_consensus.cc:993] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447: : Instructing follower 7c072a3b27ec4b5285d2ced1997af00e to start an election
I20260709 13:11:08.026322 24261 raft_consensus.cc:1081] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [term 1 LEADER]: Signalling peer 7c072a3b27ec4b5285d2ced1997af00e to start an election
I20260709 13:11:08.027933 24021 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9cbce43850304034b64d789decab4956"
dest_uuid: "7c072a3b27ec4b5285d2ced1997af00e"
 from {username='slave'} at 127.0.0.1:54066
I20260709 13:11:08.028563 24021 raft_consensus.cc:493] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:08.028903 24021 raft_consensus.cc:3060] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.035454 24021 raft_consensus.cc:515] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:08.037421 24021 leader_election.cc:290] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e [CANDIDATE]: Term 2 election: Requested vote from peers 123d785ea56446948699edd0e9f8985f (127.12.76.130:42137), 8b3d1c81b87544beb318de4ab922d447 (127.12.76.131:45741)
I20260709 13:11:08.038267 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cbce43850304034b64d789decab4956" candidate_uuid: "7c072a3b27ec4b5285d2ced1997af00e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "123d785ea56446948699edd0e9f8985f"
I20260709 13:11:08.038528 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cbce43850304034b64d789decab4956" candidate_uuid: "7c072a3b27ec4b5285d2ced1997af00e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b3d1c81b87544beb318de4ab922d447"
I20260709 13:11:08.038966 24096 raft_consensus.cc:3060] T 9cbce43850304034b64d789decab4956 P 123d785ea56446948699edd0e9f8985f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.039090 24170 raft_consensus.cc:3055] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:08.039521 24170 raft_consensus.cc:740] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b3d1c81b87544beb318de4ab922d447, State: Running, Role: LEADER
I20260709 13:11:08.040370 24170 consensus_queue.cc:260] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:08.041687 24170 raft_consensus.cc:3060] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.047433 24096 raft_consensus.cc:2468] T 9cbce43850304034b64d789decab4956 P 123d785ea56446948699edd0e9f8985f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c072a3b27ec4b5285d2ced1997af00e in term 2.
I20260709 13:11:08.048697 23984 leader_election.cc:304] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 123d785ea56446948699edd0e9f8985f, 7c072a3b27ec4b5285d2ced1997af00e; no voters: 
I20260709 13:11:08.049010 24170 raft_consensus.cc:2468] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c072a3b27ec4b5285d2ced1997af00e in term 2.
I20260709 13:11:08.049599 24254 raft_consensus.cc:2804] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:08.050115 24254 raft_consensus.cc:697] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e [term 2 LEADER]: Becoming Leader. State: Replica: 7c072a3b27ec4b5285d2ced1997af00e, State: Running, Role: LEADER
I20260709 13:11:08.050915 24254 consensus_queue.cc:237] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:08.056411 23918 catalog_manager.cc:5697] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e reported cstate change: term changed from 1 to 2, leader changed from 8b3d1c81b87544beb318de4ab922d447 (127.12.76.131) to 7c072a3b27ec4b5285d2ced1997af00e (127.12.76.129). New cstate: current_term: 2 leader_uuid: "7c072a3b27ec4b5285d2ced1997af00e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:08.114746 24250 raft_consensus.cc:993] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f: : Instructing follower 7c072a3b27ec4b5285d2ced1997af00e to start an election
I20260709 13:11:08.115190 24248 raft_consensus.cc:1081] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [term 1 LEADER]: Signalling peer 7c072a3b27ec4b5285d2ced1997af00e to start an election
I20260709 13:11:08.116859 24021 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e722da73b1c146c588652fb3ea28d755"
dest_uuid: "7c072a3b27ec4b5285d2ced1997af00e"
 from {username='slave'} at 127.0.0.1:54062
I20260709 13:11:08.117595 24021 raft_consensus.cc:493] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:08.117996 24021 raft_consensus.cc:3060] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.122910 24021 raft_consensus.cc:515] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } }
I20260709 13:11:08.124486 24021 leader_election.cc:290] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e [CANDIDATE]: Term 2 election: Requested vote from peers 8b3d1c81b87544beb318de4ab922d447 (127.12.76.131:45741), 123d785ea56446948699edd0e9f8985f (127.12.76.130:42137)
I20260709 13:11:08.125289 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e722da73b1c146c588652fb3ea28d755" candidate_uuid: "7c072a3b27ec4b5285d2ced1997af00e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b3d1c81b87544beb318de4ab922d447"
I20260709 13:11:08.125502 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e722da73b1c146c588652fb3ea28d755" candidate_uuid: "7c072a3b27ec4b5285d2ced1997af00e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "123d785ea56446948699edd0e9f8985f"
I20260709 13:11:08.125963 24170 raft_consensus.cc:3060] T e722da73b1c146c588652fb3ea28d755 P 8b3d1c81b87544beb318de4ab922d447 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.126012 24096 raft_consensus.cc:3055] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:08.126441 24096 raft_consensus.cc:740] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 123d785ea56446948699edd0e9f8985f, State: Running, Role: LEADER
I20260709 13:11:08.127285 24096 consensus_queue.cc:260] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } }
I20260709 13:11:08.128551 24096 raft_consensus.cc:3060] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.133189 24170 raft_consensus.cc:2468] T e722da73b1c146c588652fb3ea28d755 P 8b3d1c81b87544beb318de4ab922d447 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c072a3b27ec4b5285d2ced1997af00e in term 2.
I20260709 13:11:08.134703 23986 leader_election.cc:304] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c072a3b27ec4b5285d2ced1997af00e, 8b3d1c81b87544beb318de4ab922d447; no voters: 
I20260709 13:11:08.135567 24254 raft_consensus.cc:2804] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:08.135679 24096 raft_consensus.cc:2468] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c072a3b27ec4b5285d2ced1997af00e in term 2.
I20260709 13:11:08.136092 24254 raft_consensus.cc:697] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e [term 2 LEADER]: Becoming Leader. State: Replica: 7c072a3b27ec4b5285d2ced1997af00e, State: Running, Role: LEADER
I20260709 13:11:08.136958 24254 consensus_queue.cc:237] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } }
I20260709 13:11:08.138167 24248 consensus_queue.cc:1048] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:08.144343 23918 catalog_manager.cc:5697] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e reported cstate change: term changed from 1 to 2, leader changed from 123d785ea56446948699edd0e9f8985f (127.12.76.130) to 7c072a3b27ec4b5285d2ced1997af00e (127.12.76.129). New cstate: current_term: 2 leader_uuid: "7c072a3b27ec4b5285d2ced1997af00e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:08.150221 24249 consensus_queue.cc:1048] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:08.158703 24249 raft_consensus.cc:993] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f: : Instructing follower 7c072a3b27ec4b5285d2ced1997af00e to start an election
I20260709 13:11:08.159149 24248 raft_consensus.cc:1081] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [term 1 LEADER]: Signalling peer 7c072a3b27ec4b5285d2ced1997af00e to start an election
I20260709 13:11:08.160691 24021 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e32b6c1b463410c8b6125035a211994"
dest_uuid: "7c072a3b27ec4b5285d2ced1997af00e"
 from {username='slave'} at 127.0.0.1:54062
I20260709 13:11:08.161247 24021 raft_consensus.cc:493] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:08.161597 24021 raft_consensus.cc:3060] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.168385 24021 raft_consensus.cc:515] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:08.169966 24021 leader_election.cc:290] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [CANDIDATE]: Term 2 election: Requested vote from peers 123d785ea56446948699edd0e9f8985f (127.12.76.130:42137), 8b3d1c81b87544beb318de4ab922d447 (127.12.76.131:45741)
I20260709 13:11:08.170740 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e32b6c1b463410c8b6125035a211994" candidate_uuid: "7c072a3b27ec4b5285d2ced1997af00e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "123d785ea56446948699edd0e9f8985f"
I20260709 13:11:08.170948 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e32b6c1b463410c8b6125035a211994" candidate_uuid: "7c072a3b27ec4b5285d2ced1997af00e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b3d1c81b87544beb318de4ab922d447"
I20260709 13:11:08.171459 24096 raft_consensus.cc:3055] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:08.171479 24170 raft_consensus.cc:3060] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.171967 24096 raft_consensus.cc:740] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 123d785ea56446948699edd0e9f8985f, State: Running, Role: LEADER
I20260709 13:11:08.172791 24096 consensus_queue.cc:260] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:08.173861 24096 raft_consensus.cc:3060] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.177026 24170 raft_consensus.cc:2468] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c072a3b27ec4b5285d2ced1997af00e in term 2.
I20260709 13:11:08.178146 23986 leader_election.cc:304] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c072a3b27ec4b5285d2ced1997af00e, 8b3d1c81b87544beb318de4ab922d447; no voters: 
I20260709 13:11:08.178936 24254 raft_consensus.cc:2804] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:08.179445 24254 raft_consensus.cc:697] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [term 2 LEADER]: Becoming Leader. State: Replica: 7c072a3b27ec4b5285d2ced1997af00e, State: Running, Role: LEADER
I20260709 13:11:08.180348 24096 raft_consensus.cc:2468] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c072a3b27ec4b5285d2ced1997af00e in term 2.
I20260709 13:11:08.180274 24254 consensus_queue.cc:237] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:08.186821 23918 catalog_manager.cc:5697] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e reported cstate change: term changed from 1 to 2, leader changed from 123d785ea56446948699edd0e9f8985f (127.12.76.130) to 7c072a3b27ec4b5285d2ced1997af00e (127.12.76.129). New cstate: current_term: 2 leader_uuid: "7c072a3b27ec4b5285d2ced1997af00e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:08.200137 24252 raft_consensus.cc:993] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e: : Instructing follower 123d785ea56446948699edd0e9f8985f to start an election
I20260709 13:11:08.200595 24254 raft_consensus.cc:1081] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [term 1 LEADER]: Signalling peer 123d785ea56446948699edd0e9f8985f to start an election
I20260709 13:11:08.202031 24096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b53c40bb6af4d8eb108f10fb5c4d2ff"
dest_uuid: "123d785ea56446948699edd0e9f8985f"
 from {username='slave'} at 127.0.0.1:34542
I20260709 13:11:08.202469 24096 raft_consensus.cc:493] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:08.202718 24096 raft_consensus.cc:3060] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.207530 24096 raft_consensus.cc:515] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:08.209053 24096 leader_election.cc:290] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f [CANDIDATE]: Term 2 election: Requested vote from peers 7c072a3b27ec4b5285d2ced1997af00e (127.12.76.129:46283), 8b3d1c81b87544beb318de4ab922d447 (127.12.76.131:45741)
I20260709 13:11:08.209828 24021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b53c40bb6af4d8eb108f10fb5c4d2ff" candidate_uuid: "123d785ea56446948699edd0e9f8985f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c072a3b27ec4b5285d2ced1997af00e"
I20260709 13:11:08.210067 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b53c40bb6af4d8eb108f10fb5c4d2ff" candidate_uuid: "123d785ea56446948699edd0e9f8985f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b3d1c81b87544beb318de4ab922d447"
I20260709 13:11:08.210528 24021 raft_consensus.cc:3055] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:08.210608 24170 raft_consensus.cc:3060] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 8b3d1c81b87544beb318de4ab922d447 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.210964 24021 raft_consensus.cc:740] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c072a3b27ec4b5285d2ced1997af00e, State: Running, Role: LEADER
I20260709 13:11:08.211840 24021 consensus_queue.cc:260] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:08.213105 24021 raft_consensus.cc:3060] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.217767 24170 raft_consensus.cc:2468] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 8b3d1c81b87544beb318de4ab922d447 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 123d785ea56446948699edd0e9f8985f in term 2.
I20260709 13:11:08.218961 24061 leader_election.cc:304] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 123d785ea56446948699edd0e9f8985f, 8b3d1c81b87544beb318de4ab922d447; no voters: 
I20260709 13:11:08.219755 24248 raft_consensus.cc:2804] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:08.219836 24021 raft_consensus.cc:2468] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 123d785ea56446948699edd0e9f8985f in term 2.
I20260709 13:11:08.220283 24248 raft_consensus.cc:697] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f [term 2 LEADER]: Becoming Leader. State: Replica: 123d785ea56446948699edd0e9f8985f, State: Running, Role: LEADER
I20260709 13:11:08.221123 24248 consensus_queue.cc:237] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:08.227586 23918 catalog_manager.cc:5697] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f reported cstate change: term changed from 1 to 2, leader changed from 7c072a3b27ec4b5285d2ced1997af00e (127.12.76.129) to 123d785ea56446948699edd0e9f8985f (127.12.76.130). New cstate: current_term: 2 leader_uuid: "123d785ea56446948699edd0e9f8985f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:08.337169 12594 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:11:08.338734 12594 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:11:08.339139 12594 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:11:08.350682 24021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e32b6c1b463410c8b6125035a211994"
dest_uuid: "7c072a3b27ec4b5285d2ced1997af00e"
mode: GRACEFUL
new_leader_uuid: "8b3d1c81b87544beb318de4ab922d447"
 from {username='slave'} at 127.0.0.1:54088
I20260709 13:11:08.351162 24021 raft_consensus.cc:606] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [term 2 LEADER]: Received request to transfer leadership to TS 8b3d1c81b87544beb318de4ab922d447
I20260709 13:11:08.352205 12594 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:11:08.527911 24096 raft_consensus.cc:1275] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [term 2 FOLLOWER]: Refusing update from remote peer 7c072a3b27ec4b5285d2ced1997af00e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:08.529223 24254 consensus_queue.cc:1048] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:08.536433 24170 raft_consensus.cc:1275] T e722da73b1c146c588652fb3ea28d755 P 8b3d1c81b87544beb318de4ab922d447 [term 2 FOLLOWER]: Refusing update from remote peer 7c072a3b27ec4b5285d2ced1997af00e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:08.538436 24267 consensus_queue.cc:1048] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:08.566774 24170 raft_consensus.cc:1275] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447 [term 2 FOLLOWER]: Refusing update from remote peer 7c072a3b27ec4b5285d2ced1997af00e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:08.568061 24267 consensus_queue.cc:1048] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:08.573017 24254 raft_consensus.cc:993] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e: : Instructing follower 8b3d1c81b87544beb318de4ab922d447 to start an election
I20260709 13:11:08.573577 24252 raft_consensus.cc:1081] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [term 2 LEADER]: Signalling peer 8b3d1c81b87544beb318de4ab922d447 to start an election
I20260709 13:11:08.575281 24169 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e32b6c1b463410c8b6125035a211994"
dest_uuid: "8b3d1c81b87544beb318de4ab922d447"
 from {username='slave'} at 127.0.0.1:42242
I20260709 13:11:08.575966 24169 raft_consensus.cc:493] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:08.576344 24169 raft_consensus.cc:3060] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.576944 24096 raft_consensus.cc:1275] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [term 2 FOLLOWER]: Refusing update from remote peer 7c072a3b27ec4b5285d2ced1997af00e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:08.578887 24267 consensus_queue.cc:1048] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:08.583923 24169 raft_consensus.cc:515] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:08.586548 24169 leader_election.cc:290] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447 [CANDIDATE]: Term 3 election: Requested vote from peers 7c072a3b27ec4b5285d2ced1997af00e (127.12.76.129:46283), 123d785ea56446948699edd0e9f8985f (127.12.76.130:42137)
I20260709 13:11:08.587132 24021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e32b6c1b463410c8b6125035a211994" candidate_uuid: "8b3d1c81b87544beb318de4ab922d447" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c072a3b27ec4b5285d2ced1997af00e"
I20260709 13:11:08.587594 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e32b6c1b463410c8b6125035a211994" candidate_uuid: "8b3d1c81b87544beb318de4ab922d447" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "123d785ea56446948699edd0e9f8985f"
I20260709 13:11:08.587877 24021 raft_consensus.cc:3055] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:08.588315 24021 raft_consensus.cc:740] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c072a3b27ec4b5285d2ced1997af00e, State: Running, Role: LEADER
I20260709 13:11:08.588457 24096 raft_consensus.cc:3060] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.589169 24021 consensus_queue.cc:260] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:08.590553 24021 raft_consensus.cc:3060] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.594703 24096 raft_consensus.cc:2468] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b3d1c81b87544beb318de4ab922d447 in term 3.
I20260709 13:11:08.595974 24133 leader_election.cc:304] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 123d785ea56446948699edd0e9f8985f, 8b3d1c81b87544beb318de4ab922d447; no voters: 
I20260709 13:11:08.596900 24262 raft_consensus.cc:2804] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:08.596849 24021 raft_consensus.cc:2468] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b3d1c81b87544beb318de4ab922d447 in term 3.
I20260709 13:11:08.598543 24262 raft_consensus.cc:697] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447 [term 3 LEADER]: Becoming Leader. State: Replica: 8b3d1c81b87544beb318de4ab922d447, State: Running, Role: LEADER
I20260709 13:11:08.599366 24262 consensus_queue.cc:237] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } }
I20260709 13:11:08.601999 24169 raft_consensus.cc:1275] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [term 2 FOLLOWER]: Refusing update from remote peer 7c072a3b27ec4b5285d2ced1997af00e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:08.603346 24267 consensus_queue.cc:1048] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:08.607599 23917 catalog_manager.cc:5697] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447 reported cstate change: term changed from 2 to 3, leader changed from 7c072a3b27ec4b5285d2ced1997af00e (127.12.76.129) to 8b3d1c81b87544beb318de4ab922d447 (127.12.76.131). New cstate: current_term: 3 leader_uuid: "8b3d1c81b87544beb318de4ab922d447" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c072a3b27ec4b5285d2ced1997af00e" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 46283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b3d1c81b87544beb318de4ab922d447" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 45741 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:08.611366 24096 raft_consensus.cc:1275] T 9cbce43850304034b64d789decab4956 P 123d785ea56446948699edd0e9f8985f [term 2 FOLLOWER]: Refusing update from remote peer 7c072a3b27ec4b5285d2ced1997af00e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:08.612798 24252 consensus_queue.cc:1048] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "123d785ea56446948699edd0e9f8985f" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:08.696445 12594 tablet_server.cc:179] TabletServer@127.12.76.129:0 shutting down...
I20260709 13:11:08.714829 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:08.715545 12594 tablet_replica.cc:333] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e: stopping tablet replica
I20260709 13:11:08.716114 12594 raft_consensus.cc:2243] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:08.716969 12594 raft_consensus.cc:2272] T 9cbce43850304034b64d789decab4956 P 7c072a3b27ec4b5285d2ced1997af00e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.719234 12594 tablet_replica.cc:333] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e: stopping tablet replica
I20260709 13:11:08.719801 12594 raft_consensus.cc:2243] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.720223 12594 raft_consensus.cc:2272] T 6e32b6c1b463410c8b6125035a211994 P 7c072a3b27ec4b5285d2ced1997af00e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.722329 12594 tablet_replica.cc:333] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e: stopping tablet replica
I20260709 13:11:08.722834 12594 raft_consensus.cc:2243] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:08.723678 12594 raft_consensus.cc:2272] T e722da73b1c146c588652fb3ea28d755 P 7c072a3b27ec4b5285d2ced1997af00e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.725821 12594 tablet_replica.cc:333] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e: stopping tablet replica
I20260709 13:11:08.726313 12594 raft_consensus.cc:2243] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.726720 12594 raft_consensus.cc:2272] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 7c072a3b27ec4b5285d2ced1997af00e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.739621 12594 tablet_server.cc:196] TabletServer@127.12.76.129:0 shutdown complete.
I20260709 13:11:08.752758 12594 tablet_server.cc:179] TabletServer@127.12.76.130:0 shutting down...
I20260709 13:11:08.779721 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:08.780540 12594 tablet_replica.cc:333] T 9cbce43850304034b64d789decab4956 P 123d785ea56446948699edd0e9f8985f: stopping tablet replica
I20260709 13:11:08.781152 12594 raft_consensus.cc:2243] T 9cbce43850304034b64d789decab4956 P 123d785ea56446948699edd0e9f8985f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.781682 12594 raft_consensus.cc:2272] T 9cbce43850304034b64d789decab4956 P 123d785ea56446948699edd0e9f8985f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:08.781667 24060 consensus_peers.cc:597] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f -> Peer 7c072a3b27ec4b5285d2ced1997af00e (127.12.76.129:46283): Couldn't send request to peer 7c072a3b27ec4b5285d2ced1997af00e. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:46283: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:08.784615 12594 tablet_replica.cc:333] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f: stopping tablet replica
I20260709 13:11:08.785157 12594 raft_consensus.cc:2243] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.785610 12594 raft_consensus.cc:2272] T 6e32b6c1b463410c8b6125035a211994 P 123d785ea56446948699edd0e9f8985f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.788307 12594 tablet_replica.cc:333] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f: stopping tablet replica
I20260709 13:11:08.788491 24169 raft_consensus.cc:1275] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 8b3d1c81b87544beb318de4ab922d447 [term 2 FOLLOWER]: Refusing update from remote peer 123d785ea56446948699edd0e9f8985f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:08.788870 12594 raft_consensus.cc:2243] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:08.789638 12594 pending_rounds.cc:70] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f: Trying to abort 1 pending ops.
I20260709 13:11:08.789831 12594 pending_rounds.cc:77] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305636529041162240 op_type: NO_OP noop_request { }
I20260709 13:11:08.790108 12594 raft_consensus.cc:2889] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:08.790421 12594 raft_consensus.cc:2272] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 123d785ea56446948699edd0e9f8985f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.792616 12594 tablet_replica.cc:333] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f: stopping tablet replica
I20260709 13:11:08.793111 12594 raft_consensus.cc:2243] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.793574 12594 raft_consensus.cc:2272] T e722da73b1c146c588652fb3ea28d755 P 123d785ea56446948699edd0e9f8985f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.817865 12594 tablet_server.cc:196] TabletServer@127.12.76.130:0 shutdown complete.
I20260709 13:11:08.831107 12594 tablet_server.cc:179] TabletServer@127.12.76.131:0 shutting down...
I20260709 13:11:08.852394 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:08.853046 12594 tablet_replica.cc:333] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447: stopping tablet replica
I20260709 13:11:08.853621 12594 raft_consensus.cc:2243] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.854092 12594 raft_consensus.cc:2272] T 9cbce43850304034b64d789decab4956 P 8b3d1c81b87544beb318de4ab922d447 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.856339 12594 tablet_replica.cc:333] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447: stopping tablet replica
I20260709 13:11:08.856856 12594 raft_consensus.cc:2243] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:08.857508 12594 pending_rounds.cc:70] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447: Trying to abort 1 pending ops.
I20260709 13:11:08.857661 12594 pending_rounds.cc:77] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305636530591346688 op_type: NO_OP noop_request { }
I20260709 13:11:08.857945 12594 raft_consensus.cc:2889] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:08.858238 12594 raft_consensus.cc:2272] T 6e32b6c1b463410c8b6125035a211994 P 8b3d1c81b87544beb318de4ab922d447 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.860677 12594 tablet_replica.cc:333] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 8b3d1c81b87544beb318de4ab922d447: stopping tablet replica
I20260709 13:11:08.861182 12594 raft_consensus.cc:2243] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 8b3d1c81b87544beb318de4ab922d447 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.861593 12594 raft_consensus.cc:2272] T 5b53c40bb6af4d8eb108f10fb5c4d2ff P 8b3d1c81b87544beb318de4ab922d447 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.863302 12594 tablet_replica.cc:333] T e722da73b1c146c588652fb3ea28d755 P 8b3d1c81b87544beb318de4ab922d447: stopping tablet replica
I20260709 13:11:08.863821 12594 raft_consensus.cc:2243] T e722da73b1c146c588652fb3ea28d755 P 8b3d1c81b87544beb318de4ab922d447 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.864224 12594 raft_consensus.cc:2272] T e722da73b1c146c588652fb3ea28d755 P 8b3d1c81b87544beb318de4ab922d447 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.876381 12594 tablet_server.cc:196] TabletServer@127.12.76.131:0 shutdown complete.
I20260709 13:11:08.889149 12594 master.cc:562] Master@127.12.76.190:45373 shutting down...
I20260709 13:11:08.904839 12594 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:08.905404 12594 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.905725 12594 tablet_replica.cc:333] T 00000000000000000000000000000000 P 216be0b430054a23a9a851c455c60fa4: stopping tablet replica
I20260709 13:11:08.924847 12594 master.cc:584] Master@127.12.76.190:45373 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2595 ms)
[----------] 6 tests from LeaderRebalancerTest (365690 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:11:08.955035 12594 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.76.190:39059
I20260709 13:11:08.956424 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:08.961776 24271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:08.962018 24272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:08.963326 24274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:08.964582 12594 server_base.cc:1061] running on GCE node
I20260709 13:11:08.965381 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:08.965605 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:08.965767 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602668965751 us; error 0 us; skew 500 ppm
I20260709 13:11:08.966297 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:08.968822 12594 webserver.cc:533] Webserver started at http://127.12.76.190:37323/ using document root <none> and password file <none>
I20260709 13:11:08.969317 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:08.969522 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:08.969784 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:08.970835 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602303087285-12594-0/minicluster-data/master-0-root/instance:
uuid: "84afb25dd5144739bf7cc82652ffa76d"
format_stamp: "Formatted at 2026-07-09 13:11:08 on dist-test-slave-th5x"
I20260709 13:11:08.975188 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:11:08.978596 24279 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:08.979569 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:08.979823 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602303087285-12594-0/minicluster-data/master-0-root
uuid: "84afb25dd5144739bf7cc82652ffa76d"
format_stamp: "Formatted at 2026-07-09 13:11:08 on dist-test-slave-th5x"
I20260709 13:11:08.980067 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602303087285-12594-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602303087285-12594-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602303087285-12594-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:09.000819 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:09.001789 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:09.038717 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.190:39059
I20260709 13:11:09.038832 24330 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.190:39059 every 8 connection(s)
I20260709 13:11:09.043079 24331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.053929 24331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d: Bootstrap starting.
I20260709 13:11:09.058503 24331 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.062664 24331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d: No bootstrap required, opened a new log
I20260709 13:11:09.064903 24331 raft_consensus.cc:359] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84afb25dd5144739bf7cc82652ffa76d" member_type: VOTER }
I20260709 13:11:09.065325 24331 raft_consensus.cc:385] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.065524 24331 raft_consensus.cc:740] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84afb25dd5144739bf7cc82652ffa76d, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.066082 24331 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84afb25dd5144739bf7cc82652ffa76d" member_type: VOTER }
I20260709 13:11:09.066521 24331 raft_consensus.cc:399] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:09.066733 24331 raft_consensus.cc:493] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:09.066959 24331 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.072176 24331 raft_consensus.cc:515] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84afb25dd5144739bf7cc82652ffa76d" member_type: VOTER }
I20260709 13:11:09.072731 24331 leader_election.cc:304] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 84afb25dd5144739bf7cc82652ffa76d; no voters: 
I20260709 13:11:09.073863 24331 leader_election.cc:290] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:09.074240 24334 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:09.075783 24334 raft_consensus.cc:697] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d [term 1 LEADER]: Becoming Leader. State: Replica: 84afb25dd5144739bf7cc82652ffa76d, State: Running, Role: LEADER
I20260709 13:11:09.076449 24334 consensus_queue.cc:237] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84afb25dd5144739bf7cc82652ffa76d" member_type: VOTER }
I20260709 13:11:09.077248 24331 sys_catalog.cc:565] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:09.079317 24335 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "84afb25dd5144739bf7cc82652ffa76d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84afb25dd5144739bf7cc82652ffa76d" member_type: VOTER } }
I20260709 13:11:09.079365 24336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84afb25dd5144739bf7cc82652ffa76d. Latest consensus state: current_term: 1 leader_uuid: "84afb25dd5144739bf7cc82652ffa76d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84afb25dd5144739bf7cc82652ffa76d" member_type: VOTER } }
I20260709 13:11:09.080145 24335 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:09.080225 24336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:09.086524 24338 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:09.095284 24338 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:09.096375 12594 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:09.104595 24338 catalog_manager.cc:1383] Generated new cluster ID: 9dee5e55c6ee4a68a21f75252663c6ed
I20260709 13:11:09.104908 24338 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:09.123000 24338 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:09.124334 24338 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:09.139065 24338 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d: Generated new TSK 0
I20260709 13:11:09.139683 24338 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:09.162812 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:09.168700 24352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:09.169821 24353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:09.171463 24355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:09.172124 12594 server_base.cc:1061] running on GCE node
I20260709 13:11:09.172968 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:09.173142 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:09.173319 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602669173305 us; error 0 us; skew 500 ppm
I20260709 13:11:09.173900 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:09.176456 12594 webserver.cc:533] Webserver started at http://127.12.76.129:34853/ using document root <none> and password file <none>
I20260709 13:11:09.177053 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:09.177235 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:09.177595 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:09.178789 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602303087285-12594-0/minicluster-data/ts-0-root/instance:
uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
format_stamp: "Formatted at 2026-07-09 13:11:09 on dist-test-slave-th5x"
I20260709 13:11:09.183893 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:11:09.187389 24360 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:09.188246 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:11:09.188594 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602303087285-12594-0/minicluster-data/ts-0-root
uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
format_stamp: "Formatted at 2026-07-09 13:11:09 on dist-test-slave-th5x"
I20260709 13:11:09.188938 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602303087285-12594-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602303087285-12594-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602303087285-12594-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:09.205998 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:09.207185 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:09.208763 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:09.211109 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:09.211350 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:09.211687 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:09.211905 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:09.252125 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.129:33241
I20260709 13:11:09.252221 24422 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.129:33241 every 8 connection(s)
I20260709 13:11:09.257970 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:09.265516 24427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:09.270447 24428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:09.272239 24423 heartbeater.cc:344] Connected to a master server at 127.12.76.190:39059
I20260709 13:11:09.272683 24423 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:09.272903 12594 server_base.cc:1061] running on GCE node
W20260709 13:11:09.273320 24430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:09.273612 24423 heartbeater.cc:507] Master 127.12.76.190:39059 requested a full tablet report, sending...
I20260709 13:11:09.274773 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:09.275082 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:09.275278 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602669275255 us; error 0 us; skew 500 ppm
I20260709 13:11:09.275956 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:09.275954 24296 ts_manager.cc:194] Registered new tserver with Master: cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241)
I20260709 13:11:09.278076 24296 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52538
I20260709 13:11:09.279238 12594 webserver.cc:533] Webserver started at http://127.12.76.130:42235/ using document root <none> and password file <none>
I20260709 13:11:09.280035 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:09.280211 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:09.280565 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:09.281877 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602303087285-12594-0/minicluster-data/ts-1-root/instance:
uuid: "104401b105224f1e9b05d58be1749d9c"
format_stamp: "Formatted at 2026-07-09 13:11:09 on dist-test-slave-th5x"
I20260709 13:11:09.286505 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:11:09.290047 24435 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:09.290994 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:11:09.291323 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602303087285-12594-0/minicluster-data/ts-1-root
uuid: "104401b105224f1e9b05d58be1749d9c"
format_stamp: "Formatted at 2026-07-09 13:11:09 on dist-test-slave-th5x"
I20260709 13:11:09.291706 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602303087285-12594-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602303087285-12594-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602303087285-12594-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:09.315115 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:09.316309 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:09.317809 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:09.320252 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:09.320493 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:09.320762 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:09.320966 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:09.360793 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.130:43451
I20260709 13:11:09.360906 24497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.130:43451 every 8 connection(s)
I20260709 13:11:09.366036 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:09.373569 24501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:09.374506 24502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:09.381120 24504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:09.383229 24498 heartbeater.cc:344] Connected to a master server at 127.12.76.190:39059
I20260709 13:11:09.384100 24498 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:09.385188 24498 heartbeater.cc:507] Master 127.12.76.190:39059 requested a full tablet report, sending...
I20260709 13:11:09.386016 12594 server_base.cc:1061] running on GCE node
I20260709 13:11:09.387023 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:09.387274 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:09.387497 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602669387476 us; error 0 us; skew 500 ppm
I20260709 13:11:09.387537 24296 ts_manager.cc:194] Registered new tserver with Master: 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:09.388200 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:09.389232 24296 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52540
I20260709 13:11:09.391366 12594 webserver.cc:533] Webserver started at http://127.12.76.131:35369/ using document root <none> and password file <none>
I20260709 13:11:09.392153 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:09.392421 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:09.392679 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:09.393918 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602303087285-12594-0/minicluster-data/ts-2-root/instance:
uuid: "f4717668718a44baada8b0fc4b30cfe1"
format_stamp: "Formatted at 2026-07-09 13:11:09 on dist-test-slave-th5x"
I20260709 13:11:09.398620 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:11:09.402410 24509 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:09.403223 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:09.403826 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602303087285-12594-0/minicluster-data/ts-2-root
uuid: "f4717668718a44baada8b0fc4b30cfe1"
format_stamp: "Formatted at 2026-07-09 13:11:09 on dist-test-slave-th5x"
I20260709 13:11:09.404094 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602303087285-12594-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602303087285-12594-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602303087285-12594-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:09.420833 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:09.421882 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:09.423280 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:09.425498 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:09.425671 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:09.425990 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:09.426131 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:09.466506 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.131:35807
I20260709 13:11:09.466640 24571 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.131:35807 every 8 connection(s)
I20260709 13:11:09.480461 24572 heartbeater.cc:344] Connected to a master server at 127.12.76.190:39059
I20260709 13:11:09.480969 24572 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:09.481706 24572 heartbeater.cc:507] Master 127.12.76.190:39059 requested a full tablet report, sending...
I20260709 13:11:09.483678 24296 ts_manager.cc:194] Registered new tserver with Master: f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:09.483843 12594 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014194021s
I20260709 13:11:09.485037 24296 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52544
I20260709 13:11:09.509147 24296 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52550:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:09.511689 24296 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:09.576628 24388 tablet_service.cc:1511] Processing CreateTablet for tablet faee6f7d44bb40e8afcf691b6ff167f2 (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:09.578096 24388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faee6f7d44bb40e8afcf691b6ff167f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.580550 24387 tablet_service.cc:1511] Processing CreateTablet for tablet c1f30fcf9ddb433a95594b906e4b29e5 (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:09.582020 24387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f30fcf9ddb433a95594b906e4b29e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.584424 24386 tablet_service.cc:1511] Processing CreateTablet for tablet 40209789a45a43478a84057bb2f85444 (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:09.585805 24386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40209789a45a43478a84057bb2f85444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.591773 24385 tablet_service.cc:1511] Processing CreateTablet for tablet bb70e8be13544040a6bef963d1056f29 (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:09.592624 24383 tablet_service.cc:1511] Processing CreateTablet for tablet 3b3ec318f9304bc08fad059e9895e87c (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:09.594410 24384 tablet_service.cc:1511] Processing CreateTablet for tablet e7a46359788d4c1688bfff6b39ebb9ba (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:09.595935 24382 tablet_service.cc:1511] Processing CreateTablet for tablet e2eef84f60154cbfb6443c8bd9fe56d3 (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:09.593225 24385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb70e8be13544040a6bef963d1056f29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.597681 24382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2eef84f60154cbfb6443c8bd9fe56d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.599752 24383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3ec318f9304bc08fad059e9895e87c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.600410 24384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a46359788d4c1688bfff6b39ebb9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.610651 24381 tablet_service.cc:1511] Processing CreateTablet for tablet f36cde9868304ce6ba53977484021f63 (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:09.611896 24463 tablet_service.cc:1511] Processing CreateTablet for tablet faee6f7d44bb40e8afcf691b6ff167f2 (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:09.612315 24381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36cde9868304ce6ba53977484021f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.613230 24463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faee6f7d44bb40e8afcf691b6ff167f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.618534 24380 tablet_service.cc:1511] Processing CreateTablet for tablet a4cdb73e8b3f4f0f879a792183a634d7 (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:09.620064 24380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4cdb73e8b3f4f0f879a792183a634d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.624356 24462 tablet_service.cc:1511] Processing CreateTablet for tablet c1f30fcf9ddb433a95594b906e4b29e5 (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:09.625676 24462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f30fcf9ddb433a95594b906e4b29e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.641201 24461 tablet_service.cc:1511] Processing CreateTablet for tablet 40209789a45a43478a84057bb2f85444 (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:09.642752 24461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40209789a45a43478a84057bb2f85444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.653023 24460 tablet_service.cc:1511] Processing CreateTablet for tablet bb70e8be13544040a6bef963d1056f29 (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:09.654460 24460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb70e8be13544040a6bef963d1056f29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.656445 24459 tablet_service.cc:1511] Processing CreateTablet for tablet e7a46359788d4c1688bfff6b39ebb9ba (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:09.657802 24459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a46359788d4c1688bfff6b39ebb9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.660867 24458 tablet_service.cc:1511] Processing CreateTablet for tablet 3b3ec318f9304bc08fad059e9895e87c (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:09.662154 24458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3ec318f9304bc08fad059e9895e87c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.664408 24457 tablet_service.cc:1511] Processing CreateTablet for tablet e2eef84f60154cbfb6443c8bd9fe56d3 (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:09.665699 24457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2eef84f60154cbfb6443c8bd9fe56d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.668454 24456 tablet_service.cc:1511] Processing CreateTablet for tablet f36cde9868304ce6ba53977484021f63 (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:09.669759 24456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36cde9868304ce6ba53977484021f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.673525 24455 tablet_service.cc:1511] Processing CreateTablet for tablet a4cdb73e8b3f4f0f879a792183a634d7 (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:09.674816 24455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4cdb73e8b3f4f0f879a792183a634d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.696019 24587 tablet_bootstrap.cc:492] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Bootstrap starting.
I20260709 13:11:09.696182 24536 tablet_service.cc:1511] Processing CreateTablet for tablet c1f30fcf9ddb433a95594b906e4b29e5 (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:09.697721 24536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f30fcf9ddb433a95594b906e4b29e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.698948 24529 tablet_service.cc:1511] Processing CreateTablet for tablet a4cdb73e8b3f4f0f879a792183a634d7 (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:09.700001 24534 tablet_service.cc:1511] Processing CreateTablet for tablet bb70e8be13544040a6bef963d1056f29 (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:09.702137 24533 tablet_service.cc:1511] Processing CreateTablet for tablet e7a46359788d4c1688bfff6b39ebb9ba (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:09.703141 24587 tablet_bootstrap.cc:654] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.704324 24532 tablet_service.cc:1511] Processing CreateTablet for tablet 3b3ec318f9304bc08fad059e9895e87c (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:09.706416 24531 tablet_service.cc:1511] Processing CreateTablet for tablet e2eef84f60154cbfb6443c8bd9fe56d3 (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:09.708554 24530 tablet_service.cc:1511] Processing CreateTablet for tablet f36cde9868304ce6ba53977484021f63 (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:09.710726 24537 tablet_service.cc:1511] Processing CreateTablet for tablet faee6f7d44bb40e8afcf691b6ff167f2 (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:09.698944 24535 tablet_service.cc:1511] Processing CreateTablet for tablet 40209789a45a43478a84057bb2f85444 (DEFAULT_TABLE table=test-workload [id=773905762d2940f5ac8b495b2426fa73]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:09.700387 24529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4cdb73e8b3f4f0f879a792183a634d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.723816 24535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40209789a45a43478a84057bb2f85444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.727816 24533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a46359788d4c1688bfff6b39ebb9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.731796 24534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb70e8be13544040a6bef963d1056f29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.735780 24531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2eef84f60154cbfb6443c8bd9fe56d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.738746 24532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3ec318f9304bc08fad059e9895e87c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.743970 24530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36cde9868304ce6ba53977484021f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.749720 24537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faee6f7d44bb40e8afcf691b6ff167f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:09.750469 24588 tablet_bootstrap.cc:492] T c1f30fcf9ddb433a95594b906e4b29e5 P 104401b105224f1e9b05d58be1749d9c: Bootstrap starting.
I20260709 13:11:09.756913 24588 tablet_bootstrap.cc:654] T c1f30fcf9ddb433a95594b906e4b29e5 P 104401b105224f1e9b05d58be1749d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.817632 24588 tablet_bootstrap.cc:492] T c1f30fcf9ddb433a95594b906e4b29e5 P 104401b105224f1e9b05d58be1749d9c: No bootstrap required, opened a new log
I20260709 13:11:09.817633 24587 tablet_bootstrap.cc:492] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: No bootstrap required, opened a new log
I20260709 13:11:09.818221 24588 ts_tablet_manager.cc:1403] T c1f30fcf9ddb433a95594b906e4b29e5 P 104401b105224f1e9b05d58be1749d9c: Time spent bootstrapping tablet: real 0.068s	user 0.016s	sys 0.027s
I20260709 13:11:09.818223 24587 ts_tablet_manager.cc:1403] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent bootstrapping tablet: real 0.122s	user 0.038s	sys 0.045s
I20260709 13:11:09.819796 24591 tablet_bootstrap.cc:492] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1: Bootstrap starting.
I20260709 13:11:09.821457 24587 raft_consensus.cc:359] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:09.822207 24587 raft_consensus.cc:385] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.822505 24587 raft_consensus.cc:740] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.824236 24588 raft_consensus.cc:359] T c1f30fcf9ddb433a95594b906e4b29e5 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:09.824486 24587 consensus_queue.cc:260] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:09.825057 24588 raft_consensus.cc:385] T c1f30fcf9ddb433a95594b906e4b29e5 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.825368 24588 raft_consensus.cc:740] T c1f30fcf9ddb433a95594b906e4b29e5 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.826254 24588 consensus_queue.cc:260] T c1f30fcf9ddb433a95594b906e4b29e5 P 104401b105224f1e9b05d58be1749d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:09.827983 24591 tablet_bootstrap.cc:654] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.833706 24423 heartbeater.cc:499] Master 127.12.76.190:39059 was elected leader, sending a full tablet report...
I20260709 13:11:09.833771 24587 ts_tablet_manager.cc:1434] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 13:11:09.841945 24587 tablet_bootstrap.cc:492] T 3b3ec318f9304bc08fad059e9895e87c P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Bootstrap starting.
I20260709 13:11:09.844551 24498 heartbeater.cc:499] Master 127.12.76.190:39059 was elected leader, sending a full tablet report...
I20260709 13:11:09.845077 24588 ts_tablet_manager.cc:1434] T c1f30fcf9ddb433a95594b906e4b29e5 P 104401b105224f1e9b05d58be1749d9c: Time spent starting tablet: real 0.026s	user 0.018s	sys 0.005s
I20260709 13:11:09.846134 24588 tablet_bootstrap.cc:492] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c: Bootstrap starting.
I20260709 13:11:09.848546 24587 tablet_bootstrap.cc:654] T 3b3ec318f9304bc08fad059e9895e87c P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.852823 24588 tablet_bootstrap.cc:654] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.853796 24591 tablet_bootstrap.cc:492] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1: No bootstrap required, opened a new log
I20260709 13:11:09.854467 24591 ts_tablet_manager.cc:1403] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1: Time spent bootstrapping tablet: real 0.035s	user 0.006s	sys 0.008s
I20260709 13:11:09.857887 24591 raft_consensus.cc:359] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:09.858712 24591 raft_consensus.cc:385] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.859066 24591 raft_consensus.cc:740] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.860133 24591 consensus_queue.cc:260] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:09.865373 24587 tablet_bootstrap.cc:492] T 3b3ec318f9304bc08fad059e9895e87c P cb1c3a28d32d452fbc4fdbf43cc1bf7b: No bootstrap required, opened a new log
I20260709 13:11:09.866200 24587 ts_tablet_manager.cc:1403] T 3b3ec318f9304bc08fad059e9895e87c P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 13:11:09.870366 24587 raft_consensus.cc:359] T 3b3ec318f9304bc08fad059e9895e87c P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:09.871381 24587 raft_consensus.cc:385] T 3b3ec318f9304bc08fad059e9895e87c P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.871804 24587 raft_consensus.cc:740] T 3b3ec318f9304bc08fad059e9895e87c P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.872798 24587 consensus_queue.cc:260] T 3b3ec318f9304bc08fad059e9895e87c P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:09.876228 24587 ts_tablet_manager.cc:1434] T 3b3ec318f9304bc08fad059e9895e87c P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.003s
I20260709 13:11:09.877516 24587 tablet_bootstrap.cc:492] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Bootstrap starting.
I20260709 13:11:09.886161 24587 tablet_bootstrap.cc:654] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.906488 24572 heartbeater.cc:499] Master 127.12.76.190:39059 was elected leader, sending a full tablet report...
I20260709 13:11:09.906932 24591 ts_tablet_manager.cc:1434] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1: Time spent starting tablet: real 0.052s	user 0.024s	sys 0.024s
I20260709 13:11:09.908231 24591 tablet_bootstrap.cc:492] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1: Bootstrap starting.
I20260709 13:11:09.909426 24587 tablet_bootstrap.cc:492] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: No bootstrap required, opened a new log
I20260709 13:11:09.909541 24588 tablet_bootstrap.cc:492] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c: No bootstrap required, opened a new log
I20260709 13:11:09.910053 24587 ts_tablet_manager.cc:1403] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.020s
I20260709 13:11:09.910269 24588 ts_tablet_manager.cc:1403] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c: Time spent bootstrapping tablet: real 0.064s	user 0.029s	sys 0.033s
I20260709 13:11:09.913427 24587 raft_consensus.cc:359] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:09.913796 24588 raft_consensus.cc:359] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:09.914259 24587 raft_consensus.cc:385] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.914227 24591 tablet_bootstrap.cc:654] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.914798 24588 raft_consensus.cc:385] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.914855 24587 raft_consensus.cc:740] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.915503 24588 raft_consensus.cc:740] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.916045 24587 consensus_queue.cc:260] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:09.918749 24587 ts_tablet_manager.cc:1434] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:11:09.920009 24587 tablet_bootstrap.cc:492] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Bootstrap starting.
I20260709 13:11:09.916381 24588 consensus_queue.cc:260] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:09.923233 24588 ts_tablet_manager.cc:1434] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:11:09.924270 24588 tablet_bootstrap.cc:492] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c: Bootstrap starting.
I20260709 13:11:09.926573 24587 tablet_bootstrap.cc:654] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.930289 24588 tablet_bootstrap.cc:654] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.936930 24587 tablet_bootstrap.cc:492] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: No bootstrap required, opened a new log
I20260709 13:11:09.937512 24587 ts_tablet_manager.cc:1403] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:11:09.940464 24587 raft_consensus.cc:359] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:09.940898 24591 tablet_bootstrap.cc:492] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1: No bootstrap required, opened a new log
I20260709 13:11:09.941253 24587 raft_consensus.cc:385] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.941468 24591 ts_tablet_manager.cc:1403] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.008s
I20260709 13:11:09.941601 24587 raft_consensus.cc:740] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.942492 24587 consensus_queue.cc:260] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:09.944571 24591 raft_consensus.cc:359] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:09.945348 24591 raft_consensus.cc:385] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.945636 24591 raft_consensus.cc:740] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.945827 24587 ts_tablet_manager.cc:1434] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:11:09.946401 24591 consensus_queue.cc:260] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:09.947242 24587 tablet_bootstrap.cc:492] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Bootstrap starting.
I20260709 13:11:09.948966 24591 ts_tablet_manager.cc:1434] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:11:09.949996 24591 tablet_bootstrap.cc:492] T c1f30fcf9ddb433a95594b906e4b29e5 P f4717668718a44baada8b0fc4b30cfe1: Bootstrap starting.
I20260709 13:11:09.955307 24587 tablet_bootstrap.cc:654] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.957055 24591 tablet_bootstrap.cc:654] T c1f30fcf9ddb433a95594b906e4b29e5 P f4717668718a44baada8b0fc4b30cfe1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.957499 24588 tablet_bootstrap.cc:492] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c: No bootstrap required, opened a new log
I20260709 13:11:09.958158 24588 ts_tablet_manager.cc:1403] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.005s
I20260709 13:11:09.961934 24588 raft_consensus.cc:359] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:09.962730 24588 raft_consensus.cc:385] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.963001 24588 raft_consensus.cc:740] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.963675 24588 consensus_queue.cc:260] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:09.964002 24587 tablet_bootstrap.cc:492] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: No bootstrap required, opened a new log
I20260709 13:11:09.964113 24591 tablet_bootstrap.cc:492] T c1f30fcf9ddb433a95594b906e4b29e5 P f4717668718a44baada8b0fc4b30cfe1: No bootstrap required, opened a new log
I20260709 13:11:09.964709 24591 ts_tablet_manager.cc:1403] T c1f30fcf9ddb433a95594b906e4b29e5 P f4717668718a44baada8b0fc4b30cfe1: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:11:09.964709 24587 ts_tablet_manager.cc:1403] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.003s
I20260709 13:11:09.965740 24588 ts_tablet_manager.cc:1434] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:11:09.966770 24588 tablet_bootstrap.cc:492] T a4cdb73e8b3f4f0f879a792183a634d7 P 104401b105224f1e9b05d58be1749d9c: Bootstrap starting.
I20260709 13:11:09.967790 24591 raft_consensus.cc:359] T c1f30fcf9ddb433a95594b906e4b29e5 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:09.968051 24587 raft_consensus.cc:359] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:09.968577 24591 raft_consensus.cc:385] T c1f30fcf9ddb433a95594b906e4b29e5 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.968721 24587 raft_consensus.cc:385] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.968914 24591 raft_consensus.cc:740] T c1f30fcf9ddb433a95594b906e4b29e5 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.969062 24587 raft_consensus.cc:740] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.970219 24597 raft_consensus.cc:493] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.970710 24597 raft_consensus.cc:515] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:09.969952 24587 consensus_queue.cc:260] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:09.973448 24587 ts_tablet_manager.cc:1434] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.004s
I20260709 13:11:09.974509 24587 tablet_bootstrap.cc:492] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Bootstrap starting.
I20260709 13:11:09.977775 24593 raft_consensus.cc:493] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.984201 24587 tablet_bootstrap.cc:654] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.984185 24593 raft_consensus.cc:515] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:09.984194 24588 tablet_bootstrap.cc:654] T a4cdb73e8b3f4f0f879a792183a634d7 P 104401b105224f1e9b05d58be1749d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.998736 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faee6f7d44bb40e8afcf691b6ff167f2" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" is_pre_election: true
I20260709 13:11:10.000954 24593 leader_election.cc:290] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:10.001950 24398 raft_consensus.cc:2468] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 0.
I20260709 13:11:10.004117 24512 leader_election.cc:304] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:10.005920 24587 tablet_bootstrap.cc:492] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: No bootstrap required, opened a new log
I20260709 13:11:09.976686 24597 leader_election.cc:290] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:10.006655 24587 ts_tablet_manager.cc:1403] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.017s
I20260709 13:11:10.006755 24597 raft_consensus.cc:2804] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.007171 24597 raft_consensus.cc:493] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.010352 24587 raft_consensus.cc:359] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.007547 24597 raft_consensus.cc:3060] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.011518 24587 raft_consensus.cc:385] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.011899 24587 raft_consensus.cc:740] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.012898 24587 consensus_queue.cc:260] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.015709 24587 ts_tablet_manager.cc:1434] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:11:10.016942 24587 tablet_bootstrap.cc:492] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Bootstrap starting.
I20260709 13:11:09.982762 24591 consensus_queue.cc:260] T c1f30fcf9ddb433a95594b906e4b29e5 P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.022539 24588 tablet_bootstrap.cc:492] T a4cdb73e8b3f4f0f879a792183a634d7 P 104401b105224f1e9b05d58be1749d9c: No bootstrap required, opened a new log
I20260709 13:11:10.023240 24588 ts_tablet_manager.cc:1403] T a4cdb73e8b3f4f0f879a792183a634d7 P 104401b105224f1e9b05d58be1749d9c: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.006s
I20260709 13:11:10.024880 24587 tablet_bootstrap.cc:654] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.026687 24588 raft_consensus.cc:359] T a4cdb73e8b3f4f0f879a792183a634d7 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.027756 24588 raft_consensus.cc:385] T a4cdb73e8b3f4f0f879a792183a634d7 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.028136 24588 raft_consensus.cc:740] T a4cdb73e8b3f4f0f879a792183a634d7 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.029239 24588 consensus_queue.cc:260] T a4cdb73e8b3f4f0f879a792183a634d7 P 104401b105224f1e9b05d58be1749d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.030017 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faee6f7d44bb40e8afcf691b6ff167f2" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c" is_pre_election: true
I20260709 13:11:10.031000 24473 raft_consensus.cc:2468] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 0.
I20260709 13:11:10.019351 24591 ts_tablet_manager.cc:1434] T c1f30fcf9ddb433a95594b906e4b29e5 P f4717668718a44baada8b0fc4b30cfe1: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:11:10.037082 24591 tablet_bootstrap.cc:492] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1: Bootstrap starting.
I20260709 13:11:10.039075 24588 ts_tablet_manager.cc:1434] T a4cdb73e8b3f4f0f879a792183a634d7 P 104401b105224f1e9b05d58be1749d9c: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:11:10.042704 24588 tablet_bootstrap.cc:492] T 40209789a45a43478a84057bb2f85444 P 104401b105224f1e9b05d58be1749d9c: Bootstrap starting.
I20260709 13:11:10.048898 24588 tablet_bootstrap.cc:654] T 40209789a45a43478a84057bb2f85444 P 104401b105224f1e9b05d58be1749d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.051237 24592 raft_consensus.cc:493] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.051878 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faee6f7d44bb40e8afcf691b6ff167f2" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" is_pre_election: true
I20260709 13:11:10.051808 24592 raft_consensus.cc:515] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.052548 24398 raft_consensus.cc:2468] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 0.
I20260709 13:11:10.054085 24438 leader_election.cc:304] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: 
I20260709 13:11:10.054481 24592 leader_election.cc:290] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:10.055876 24593 raft_consensus.cc:2804] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.056468 24593 raft_consensus.cc:493] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.056929 24593 raft_consensus.cc:3060] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.058126 24597 raft_consensus.cc:515] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.066620 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faee6f7d44bb40e8afcf691b6ff167f2" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:10.067219 24398 raft_consensus.cc:3060] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.067389 24597 leader_election.cc:290] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:10.063673 24591 tablet_bootstrap.cc:654] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.068421 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faee6f7d44bb40e8afcf691b6ff167f2" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:10.067921 24610 raft_consensus.cc:493] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.070829 24610 raft_consensus.cc:515] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.073844 24610 leader_election.cc:290] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:10.075083 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ec318f9304bc08fad059e9895e87c" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c" is_pre_election: true
I20260709 13:11:10.076967 24593 raft_consensus.cc:515] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
W20260709 13:11:10.077275 24510 leader_election.cc:343] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.078357 24473 raft_consensus.cc:2393] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f4717668718a44baada8b0fc4b30cfe1 in current term 1: Already voted for candidate 104401b105224f1e9b05d58be1749d9c in this term.
I20260709 13:11:10.080928 24592 raft_consensus.cc:493] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.081562 24592 raft_consensus.cc:515] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.082218 24398 raft_consensus.cc:2468] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 1.
I20260709 13:11:10.083498 24512 leader_election.cc:304] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:10.084069 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ec318f9304bc08fad059e9895e87c" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" is_pre_election: true
I20260709 13:11:10.084707 24610 raft_consensus.cc:2804] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.085074 24397 raft_consensus.cc:2468] T 3b3ec318f9304bc08fad059e9895e87c P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 0.
I20260709 13:11:10.086007 24610 raft_consensus.cc:697] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Becoming Leader. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Running, Role: LEADER
I20260709 13:11:10.086513 24587 tablet_bootstrap.cc:492] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: No bootstrap required, opened a new log
I20260709 13:11:10.087021 24587 ts_tablet_manager.cc:1403] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent bootstrapping tablet: real 0.070s	user 0.026s	sys 0.023s
I20260709 13:11:10.086941 24610 consensus_queue.cc:237] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.089351 24592 leader_election.cc:290] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:10.086774 24512 leader_election.cc:304] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1; no voters: 104401b105224f1e9b05d58be1749d9c
W20260709 13:11:10.090932 24344 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:10.090499 24587 raft_consensus.cc:359] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.091383 24587 raft_consensus.cc:385] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.091324 24597 raft_consensus.cc:2804] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.092226 24597 raft_consensus.cc:493] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.092576 24597 raft_consensus.cc:3060] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.092703 24593 leader_election.cc:290] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:10.098711 24547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faee6f7d44bb40e8afcf691b6ff167f2" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1" is_pre_election: true
I20260709 13:11:10.100514 24587 raft_consensus.cc:740] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.100401 24546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faee6f7d44bb40e8afcf691b6ff167f2" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:10.100446 24597 raft_consensus.cc:515] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.102238 24587 consensus_queue.cc:260] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.105222 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ec318f9304bc08fad059e9895e87c" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:10.105692 24597 leader_election.cc:290] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:10.105995 24397 raft_consensus.cc:3060] T 3b3ec318f9304bc08fad059e9895e87c P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.108040 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ec318f9304bc08fad059e9895e87c" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c"
W20260709 13:11:10.109468 24510 leader_election.cc:343] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.117120 24397 raft_consensus.cc:2468] T 3b3ec318f9304bc08fad059e9895e87c P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 1.
I20260709 13:11:10.118211 24512 leader_election.cc:304] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1; no voters: 104401b105224f1e9b05d58be1749d9c
I20260709 13:11:10.118896 24587 ts_tablet_manager.cc:1434] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.002s
I20260709 13:11:10.118927 24597 raft_consensus.cc:2804] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.120129 24587 tablet_bootstrap.cc:492] T e2eef84f60154cbfb6443c8bd9fe56d3 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Bootstrap starting.
I20260709 13:11:10.120683 24591 tablet_bootstrap.cc:492] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1: No bootstrap required, opened a new log
I20260709 13:11:10.121253 24591 ts_tablet_manager.cc:1403] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1: Time spent bootstrapping tablet: real 0.085s	user 0.014s	sys 0.035s
I20260709 13:11:10.124503 24591 raft_consensus.cc:359] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.128391 24591 raft_consensus.cc:385] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.128749 24591 raft_consensus.cc:740] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.130061 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36cde9868304ce6ba53977484021f63" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c" is_pre_election: true
I20260709 13:11:10.129827 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faee6f7d44bb40e8afcf691b6ff167f2" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:10.130501 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f30fcf9ddb433a95594b906e4b29e5" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c" is_pre_election: true
I20260709 13:11:10.131953 24472 raft_consensus.cc:2468] T c1f30fcf9ddb433a95594b906e4b29e5 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 0.
I20260709 13:11:10.129762 24295 catalog_manager.cc:5697] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "f4717668718a44baada8b0fc4b30cfe1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:10.133035 24361 leader_election.cc:343] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.133733 24588 tablet_bootstrap.cc:492] T 40209789a45a43478a84057bb2f85444 P 104401b105224f1e9b05d58be1749d9c: No bootstrap required, opened a new log
I20260709 13:11:10.133838 24361 leader_election.cc:304] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: 
I20260709 13:11:10.134366 24588 ts_tablet_manager.cc:1403] T 40209789a45a43478a84057bb2f85444 P 104401b105224f1e9b05d58be1749d9c: Time spent bootstrapping tablet: real 0.092s	user 0.013s	sys 0.010s
I20260709 13:11:10.133450 24591 consensus_queue.cc:260] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.134774 24592 raft_consensus.cc:2804] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.139067 24592 raft_consensus.cc:493] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.139559 24592 raft_consensus.cc:3060] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.140933 24591 ts_tablet_manager.cc:1434] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.005s
I20260709 13:11:10.141256 24546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36cde9868304ce6ba53977484021f63" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1" is_pre_election: true
I20260709 13:11:10.142099 24591 tablet_bootstrap.cc:492] T e2eef84f60154cbfb6443c8bd9fe56d3 P f4717668718a44baada8b0fc4b30cfe1: Bootstrap starting.
I20260709 13:11:10.143208 24546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f30fcf9ddb433a95594b906e4b29e5" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1" is_pre_election: true
I20260709 13:11:10.143879 24546 raft_consensus.cc:2468] T c1f30fcf9ddb433a95594b906e4b29e5 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 0.
W20260709 13:11:10.145166 24361 leader_election.cc:343] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.145618 24361 leader_election.cc:304] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: 104401b105224f1e9b05d58be1749d9c, f4717668718a44baada8b0fc4b30cfe1
I20260709 13:11:10.147918 24597 raft_consensus.cc:697] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Becoming Leader. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Running, Role: LEADER
I20260709 13:11:10.148869 24597 consensus_queue.cc:237] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.149226 24592 raft_consensus.cc:515] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.131963 24397 raft_consensus.cc:2393] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 104401b105224f1e9b05d58be1749d9c in current term 1: Already voted for candidate f4717668718a44baada8b0fc4b30cfe1 in this term.
I20260709 13:11:10.135723 24587 tablet_bootstrap.cc:654] T e2eef84f60154cbfb6443c8bd9fe56d3 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.151314 24592 leader_election.cc:290] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 election: Requested vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:10.152410 24592 raft_consensus.cc:2749] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:10.137831 24588 raft_consensus.cc:359] T 40209789a45a43478a84057bb2f85444 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.154953 24588 raft_consensus.cc:385] T 40209789a45a43478a84057bb2f85444 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.155300 24588 raft_consensus.cc:740] T 40209789a45a43478a84057bb2f85444 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.158874 24591 tablet_bootstrap.cc:654] T e2eef84f60154cbfb6443c8bd9fe56d3 P f4717668718a44baada8b0fc4b30cfe1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.158577 24588 consensus_queue.cc:260] T 40209789a45a43478a84057bb2f85444 P 104401b105224f1e9b05d58be1749d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.163807 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f30fcf9ddb433a95594b906e4b29e5" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:10.161988 24587 tablet_bootstrap.cc:492] T e2eef84f60154cbfb6443c8bd9fe56d3 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: No bootstrap required, opened a new log
I20260709 13:11:10.164031 24588 ts_tablet_manager.cc:1434] T 40209789a45a43478a84057bb2f85444 P 104401b105224f1e9b05d58be1749d9c: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.001s
I20260709 13:11:10.164496 24472 raft_consensus.cc:3060] T c1f30fcf9ddb433a95594b906e4b29e5 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.164742 24587 ts_tablet_manager.cc:1403] T e2eef84f60154cbfb6443c8bd9fe56d3 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.004s
I20260709 13:11:10.165315 24588 tablet_bootstrap.cc:492] T bb70e8be13544040a6bef963d1056f29 P 104401b105224f1e9b05d58be1749d9c: Bootstrap starting.
I20260709 13:11:10.168608 24587 raft_consensus.cc:359] T e2eef84f60154cbfb6443c8bd9fe56d3 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.169378 24587 raft_consensus.cc:385] T e2eef84f60154cbfb6443c8bd9fe56d3 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.169713 24587 raft_consensus.cc:740] T e2eef84f60154cbfb6443c8bd9fe56d3 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.170382 24587 consensus_queue.cc:260] T e2eef84f60154cbfb6443c8bd9fe56d3 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.172371 24588 tablet_bootstrap.cc:654] T bb70e8be13544040a6bef963d1056f29 P 104401b105224f1e9b05d58be1749d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.172461 24472 raft_consensus.cc:2468] T c1f30fcf9ddb433a95594b906e4b29e5 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 1.
I20260709 13:11:10.174340 24587 ts_tablet_manager.cc:1434] T e2eef84f60154cbfb6443c8bd9fe56d3 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:11:10.175887 24438 leader_election.cc:304] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c; no voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1
I20260709 13:11:10.175179 24295 catalog_manager.cc:5697] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "f4717668718a44baada8b0fc4b30cfe1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.177136 24593 raft_consensus.cc:2749] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:10.174810 24546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f30fcf9ddb433a95594b906e4b29e5" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:10.177945 24546 raft_consensus.cc:3060] T c1f30fcf9ddb433a95594b906e4b29e5 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.179239 24587 tablet_bootstrap.cc:492] T e7a46359788d4c1688bfff6b39ebb9ba P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Bootstrap starting.
I20260709 13:11:10.180238 24592 raft_consensus.cc:493] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.180817 24592 raft_consensus.cc:515] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.182909 24592 leader_election.cc:290] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:10.191224 24587 tablet_bootstrap.cc:654] T e7a46359788d4c1688bfff6b39ebb9ba P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.191700 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cdb73e8b3f4f0f879a792183a634d7" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c" is_pre_election: true
I20260709 13:11:10.193568 24473 raft_consensus.cc:2468] T a4cdb73e8b3f4f0f879a792183a634d7 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 0.
I20260709 13:11:10.195010 24547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cdb73e8b3f4f0f879a792183a634d7" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1" is_pre_election: true
I20260709 13:11:10.193014 24546 raft_consensus.cc:2468] T c1f30fcf9ddb433a95594b906e4b29e5 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 1.
I20260709 13:11:10.195979 24547 raft_consensus.cc:2468] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 0.
I20260709 13:11:10.197816 24361 leader_election.cc:304] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: 
I20260709 13:11:10.198920 24592 raft_consensus.cc:2804] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.199510 24592 raft_consensus.cc:697] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Becoming Leader. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Running, Role: LEADER
I20260709 13:11:10.200551 24592 consensus_queue.cc:237] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.205524 24361 leader_election.cc:304] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: 
I20260709 13:11:10.208021 24619 raft_consensus.cc:2804] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.208501 24619 raft_consensus.cc:493] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.208895 24619 raft_consensus.cc:3060] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.216687 24593 raft_consensus.cc:493] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.217360 24593 raft_consensus.cc:515] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.221500 24593 leader_election.cc:290] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:10.222245 24546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2eef84f60154cbfb6443c8bd9fe56d3" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1" is_pre_election: true
W20260709 13:11:10.223958 24436 leader_election.cc:343] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.225449 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2eef84f60154cbfb6443c8bd9fe56d3" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" is_pre_election: true
I20260709 13:11:10.226291 24397 raft_consensus.cc:2468] T e2eef84f60154cbfb6443c8bd9fe56d3 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 0.
I20260709 13:11:10.225214 24295 catalog_manager.cc:5697] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b reported cstate change: term changed from 0 to 1, leader changed from <none> to cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129). New cstate: current_term: 1 leader_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.227627 24438 leader_election.cc:304] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: f4717668718a44baada8b0fc4b30cfe1
I20260709 13:11:10.229024 24593 raft_consensus.cc:2804] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.229496 24593 raft_consensus.cc:493] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.229884 24593 raft_consensus.cc:3060] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.231472 24591 tablet_bootstrap.cc:492] T e2eef84f60154cbfb6443c8bd9fe56d3 P f4717668718a44baada8b0fc4b30cfe1: No bootstrap required, opened a new log
I20260709 13:11:10.232081 24591 ts_tablet_manager.cc:1403] T e2eef84f60154cbfb6443c8bd9fe56d3 P f4717668718a44baada8b0fc4b30cfe1: Time spent bootstrapping tablet: real 0.090s	user 0.021s	sys 0.019s
I20260709 13:11:10.235229 24591 raft_consensus.cc:359] T e2eef84f60154cbfb6443c8bd9fe56d3 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.236050 24591 raft_consensus.cc:385] T e2eef84f60154cbfb6443c8bd9fe56d3 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.236335 24588 tablet_bootstrap.cc:492] T bb70e8be13544040a6bef963d1056f29 P 104401b105224f1e9b05d58be1749d9c: No bootstrap required, opened a new log
I20260709 13:11:10.236383 24591 raft_consensus.cc:740] T e2eef84f60154cbfb6443c8bd9fe56d3 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.237154 24593 raft_consensus.cc:515] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.237038 24588 ts_tablet_manager.cc:1403] T bb70e8be13544040a6bef963d1056f29 P 104401b105224f1e9b05d58be1749d9c: Time spent bootstrapping tablet: real 0.072s	user 0.026s	sys 0.036s
I20260709 13:11:10.233225 24619 raft_consensus.cc:515] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.239667 24619 leader_election.cc:290] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 election: Requested vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:10.240581 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2eef84f60154cbfb6443c8bd9fe56d3" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:10.240587 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cdb73e8b3f4f0f879a792183a634d7" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:10.241271 24397 raft_consensus.cc:3060] T e2eef84f60154cbfb6443c8bd9fe56d3 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.241359 24473 raft_consensus.cc:3060] T a4cdb73e8b3f4f0f879a792183a634d7 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.241984 24587 tablet_bootstrap.cc:492] T e7a46359788d4c1688bfff6b39ebb9ba P cb1c3a28d32d452fbc4fdbf43cc1bf7b: No bootstrap required, opened a new log
I20260709 13:11:10.242502 24587 ts_tablet_manager.cc:1403] T e7a46359788d4c1688bfff6b39ebb9ba P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.010s
I20260709 13:11:10.242400 24588 raft_consensus.cc:359] T bb70e8be13544040a6bef963d1056f29 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.243340 24588 raft_consensus.cc:385] T bb70e8be13544040a6bef963d1056f29 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.243719 24588 raft_consensus.cc:740] T bb70e8be13544040a6bef963d1056f29 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.243916 24546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cdb73e8b3f4f0f879a792183a634d7" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:10.244640 24546 raft_consensus.cc:3060] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.244606 24588 consensus_queue.cc:260] T bb70e8be13544040a6bef963d1056f29 P 104401b105224f1e9b05d58be1749d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.245437 24587 raft_consensus.cc:359] T e7a46359788d4c1688bfff6b39ebb9ba P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.246117 24587 raft_consensus.cc:385] T e7a46359788d4c1688bfff6b39ebb9ba P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.246395 24587 raft_consensus.cc:740] T e7a46359788d4c1688bfff6b39ebb9ba P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.247048 24587 consensus_queue.cc:260] T e7a46359788d4c1688bfff6b39ebb9ba P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.248005 24591 consensus_queue.cc:260] T e2eef84f60154cbfb6443c8bd9fe56d3 P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.250372 24591 ts_tablet_manager.cc:1434] T e2eef84f60154cbfb6443c8bd9fe56d3 P f4717668718a44baada8b0fc4b30cfe1: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:11:10.251363 24591 tablet_bootstrap.cc:492] T bb70e8be13544040a6bef963d1056f29 P f4717668718a44baada8b0fc4b30cfe1: Bootstrap starting.
I20260709 13:11:10.248978 24473 raft_consensus.cc:2468] T a4cdb73e8b3f4f0f879a792183a634d7 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 1.
I20260709 13:11:10.256036 24361 leader_election.cc:304] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: 
I20260709 13:11:10.257826 24591 tablet_bootstrap.cc:654] T bb70e8be13544040a6bef963d1056f29 P f4717668718a44baada8b0fc4b30cfe1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.261896 24587 ts_tablet_manager.cc:1434] T e7a46359788d4c1688bfff6b39ebb9ba P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:11:10.264595 24619 raft_consensus.cc:2804] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.265275 24619 raft_consensus.cc:697] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Becoming Leader. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Running, Role: LEADER
I20260709 13:11:10.266391 24619 consensus_queue.cc:237] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.276746 24397 raft_consensus.cc:2468] T e2eef84f60154cbfb6443c8bd9fe56d3 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 1.
I20260709 13:11:10.278328 24438 leader_election.cc:304] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: 
I20260709 13:11:10.282135 24547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2eef84f60154cbfb6443c8bd9fe56d3" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:10.282876 24547 raft_consensus.cc:3060] T e2eef84f60154cbfb6443c8bd9fe56d3 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.285279 24592 raft_consensus.cc:493] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.285530 24631 raft_consensus.cc:2804] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.286042 24631 raft_consensus.cc:697] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c [term 1 LEADER]: Becoming Leader. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Running, Role: LEADER
I20260709 13:11:10.285867 24592 raft_consensus.cc:515] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.288239 24592 leader_election.cc:290] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:10.286939 24631 consensus_queue.cc:237] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.293681 24294 catalog_manager.cc:5697] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b reported cstate change: term changed from 0 to 1, leader changed from <none> to cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129). New cstate: current_term: 1 leader_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.301059 24545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb70e8be13544040a6bef963d1056f29" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1" is_pre_election: true
I20260709 13:11:10.295109 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb70e8be13544040a6bef963d1056f29" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c" is_pre_election: true
I20260709 13:11:10.303066 24473 raft_consensus.cc:2468] T bb70e8be13544040a6bef963d1056f29 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 0.
I20260709 13:11:10.303879 24546 raft_consensus.cc:2468] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 1.
W20260709 13:11:10.305540 24361 leader_election.cc:343] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.307101 24361 leader_election.cc:304] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: f4717668718a44baada8b0fc4b30cfe1
I20260709 13:11:10.308132 24619 raft_consensus.cc:2804] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.308575 24619 raft_consensus.cc:493] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.308970 24619 raft_consensus.cc:3060] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.319931 24619 raft_consensus.cc:515] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.298918 24547 raft_consensus.cc:2468] T e2eef84f60154cbfb6443c8bd9fe56d3 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 1.
I20260709 13:11:10.321470 24593 leader_election.cc:290] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:10.321579 24588 ts_tablet_manager.cc:1434] T bb70e8be13544040a6bef963d1056f29 P 104401b105224f1e9b05d58be1749d9c: Time spent starting tablet: real 0.083s	user 0.026s	sys 0.033s
I20260709 13:11:10.323542 24619 leader_election.cc:290] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 election: Requested vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:10.323655 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb70e8be13544040a6bef963d1056f29" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:10.324087 24591 tablet_bootstrap.cc:492] T bb70e8be13544040a6bef963d1056f29 P f4717668718a44baada8b0fc4b30cfe1: No bootstrap required, opened a new log
I20260709 13:11:10.324314 24473 raft_consensus.cc:3060] T bb70e8be13544040a6bef963d1056f29 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.324774 24591 ts_tablet_manager.cc:1403] T bb70e8be13544040a6bef963d1056f29 P f4717668718a44baada8b0fc4b30cfe1: Time spent bootstrapping tablet: real 0.074s	user 0.028s	sys 0.041s
I20260709 13:11:10.325415 24547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb70e8be13544040a6bef963d1056f29" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:10.326182 24588 tablet_bootstrap.cc:492] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c: Bootstrap starting.
W20260709 13:11:10.327564 24361 leader_election.cc:343] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.328040 24591 raft_consensus.cc:359] T bb70e8be13544040a6bef963d1056f29 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.328825 24591 raft_consensus.cc:385] T bb70e8be13544040a6bef963d1056f29 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.329116 24591 raft_consensus.cc:740] T bb70e8be13544040a6bef963d1056f29 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.329908 24591 consensus_queue.cc:260] T bb70e8be13544040a6bef963d1056f29 P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.330660 24473 raft_consensus.cc:2468] T bb70e8be13544040a6bef963d1056f29 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 1.
I20260709 13:11:10.332257 24591 ts_tablet_manager.cc:1434] T bb70e8be13544040a6bef963d1056f29 P f4717668718a44baada8b0fc4b30cfe1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:11:10.333324 24591 tablet_bootstrap.cc:492] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1: Bootstrap starting.
I20260709 13:11:10.333411 24588 tablet_bootstrap.cc:654] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.336954 24597 raft_consensus.cc:493] T bb70e8be13544040a6bef963d1056f29 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.337498 24597 raft_consensus.cc:515] T bb70e8be13544040a6bef963d1056f29 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.338606 24295 catalog_manager.cc:5697] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 104401b105224f1e9b05d58be1749d9c (127.12.76.130). New cstate: current_term: 1 leader_uuid: "104401b105224f1e9b05d58be1749d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.341970 24591 tablet_bootstrap.cc:654] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.345592 24597 leader_election.cc:290] T bb70e8be13544040a6bef963d1056f29 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:10.346196 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb70e8be13544040a6bef963d1056f29" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c" is_pre_election: true
I20260709 13:11:10.347019 24472 raft_consensus.cc:2393] T bb70e8be13544040a6bef963d1056f29 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4717668718a44baada8b0fc4b30cfe1 in current term 1: Already voted for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in this term.
I20260709 13:11:10.347038 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb70e8be13544040a6bef963d1056f29" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" is_pre_election: true
I20260709 13:11:10.350087 24397 raft_consensus.cc:2393] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4717668718a44baada8b0fc4b30cfe1 in current term 1: Already voted for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in this term.
I20260709 13:11:10.351270 24512 leader_election.cc:304] T bb70e8be13544040a6bef963d1056f29 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4717668718a44baada8b0fc4b30cfe1; no voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b
I20260709 13:11:10.352537 24597 raft_consensus.cc:3060] T bb70e8be13544040a6bef963d1056f29 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.358762 24361 leader_election.cc:304] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: f4717668718a44baada8b0fc4b30cfe1
I20260709 13:11:10.361052 24619 raft_consensus.cc:2804] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.362671 24619 raft_consensus.cc:697] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Becoming Leader. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Running, Role: LEADER
I20260709 13:11:10.363761 24619 consensus_queue.cc:237] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.362939 24588 tablet_bootstrap.cc:492] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c: No bootstrap required, opened a new log
I20260709 13:11:10.364837 24588 ts_tablet_manager.cc:1403] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.016s
I20260709 13:11:10.365713 24591 tablet_bootstrap.cc:492] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1: No bootstrap required, opened a new log
I20260709 13:11:10.366266 24591 ts_tablet_manager.cc:1403] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.015s
I20260709 13:11:10.366658 24597 raft_consensus.cc:2749] T bb70e8be13544040a6bef963d1056f29 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:10.367789 24588 raft_consensus.cc:359] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.368399 24588 raft_consensus.cc:385] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.368666 24588 raft_consensus.cc:740] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.369360 24588 consensus_queue.cc:260] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.370249 24591 raft_consensus.cc:359] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.370967 24591 raft_consensus.cc:385] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.371258 24591 raft_consensus.cc:740] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.371459 24588 ts_tablet_manager.cc:1434] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:11:10.372424 24588 tablet_bootstrap.cc:492] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c: Bootstrap starting.
I20260709 13:11:10.372061 24591 consensus_queue.cc:260] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.374912 24591 ts_tablet_manager.cc:1434] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:10.376118 24591 tablet_bootstrap.cc:492] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1: Bootstrap starting.
I20260709 13:11:10.379873 24588 tablet_bootstrap.cc:654] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.382990 24591 tablet_bootstrap.cc:654] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.388178 24296 catalog_manager.cc:5697] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b reported cstate change: term changed from 0 to 1, leader changed from <none> to cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129). New cstate: current_term: 1 leader_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.405579 24588 tablet_bootstrap.cc:492] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c: No bootstrap required, opened a new log
I20260709 13:11:10.405599 24591 tablet_bootstrap.cc:492] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1: No bootstrap required, opened a new log
I20260709 13:11:10.406349 24588 ts_tablet_manager.cc:1403] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.013s
I20260709 13:11:10.406376 24591 ts_tablet_manager.cc:1403] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.011s
I20260709 13:11:10.409473 24588 raft_consensus.cc:359] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.409613 24591 raft_consensus.cc:359] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.410180 24588 raft_consensus.cc:385] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.410264 24591 raft_consensus.cc:385] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.410527 24588 raft_consensus.cc:740] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.410571 24591 raft_consensus.cc:740] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.411312 24591 consensus_queue.cc:260] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.411312 24588 consensus_queue.cc:260] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.413365 24591 ts_tablet_manager.cc:1434] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:11:10.413373 24588 ts_tablet_manager.cc:1434] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:10.414397 24591 tablet_bootstrap.cc:492] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1: Bootstrap starting.
I20260709 13:11:10.414399 24588 tablet_bootstrap.cc:492] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c: Bootstrap starting.
I20260709 13:11:10.420782 24588 tablet_bootstrap.cc:654] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.420782 24591 tablet_bootstrap.cc:654] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.426223 24617 raft_consensus.cc:493] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.426652 24617 raft_consensus.cc:515] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.428519 24617 leader_election.cc:290] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:10.428958 24617 raft_consensus.cc:493] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.429239 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36cde9868304ce6ba53977484021f63" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" is_pre_election: true
I20260709 13:11:10.429374 24617 raft_consensus.cc:515] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.429977 24397 raft_consensus.cc:2468] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 0.
I20260709 13:11:10.432106 24512 leader_election.cc:304] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:10.432950 24610 raft_consensus.cc:2804] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.433131 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36cde9868304ce6ba53977484021f63" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c" is_pre_election: true
I20260709 13:11:10.433836 24473 raft_consensus.cc:2468] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 0.
I20260709 13:11:10.433987 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40209789a45a43478a84057bb2f85444" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" is_pre_election: true
I20260709 13:11:10.434671 24397 raft_consensus.cc:2468] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 0.
I20260709 13:11:10.434890 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40209789a45a43478a84057bb2f85444" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c" is_pre_election: true
I20260709 13:11:10.435570 24472 raft_consensus.cc:2468] T 40209789a45a43478a84057bb2f85444 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 0.
I20260709 13:11:10.435797 24619 raft_consensus.cc:493] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.433324 24610 raft_consensus.cc:493] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.436379 24610 raft_consensus.cc:3060] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.436291 24619 raft_consensus.cc:515] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.438421 24619 leader_election.cc:290] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:10.440686 24547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40209789a45a43478a84057bb2f85444" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1" is_pre_election: true
I20260709 13:11:10.440779 24512 leader_election.cc:304] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:10.441890 24547 raft_consensus.cc:2468] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 0.
I20260709 13:11:10.441458 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40209789a45a43478a84057bb2f85444" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c" is_pre_election: true
I20260709 13:11:10.444089 24472 raft_consensus.cc:2468] T 40209789a45a43478a84057bb2f85444 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 0.
I20260709 13:11:10.444854 24361 leader_election.cc:304] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:10.446360 24619 raft_consensus.cc:2804] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.446801 24619 raft_consensus.cc:493] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.447193 24619 raft_consensus.cc:3060] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.448088 24617 leader_election.cc:290] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:10.448972 24617 raft_consensus.cc:2804] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.449324 24617 raft_consensus.cc:493] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.449651 24617 raft_consensus.cc:3060] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.455600 24619 raft_consensus.cc:515] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.458684 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40209789a45a43478a84057bb2f85444" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:10.459280 24472 raft_consensus.cc:3060] T 40209789a45a43478a84057bb2f85444 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.459581 24547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40209789a45a43478a84057bb2f85444" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:10.460391 24619 leader_election.cc:290] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 election: Requested vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:10.465399 24472 raft_consensus.cc:2468] T 40209789a45a43478a84057bb2f85444 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 1.
I20260709 13:11:10.465531 24610 raft_consensus.cc:515] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.466825 24361 leader_election.cc:304] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: 
I20260709 13:11:10.468111 24619 raft_consensus.cc:2804] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.468799 24619 raft_consensus.cc:697] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Becoming Leader. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Running, Role: LEADER
I20260709 13:11:10.469615 24619 consensus_queue.cc:237] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.472543 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36cde9868304ce6ba53977484021f63" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:10.473147 24397 raft_consensus.cc:3060] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.474982 24610 leader_election.cc:290] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:10.480541 24591 tablet_bootstrap.cc:492] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1: No bootstrap required, opened a new log
I20260709 13:11:10.481068 24591 ts_tablet_manager.cc:1403] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1: Time spent bootstrapping tablet: real 0.067s	user 0.048s	sys 0.007s
I20260709 13:11:10.483251 24591 raft_consensus.cc:359] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.482965 24296 catalog_manager.cc:5697] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b reported cstate change: term changed from 0 to 1, leader changed from <none> to cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129). New cstate: current_term: 1 leader_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.484048 24591 raft_consensus.cc:385] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.483927 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36cde9868304ce6ba53977484021f63" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:10.484473 24591 raft_consensus.cc:740] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.484889 24472 raft_consensus.cc:3060] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.485287 24397 raft_consensus.cc:2468] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 1.
I20260709 13:11:10.485371 24591 consensus_queue.cc:260] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.486608 24512 leader_election.cc:304] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:10.487213 24591 ts_tablet_manager.cc:1434] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:11:10.487742 24597 raft_consensus.cc:2804] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.488242 24597 raft_consensus.cc:697] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Becoming Leader. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Running, Role: LEADER
I20260709 13:11:10.489048 24597 consensus_queue.cc:237] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.492915 24472 raft_consensus.cc:2468] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 1.
I20260709 13:11:10.470798 24617 raft_consensus.cc:515] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.494949 24588 tablet_bootstrap.cc:492] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c: No bootstrap required, opened a new log
I20260709 13:11:10.496428 24588 ts_tablet_manager.cc:1403] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c: Time spent bootstrapping tablet: real 0.082s	user 0.034s	sys 0.029s
I20260709 13:11:10.495976 24547 raft_consensus.cc:2393] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in current term 1: Already voted for candidate f4717668718a44baada8b0fc4b30cfe1 in this term.
I20260709 13:11:10.499402 24588 raft_consensus.cc:359] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.500223 24588 raft_consensus.cc:385] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.500545 24588 raft_consensus.cc:740] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.501461 24588 consensus_queue.cc:260] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.502691 24617 leader_election.cc:290] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:10.502806 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40209789a45a43478a84057bb2f85444" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:10.504010 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40209789a45a43478a84057bb2f85444" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:10.504834 24472 raft_consensus.cc:2393] T 40209789a45a43478a84057bb2f85444 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f4717668718a44baada8b0fc4b30cfe1 in current term 1: Already voted for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in this term.
I20260709 13:11:10.506031 24588 ts_tablet_manager.cc:1434] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:11:10.506322 24510 leader_election.cc:304] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4717668718a44baada8b0fc4b30cfe1; no voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b
I20260709 13:11:10.507275 24617 raft_consensus.cc:2749] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:10.509750 24296 catalog_manager.cc:5697] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "f4717668718a44baada8b0fc4b30cfe1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.546531 24472 raft_consensus.cc:3060] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.552752 24617 consensus_queue.cc:1048] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.564359 24597 consensus_queue.cc:1048] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.568444 24597 consensus_queue.cc:1048] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.585000 24617 consensus_queue.cc:1048] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.628973 24619 consensus_queue.cc:1048] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.640456 24650 consensus_queue.cc:1048] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:10.672009 24617 raft_consensus.cc:493] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.672595 24617 raft_consensus.cc:515] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.674762 24617 leader_election.cc:290] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:10.675611 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a46359788d4c1688bfff6b39ebb9ba" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" is_pre_election: true
I20260709 13:11:10.675769 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a46359788d4c1688bfff6b39ebb9ba" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c" is_pre_election: true
I20260709 13:11:10.676213 24397 raft_consensus.cc:2468] T e7a46359788d4c1688bfff6b39ebb9ba P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 0.
I20260709 13:11:10.676472 24472 raft_consensus.cc:2468] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 0.
I20260709 13:11:10.677199 24512 leader_election.cc:304] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:10.677977 24617 raft_consensus.cc:2804] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.678326 24617 raft_consensus.cc:493] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.678544 24617 raft_consensus.cc:3060] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.683842 24617 raft_consensus.cc:515] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.685547 24617 leader_election.cc:290] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:10.686203 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a46359788d4c1688bfff6b39ebb9ba" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:10.686455 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a46359788d4c1688bfff6b39ebb9ba" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:10.686764 24397 raft_consensus.cc:3060] T e7a46359788d4c1688bfff6b39ebb9ba P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.687004 24472 raft_consensus.cc:3060] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.692142 24397 raft_consensus.cc:2468] T e7a46359788d4c1688bfff6b39ebb9ba P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 1.
I20260709 13:11:10.692350 24472 raft_consensus.cc:2468] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 1.
I20260709 13:11:10.693192 24512 leader_election.cc:304] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:10.694059 24617 raft_consensus.cc:2804] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.694535 24617 raft_consensus.cc:697] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Becoming Leader. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Running, Role: LEADER
I20260709 13:11:10.695147 24617 consensus_queue.cc:237] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.702435 24295 catalog_manager.cc:5697] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "f4717668718a44baada8b0fc4b30cfe1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.737247 24650 consensus_queue.cc:1048] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.747299 24592 consensus_queue.cc:1048] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.768210 24547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "faee6f7d44bb40e8afcf691b6ff167f2"
dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
mode: GRACEFUL
new_leader_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
 from {username='slave'} at 127.0.0.1:52100
I20260709 13:11:10.768908 24547 raft_consensus.cc:606] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Received request to transfer leadership to TS cb1c3a28d32d452fbc4fdbf43cc1bf7b
I20260709 13:11:10.771517 24628 consensus_queue.cc:1048] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.783072 24628 consensus_queue.cc:1048] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.787971 24546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7a46359788d4c1688bfff6b39ebb9ba"
dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
mode: GRACEFUL
new_leader_uuid: "104401b105224f1e9b05d58be1749d9c"
 from {username='slave'} at 127.0.0.1:52100
I20260709 13:11:10.788612 24546 raft_consensus.cc:606] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Received request to transfer leadership to TS 104401b105224f1e9b05d58be1749d9c
I20260709 13:11:10.794721 24547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b3ec318f9304bc08fad059e9895e87c"
dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
mode: GRACEFUL
new_leader_uuid: "104401b105224f1e9b05d58be1749d9c"
 from {username='slave'} at 127.0.0.1:52100
I20260709 13:11:10.795261 24547 raft_consensus.cc:606] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Received request to transfer leadership to TS 104401b105224f1e9b05d58be1749d9c
I20260709 13:11:10.803380 24547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f36cde9868304ce6ba53977484021f63"
dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
mode: GRACEFUL
new_leader_uuid: "104401b105224f1e9b05d58be1749d9c"
 from {username='slave'} at 127.0.0.1:52100
I20260709 13:11:10.803867 24547 raft_consensus.cc:606] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Received request to transfer leadership to TS 104401b105224f1e9b05d58be1749d9c
I20260709 13:11:10.810073 24592 consensus_queue.cc:1048] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.821990 24397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4cdb73e8b3f4f0f879a792183a634d7"
dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
mode: GRACEFUL
new_leader_uuid: "f4717668718a44baada8b0fc4b30cfe1"
 from {username='slave'} at 127.0.0.1:40042
I20260709 13:11:10.822084 24619 consensus_queue.cc:1048] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.822619 24397 raft_consensus.cc:606] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Received request to transfer leadership to TS f4717668718a44baada8b0fc4b30cfe1
I20260709 13:11:10.919104 24617 consensus_queue.cc:1048] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.925086 24610 raft_consensus.cc:993] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1: : Instructing follower 104401b105224f1e9b05d58be1749d9c to start an election
I20260709 13:11:10.925595 24610 raft_consensus.cc:1081] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Signalling peer 104401b105224f1e9b05d58be1749d9c to start an election
I20260709 13:11:10.927273 24473 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f36cde9868304ce6ba53977484021f63"
dest_uuid: "104401b105224f1e9b05d58be1749d9c"
 from {username='slave'} at 127.0.0.1:43968
I20260709 13:11:10.928399 24473 raft_consensus.cc:493] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:10.928786 24473 raft_consensus.cc:3060] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:10.930756 24617 consensus_queue.cc:1048] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.936918 24473 raft_consensus.cc:515] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.939107 24473 leader_election.cc:290] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 2 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:10.939956 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36cde9868304ce6ba53977484021f63" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:10.940653 24397 raft_consensus.cc:3060] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:10.941047 24547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36cde9868304ce6ba53977484021f63" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:10.941674 24547 raft_consensus.cc:3055] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:10.942039 24547 raft_consensus.cc:740] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Running, Role: LEADER
I20260709 13:11:10.942821 24547 consensus_queue.cc:260] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.944094 24547 raft_consensus.cc:3060] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:10.948143 24397 raft_consensus.cc:2468] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 2.
I20260709 13:11:10.949366 24438 leader_election.cc:304] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: 
I20260709 13:11:10.950169 24628 raft_consensus.cc:2804] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:10.950697 24628 raft_consensus.cc:697] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c [term 2 LEADER]: Becoming Leader. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Running, Role: LEADER
I20260709 13:11:10.951201 24547 raft_consensus.cc:2468] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 2.
I20260709 13:11:10.951578 24628 consensus_queue.cc:237] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:10.957991 24295 catalog_manager.cc:5697] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c reported cstate change: term changed from 1 to 2, leader changed from f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131) to 104401b105224f1e9b05d58be1749d9c (127.12.76.130). New cstate: current_term: 2 leader_uuid: "104401b105224f1e9b05d58be1749d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:11.030838 24619 consensus_queue.cc:1048] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:11.042225 24650 consensus_queue.cc:1048] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:11.159031 24650 raft_consensus.cc:993] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: : Instructing follower f4717668718a44baada8b0fc4b30cfe1 to start an election
I20260709 13:11:11.159548 24592 raft_consensus.cc:1081] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Signalling peer f4717668718a44baada8b0fc4b30cfe1 to start an election
I20260709 13:11:11.161036 24547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4cdb73e8b3f4f0f879a792183a634d7"
dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
 from {username='slave'} at 127.0.0.1:40818
I20260709 13:11:11.161527 24547 raft_consensus.cc:493] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:11.161834 24547 raft_consensus.cc:3060] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.166692 24547 raft_consensus.cc:515] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:11.168251 24547 leader_election.cc:290] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 2 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:11.169014 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cdb73e8b3f4f0f879a792183a634d7" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:11.169209 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cdb73e8b3f4f0f879a792183a634d7" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:11.169721 24397 raft_consensus.cc:3055] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:11.169845 24473 raft_consensus.cc:3060] T a4cdb73e8b3f4f0f879a792183a634d7 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.170063 24397 raft_consensus.cc:740] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Running, Role: LEADER
I20260709 13:11:11.170917 24397 consensus_queue.cc:260] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:11.171914 24397 raft_consensus.cc:3060] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.174865 24473 raft_consensus.cc:2468] T a4cdb73e8b3f4f0f879a792183a634d7 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 2.
I20260709 13:11:11.175978 24510 leader_election.cc:304] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:11.176676 24617 raft_consensus.cc:2804] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:11.176751 24397 raft_consensus.cc:2468] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 2.
I20260709 13:11:11.177197 24617 raft_consensus.cc:697] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1 [term 2 LEADER]: Becoming Leader. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Running, Role: LEADER
I20260709 13:11:11.178030 24617 consensus_queue.cc:237] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:11.184791 24597 raft_consensus.cc:993] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1: : Instructing follower 104401b105224f1e9b05d58be1749d9c to start an election
I20260709 13:11:11.185241 24617 raft_consensus.cc:1081] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Signalling peer 104401b105224f1e9b05d58be1749d9c to start an election
I20260709 13:11:11.184820 24293 catalog_manager.cc:5697] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1 reported cstate change: term changed from 1 to 2, leader changed from cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129) to f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131). New cstate: current_term: 2 leader_uuid: "f4717668718a44baada8b0fc4b30cfe1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:11.186820 24473 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b3ec318f9304bc08fad059e9895e87c"
dest_uuid: "104401b105224f1e9b05d58be1749d9c"
 from {username='slave'} at 127.0.0.1:43968
I20260709 13:11:11.187264 24473 raft_consensus.cc:493] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:11.187654 24473 raft_consensus.cc:3060] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.193826 24473 raft_consensus.cc:515] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:11.195741 24473 leader_election.cc:290] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 2 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:11.196457 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ec318f9304bc08fad059e9895e87c" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:11.196870 24547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ec318f9304bc08fad059e9895e87c" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:11.197108 24397 raft_consensus.cc:3060] T 3b3ec318f9304bc08fad059e9895e87c P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.197476 24547 raft_consensus.cc:3055] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:11.197810 24547 raft_consensus.cc:740] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Running, Role: LEADER
I20260709 13:11:11.198625 24547 consensus_queue.cc:260] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:11.199880 24547 raft_consensus.cc:3060] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.204305 24397 raft_consensus.cc:2468] T 3b3ec318f9304bc08fad059e9895e87c P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 2.
I20260709 13:11:11.205551 24438 leader_election.cc:304] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: 
I20260709 13:11:11.206382 24610 raft_consensus.cc:993] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1: : Instructing follower cb1c3a28d32d452fbc4fdbf43cc1bf7b to start an election
I20260709 13:11:11.206840 24610 raft_consensus.cc:1081] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Signalling peer cb1c3a28d32d452fbc4fdbf43cc1bf7b to start an election
I20260709 13:11:11.207032 24547 raft_consensus.cc:2468] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 2.
I20260709 13:11:11.206421 24628 raft_consensus.cc:2804] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:11.208024 24628 raft_consensus.cc:697] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c [term 2 LEADER]: Becoming Leader. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Running, Role: LEADER
I20260709 13:11:11.208841 24628 consensus_queue.cc:237] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:11.209471 24397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "faee6f7d44bb40e8afcf691b6ff167f2"
dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
 from {username='slave'} at 127.0.0.1:46816
I20260709 13:11:11.210084 24397 raft_consensus.cc:493] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:11.210456 24397 raft_consensus.cc:3060] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.211498 24617 consensus_queue.cc:1048] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:11.215934 24597 consensus_queue.cc:1048] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:11.216858 24293 catalog_manager.cc:5697] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c reported cstate change: term changed from 1 to 2, leader changed from f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131) to 104401b105224f1e9b05d58be1749d9c (127.12.76.130). New cstate: current_term: 2 leader_uuid: "104401b105224f1e9b05d58be1749d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:11.217586 24397 raft_consensus.cc:515] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:11.219619 24397 leader_election.cc:290] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 2 election: Requested vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:11.221019 24547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faee6f7d44bb40e8afcf691b6ff167f2" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:11.221622 24547 raft_consensus.cc:3055] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:11.221930 24547 raft_consensus.cc:740] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Running, Role: LEADER
I20260709 13:11:11.222725 24547 consensus_queue.cc:260] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:11.223915 24472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faee6f7d44bb40e8afcf691b6ff167f2" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:11.224093 24547 raft_consensus.cc:3060] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.224536 24472 raft_consensus.cc:3060] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.227598 24610 raft_consensus.cc:993] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1: : Instructing follower 104401b105224f1e9b05d58be1749d9c to start an election
I20260709 13:11:11.228050 24610 raft_consensus.cc:1081] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Signalling peer 104401b105224f1e9b05d58be1749d9c to start an election
I20260709 13:11:11.230763 24471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7a46359788d4c1688bfff6b39ebb9ba"
dest_uuid: "104401b105224f1e9b05d58be1749d9c"
 from {username='slave'} at 127.0.0.1:43968
I20260709 13:11:11.231334 24471 raft_consensus.cc:493] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:11.231528 24547 raft_consensus.cc:2468] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 2.
I20260709 13:11:11.231717 24471 raft_consensus.cc:3060] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.232199 24472 raft_consensus.cc:2468] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 2.
I20260709 13:11:11.232774 24361 leader_election.cc:304] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:11.233677 24619 raft_consensus.cc:2804] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:11.234130 24619 raft_consensus.cc:697] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 LEADER]: Becoming Leader. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Running, Role: LEADER
I20260709 13:11:11.234921 24619 consensus_queue.cc:237] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:11.239223 24471 raft_consensus.cc:515] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:11.240221 24473 raft_consensus.cc:1240] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Rejecting Update request from peer f4717668718a44baada8b0fc4b30cfe1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:11.242063 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a46359788d4c1688bfff6b39ebb9ba" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:11.244288 24617 consensus_queue.cc:1059] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:11.245105 24471 leader_election.cc:290] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 2 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:11.245246 24610 raft_consensus.cc:3055] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:11.245622 24610 raft_consensus.cc:740] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Running, Role: LEADER
I20260709 13:11:11.246440 24610 consensus_queue.cc:260] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:11.247335 24610 raft_consensus.cc:3060] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.248586 24547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a46359788d4c1688bfff6b39ebb9ba" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:11.259306 24547 raft_consensus.cc:2468] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 2.
I20260709 13:11:11.259923 24295 catalog_manager.cc:5697] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b reported cstate change: term changed from 1 to 2, leader changed from f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131) to cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129). New cstate: current_term: 2 leader_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:11.260731 24436 leader_election.cc:304] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, f4717668718a44baada8b0fc4b30cfe1; no voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b
I20260709 13:11:11.261484 24628 raft_consensus.cc:2804] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:11.261976 24628 raft_consensus.cc:697] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [term 2 LEADER]: Becoming Leader. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Running, Role: LEADER
I20260709 13:11:11.262748 24628 consensus_queue.cc:237] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:11.272593 24293 catalog_manager.cc:5697] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c reported cstate change: term changed from 1 to 2, leader changed from f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131) to 104401b105224f1e9b05d58be1749d9c (127.12.76.130). New cstate: current_term: 2 leader_uuid: "104401b105224f1e9b05d58be1749d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:11.457794 24398 raft_consensus.cc:1275] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Refusing update from remote peer 104401b105224f1e9b05d58be1749d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:11.459059 24593 consensus_queue.cc:1048] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:11.468389 24546 raft_consensus.cc:1275] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Refusing update from remote peer 104401b105224f1e9b05d58be1749d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:11.469878 24628 consensus_queue.cc:1048] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:11.579559 24471 raft_consensus.cc:1275] T a4cdb73e8b3f4f0f879a792183a634d7 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Refusing update from remote peer f4717668718a44baada8b0fc4b30cfe1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:11.580891 24610 consensus_queue.cc:1048] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:11.589834 24398 raft_consensus.cc:1275] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Refusing update from remote peer f4717668718a44baada8b0fc4b30cfe1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:11.591557 24617 consensus_queue.cc:1048] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:11.615823 24471 raft_consensus.cc:1275] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Refusing update from remote peer cb1c3a28d32d452fbc4fdbf43cc1bf7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:11.615903 24546 raft_consensus.cc:1275] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Refusing update from remote peer 104401b105224f1e9b05d58be1749d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:11.617287 24592 consensus_queue.cc:1048] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:11.617347 24628 consensus_queue.cc:1048] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:11.628134 24546 raft_consensus.cc:1275] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Refusing update from remote peer cb1c3a28d32d452fbc4fdbf43cc1bf7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:11.629657 24398 raft_consensus.cc:1275] T 3b3ec318f9304bc08fad059e9895e87c P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Refusing update from remote peer 104401b105224f1e9b05d58be1749d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:11.630656 24619 consensus_queue.cc:1048] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:11.631263 24593 consensus_queue.cc:1048] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:11.772830 24398 raft_consensus.cc:3060] T e7a46359788d4c1688bfff6b39ebb9ba P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.779181 24398 raft_consensus.cc:1275] T e7a46359788d4c1688bfff6b39ebb9ba P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Refusing update from remote peer 104401b105224f1e9b05d58be1749d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:11.780875 24593 consensus_queue.cc:1048] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:11.789186 24547 raft_consensus.cc:1275] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Refusing update from remote peer 104401b105224f1e9b05d58be1749d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:11.793778 24593 consensus_queue.cc:1048] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:13.849040 24295 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51008:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:13.851186 24295 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:13.898994 24384 tablet_service.cc:1511] Processing CreateTablet for tablet 49d6d03206a0410aa73ce2a90384d519 (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:13.900352 24384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49d6d03206a0410aa73ce2a90384d519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:13.900116 24458 tablet_service.cc:1511] Processing CreateTablet for tablet 49d6d03206a0410aa73ce2a90384d519 (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:13.901434 24458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49d6d03206a0410aa73ce2a90384d519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:13.902010 24533 tablet_service.cc:1511] Processing CreateTablet for tablet 49d6d03206a0410aa73ce2a90384d519 (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:13.903225 24533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49d6d03206a0410aa73ce2a90384d519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:13.907217 24459 tablet_service.cc:1511] Processing CreateTablet for tablet 417e26d295ef405584514341f5a6bd21 (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:13.908571 24459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 417e26d295ef405584514341f5a6bd21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:13.911194 24535 tablet_service.cc:1511] Processing CreateTablet for tablet 417e26d295ef405584514341f5a6bd21 (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:13.912529 24535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 417e26d295ef405584514341f5a6bd21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:13.913993 24460 tablet_service.cc:1511] Processing CreateTablet for tablet 853da295b17940229be236438a3d75a9 (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:13.914623 24461 tablet_service.cc:1511] Processing CreateTablet for tablet 465329cb805e4e7fba15939cecd9759e (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:13.916356 24534 tablet_service.cc:1511] Processing CreateTablet for tablet 853da295b17940229be236438a3d75a9 (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:13.916694 24381 tablet_service.cc:1511] Processing CreateTablet for tablet 417e26d295ef405584514341f5a6bd21 (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:13.917668 24534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 853da295b17940229be236438a3d75a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:13.917999 24381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 417e26d295ef405584514341f5a6bd21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:13.918864 24382 tablet_service.cc:1511] Processing CreateTablet for tablet 7b164bcf2be54c5a84127382df5c2365 (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:13.920092 24382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b164bcf2be54c5a84127382df5c2365. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:13.916356 24456 tablet_service.cc:1511] Processing CreateTablet for tablet 7b164bcf2be54c5a84127382df5c2365 (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:13.924044 24386 tablet_service.cc:1511] Processing CreateTablet for tablet 853da295b17940229be236438a3d75a9 (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:13.915292 24460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 853da295b17940229be236438a3d75a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:13.925240 24386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 853da295b17940229be236438a3d75a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:13.925400 24461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 465329cb805e4e7fba15939cecd9759e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:13.927493 24456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b164bcf2be54c5a84127382df5c2365. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:13.928514 24385 tablet_service.cc:1511] Processing CreateTablet for tablet 465329cb805e4e7fba15939cecd9759e (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:13.929771 24385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 465329cb805e4e7fba15939cecd9759e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:13.917336 24530 tablet_service.cc:1511] Processing CreateTablet for tablet 7b164bcf2be54c5a84127382df5c2365 (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:13.932677 24530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b164bcf2be54c5a84127382df5c2365. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:13.935756 24531 tablet_service.cc:1511] Processing CreateTablet for tablet 465329cb805e4e7fba15939cecd9759e (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:13.937088 24531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 465329cb805e4e7fba15939cecd9759e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:13.950723 24380 tablet_service.cc:1511] Processing CreateTablet for tablet 19b1fd5922b448ebbf580bca848ac864 (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:13.952153 24380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b1fd5922b448ebbf580bca848ac864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:13.957569 24455 tablet_service.cc:1511] Processing CreateTablet for tablet 19b1fd5922b448ebbf580bca848ac864 (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:13.958976 24455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b1fd5922b448ebbf580bca848ac864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:13.962384 24536 tablet_service.cc:1511] Processing CreateTablet for tablet 19b1fd5922b448ebbf580bca848ac864 (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:13.963814 24536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b1fd5922b448ebbf580bca848ac864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:13.963898 24388 tablet_service.cc:1511] Processing CreateTablet for tablet bbfb443d80634ca48fe563786c4df46d (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:13.965257 24388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbfb443d80634ca48fe563786c4df46d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:13.974802 24462 tablet_service.cc:1511] Processing CreateTablet for tablet bbfb443d80634ca48fe563786c4df46d (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:13.976212 24462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbfb443d80634ca48fe563786c4df46d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:13.977250 24387 tablet_service.cc:1511] Processing CreateTablet for tablet 33faf243a678428d85bee175371e7bd0 (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:13.978542 24387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33faf243a678428d85bee175371e7bd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:13.979293 24457 tablet_service.cc:1511] Processing CreateTablet for tablet 33faf243a678428d85bee175371e7bd0 (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:13.980144 24531 tablet_service.cc:1511] Processing CreateTablet for tablet bbfb443d80634ca48fe563786c4df46d (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:13.980599 24457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33faf243a678428d85bee175371e7bd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:13.980429 24529 tablet_service.cc:1511] Processing CreateTablet for tablet 33faf243a678428d85bee175371e7bd0 (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:13.981716 24529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33faf243a678428d85bee175371e7bd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:14.008919 24537 tablet_service.cc:1511] Processing CreateTablet for tablet 263d149907bb4478a4af8c412649244a (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:14.010282 24537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 263d149907bb4478a4af8c412649244a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:14.011669 24463 tablet_service.cc:1511] Processing CreateTablet for tablet 263d149907bb4478a4af8c412649244a (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:14.012228 24531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbfb443d80634ca48fe563786c4df46d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:14.012928 24463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 263d149907bb4478a4af8c412649244a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:14.015398 24383 tablet_service.cc:1511] Processing CreateTablet for tablet 263d149907bb4478a4af8c412649244a (DEFAULT_TABLE table=soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:14.016824 24383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 263d149907bb4478a4af8c412649244a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:14.072036 24685 tablet_bootstrap.cc:492] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Bootstrap starting.
I20260709 13:11:14.095175 24684 tablet_bootstrap.cc:492] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1: Bootstrap starting.
I20260709 13:11:14.101785 24684 tablet_bootstrap.cc:654] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.122117 24686 tablet_bootstrap.cc:492] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c: Bootstrap starting.
W20260709 13:11:14.127727 24344 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:14.130982 24686 tablet_bootstrap.cc:654] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.124406 24685 tablet_bootstrap.cc:654] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.131666 24684 tablet_bootstrap.cc:492] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1: No bootstrap required, opened a new log
I20260709 13:11:14.132123 24684 ts_tablet_manager.cc:1403] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.004s
I20260709 13:11:14.134532 24684 raft_consensus.cc:359] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.135306 24684 raft_consensus.cc:385] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.135643 24684 raft_consensus.cc:740] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.136193 24685 tablet_bootstrap.cc:492] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: No bootstrap required, opened a new log
I20260709 13:11:14.136672 24685 ts_tablet_manager.cc:1403] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent bootstrapping tablet: real 0.065s	user 0.008s	sys 0.004s
I20260709 13:11:14.136407 24684 consensus_queue.cc:260] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.139509 24684 ts_tablet_manager.cc:1434] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:14.139531 24685 raft_consensus.cc:359] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.140612 24685 raft_consensus.cc:385] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.140911 24685 raft_consensus.cc:740] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.141032 24684 tablet_bootstrap.cc:492] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1: Bootstrap starting.
I20260709 13:11:14.141602 24685 consensus_queue.cc:260] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.143919 24685 ts_tablet_manager.cc:1434] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:14.145502 24685 tablet_bootstrap.cc:492] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Bootstrap starting.
I20260709 13:11:14.148648 24684 tablet_bootstrap.cc:654] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.152025 24685 tablet_bootstrap.cc:654] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.157249 24686 tablet_bootstrap.cc:492] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c: No bootstrap required, opened a new log
I20260709 13:11:14.157927 24686 ts_tablet_manager.cc:1403] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.004s
I20260709 13:11:14.162223 24684 tablet_bootstrap.cc:492] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1: No bootstrap required, opened a new log
I20260709 13:11:14.161088 24686 raft_consensus.cc:359] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.162910 24684 ts_tablet_manager.cc:1403] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.008s
I20260709 13:11:14.162832 24686 raft_consensus.cc:385] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.163929 24685 tablet_bootstrap.cc:492] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: No bootstrap required, opened a new log
I20260709 13:11:14.164254 24686 raft_consensus.cc:740] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.164608 24685 ts_tablet_manager.cc:1403] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.003s
I20260709 13:11:14.165297 24686 consensus_queue.cc:260] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.166189 24684 raft_consensus.cc:359] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.166929 24684 raft_consensus.cc:385] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.167217 24684 raft_consensus.cc:740] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.167646 24686 ts_tablet_manager.cc:1434] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:11:14.168156 24684 consensus_queue.cc:260] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.169240 24686 tablet_bootstrap.cc:492] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c: Bootstrap starting.
I20260709 13:11:14.168869 24685 raft_consensus.cc:359] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.169770 24685 raft_consensus.cc:385] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.170110 24685 raft_consensus.cc:740] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.170575 24684 ts_tablet_manager.cc:1434] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:14.170876 24685 consensus_queue.cc:260] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.171756 24684 tablet_bootstrap.cc:492] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1: Bootstrap starting.
I20260709 13:11:14.173352 24685 ts_tablet_manager.cc:1434] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:11:14.174371 24685 tablet_bootstrap.cc:492] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Bootstrap starting.
I20260709 13:11:14.178956 24684 tablet_bootstrap.cc:654] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.180751 24685 tablet_bootstrap.cc:654] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.192737 24685 tablet_bootstrap.cc:492] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b: No bootstrap required, opened a new log
I20260709 13:11:14.193311 24685 ts_tablet_manager.cc:1403] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:11:14.196058 24685 raft_consensus.cc:359] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.196885 24685 raft_consensus.cc:385] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.197213 24685 raft_consensus.cc:740] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.197908 24685 consensus_queue.cc:260] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.200125 24685 ts_tablet_manager.cc:1434] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:11:14.201054 24686 tablet_bootstrap.cc:654] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.201243 24685 tablet_bootstrap.cc:492] T 465329cb805e4e7fba15939cecd9759e P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Bootstrap starting.
I20260709 13:11:14.206810 24684 tablet_bootstrap.cc:492] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1: No bootstrap required, opened a new log
I20260709 13:11:14.207360 24684 ts_tablet_manager.cc:1403] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.015s
I20260709 13:11:14.209334 24685 tablet_bootstrap.cc:654] T 465329cb805e4e7fba15939cecd9759e P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.210414 24684 raft_consensus.cc:359] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.211177 24684 raft_consensus.cc:385] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.212533 24684 raft_consensus.cc:740] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.213356 24684 consensus_queue.cc:260] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.215708 24686 tablet_bootstrap.cc:492] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c: No bootstrap required, opened a new log
I20260709 13:11:14.216310 24686 ts_tablet_manager.cc:1403] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.004s
I20260709 13:11:14.215710 24684 ts_tablet_manager.cc:1434] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:14.217921 24684 tablet_bootstrap.cc:492] T 7b164bcf2be54c5a84127382df5c2365 P f4717668718a44baada8b0fc4b30cfe1: Bootstrap starting.
I20260709 13:11:14.218331 24685 tablet_bootstrap.cc:492] T 465329cb805e4e7fba15939cecd9759e P cb1c3a28d32d452fbc4fdbf43cc1bf7b: No bootstrap required, opened a new log
I20260709 13:11:14.218888 24685 ts_tablet_manager.cc:1403] T 465329cb805e4e7fba15939cecd9759e P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent bootstrapping tablet: real 0.018s	user 0.004s	sys 0.013s
I20260709 13:11:14.221935 24685 raft_consensus.cc:359] T 465329cb805e4e7fba15939cecd9759e P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.222646 24685 raft_consensus.cc:385] T 465329cb805e4e7fba15939cecd9759e P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.222988 24685 raft_consensus.cc:740] T 465329cb805e4e7fba15939cecd9759e P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.224649 24685 consensus_queue.cc:260] T 465329cb805e4e7fba15939cecd9759e P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.224174 24686 raft_consensus.cc:359] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.225867 24686 raft_consensus.cc:385] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.226200 24686 raft_consensus.cc:740] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.226723 24684 tablet_bootstrap.cc:654] T 7b164bcf2be54c5a84127382df5c2365 P f4717668718a44baada8b0fc4b30cfe1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.227073 24685 ts_tablet_manager.cc:1434] T 465329cb805e4e7fba15939cecd9759e P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:11:14.226982 24686 consensus_queue.cc:260] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.228449 24685 tablet_bootstrap.cc:492] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Bootstrap starting.
I20260709 13:11:14.232141 24686 ts_tablet_manager.cc:1434] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:11:14.233256 24686 tablet_bootstrap.cc:492] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c: Bootstrap starting.
I20260709 13:11:14.234933 24685 tablet_bootstrap.cc:654] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.240607 24686 tablet_bootstrap.cc:654] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.247116 24685 tablet_bootstrap.cc:492] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: No bootstrap required, opened a new log
I20260709 13:11:14.247905 24685 ts_tablet_manager.cc:1403] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.013s
I20260709 13:11:14.251722 24685 raft_consensus.cc:359] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.252621 24685 raft_consensus.cc:385] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.252969 24685 raft_consensus.cc:740] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.254048 24686 tablet_bootstrap.cc:492] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c: No bootstrap required, opened a new log
I20260709 13:11:14.253811 24685 consensus_queue.cc:260] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.254611 24686 ts_tablet_manager.cc:1403] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.003s
I20260709 13:11:14.256700 24685 ts_tablet_manager.cc:1434] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:11:14.257831 24685 tablet_bootstrap.cc:492] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Bootstrap starting.
I20260709 13:11:14.257717 24686 raft_consensus.cc:359] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.258885 24686 raft_consensus.cc:385] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.259212 24686 raft_consensus.cc:740] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.259989 24686 consensus_queue.cc:260] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.260241 24592 raft_consensus.cc:493] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.261013 24592 raft_consensus.cc:515] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.264508 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417e26d295ef405584514341f5a6bd21" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c" is_pre_election: true
I20260709 13:11:14.265196 24686 ts_tablet_manager.cc:1434] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:11:14.265547 24592 leader_election.cc:290] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:14.265076 24547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417e26d295ef405584514341f5a6bd21" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1" is_pre_election: true
I20260709 13:11:14.266268 24686 tablet_bootstrap.cc:492] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c: Bootstrap starting.
W20260709 13:11:14.266120 24361 leader_election.cc:343] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:14.267582 24361 leader_election.cc:343] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.268193 24361 leader_election.cc:304] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: 104401b105224f1e9b05d58be1749d9c, f4717668718a44baada8b0fc4b30cfe1
I20260709 13:11:14.269240 24685 tablet_bootstrap.cc:654] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.272455 24592 raft_consensus.cc:2749] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:14.274277 24686 tablet_bootstrap.cc:654] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.276528 24593 raft_consensus.cc:493] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.277216 24593 raft_consensus.cc:515] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.282424 24685 tablet_bootstrap.cc:492] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: No bootstrap required, opened a new log
I20260709 13:11:14.282893 24593 leader_election.cc:290] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:14.282280 24547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b164bcf2be54c5a84127382df5c2365" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1" is_pre_election: true
I20260709 13:11:14.283252 24685 ts_tablet_manager.cc:1403] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.005s
W20260709 13:11:14.284924 24436 leader_election.cc:343] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.287935 24685 raft_consensus.cc:359] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.288997 24685 raft_consensus.cc:385] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.289952 24685 raft_consensus.cc:740] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.290815 24685 consensus_queue.cc:260] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.292315 24686 tablet_bootstrap.cc:492] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c: No bootstrap required, opened a new log
I20260709 13:11:14.292904 24686 ts_tablet_manager.cc:1403] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.014s
I20260709 13:11:14.293484 24685 ts_tablet_manager.cc:1434] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.006s
I20260709 13:11:14.294541 24685 tablet_bootstrap.cc:492] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Bootstrap starting.
I20260709 13:11:14.296137 24686 raft_consensus.cc:359] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.296962 24686 raft_consensus.cc:385] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.297374 24686 raft_consensus.cc:740] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.298225 24686 consensus_queue.cc:260] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.300630 24686 ts_tablet_manager.cc:1434] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:11:14.301681 24686 tablet_bootstrap.cc:492] T 417e26d295ef405584514341f5a6bd21 P 104401b105224f1e9b05d58be1749d9c: Bootstrap starting.
I20260709 13:11:14.301793 24685 tablet_bootstrap.cc:654] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.302505 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b164bcf2be54c5a84127382df5c2365" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" is_pre_election: true
I20260709 13:11:14.303761 24398 raft_consensus.cc:2468] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 0.
I20260709 13:11:14.308235 24438 leader_election.cc:304] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: f4717668718a44baada8b0fc4b30cfe1
I20260709 13:11:14.310438 24593 raft_consensus.cc:2804] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:14.310938 24593 raft_consensus.cc:493] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.311082 24686 tablet_bootstrap.cc:654] T 417e26d295ef405584514341f5a6bd21 P 104401b105224f1e9b05d58be1749d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.311436 24593 raft_consensus.cc:3060] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.322880 24686 tablet_bootstrap.cc:492] T 417e26d295ef405584514341f5a6bd21 P 104401b105224f1e9b05d58be1749d9c: No bootstrap required, opened a new log
I20260709 13:11:14.323478 24686 ts_tablet_manager.cc:1403] T 417e26d295ef405584514341f5a6bd21 P 104401b105224f1e9b05d58be1749d9c: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.013s
I20260709 13:11:14.326473 24686 raft_consensus.cc:359] T 417e26d295ef405584514341f5a6bd21 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.327316 24686 raft_consensus.cc:385] T 417e26d295ef405584514341f5a6bd21 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.327673 24686 raft_consensus.cc:740] T 417e26d295ef405584514341f5a6bd21 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.328684 24686 consensus_queue.cc:260] T 417e26d295ef405584514341f5a6bd21 P 104401b105224f1e9b05d58be1749d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.331014 24686 ts_tablet_manager.cc:1434] T 417e26d295ef405584514341f5a6bd21 P 104401b105224f1e9b05d58be1749d9c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:14.332031 24686 tablet_bootstrap.cc:492] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c: Bootstrap starting.
I20260709 13:11:14.331468 24593 raft_consensus.cc:515] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.335646 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b164bcf2be54c5a84127382df5c2365" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:14.336448 24398 raft_consensus.cc:3060] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.344453 24686 tablet_bootstrap.cc:654] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.346370 24398 raft_consensus.cc:2468] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 1.
I20260709 13:11:14.348418 24438 leader_election.cc:304] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: 
I20260709 13:11:14.350579 24702 raft_consensus.cc:2804] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:14.354519 24685 tablet_bootstrap.cc:492] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b: No bootstrap required, opened a new log
I20260709 13:11:14.355069 24685 ts_tablet_manager.cc:1403] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.006s
I20260709 13:11:14.355479 24686 tablet_bootstrap.cc:492] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c: No bootstrap required, opened a new log
I20260709 13:11:14.355511 24702 raft_consensus.cc:697] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [term 1 LEADER]: Becoming Leader. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Running, Role: LEADER
I20260709 13:11:14.356245 24686 ts_tablet_manager.cc:1403] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.008s
I20260709 13:11:14.356647 24702 consensus_queue.cc:237] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.358502 24684 tablet_bootstrap.cc:492] T 7b164bcf2be54c5a84127382df5c2365 P f4717668718a44baada8b0fc4b30cfe1: No bootstrap required, opened a new log
I20260709 13:11:14.359019 24684 ts_tablet_manager.cc:1403] T 7b164bcf2be54c5a84127382df5c2365 P f4717668718a44baada8b0fc4b30cfe1: Time spent bootstrapping tablet: real 0.141s	user 0.054s	sys 0.067s
I20260709 13:11:14.359740 24686 raft_consensus.cc:359] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.360598 24686 raft_consensus.cc:385] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.360930 24686 raft_consensus.cc:740] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.361692 24686 consensus_queue.cc:260] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.362071 24684 raft_consensus.cc:359] T 7b164bcf2be54c5a84127382df5c2365 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.362792 24684 raft_consensus.cc:385] T 7b164bcf2be54c5a84127382df5c2365 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.363799 24684 raft_consensus.cc:740] T 7b164bcf2be54c5a84127382df5c2365 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.364566 24684 consensus_queue.cc:260] T 7b164bcf2be54c5a84127382df5c2365 P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.364123 24593 leader_election.cc:290] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:14.362776 24685 raft_consensus.cc:359] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.365494 24547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b164bcf2be54c5a84127382df5c2365" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:14.367242 24547 raft_consensus.cc:3060] T 7b164bcf2be54c5a84127382df5c2365 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.368775 24684 ts_tablet_manager.cc:1434] T 7b164bcf2be54c5a84127382df5c2365 P f4717668718a44baada8b0fc4b30cfe1: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:11:14.371209 24684 tablet_bootstrap.cc:492] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1: Bootstrap starting.
I20260709 13:11:14.374903 24547 raft_consensus.cc:2468] T 7b164bcf2be54c5a84127382df5c2365 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 1.
I20260709 13:11:14.369891 24686 ts_tablet_manager.cc:1434] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:11:14.376123 24592 raft_consensus.cc:493] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.376652 24686 tablet_bootstrap.cc:492] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c: Bootstrap starting.
I20260709 13:11:14.376605 24592 raft_consensus.cc:515] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.378780 24592 leader_election.cc:290] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:14.381475 24684 tablet_bootstrap.cc:654] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.382234 24546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33faf243a678428d85bee175371e7bd0" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1" is_pre_election: true
I20260709 13:11:14.382973 24546 raft_consensus.cc:2468] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 0.
I20260709 13:11:14.366847 24685 raft_consensus.cc:385] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.383775 24685 raft_consensus.cc:740] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.381356 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33faf243a678428d85bee175371e7bd0" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c" is_pre_election: true
I20260709 13:11:14.384562 24685 consensus_queue.cc:260] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.386699 24686 tablet_bootstrap.cc:654] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.387915 24685 ts_tablet_manager.cc:1434] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.004s
I20260709 13:11:14.389981 24685 tablet_bootstrap.cc:492] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Bootstrap starting.
I20260709 13:11:14.393832 24673 raft_consensus.cc:493] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.399917 24296 catalog_manager.cc:5697] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 104401b105224f1e9b05d58be1749d9c (127.12.76.130). New cstate: current_term: 1 leader_uuid: "104401b105224f1e9b05d58be1749d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.395347 24673 raft_consensus.cc:515] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
W20260709 13:11:14.405383 24361 leader_election.cc:343] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.410490 24361 leader_election.cc:304] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1; no voters: 104401b105224f1e9b05d58be1749d9c
I20260709 13:11:14.411234 24592 raft_consensus.cc:2804] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:14.411605 24592 raft_consensus.cc:493] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.411922 24592 raft_consensus.cc:3060] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.415691 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465329cb805e4e7fba15939cecd9759e" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c" is_pre_election: true
I20260709 13:11:14.416391 24473 raft_consensus.cc:2468] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 0.
I20260709 13:11:14.419545 24673 leader_election.cc:290] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:14.421838 24510 leader_election.cc:304] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:14.423116 24673 raft_consensus.cc:2804] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:14.423655 24673 raft_consensus.cc:493] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.424136 24673 raft_consensus.cc:3060] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.427341 24685 tablet_bootstrap.cc:654] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.429358 24593 raft_consensus.cc:493] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.429996 24593 raft_consensus.cc:515] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.431375 24684 tablet_bootstrap.cc:492] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1: No bootstrap required, opened a new log
I20260709 13:11:14.432157 24684 ts_tablet_manager.cc:1403] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1: Time spent bootstrapping tablet: real 0.061s	user 0.005s	sys 0.014s
I20260709 13:11:14.432610 24593 leader_election.cc:290] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:14.433485 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d6d03206a0410aa73ce2a90384d519" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" is_pre_election: true
I20260709 13:11:14.434190 24398 raft_consensus.cc:2468] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 0.
I20260709 13:11:14.436627 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465329cb805e4e7fba15939cecd9759e" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" is_pre_election: true
I20260709 13:11:14.437032 24546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d6d03206a0410aa73ce2a90384d519" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1" is_pre_election: true
I20260709 13:11:14.437311 24397 raft_consensus.cc:2468] T 465329cb805e4e7fba15939cecd9759e P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 0.
I20260709 13:11:14.437700 24546 raft_consensus.cc:2468] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 0.
I20260709 13:11:14.439067 24436 leader_election.cc:304] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:14.419955 24592 raft_consensus.cc:515] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.440238 24593 raft_consensus.cc:2804] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:14.438393 24684 raft_consensus.cc:359] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.440785 24593 raft_consensus.cc:493] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.440955 24684 raft_consensus.cc:385] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.441254 24593 raft_consensus.cc:3060] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.441478 24684 raft_consensus.cc:740] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.442409 24684 consensus_queue.cc:260] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.444217 24673 raft_consensus.cc:515] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.445204 24684 ts_tablet_manager.cc:1434] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:11:14.446206 24684 tablet_bootstrap.cc:492] T 19b1fd5922b448ebbf580bca848ac864 P f4717668718a44baada8b0fc4b30cfe1: Bootstrap starting.
I20260709 13:11:14.447446 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465329cb805e4e7fba15939cecd9759e" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:14.448050 24473 raft_consensus.cc:3060] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.449265 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33faf243a678428d85bee175371e7bd0" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c"
W20260709 13:11:14.450677 24361 leader_election.cc:343] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.451323 24547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33faf243a678428d85bee175371e7bd0" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:14.464286 24685 tablet_bootstrap.cc:492] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: No bootstrap required, opened a new log
I20260709 13:11:14.464403 24547 raft_consensus.cc:3060] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.464919 24685 ts_tablet_manager.cc:1403] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent bootstrapping tablet: real 0.075s	user 0.019s	sys 0.004s
I20260709 13:11:14.452582 24684 tablet_bootstrap.cc:654] T 19b1fd5922b448ebbf580bca848ac864 P f4717668718a44baada8b0fc4b30cfe1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.452955 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465329cb805e4e7fba15939cecd9759e" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:14.467836 24398 raft_consensus.cc:3060] T 465329cb805e4e7fba15939cecd9759e P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.469779 24547 raft_consensus.cc:2468] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 1.
I20260709 13:11:14.470659 24361 leader_election.cc:304] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1; no voters: 104401b105224f1e9b05d58be1749d9c
I20260709 13:11:14.452708 24593 raft_consensus.cc:515] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.441931 24592 leader_election.cc:290] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 election: Requested vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:14.471431 24701 raft_consensus.cc:2804] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:14.440267 24686 tablet_bootstrap.cc:492] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c: No bootstrap required, opened a new log
I20260709 13:11:14.472123 24701 raft_consensus.cc:697] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Becoming Leader. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Running, Role: LEADER
I20260709 13:11:14.472486 24686 ts_tablet_manager.cc:1403] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c: Time spent bootstrapping tablet: real 0.096s	user 0.015s	sys 0.024s
I20260709 13:11:14.472996 24593 leader_election.cc:290] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:14.473040 24701 consensus_queue.cc:237] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.461104 24473 raft_consensus.cc:2468] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 1.
I20260709 13:11:14.461608 24673 leader_election.cc:290] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:14.475220 24398 raft_consensus.cc:2468] T 465329cb805e4e7fba15939cecd9759e P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 1.
I20260709 13:11:14.467056 24685 raft_consensus.cc:359] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.475059 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d6d03206a0410aa73ce2a90384d519" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:14.476379 24510 leader_election.cc:304] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:14.477008 24397 raft_consensus.cc:3060] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.477453 24673 raft_consensus.cc:2804] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:14.477979 24673 raft_consensus.cc:697] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Becoming Leader. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Running, Role: LEADER
I20260709 13:11:14.478778 24673 consensus_queue.cc:237] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.479727 24547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d6d03206a0410aa73ce2a90384d519" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:14.480898 24547 raft_consensus.cc:3060] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.481465 24686 raft_consensus.cc:359] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.483253 24686 raft_consensus.cc:385] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.483743 24686 raft_consensus.cc:740] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.486763 24397 raft_consensus.cc:2468] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 1.
I20260709 13:11:14.488523 24438 leader_election.cc:304] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: 
I20260709 13:11:14.489490 24685 raft_consensus.cc:385] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.489813 24685 raft_consensus.cc:740] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.489977 24593 raft_consensus.cc:2804] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:14.490607 24593 raft_consensus.cc:697] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [term 1 LEADER]: Becoming Leader. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Running, Role: LEADER
I20260709 13:11:14.490852 24685 consensus_queue.cc:260] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.491477 24593 consensus_queue.cc:237] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.493250 24685 ts_tablet_manager.cc:1434] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 13:11:14.494382 24685 tablet_bootstrap.cc:492] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Bootstrap starting.
I20260709 13:11:14.498876 24702 raft_consensus.cc:493] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.499387 24702 raft_consensus.cc:515] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.501893 24702 leader_election.cc:290] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:14.501998 24294 catalog_manager.cc:5697] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b reported cstate change: term changed from 0 to 1, leader changed from <none> to cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129). New cstate: current_term: 1 leader_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.484704 24686 consensus_queue.cc:260] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.503664 24592 raft_consensus.cc:493] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.503878 24685 tablet_bootstrap.cc:654] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.504184 24592 raft_consensus.cc:515] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.505283 24686 ts_tablet_manager.cc:1434] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:11:14.506318 24592 leader_election.cc:290] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:14.504266 24546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d149907bb4478a4af8c412649244a" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1" is_pre_election: true
I20260709 13:11:14.513062 24686 tablet_bootstrap.cc:492] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c: Bootstrap starting.
W20260709 13:11:14.513909 24436 leader_election.cc:343] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.515367 24547 raft_consensus.cc:2468] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 1.
I20260709 13:11:14.518172 24685 tablet_bootstrap.cc:492] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: No bootstrap required, opened a new log
I20260709 13:11:14.518646 24685 ts_tablet_manager.cc:1403] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.000s
I20260709 13:11:14.521413 24685 raft_consensus.cc:359] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.522051 24685 raft_consensus.cc:385] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.522303 24685 raft_consensus.cc:740] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.522851 24685 consensus_queue.cc:260] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.524868 24685 ts_tablet_manager.cc:1434] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:11:14.525177 24684 tablet_bootstrap.cc:492] T 19b1fd5922b448ebbf580bca848ac864 P f4717668718a44baada8b0fc4b30cfe1: No bootstrap required, opened a new log
I20260709 13:11:14.525641 24684 ts_tablet_manager.cc:1403] T 19b1fd5922b448ebbf580bca848ac864 P f4717668718a44baada8b0fc4b30cfe1: Time spent bootstrapping tablet: real 0.080s	user 0.011s	sys 0.001s
I20260709 13:11:14.528796 24684 raft_consensus.cc:359] T 19b1fd5922b448ebbf580bca848ac864 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.529798 24684 raft_consensus.cc:385] T 19b1fd5922b448ebbf580bca848ac864 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.530225 24684 raft_consensus.cc:740] T 19b1fd5922b448ebbf580bca848ac864 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.531226 24684 consensus_queue.cc:260] T 19b1fd5922b448ebbf580bca848ac864 P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.534543 24296 catalog_manager.cc:5697] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "f4717668718a44baada8b0fc4b30cfe1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:14.536172 24684 ts_tablet_manager.cc:1434] T 19b1fd5922b448ebbf580bca848ac864 P f4717668718a44baada8b0fc4b30cfe1: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:11:14.537449 24684 tablet_bootstrap.cc:492] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1: Bootstrap starting.
I20260709 13:11:14.544690 24684 tablet_bootstrap.cc:654] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.550832 24684 tablet_bootstrap.cc:492] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1: No bootstrap required, opened a new log
I20260709 13:11:14.551353 24684 ts_tablet_manager.cc:1403] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 13:11:14.554205 24684 raft_consensus.cc:359] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.559592 24684 raft_consensus.cc:385] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.560034 24684 raft_consensus.cc:740] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Initialized, Role: FOLLOWER
W20260709 13:11:14.561395 24361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:43451, user_credentials={real_user=slave}} blocked reactor thread for 61392.9us
I20260709 13:11:14.561058 24684 consensus_queue.cc:260] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.565384 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfb443d80634ca48fe563786c4df46d" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c" is_pre_election: true
I20260709 13:11:14.566001 24473 raft_consensus.cc:2468] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 0.
I20260709 13:11:14.566417 24684 ts_tablet_manager.cc:1434] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.003s
I20260709 13:11:14.568079 24547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfb443d80634ca48fe563786c4df46d" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1" is_pre_election: true
I20260709 13:11:14.569355 24684 tablet_bootstrap.cc:492] T bbfb443d80634ca48fe563786c4df46d P f4717668718a44baada8b0fc4b30cfe1: Bootstrap starting.
I20260709 13:11:14.577008 24684 tablet_bootstrap.cc:654] T bbfb443d80634ca48fe563786c4df46d P f4717668718a44baada8b0fc4b30cfe1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.577602 24701 raft_consensus.cc:493] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.578189 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d149907bb4478a4af8c412649244a" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" is_pre_election: true
I20260709 13:11:14.578277 24686 tablet_bootstrap.cc:654] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.578308 24701 raft_consensus.cc:515] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.580991 24701 leader_election.cc:290] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
W20260709 13:11:14.579798 24361 leader_election.cc:343] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.581715 24397 raft_consensus.cc:2468] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 0.
I20260709 13:11:14.582188 24361 leader_election.cc:304] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: f4717668718a44baada8b0fc4b30cfe1
I20260709 13:11:14.583648 24719 raft_consensus.cc:2804] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:14.584033 24719 raft_consensus.cc:493] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.584335 24719 raft_consensus.cc:3060] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.584383 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d149907bb4478a4af8c412649244a" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c" is_pre_election: true
I20260709 13:11:14.585067 24473 raft_consensus.cc:2468] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 0.
I20260709 13:11:14.576021 24296 catalog_manager.cc:5697] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 104401b105224f1e9b05d58be1749d9c (127.12.76.130). New cstate: current_term: 1 leader_uuid: "104401b105224f1e9b05d58be1749d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.594619 24686 tablet_bootstrap.cc:492] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c: No bootstrap required, opened a new log
I20260709 13:11:14.594492 24546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d149907bb4478a4af8c412649244a" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1" is_pre_election: true
I20260709 13:11:14.595239 24686 ts_tablet_manager.cc:1403] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c: Time spent bootstrapping tablet: real 0.082s	user 0.011s	sys 0.011s
I20260709 13:11:14.596845 24684 tablet_bootstrap.cc:492] T bbfb443d80634ca48fe563786c4df46d P f4717668718a44baada8b0fc4b30cfe1: No bootstrap required, opened a new log
I20260709 13:11:14.596902 24438 leader_election.cc:304] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: f4717668718a44baada8b0fc4b30cfe1
I20260709 13:11:14.596923 24701 raft_consensus.cc:493] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.598102 24702 raft_consensus.cc:2804] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:14.598225 24701 raft_consensus.cc:515] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.597757 24684 ts_tablet_manager.cc:1403] T bbfb443d80634ca48fe563786c4df46d P f4717668718a44baada8b0fc4b30cfe1: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.002s
I20260709 13:11:14.600586 24701 leader_election.cc:290] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:14.600879 24686 raft_consensus.cc:359] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.601662 24686 raft_consensus.cc:385] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.598640 24702 raft_consensus.cc:493] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.592659 24719 raft_consensus.cc:515] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.602331 24702 raft_consensus.cc:3060] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.602272 24684 raft_consensus.cc:359] T bbfb443d80634ca48fe563786c4df46d P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.603142 24684 raft_consensus.cc:385] T bbfb443d80634ca48fe563786c4df46d P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.603453 24684 raft_consensus.cc:740] T bbfb443d80634ca48fe563786c4df46d P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.604100 24719 leader_election.cc:290] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 election: Requested vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:14.601933 24686 raft_consensus.cc:740] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.604219 24684 consensus_queue.cc:260] T bbfb443d80634ca48fe563786c4df46d P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.605257 24686 consensus_queue.cc:260] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
W20260709 13:11:14.606686 24361 leader_election.cc:343] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.607839 24361 leader_election.cc:304] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: f4717668718a44baada8b0fc4b30cfe1
I20260709 13:11:14.608229 24686 ts_tablet_manager.cc:1434] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:11:14.609277 24686 tablet_bootstrap.cc:492] T 853da295b17940229be236438a3d75a9 P 104401b105224f1e9b05d58be1749d9c: Bootstrap starting.
I20260709 13:11:14.609515 24702 raft_consensus.cc:515] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.610105 24719 raft_consensus.cc:2804] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:14.610569 24719 raft_consensus.cc:493] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.612687 24546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d149907bb4478a4af8c412649244a" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:14.613905 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b1fd5922b448ebbf580bca848ac864" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c" is_pre_election: true
I20260709 13:11:14.614081 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfb443d80634ca48fe563786c4df46d" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:14.614648 24473 raft_consensus.cc:2468] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 0.
I20260709 13:11:14.614821 24471 raft_consensus.cc:3060] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.606699 24684 ts_tablet_manager.cc:1434] T bbfb443d80634ca48fe563786c4df46d P f4717668718a44baada8b0fc4b30cfe1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:11:14.616552 24684 tablet_bootstrap.cc:492] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1: Bootstrap starting.
W20260709 13:11:14.616942 24436 leader_election.cc:343] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.617766 24546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b1fd5922b448ebbf580bca848ac864" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1" is_pre_election: true
I20260709 13:11:14.618403 24546 raft_consensus.cc:2468] T 19b1fd5922b448ebbf580bca848ac864 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 0.
I20260709 13:11:14.619016 24673 raft_consensus.cc:493] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.619526 24673 raft_consensus.cc:515] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.621628 24673 leader_election.cc:290] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:14.622851 24684 tablet_bootstrap.cc:654] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.610942 24719 raft_consensus.cc:3060] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.624228 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853da295b17940229be236438a3d75a9" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" is_pre_election: true
I20260709 13:11:14.624864 24397 raft_consensus.cc:2468] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 0.
I20260709 13:11:14.626255 24361 leader_election.cc:304] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:14.626605 24512 leader_election.cc:304] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:14.623199 24471 raft_consensus.cc:2468] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 1.
I20260709 13:11:14.627564 24701 raft_consensus.cc:2804] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:14.627581 24546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfb443d80634ca48fe563786c4df46d" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:14.628127 24701 raft_consensus.cc:493] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.628319 24546 raft_consensus.cc:3060] T bbfb443d80634ca48fe563786c4df46d P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.628512 24701 raft_consensus.cc:3060] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.629093 24686 tablet_bootstrap.cc:654] T 853da295b17940229be236438a3d75a9 P 104401b105224f1e9b05d58be1749d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.631861 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d149907bb4478a4af8c412649244a" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:14.633373 24673 raft_consensus.cc:2804] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:14.634002 24673 raft_consensus.cc:493] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.635494 24673 raft_consensus.cc:3060] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.640933 24719 raft_consensus.cc:515] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.642511 24397 raft_consensus.cc:2393] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 104401b105224f1e9b05d58be1749d9c in current term 1: Already voted for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in this term.
I20260709 13:11:14.636822 24702 leader_election.cc:290] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:14.643098 24546 raft_consensus.cc:2468] T bbfb443d80634ca48fe563786c4df46d P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 1.
I20260709 13:11:14.645622 24438 leader_election.cc:304] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c; no voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1
I20260709 13:11:14.645889 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d149907bb4478a4af8c412649244a" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:14.646744 24473 raft_consensus.cc:2393] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in current term 1: Already voted for candidate 104401b105224f1e9b05d58be1749d9c in this term.
I20260709 13:11:14.647168 24702 raft_consensus.cc:2749] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:14.647298 24701 raft_consensus.cc:515] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.648660 24361 leader_election.cc:304] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: 
I20260709 13:11:14.649760 24592 raft_consensus.cc:2804] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:14.651536 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b1fd5922b448ebbf580bca848ac864" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:14.651798 24546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b1fd5922b448ebbf580bca848ac864" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:14.652148 24473 raft_consensus.cc:3060] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.652410 24673 raft_consensus.cc:515] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.652642 24546 raft_consensus.cc:3060] T 19b1fd5922b448ebbf580bca848ac864 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.657640 24686 tablet_bootstrap.cc:492] T 853da295b17940229be236438a3d75a9 P 104401b105224f1e9b05d58be1749d9c: No bootstrap required, opened a new log
I20260709 13:11:14.658156 24686 ts_tablet_manager.cc:1403] T 853da295b17940229be236438a3d75a9 P 104401b105224f1e9b05d58be1749d9c: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.000s
I20260709 13:11:14.659777 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853da295b17940229be236438a3d75a9" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c" is_pre_election: true
W20260709 13:11:14.661156 24510 leader_election.cc:343] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.661365 24673 leader_election.cc:290] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:14.649206 24701 leader_election.cc:290] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 election: Requested vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:14.663535 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853da295b17940229be236438a3d75a9" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:14.665297 24397 raft_consensus.cc:3060] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.666725 24719 leader_election.cc:290] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 election: Requested vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:14.667577 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853da295b17940229be236438a3d75a9" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:14.667833 24547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d149907bb4478a4af8c412649244a" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:14.667505 24686 raft_consensus.cc:359] T 853da295b17940229be236438a3d75a9 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.668473 24686 raft_consensus.cc:385] T 853da295b17940229be236438a3d75a9 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.668761 24686 raft_consensus.cc:740] T 853da295b17940229be236438a3d75a9 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Initialized, Role: FOLLOWER
W20260709 13:11:14.669225 24361 leader_election.cc:343] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:14.669466 24686 consensus_queue.cc:260] T 853da295b17940229be236438a3d75a9 P 104401b105224f1e9b05d58be1749d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.669927 24684 tablet_bootstrap.cc:492] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1: No bootstrap required, opened a new log
I20260709 13:11:14.669865 24361 leader_election.cc:304] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: 104401b105224f1e9b05d58be1749d9c, f4717668718a44baada8b0fc4b30cfe1
I20260709 13:11:14.670390 24471 raft_consensus.cc:3060] T 853da295b17940229be236438a3d75a9 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.670518 24684 ts_tablet_manager.cc:1403] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.025s
I20260709 13:11:14.671638 24686 ts_tablet_manager.cc:1434] T 853da295b17940229be236438a3d75a9 P 104401b105224f1e9b05d58be1749d9c: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:11:14.671739 24719 raft_consensus.cc:2749] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:14.673422 24684 raft_consensus.cc:359] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.674106 24684 raft_consensus.cc:385] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.674407 24684 raft_consensus.cc:740] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.675132 24473 raft_consensus.cc:2468] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 1.
I20260709 13:11:14.675081 24684 consensus_queue.cc:260] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.665746 24546 raft_consensus.cc:2468] T 19b1fd5922b448ebbf580bca848ac864 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 1.
I20260709 13:11:14.676723 24361 leader_election.cc:304] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: 
I20260709 13:11:14.677371 24592 raft_consensus.cc:697] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Becoming Leader. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Running, Role: LEADER
I20260709 13:11:14.679152 24397 raft_consensus.cc:2468] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 1.
I20260709 13:11:14.680091 24592 consensus_queue.cc:237] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.680543 24512 leader_election.cc:304] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:14.681466 24673 raft_consensus.cc:2804] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:14.681929 24673 raft_consensus.cc:697] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Becoming Leader. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Running, Role: LEADER
I20260709 13:11:14.682690 24673 consensus_queue.cc:237] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.684325 24684 ts_tablet_manager.cc:1434] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:11:14.679729 24726 raft_consensus.cc:2804] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:14.685556 24471 raft_consensus.cc:2468] T 853da295b17940229be236438a3d75a9 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 1.
I20260709 13:11:14.685954 24726 raft_consensus.cc:697] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Becoming Leader. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Running, Role: LEADER
I20260709 13:11:14.687285 24726 consensus_queue.cc:237] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.701939 24295 catalog_manager.cc:5697] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "f4717668718a44baada8b0fc4b30cfe1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:14.705971 24673 raft_consensus.cc:493] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.706597 24673 raft_consensus.cc:515] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.706734 24296 catalog_manager.cc:5697] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b reported cstate change: term changed from 0 to 1, leader changed from <none> to cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129). New cstate: current_term: 1 leader_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.708668 24673 leader_election.cc:290] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:14.709458 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d149907bb4478a4af8c412649244a" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" is_pre_election: true
I20260709 13:11:14.710245 24397 raft_consensus.cc:2393] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4717668718a44baada8b0fc4b30cfe1 in current term 1: Already voted for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in this term.
I20260709 13:11:14.711710 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d149907bb4478a4af8c412649244a" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c" is_pre_election: true
I20260709 13:11:14.712925 24471 raft_consensus.cc:2393] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4717668718a44baada8b0fc4b30cfe1 in current term 1: Already voted for candidate 104401b105224f1e9b05d58be1749d9c in this term.
I20260709 13:11:14.713893 24510 leader_election.cc:304] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4717668718a44baada8b0fc4b30cfe1; no voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b
I20260709 13:11:14.714643 24673 raft_consensus.cc:3060] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.720377 24673 raft_consensus.cc:2749] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:14.722280 24295 catalog_manager.cc:5697] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b reported cstate change: term changed from 0 to 1, leader changed from <none> to cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129). New cstate: current_term: 1 leader_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.752594 24702 raft_consensus.cc:493] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.753221 24702 raft_consensus.cc:515] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.755122 24702 leader_election.cc:290] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:14.756215 24546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33faf243a678428d85bee175371e7bd0" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1" is_pre_election: true
I20260709 13:11:14.756119 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33faf243a678428d85bee175371e7bd0" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" is_pre_election: true
I20260709 13:11:14.757189 24546 raft_consensus.cc:2393] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 104401b105224f1e9b05d58be1749d9c in current term 1: Already voted for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in this term.
I20260709 13:11:14.758103 24436 leader_election.cc:304] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c; no voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1
I20260709 13:11:14.758816 24702 raft_consensus.cc:3060] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.764142 24702 raft_consensus.cc:2749] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:14.769352 24673 raft_consensus.cc:493] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.769860 24673 raft_consensus.cc:515] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.771528 24673 leader_election.cc:290] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:14.772382 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417e26d295ef405584514341f5a6bd21" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" is_pre_election: true
I20260709 13:11:14.772629 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417e26d295ef405584514341f5a6bd21" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c" is_pre_election: true
I20260709 13:11:14.773139 24397 raft_consensus.cc:2468] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 0.
I20260709 13:11:14.773217 24471 raft_consensus.cc:2468] T 417e26d295ef405584514341f5a6bd21 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 0.
I20260709 13:11:14.774204 24512 leader_election.cc:304] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:14.774871 24673 raft_consensus.cc:2804] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:14.775241 24673 raft_consensus.cc:493] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.775563 24673 raft_consensus.cc:3060] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.780952 24673 raft_consensus.cc:515] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.782682 24673 leader_election.cc:290] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:14.783365 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417e26d295ef405584514341f5a6bd21" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:14.783677 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417e26d295ef405584514341f5a6bd21" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:14.783977 24397 raft_consensus.cc:3060] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.784286 24471 raft_consensus.cc:3060] T 417e26d295ef405584514341f5a6bd21 P 104401b105224f1e9b05d58be1749d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.790282 24397 raft_consensus.cc:2468] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 1.
I20260709 13:11:14.790293 24471 raft_consensus.cc:2468] T 417e26d295ef405584514341f5a6bd21 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 1.
I20260709 13:11:14.791399 24512 leader_election.cc:304] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:14.792115 24673 raft_consensus.cc:2804] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:14.792553 24673 raft_consensus.cc:697] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Becoming Leader. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Running, Role: LEADER
I20260709 13:11:14.793246 24673 consensus_queue.cc:237] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:14.800992 24295 catalog_manager.cc:5697] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131). New cstate: current_term: 1 leader_uuid: "f4717668718a44baada8b0fc4b30cfe1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:14.855304 24702 consensus_queue.cc:1048] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:14.867321 24702 consensus_queue.cc:1048] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:14.904006 24673 consensus_queue.cc:1048] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:14.914577 24673 consensus_queue.cc:1048] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:14.941074 24702 consensus_queue.cc:1048] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:14.951143 24706 consensus_queue.cc:1048] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:14.969595 24592 consensus_queue.cc:1048] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:14.974133 24592 consensus_queue.cc:1048] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:11:15.134347 24344 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:15.139114 24719 consensus_queue.cc:1048] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:15.148047 24673 consensus_queue.cc:1048] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:15.149111 24592 consensus_queue.cc:1048] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:15.170069 24737 consensus_queue.cc:1048] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:15.190325 24709 consensus_queue.cc:1048] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:15.201330 24709 consensus_queue.cc:1048] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:15.272307 24592 consensus_queue.cc:1048] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:15.277280 24592 consensus_queue.cc:1048] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:11:16.140903 24344 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:16.266654 24726 raft_consensus.cc:493] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.267578 24726 raft_consensus.cc:515] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:16.269881 24726 leader_election.cc:290] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:16.270795 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d149907bb4478a4af8c412649244a" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c" is_pre_election: true
I20260709 13:11:16.271077 24546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d149907bb4478a4af8c412649244a" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1" is_pre_election: true
I20260709 13:11:16.271840 24473 raft_consensus.cc:2468] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 1.
I20260709 13:11:16.271960 24546 raft_consensus.cc:2468] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 1.
I20260709 13:11:16.273506 24361 leader_election.cc:304] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: 
I20260709 13:11:16.274420 24592 raft_consensus.cc:2804] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:16.274747 24592 raft_consensus.cc:493] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.275048 24592 raft_consensus.cc:3060] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:16.284080 24592 raft_consensus.cc:515] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:16.285739 24592 leader_election.cc:290] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 2 election: Requested vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:16.286669 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d149907bb4478a4af8c412649244a" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:16.287336 24546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d149907bb4478a4af8c412649244a" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:16.288153 24546 raft_consensus.cc:3060] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:16.287542 24473 raft_consensus.cc:3060] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:16.297071 24546 raft_consensus.cc:2468] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 2.
I20260709 13:11:16.298265 24361 leader_election.cc:304] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:16.298758 24473 raft_consensus.cc:2468] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 2.
I20260709 13:11:16.298954 24592 raft_consensus.cc:2804] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:16.299602 24592 raft_consensus.cc:697] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 LEADER]: Becoming Leader. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Running, Role: LEADER
I20260709 13:11:16.300712 24592 consensus_queue.cc:237] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:16.311689 24296 catalog_manager.cc:5697] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b reported cstate change: term changed from 0 to 2, leader changed from <none> to cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129). New cstate: current_term: 2 leader_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:16.600296 24473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49d6d03206a0410aa73ce2a90384d519"
dest_uuid: "104401b105224f1e9b05d58be1749d9c"
mode: GRACEFUL
new_leader_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
 from {username='slave'} at 127.0.0.1:55758
I20260709 13:11:16.601001 24473 raft_consensus.cc:606] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [term 1 LEADER]: Received request to transfer leadership to TS cb1c3a28d32d452fbc4fdbf43cc1bf7b
I20260709 13:11:16.606782 24546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "417e26d295ef405584514341f5a6bd21"
dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
mode: GRACEFUL
new_leader_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
 from {username='slave'} at 127.0.0.1:52100
I20260709 13:11:16.607287 24546 raft_consensus.cc:606] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Received request to transfer leadership to TS cb1c3a28d32d452fbc4fdbf43cc1bf7b
I20260709 13:11:16.612246 24473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b164bcf2be54c5a84127382df5c2365"
dest_uuid: "104401b105224f1e9b05d58be1749d9c"
mode: GRACEFUL
new_leader_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
 from {username='slave'} at 127.0.0.1:55758
I20260709 13:11:16.612728 24473 raft_consensus.cc:606] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [term 1 LEADER]: Received request to transfer leadership to TS cb1c3a28d32d452fbc4fdbf43cc1bf7b
I20260709 13:11:16.617877 24546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "853da295b17940229be236438a3d75a9"
dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
mode: GRACEFUL
new_leader_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
 from {username='slave'} at 127.0.0.1:52100
I20260709 13:11:16.618496 24546 raft_consensus.cc:606] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Received request to transfer leadership to TS cb1c3a28d32d452fbc4fdbf43cc1bf7b
I20260709 13:11:16.623513 24546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "465329cb805e4e7fba15939cecd9759e"
dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
mode: GRACEFUL
new_leader_uuid: "104401b105224f1e9b05d58be1749d9c"
 from {username='slave'} at 127.0.0.1:52100
I20260709 13:11:16.624078 24546 raft_consensus.cc:606] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Received request to transfer leadership to TS 104401b105224f1e9b05d58be1749d9c
I20260709 13:11:16.629644 24397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19b1fd5922b448ebbf580bca848ac864"
dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
mode: GRACEFUL
new_leader_uuid: "104401b105224f1e9b05d58be1749d9c"
 from {username='slave'} at 127.0.0.1:40042
I20260709 13:11:16.630095 24397 raft_consensus.cc:606] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Received request to transfer leadership to TS 104401b105224f1e9b05d58be1749d9c
I20260709 13:11:16.634735 24397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbfb443d80634ca48fe563786c4df46d"
dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
mode: GRACEFUL
new_leader_uuid: "104401b105224f1e9b05d58be1749d9c"
 from {username='slave'} at 127.0.0.1:40042
I20260709 13:11:16.635181 24397 raft_consensus.cc:606] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Received request to transfer leadership to TS 104401b105224f1e9b05d58be1749d9c
I20260709 13:11:16.639819 24397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33faf243a678428d85bee175371e7bd0"
dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
mode: GRACEFUL
new_leader_uuid: "104401b105224f1e9b05d58be1749d9c"
 from {username='slave'} at 127.0.0.1:40042
I20260709 13:11:16.640270 24397 raft_consensus.cc:606] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Received request to transfer leadership to TS 104401b105224f1e9b05d58be1749d9c
I20260709 13:11:16.644690 24397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "263d149907bb4478a4af8c412649244a"
dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
mode: GRACEFUL
new_leader_uuid: "f4717668718a44baada8b0fc4b30cfe1"
 from {username='slave'} at 127.0.0.1:40042
I20260709 13:11:16.645136 24397 raft_consensus.cc:606] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 LEADER]: Received request to transfer leadership to TS f4717668718a44baada8b0fc4b30cfe1
I20260709 13:11:16.704324 24547 raft_consensus.cc:1275] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Refusing update from remote peer cb1c3a28d32d452fbc4fdbf43cc1bf7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:16.705739 24726 consensus_queue.cc:1048] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:16.710335 24592 raft_consensus.cc:993] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b: : Instructing follower 104401b105224f1e9b05d58be1749d9c to start an election
I20260709 13:11:16.710778 24726 raft_consensus.cc:1081] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Signalling peer 104401b105224f1e9b05d58be1749d9c to start an election
I20260709 13:11:16.712886 24473 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbfb443d80634ca48fe563786c4df46d"
dest_uuid: "104401b105224f1e9b05d58be1749d9c"
 from {username='slave'} at 127.0.0.1:43976
I20260709 13:11:16.713618 24473 raft_consensus.cc:493] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:16.714082 24473 raft_consensus.cc:3060] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:16.714738 24592 raft_consensus.cc:993] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b: : Instructing follower f4717668718a44baada8b0fc4b30cfe1 to start an election
I20260709 13:11:16.715260 24726 raft_consensus.cc:1081] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 LEADER]: Signalling peer f4717668718a44baada8b0fc4b30cfe1 to start an election
I20260709 13:11:16.718176 24546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "263d149907bb4478a4af8c412649244a"
dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
 from {username='slave'} at 127.0.0.1:40818
I20260709 13:11:16.721014 24546 raft_consensus.cc:493] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:16.721408 24546 raft_consensus.cc:3060] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:16.724596 24471 raft_consensus.cc:1275] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Refusing update from remote peer cb1c3a28d32d452fbc4fdbf43cc1bf7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:16.727478 24473 raft_consensus.cc:515] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:16.727802 24763 consensus_queue.cc:1048] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:16.738035 24473 leader_election.cc:290] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 2 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:16.739631 24547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfb443d80634ca48fe563786c4df46d" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:16.740206 24547 raft_consensus.cc:3060] T bbfb443d80634ca48fe563786c4df46d P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:16.741452 24546 raft_consensus.cc:515] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:16.748690 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfb443d80634ca48fe563786c4df46d" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:16.748756 24547 raft_consensus.cc:2468] T bbfb443d80634ca48fe563786c4df46d P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 2.
I20260709 13:11:16.749495 24397 raft_consensus.cc:3055] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:16.749924 24397 raft_consensus.cc:740] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Running, Role: LEADER
I20260709 13:11:16.750828 24436 leader_election.cc:304] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:16.750963 24397 consensus_queue.cc:260] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:16.752243 24546 leader_election.cc:290] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 3 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:16.752472 24753 raft_consensus.cc:2804] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:16.752350 24766 raft_consensus.cc:993] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1: : Instructing follower cb1c3a28d32d452fbc4fdbf43cc1bf7b to start an election
I20260709 13:11:16.754212 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d149907bb4478a4af8c412649244a" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:16.752410 24397 raft_consensus.cc:3060] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:16.754931 24398 raft_consensus.cc:3055] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:16.755343 24398 raft_consensus.cc:740] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Running, Role: LEADER
I20260709 13:11:16.756230 24398 consensus_queue.cc:260] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:16.757721 24737 raft_consensus.cc:1081] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Signalling peer cb1c3a28d32d452fbc4fdbf43cc1bf7b to start an election
I20260709 13:11:16.758023 24398 raft_consensus.cc:3060] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:16.759949 24396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "417e26d295ef405584514341f5a6bd21"
dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
 from {username='slave'} at 127.0.0.1:46816
I20260709 13:11:16.760593 24396 raft_consensus.cc:493] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:16.760998 24396 raft_consensus.cc:3060] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:16.764847 24397 raft_consensus.cc:2468] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 2.
I20260709 13:11:16.768522 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d149907bb4478a4af8c412649244a" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:16.769182 24471 raft_consensus.cc:3060] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:16.775094 24398 raft_consensus.cc:2468] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 3.
I20260709 13:11:16.777169 24512 leader_election.cc:304] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:16.775118 24753 raft_consensus.cc:697] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c [term 2 LEADER]: Becoming Leader. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Running, Role: LEADER
I20260709 13:11:16.779181 24471 raft_consensus.cc:2468] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 3.
I20260709 13:11:16.779701 24766 raft_consensus.cc:2804] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:16.779351 24753 consensus_queue.cc:237] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:16.779363 24396 raft_consensus.cc:515] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:16.786350 24396 leader_election.cc:290] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 2 election: Requested vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:16.787585 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417e26d295ef405584514341f5a6bd21" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:16.788210 24471 raft_consensus.cc:3060] T 417e26d295ef405584514341f5a6bd21 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:16.788990 24766 raft_consensus.cc:697] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [term 3 LEADER]: Becoming Leader. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Running, Role: LEADER
I20260709 13:11:16.789258 24547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417e26d295ef405584514341f5a6bd21" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:16.790210 24547 raft_consensus.cc:3055] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:16.790547 24547 raft_consensus.cc:740] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Running, Role: LEADER
I20260709 13:11:16.791539 24547 consensus_queue.cc:260] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:16.793078 24547 raft_consensus.cc:3060] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:16.791591 24766 consensus_queue.cc:237] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:16.797333 24773 raft_consensus.cc:993] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1: : Instructing follower cb1c3a28d32d452fbc4fdbf43cc1bf7b to start an election
I20260709 13:11:16.796572 24296 catalog_manager.cc:5697] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c reported cstate change: term changed from 1 to 2, leader changed from cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129) to 104401b105224f1e9b05d58be1749d9c (127.12.76.130). New cstate: current_term: 2 leader_uuid: "104401b105224f1e9b05d58be1749d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:16.798866 24471 raft_consensus.cc:2468] T 417e26d295ef405584514341f5a6bd21 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 2.
I20260709 13:11:16.800042 24773 raft_consensus.cc:1081] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Signalling peer cb1c3a28d32d452fbc4fdbf43cc1bf7b to start an election
I20260709 13:11:16.801354 24361 leader_election.cc:304] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: 
I20260709 13:11:16.801923 24547 raft_consensus.cc:2468] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 2.
I20260709 13:11:16.802150 24592 raft_consensus.cc:2804] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:16.802314 24396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "853da295b17940229be236438a3d75a9"
dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
 from {username='slave'} at 127.0.0.1:46816
I20260709 13:11:16.802685 24592 raft_consensus.cc:697] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 LEADER]: Becoming Leader. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Running, Role: LEADER
I20260709 13:11:16.802956 24396 raft_consensus.cc:493] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:16.803428 24396 raft_consensus.cc:3060] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:16.803617 24592 consensus_queue.cc:237] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:16.803915 24295 catalog_manager.cc:5697] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 reported cstate change: term changed from 2 to 3, leader changed from cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129) to f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131). New cstate: current_term: 3 leader_uuid: "f4717668718a44baada8b0fc4b30cfe1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.815128 24296 catalog_manager.cc:5697] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b reported cstate change: term changed from 1 to 2, leader changed from f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131) to cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129). New cstate: current_term: 2 leader_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:16.816596 24396 raft_consensus.cc:515] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:16.818543 24396 leader_election.cc:290] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 2 election: Requested vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:16.819247 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853da295b17940229be236438a3d75a9" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:16.819537 24547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853da295b17940229be236438a3d75a9" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:16.819859 24471 raft_consensus.cc:3060] T 853da295b17940229be236438a3d75a9 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:16.820076 24547 raft_consensus.cc:3055] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:16.820430 24547 raft_consensus.cc:740] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Running, Role: LEADER
I20260709 13:11:16.821377 24547 consensus_queue.cc:260] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:16.822726 24547 raft_consensus.cc:3060] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:16.826887 24471 raft_consensus.cc:2468] T 853da295b17940229be236438a3d75a9 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 2.
I20260709 13:11:16.827941 24361 leader_election.cc:304] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: 
I20260709 13:11:16.828611 24592 raft_consensus.cc:2804] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:16.829030 24592 raft_consensus.cc:697] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 LEADER]: Becoming Leader. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Running, Role: LEADER
I20260709 13:11:16.829442 24547 raft_consensus.cc:2468] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 2.
I20260709 13:11:16.829918 24592 consensus_queue.cc:237] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:16.837989 24296 catalog_manager.cc:5697] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b reported cstate change: term changed from 1 to 2, leader changed from f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131) to cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129). New cstate: current_term: 2 leader_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:16.841956 24753 raft_consensus.cc:993] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c: : Instructing follower cb1c3a28d32d452fbc4fdbf43cc1bf7b to start an election
I20260709 13:11:16.842602 24770 raft_consensus.cc:1081] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [term 1 LEADER]: Signalling peer cb1c3a28d32d452fbc4fdbf43cc1bf7b to start an election
I20260709 13:11:16.844152 24396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b164bcf2be54c5a84127382df5c2365"
dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
 from {username='slave'} at 127.0.0.1:46822
I20260709 13:11:16.844681 24396 raft_consensus.cc:493] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:16.845017 24396 raft_consensus.cc:3060] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:16.851153 24396 raft_consensus.cc:515] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:16.852881 24396 leader_election.cc:290] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 2 election: Requested vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:16.853487 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b164bcf2be54c5a84127382df5c2365" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:16.853772 24546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b164bcf2be54c5a84127382df5c2365" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:16.854133 24471 raft_consensus.cc:3055] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:16.854322 24546 raft_consensus.cc:3060] T 7b164bcf2be54c5a84127382df5c2365 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:16.854573 24471 raft_consensus.cc:740] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Running, Role: LEADER
I20260709 13:11:16.855613 24471 consensus_queue.cc:260] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:16.856920 24471 raft_consensus.cc:3060] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:16.861179 24546 raft_consensus.cc:2468] T 7b164bcf2be54c5a84127382df5c2365 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 2.
I20260709 13:11:16.862504 24361 leader_election.cc:304] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:16.863246 24592 raft_consensus.cc:2804] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:16.863687 24471 raft_consensus.cc:2468] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 2.
I20260709 13:11:16.863754 24592 raft_consensus.cc:697] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 LEADER]: Becoming Leader. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Running, Role: LEADER
I20260709 13:11:16.865489 24592 consensus_queue.cc:237] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:16.873178 24296 catalog_manager.cc:5697] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b reported cstate change: term changed from 1 to 2, leader changed from 104401b105224f1e9b05d58be1749d9c (127.12.76.130) to cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129). New cstate: current_term: 2 leader_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:16.935081 24753 raft_consensus.cc:993] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c: : Instructing follower cb1c3a28d32d452fbc4fdbf43cc1bf7b to start an election
I20260709 13:11:16.935598 24770 raft_consensus.cc:1081] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [term 1 LEADER]: Signalling peer cb1c3a28d32d452fbc4fdbf43cc1bf7b to start an election
I20260709 13:11:16.936983 24396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49d6d03206a0410aa73ce2a90384d519"
dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
 from {username='slave'} at 127.0.0.1:46822
I20260709 13:11:16.937453 24396 raft_consensus.cc:493] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:16.937757 24396 raft_consensus.cc:3060] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:16.942684 24396 raft_consensus.cc:515] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:16.944422 24396 leader_election.cc:290] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 2 election: Requested vote from peers 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:16.945524 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d6d03206a0410aa73ce2a90384d519" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:16.945760 24546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d6d03206a0410aa73ce2a90384d519" candidate_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:16.946076 24471 raft_consensus.cc:3055] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:16.946292 24546 raft_consensus.cc:3060] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:16.946429 24471 raft_consensus.cc:740] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Running, Role: LEADER
I20260709 13:11:16.947316 24471 consensus_queue.cc:260] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:16.948323 24471 raft_consensus.cc:3060] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:16.950886 24546 raft_consensus.cc:2468] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 2.
I20260709 13:11:16.951875 24361 leader_election.cc:304] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:16.952474 24592 raft_consensus.cc:2804] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:16.952798 24471 raft_consensus.cc:2468] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1c3a28d32d452fbc4fdbf43cc1bf7b in term 2.
I20260709 13:11:16.952848 24592 raft_consensus.cc:697] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 LEADER]: Becoming Leader. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Running, Role: LEADER
I20260709 13:11:16.953990 24592 consensus_queue.cc:237] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:16.961664 24296 catalog_manager.cc:5697] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b reported cstate change: term changed from 1 to 2, leader changed from 104401b105224f1e9b05d58be1749d9c (127.12.76.130) to cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129). New cstate: current_term: 2 leader_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:17.001540 24763 raft_consensus.cc:993] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: : Instructing follower 104401b105224f1e9b05d58be1749d9c to start an election
I20260709 13:11:17.002002 24592 raft_consensus.cc:1081] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Signalling peer 104401b105224f1e9b05d58be1749d9c to start an election
I20260709 13:11:17.003288 24471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33faf243a678428d85bee175371e7bd0"
dest_uuid: "104401b105224f1e9b05d58be1749d9c"
 from {username='slave'} at 127.0.0.1:43976
I20260709 13:11:17.003837 24471 raft_consensus.cc:493] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:17.004118 24471 raft_consensus.cc:3060] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:17.008960 24471 raft_consensus.cc:515] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:17.010555 24471 leader_election.cc:290] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 2 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:17.011201 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33faf243a678428d85bee175371e7bd0" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:17.011626 24546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33faf243a678428d85bee175371e7bd0" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:17.011843 24397 raft_consensus.cc:3055] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:17.012233 24546 raft_consensus.cc:3060] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:17.012321 24397 raft_consensus.cc:740] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Running, Role: LEADER
I20260709 13:11:17.013211 24397 consensus_queue.cc:260] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:17.014127 24397 raft_consensus.cc:3060] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:17.017249 24546 raft_consensus.cc:2468] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 2.
I20260709 13:11:17.018301 24436 leader_election.cc:304] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:17.019058 24770 raft_consensus.cc:2804] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:17.019582 24770 raft_consensus.cc:697] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [term 2 LEADER]: Becoming Leader. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Running, Role: LEADER
I20260709 13:11:17.019671 24397 raft_consensus.cc:2468] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 2.
I20260709 13:11:17.020486 24770 consensus_queue.cc:237] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:17.028782 24296 catalog_manager.cc:5697] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c reported cstate change: term changed from 1 to 2, leader changed from cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129) to 104401b105224f1e9b05d58be1749d9c (127.12.76.130). New cstate: current_term: 2 leader_uuid: "104401b105224f1e9b05d58be1749d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:17.048804 24763 raft_consensus.cc:993] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: : Instructing follower 104401b105224f1e9b05d58be1749d9c to start an election
I20260709 13:11:17.049293 24592 raft_consensus.cc:1081] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Signalling peer 104401b105224f1e9b05d58be1749d9c to start an election
I20260709 13:11:17.050688 24471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19b1fd5922b448ebbf580bca848ac864"
dest_uuid: "104401b105224f1e9b05d58be1749d9c"
 from {username='slave'} at 127.0.0.1:43976
I20260709 13:11:17.051156 24471 raft_consensus.cc:493] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:17.051476 24471 raft_consensus.cc:3060] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:17.056253 24471 raft_consensus.cc:515] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:17.057662 24471 leader_election.cc:290] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 2 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:17.058622 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b1fd5922b448ebbf580bca848ac864" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:17.058672 24546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b1fd5922b448ebbf580bca848ac864" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:17.059230 24397 raft_consensus.cc:3055] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:17.059551 24546 raft_consensus.cc:3060] T 19b1fd5922b448ebbf580bca848ac864 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:17.059649 24397 raft_consensus.cc:740] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Running, Role: LEADER
I20260709 13:11:17.060462 24397 consensus_queue.cc:260] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:17.061419 24397 raft_consensus.cc:3060] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:17.064968 24546 raft_consensus.cc:2468] T 19b1fd5922b448ebbf580bca848ac864 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 2.
I20260709 13:11:17.065924 24397 raft_consensus.cc:2468] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 2.
I20260709 13:11:17.066008 24436 leader_election.cc:304] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:17.066838 24770 raft_consensus.cc:2804] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:17.067266 24770 raft_consensus.cc:697] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c [term 2 LEADER]: Becoming Leader. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Running, Role: LEADER
I20260709 13:11:17.068125 24770 consensus_queue.cc:237] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:17.076035 24296 catalog_manager.cc:5697] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c reported cstate change: term changed from 1 to 2, leader changed from cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129) to 104401b105224f1e9b05d58be1749d9c (127.12.76.130). New cstate: current_term: 2 leader_uuid: "104401b105224f1e9b05d58be1749d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:17.092032 24737 raft_consensus.cc:993] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1: : Instructing follower 104401b105224f1e9b05d58be1749d9c to start an election
I20260709 13:11:17.092557 24773 raft_consensus.cc:1081] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Signalling peer 104401b105224f1e9b05d58be1749d9c to start an election
I20260709 13:11:17.093945 24471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "465329cb805e4e7fba15939cecd9759e"
dest_uuid: "104401b105224f1e9b05d58be1749d9c"
 from {username='slave'} at 127.0.0.1:43968
I20260709 13:11:17.094426 24471 raft_consensus.cc:493] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:17.094722 24471 raft_consensus.cc:3060] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:17.099138 24471 raft_consensus.cc:515] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:17.101330 24471 leader_election.cc:290] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 2 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807)
I20260709 13:11:17.102039 24397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465329cb805e4e7fba15939cecd9759e" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:17.102324 24546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465329cb805e4e7fba15939cecd9759e" candidate_uuid: "104401b105224f1e9b05d58be1749d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
I20260709 13:11:17.102820 24397 raft_consensus.cc:3060] T 465329cb805e4e7fba15939cecd9759e P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:17.102986 24546 raft_consensus.cc:3055] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:17.103500 24546 raft_consensus.cc:740] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Running, Role: LEADER
I20260709 13:11:17.104441 24546 consensus_queue.cc:260] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:17.105695 24546 raft_consensus.cc:3060] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:17.109804 24397 raft_consensus.cc:2468] T 465329cb805e4e7fba15939cecd9759e P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 2.
I20260709 13:11:17.111070 24438 leader_election.cc:304] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, cb1c3a28d32d452fbc4fdbf43cc1bf7b; no voters: 
I20260709 13:11:17.111513 24546 raft_consensus.cc:2468] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 104401b105224f1e9b05d58be1749d9c in term 2.
I20260709 13:11:17.111888 24770 raft_consensus.cc:2804] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:17.112408 24770 raft_consensus.cc:697] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c [term 2 LEADER]: Becoming Leader. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Running, Role: LEADER
I20260709 13:11:17.113240 24770 consensus_queue.cc:237] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:17.120054 24296 catalog_manager.cc:5697] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c reported cstate change: term changed from 1 to 2, leader changed from f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131) to 104401b105224f1e9b05d58be1749d9c (127.12.76.130). New cstate: current_term: 2 leader_uuid: "104401b105224f1e9b05d58be1749d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:17.210079 24397 raft_consensus.cc:1275] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Refusing update from remote peer 104401b105224f1e9b05d58be1749d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:17.211568 24753 consensus_queue.cc:1048] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:17.212709 24546 raft_consensus.cc:1275] T bbfb443d80634ca48fe563786c4df46d P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Refusing update from remote peer 104401b105224f1e9b05d58be1749d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:17.214089 24753 consensus_queue.cc:1048] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:17.242583 24471 raft_consensus.cc:1275] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [term 3 FOLLOWER]: Refusing update from remote peer f4717668718a44baada8b0fc4b30cfe1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:17.243861 24773 consensus_queue.cc:1048] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:17.246783 24397 raft_consensus.cc:1275] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 3 FOLLOWER]: Refusing update from remote peer f4717668718a44baada8b0fc4b30cfe1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:17.247224 24473 raft_consensus.cc:1275] T 417e26d295ef405584514341f5a6bd21 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Refusing update from remote peer cb1c3a28d32d452fbc4fdbf43cc1bf7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:17.248898 24592 consensus_queue.cc:1048] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:17.249715 24737 consensus_queue.cc:1048] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:17.261637 24546 raft_consensus.cc:1275] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Refusing update from remote peer cb1c3a28d32d452fbc4fdbf43cc1bf7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:17.264411 24592 consensus_queue.cc:1048] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:17.348457 24546 raft_consensus.cc:1275] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Refusing update from remote peer cb1c3a28d32d452fbc4fdbf43cc1bf7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:17.349643 24592 consensus_queue.cc:1048] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:17.361792 24473 raft_consensus.cc:1275] T 853da295b17940229be236438a3d75a9 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Refusing update from remote peer cb1c3a28d32d452fbc4fdbf43cc1bf7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:17.362655 24471 raft_consensus.cc:1275] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Refusing update from remote peer cb1c3a28d32d452fbc4fdbf43cc1bf7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:17.363018 24592 consensus_queue.cc:1048] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:17.365079 24787 consensus_queue.cc:1048] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:17.367918 24547 raft_consensus.cc:1275] T 7b164bcf2be54c5a84127382df5c2365 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Refusing update from remote peer cb1c3a28d32d452fbc4fdbf43cc1bf7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:17.373204 24787 consensus_queue.cc:1048] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:17.496209 24471 raft_consensus.cc:1275] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Refusing update from remote peer cb1c3a28d32d452fbc4fdbf43cc1bf7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:17.497323 24592 consensus_queue.cc:1048] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:17.500864 24546 raft_consensus.cc:1275] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Refusing update from remote peer 104401b105224f1e9b05d58be1749d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:17.504130 24770 consensus_queue.cc:1048] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:17.508497 24397 raft_consensus.cc:1275] T 465329cb805e4e7fba15939cecd9759e P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Refusing update from remote peer 104401b105224f1e9b05d58be1749d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:17.509788 24546 raft_consensus.cc:1275] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Refusing update from remote peer cb1c3a28d32d452fbc4fdbf43cc1bf7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:17.512694 24753 consensus_queue.cc:1048] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:17.513008 24592 consensus_queue.cc:1048] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:17.529732 24396 raft_consensus.cc:1275] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Refusing update from remote peer 104401b105224f1e9b05d58be1749d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:17.534041 24753 consensus_queue.cc:1048] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:17.534847 24547 raft_consensus.cc:1275] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Refusing update from remote peer 104401b105224f1e9b05d58be1749d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:17.536463 24753 consensus_queue.cc:1048] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:17.591523 24396 raft_consensus.cc:1275] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Refusing update from remote peer 104401b105224f1e9b05d58be1749d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:17.592707 24753 consensus_queue.cc:1048] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:17.602018 24547 raft_consensus.cc:1275] T 19b1fd5922b448ebbf580bca848ac864 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Refusing update from remote peer 104401b105224f1e9b05d58be1749d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:17.603718 24797 consensus_queue.cc:1048] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:19.648386 24295 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51008:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:11:19.667728 24295 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51008:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:11:19.796711 12594 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:11:19.903774 24848 tablet.cc:1724] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:19.922650 24295 catalog_manager.cc:5789] TS f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131:35807) does not have the latest schema for tablet 263d149907bb4478a4af8c412649244a (table soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]). Expected version 1 got 0
W20260709 13:11:19.936947 24424 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:417e26d295ef405584514341f5a6bd21)
W20260709 13:11:19.943711 24424 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:417e26d295ef405584514341f5a6bd21)
W20260709 13:11:19.944782 24424 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:417e26d295ef405584514341f5a6bd21)
I20260709 13:11:19.957543 24854 tablet.cc:1724] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:19.936038 24361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:43451, user_credentials={real_user=slave}} blocked reactor thread for 64015.1us
I20260709 13:11:19.994778 24860 tablet.cc:1724] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:19.976518 24861 tablet.cc:1724] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:20.006999 24295 catalog_manager.cc:5789] TS cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241) does not have the latest schema for tablet 853da295b17940229be236438a3d75a9 (table soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]). Expected version 1 got 0
I20260709 13:11:20.008265 24295 catalog_manager.cc:5789] TS cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241) does not have the latest schema for tablet 49d6d03206a0410aa73ce2a90384d519 (table soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]). Expected version 1 got 0
I20260709 13:11:20.000329 24472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33faf243a678428d85bee175371e7bd0"
dest_uuid: "104401b105224f1e9b05d58be1749d9c"
mode: GRACEFUL
new_leader_uuid: "f4717668718a44baada8b0fc4b30cfe1"
 from {username='slave'} at 127.0.0.1:55762
I20260709 13:11:20.010537 24472 raft_consensus.cc:606] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [term 2 LEADER]: Received request to transfer leadership to TS f4717668718a44baada8b0fc4b30cfe1
I20260709 13:11:20.027160 24848 tablet.cc:1724] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:20.077780 24361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.130:43451, user_credentials={real_user=slave}} blocked reactor thread for 72123.1us
I20260709 13:11:20.092743 24864 tablet.cc:1724] T 417e26d295ef405584514341f5a6bd21 P 104401b105224f1e9b05d58be1749d9c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:20.103252 24858 tablet.cc:1724] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:20.116524 24869 tablet.cc:1724] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:20.127595 24436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:35807, user_credentials={real_user=slave}} blocked reactor thread for 116726us
I20260709 13:11:20.123237 24847 raft_consensus.cc:993] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c: : Instructing follower f4717668718a44baada8b0fc4b30cfe1 to start an election
I20260709 13:11:20.173931 24847 raft_consensus.cc:1081] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [term 2 LEADER]: Signalling peer f4717668718a44baada8b0fc4b30cfe1 to start an election
I20260709 13:11:20.153561 24863 tablet.cc:1724] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:20.114401 24874 tablet.cc:1724] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:20.188172 24295 catalog_manager.cc:5789] TS 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451) does not have the latest schema for tablet bbfb443d80634ca48fe563786c4df46d (table soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]). Expected version 1 got 0
I20260709 13:11:20.188932 24295 catalog_manager.cc:5789] TS 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451) does not have the latest schema for tablet 19b1fd5922b448ebbf580bca848ac864 (table soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395]). Expected version 1 got 0
I20260709 13:11:20.192619 24876 tablet.cc:1724] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:20.203045 24543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33faf243a678428d85bee175371e7bd0"
dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
 from {username='slave'} at 127.0.0.1:40816
I20260709 13:11:20.203824 24543 raft_consensus.cc:493] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:20.204236 24543 raft_consensus.cc:3060] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:20.082326 24862 tablet.cc:1724] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:20.217478 24861 tablet.cc:1724] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:20.219834 24394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49d6d03206a0410aa73ce2a90384d519"
dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
mode: GRACEFUL
new_leader_uuid: "f4717668718a44baada8b0fc4b30cfe1"
 from {username='slave'} at 127.0.0.1:40044
I20260709 13:11:20.237356 24394 raft_consensus.cc:606] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 LEADER]: Received request to transfer leadership to TS f4717668718a44baada8b0fc4b30cfe1
I20260709 13:11:20.244805 12594 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:11:20.251041 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:20.241546 24854 tablet.cc:1724] T 465329cb805e4e7fba15939cecd9759e P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:20.241845 24848 tablet.cc:1724] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:20.239379 24864 tablet.cc:1724] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:20.240233 24860 tablet.cc:1724] T 7b164bcf2be54c5a84127382df5c2365 P f4717668718a44baada8b0fc4b30cfe1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:20.268225 24470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7a46359788d4c1688bfff6b39ebb9ba"
dest_uuid: "104401b105224f1e9b05d58be1749d9c"
mode: GRACEFUL
new_leader_uuid: "f4717668718a44baada8b0fc4b30cfe1"
 from {username='slave'} at 127.0.0.1:55762
I20260709 13:11:20.268913 24470 raft_consensus.cc:606] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [term 2 LEADER]: Received request to transfer leadership to TS f4717668718a44baada8b0fc4b30cfe1
I20260709 13:11:20.271175 24876 tablet.cc:1724] T 19b1fd5922b448ebbf580bca848ac864 P f4717668718a44baada8b0fc4b30cfe1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:20.274668 24863 tablet.cc:1724] T bbfb443d80634ca48fe563786c4df46d P f4717668718a44baada8b0fc4b30cfe1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:20.271541 24543 raft_consensus.cc:515] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:20.275182 24394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "faee6f7d44bb40e8afcf691b6ff167f2"
dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
mode: GRACEFUL
new_leader_uuid: "f4717668718a44baada8b0fc4b30cfe1"
 from {username='slave'} at 127.0.0.1:40044
I20260709 13:11:20.282356 24394 raft_consensus.cc:606] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 LEADER]: Received request to transfer leadership to TS f4717668718a44baada8b0fc4b30cfe1
I20260709 13:11:20.276182 24874 tablet.cc:1724] T 853da295b17940229be236438a3d75a9 P 104401b105224f1e9b05d58be1749d9c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:20.277391 24878 tablet.cc:1724] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:20.289419 24543 leader_election.cc:290] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 3 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:20.290620 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33faf243a678428d85bee175371e7bd0" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:20.300017 24470 raft_consensus.cc:3055] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:20.300367 24470 raft_consensus.cc:740] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Running, Role: LEADER
I20260709 13:11:20.300292 24862 tablet.cc:1724] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:20.301367 24470 consensus_queue.cc:260] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:20.302541 24470 raft_consensus.cc:3060] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:20.304502 24860 tablet.cc:1724] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:20.310120 24470 raft_consensus.cc:2468] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 3.
I20260709 13:11:20.288939 24864 tablet.cc:1724] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:20.293135 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33faf243a678428d85bee175371e7bd0" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:20.311547 24510 leader_election.cc:304] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:20.299010 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:20.312762 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:20.264109 24858 tablet.cc:1724] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:20.311689 24398 raft_consensus.cc:3060] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:20.313480 24806 raft_consensus.cc:2804] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:20.314005 24806 raft_consensus.cc:697] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 [term 3 LEADER]: Becoming Leader. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Running, Role: LEADER
I20260709 13:11:20.314914 24806 consensus_queue.cc:237] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:20.298702 24869 tablet.cc:1724] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:20.320271 24398 raft_consensus.cc:2468] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 3.
I20260709 13:11:20.323218 24878 tablet.cc:1724] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:20.340919 24293 catalog_manager.cc:5697] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 reported cstate change: term changed from 2 to 3, leader changed from 104401b105224f1e9b05d58be1749d9c (127.12.76.130) to f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131). New cstate: current_term: 3 leader_uuid: "f4717668718a44baada8b0fc4b30cfe1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:20.357122 24296 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d: soft_deleted_table [id=bedac827f6e14b70a65bdf6f838ba395] alter complete (version 1)
I20260709 13:11:20.573962 24833 raft_consensus.cc:993] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: : Instructing follower f4717668718a44baada8b0fc4b30cfe1 to start an election
I20260709 13:11:20.574617 24852 raft_consensus.cc:1081] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 LEADER]: Signalling peer f4717668718a44baada8b0fc4b30cfe1 to start an election
I20260709 13:11:20.576248 24543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49d6d03206a0410aa73ce2a90384d519"
dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
 from {username='slave'} at 127.0.0.1:40818
I20260709 13:11:20.576821 24543 raft_consensus.cc:493] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:20.577121 24543 raft_consensus.cc:3060] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:20.582165 24543 raft_consensus.cc:515] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:20.583817 24543 leader_election.cc:290] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 3 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:20.584580 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d6d03206a0410aa73ce2a90384d519" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:20.585251 24398 raft_consensus.cc:3055] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:20.585644 24398 raft_consensus.cc:740] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Running, Role: LEADER
I20260709 13:11:20.586006 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d6d03206a0410aa73ce2a90384d519" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:20.586556 24470 raft_consensus.cc:3060] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:20.586365 24398 consensus_queue.cc:260] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:20.587598 24398 raft_consensus.cc:3060] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:20.592271 24470 raft_consensus.cc:2468] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 3.
I20260709 13:11:20.593771 24398 raft_consensus.cc:2468] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 3.
I20260709 13:11:20.593722 24510 leader_election.cc:304] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104401b105224f1e9b05d58be1749d9c, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:20.594704 24806 raft_consensus.cc:2804] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:20.595212 24806 raft_consensus.cc:697] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 [term 3 LEADER]: Becoming Leader. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Running, Role: LEADER
I20260709 13:11:20.596035 24806 consensus_queue.cc:237] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:20.603017 24293 catalog_manager.cc:5697] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 reported cstate change: term changed from 2 to 3, leader changed from cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129) to f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131). New cstate: current_term: 3 leader_uuid: "f4717668718a44baada8b0fc4b30cfe1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:20.614924 24808 raft_consensus.cc:993] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c: : Instructing follower f4717668718a44baada8b0fc4b30cfe1 to start an election
I20260709 13:11:20.615483 24847 raft_consensus.cc:1081] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [term 2 LEADER]: Signalling peer f4717668718a44baada8b0fc4b30cfe1 to start an election
I20260709 13:11:20.616830 24543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7a46359788d4c1688bfff6b39ebb9ba"
dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
 from {username='slave'} at 127.0.0.1:40816
I20260709 13:11:20.617233 24543 raft_consensus.cc:493] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:20.617547 24543 raft_consensus.cc:3060] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:20.622810 24543 raft_consensus.cc:515] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:20.624519 24543 leader_election.cc:290] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 3 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:20.625221 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a46359788d4c1688bfff6b39ebb9ba" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:20.625483 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a46359788d4c1688bfff6b39ebb9ba" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:20.625829 24398 raft_consensus.cc:3060] T e7a46359788d4c1688bfff6b39ebb9ba P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:20.626104 24470 raft_consensus.cc:3055] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:20.626428 24470 raft_consensus.cc:740] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 104401b105224f1e9b05d58be1749d9c, State: Running, Role: LEADER
I20260709 13:11:20.627120 24470 consensus_queue.cc:260] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:20.628170 24470 raft_consensus.cc:3060] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:20.634510 24398 raft_consensus.cc:2468] T e7a46359788d4c1688bfff6b39ebb9ba P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 3.
I20260709 13:11:20.635404 24470 raft_consensus.cc:2468] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 3.
I20260709 13:11:20.635810 24512 leader_election.cc:304] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:20.636909 24806 raft_consensus.cc:2804] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:20.637460 24806 raft_consensus.cc:697] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 3 LEADER]: Becoming Leader. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Running, Role: LEADER
I20260709 13:11:20.638298 24806 consensus_queue.cc:237] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:20.645911 24293 catalog_manager.cc:5697] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 reported cstate change: term changed from 2 to 3, leader changed from 104401b105224f1e9b05d58be1749d9c (127.12.76.130) to f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131). New cstate: current_term: 3 leader_uuid: "f4717668718a44baada8b0fc4b30cfe1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:20.647147 24833 raft_consensus.cc:993] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: : Instructing follower f4717668718a44baada8b0fc4b30cfe1 to start an election
I20260709 13:11:20.647706 24852 raft_consensus.cc:1081] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 LEADER]: Signalling peer f4717668718a44baada8b0fc4b30cfe1 to start an election
I20260709 13:11:20.649165 24543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "faee6f7d44bb40e8afcf691b6ff167f2"
dest_uuid: "f4717668718a44baada8b0fc4b30cfe1"
 from {username='slave'} at 127.0.0.1:40818
I20260709 13:11:20.649648 24543 raft_consensus.cc:493] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:20.649963 24543 raft_consensus.cc:3060] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:20.656404 24543 raft_consensus.cc:515] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:20.658293 24543 leader_election.cc:290] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 3 election: Requested vote from peers cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241), 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451)
I20260709 13:11:20.659029 24398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faee6f7d44bb40e8afcf691b6ff167f2" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b"
I20260709 13:11:20.659459 24470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faee6f7d44bb40e8afcf691b6ff167f2" candidate_uuid: "f4717668718a44baada8b0fc4b30cfe1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "104401b105224f1e9b05d58be1749d9c"
I20260709 13:11:20.659650 24398 raft_consensus.cc:3055] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:20.660053 24398 raft_consensus.cc:740] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cb1c3a28d32d452fbc4fdbf43cc1bf7b, State: Running, Role: LEADER
I20260709 13:11:20.660086 24470 raft_consensus.cc:3060] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:20.660846 24398 consensus_queue.cc:260] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:20.662199 24398 raft_consensus.cc:3060] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:20.669059 24398 raft_consensus.cc:2468] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 3.
I20260709 13:11:20.669976 24470 raft_consensus.cc:2468] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4717668718a44baada8b0fc4b30cfe1 in term 3.
I20260709 13:11:20.670456 24512 leader_election.cc:304] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb1c3a28d32d452fbc4fdbf43cc1bf7b, f4717668718a44baada8b0fc4b30cfe1; no voters: 
I20260709 13:11:20.671357 24806 raft_consensus.cc:2804] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:20.671900 24806 raft_consensus.cc:697] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 3 LEADER]: Becoming Leader. State: Replica: f4717668718a44baada8b0fc4b30cfe1, State: Running, Role: LEADER
I20260709 13:11:20.672737 24806 consensus_queue.cc:237] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } }
I20260709 13:11:20.680365 24293 catalog_manager.cc:5697] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 reported cstate change: term changed from 2 to 3, leader changed from cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129) to f4717668718a44baada8b0fc4b30cfe1 (127.12.76.131). New cstate: current_term: 3 leader_uuid: "f4717668718a44baada8b0fc4b30cfe1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4717668718a44baada8b0fc4b30cfe1" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 35807 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:20.754837 24394 raft_consensus.cc:1275] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 3 FOLLOWER]: Refusing update from remote peer f4717668718a44baada8b0fc4b30cfe1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:20.756213 24806 consensus_queue.cc:1048] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:20.759662 24470 raft_consensus.cc:1275] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [term 3 FOLLOWER]: Refusing update from remote peer f4717668718a44baada8b0fc4b30cfe1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:20.760977 24806 consensus_queue.cc:1048] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:21.025311 24394 raft_consensus.cc:1275] T e7a46359788d4c1688bfff6b39ebb9ba P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 3 FOLLOWER]: Refusing update from remote peer f4717668718a44baada8b0fc4b30cfe1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:21.026643 24806 consensus_queue.cc:1048] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:21.036017 24470 raft_consensus.cc:1275] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [term 3 FOLLOWER]: Refusing update from remote peer f4717668718a44baada8b0fc4b30cfe1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:21.038851 24831 consensus_queue.cc:1048] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:21.149699 24470 raft_consensus.cc:1275] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [term 3 FOLLOWER]: Refusing update from remote peer f4717668718a44baada8b0fc4b30cfe1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:21.150961 24831 consensus_queue.cc:1048] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:21.158732 24394 raft_consensus.cc:1275] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 3 FOLLOWER]: Refusing update from remote peer f4717668718a44baada8b0fc4b30cfe1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:21.160235 24806 consensus_queue.cc:1048] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:21.199497 24398 raft_consensus.cc:1275] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 3 FOLLOWER]: Refusing update from remote peer f4717668718a44baada8b0fc4b30cfe1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:21.200757 24806 consensus_queue.cc:1048] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1c3a28d32d452fbc4fdbf43cc1bf7b" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:21.209276 24470 raft_consensus.cc:1275] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [term 3 FOLLOWER]: Refusing update from remote peer f4717668718a44baada8b0fc4b30cfe1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:21.210924 24806 consensus_queue.cc:1048] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "104401b105224f1e9b05d58be1749d9c" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:21.373844 12594 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:11:21.378798 12594 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:11:21.379289 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:21.384222 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:11:21.384609 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:22.414090 12594 tablet_server.cc:179] TabletServer@127.12.76.129:0 shutting down...
I20260709 13:11:22.440742 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:22.441588 12594 tablet_replica.cc:333] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b: stopping tablet replica
I20260709 13:11:22.442433 12594 raft_consensus.cc:2243] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.442974 12594 raft_consensus.cc:2272] T 263d149907bb4478a4af8c412649244a P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.445396 12594 tablet_replica.cc:333] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: stopping tablet replica
I20260709 13:11:22.446023 12594 raft_consensus.cc:2243] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.446818 12594 raft_consensus.cc:2272] T 853da295b17940229be236438a3d75a9 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.449492 12594 tablet_replica.cc:333] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b: stopping tablet replica
I20260709 13:11:22.450259 12594 raft_consensus.cc:2243] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.450740 12594 raft_consensus.cc:2272] T bbfb443d80634ca48fe563786c4df46d P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:22.450941 24512 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
I20260709 13:11:22.453702 12594 tablet_replica.cc:333] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: stopping tablet replica
W20260709 13:11:22.453969 24512 consensus_peers.cc:597] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1 -> Peer cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241): Couldn't send request to peer cb1c3a28d32d452fbc4fdbf43cc1bf7b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:22.454653 12594 raft_consensus.cc:2243] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.455152 12594 raft_consensus.cc:2272] T faee6f7d44bb40e8afcf691b6ff167f2 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.457423 12594 tablet_replica.cc:333] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: stopping tablet replica
I20260709 13:11:22.458011 12594 raft_consensus.cc:2243] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.458424 12594 raft_consensus.cc:2272] T 33faf243a678428d85bee175371e7bd0 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.460476 12594 tablet_replica.cc:333] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: stopping tablet replica
I20260709 13:11:22.461081 12594 raft_consensus.cc:2243] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.461515 12594 raft_consensus.cc:2272] T 19b1fd5922b448ebbf580bca848ac864 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.463709 12594 tablet_replica.cc:333] T 465329cb805e4e7fba15939cecd9759e P cb1c3a28d32d452fbc4fdbf43cc1bf7b: stopping tablet replica
I20260709 13:11:22.464295 12594 raft_consensus.cc:2243] T 465329cb805e4e7fba15939cecd9759e P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.464716 12594 raft_consensus.cc:2272] T 465329cb805e4e7fba15939cecd9759e P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.466771 12594 tablet_replica.cc:333] T 3b3ec318f9304bc08fad059e9895e87c P cb1c3a28d32d452fbc4fdbf43cc1bf7b: stopping tablet replica
I20260709 13:11:22.467478 12594 raft_consensus.cc:2243] T 3b3ec318f9304bc08fad059e9895e87c P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.467883 12594 raft_consensus.cc:2272] T 3b3ec318f9304bc08fad059e9895e87c P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.470250 12594 tablet_replica.cc:333] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: stopping tablet replica
I20260709 13:11:22.470845 12594 raft_consensus.cc:2243] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.471750 12594 raft_consensus.cc:2272] T 40209789a45a43478a84057bb2f85444 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.473904 12594 tablet_replica.cc:333] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: stopping tablet replica
I20260709 13:11:22.474490 12594 raft_consensus.cc:2243] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.474956 12594 raft_consensus.cc:2272] T f36cde9868304ce6ba53977484021f63 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.477875 12594 tablet_replica.cc:333] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: stopping tablet replica
I20260709 13:11:22.478750 12594 raft_consensus.cc:2243] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.479525 12594 raft_consensus.cc:2272] T 7b164bcf2be54c5a84127382df5c2365 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.481453 12594 tablet_replica.cc:333] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: stopping tablet replica
I20260709 13:11:22.482031 12594 raft_consensus.cc:2243] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.482939 12594 raft_consensus.cc:2272] T bb70e8be13544040a6bef963d1056f29 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.485885 12594 tablet_replica.cc:333] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: stopping tablet replica
I20260709 13:11:22.486488 12594 raft_consensus.cc:2243] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:11:22.487160 24438 consensus_peers.cc:597] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c -> Peer cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241): Couldn't send request to peer cb1c3a28d32d452fbc4fdbf43cc1bf7b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:22.487200 12594 raft_consensus.cc:2272] T 417e26d295ef405584514341f5a6bd21 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.489535 12594 tablet_replica.cc:333] T e7a46359788d4c1688bfff6b39ebb9ba P cb1c3a28d32d452fbc4fdbf43cc1bf7b: stopping tablet replica
I20260709 13:11:22.490116 12594 raft_consensus.cc:2243] T e7a46359788d4c1688bfff6b39ebb9ba P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.490661 12594 raft_consensus.cc:2272] T e7a46359788d4c1688bfff6b39ebb9ba P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.492650 12594 tablet_replica.cc:333] T e2eef84f60154cbfb6443c8bd9fe56d3 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: stopping tablet replica
I20260709 13:11:22.493148 12594 raft_consensus.cc:2243] T e2eef84f60154cbfb6443c8bd9fe56d3 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.493614 12594 raft_consensus.cc:2272] T e2eef84f60154cbfb6443c8bd9fe56d3 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.496042 12594 tablet_replica.cc:333] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: stopping tablet replica
I20260709 13:11:22.496575 12594 raft_consensus.cc:2243] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.497388 12594 raft_consensus.cc:2272] T c1f30fcf9ddb433a95594b906e4b29e5 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.499522 12594 tablet_replica.cc:333] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: stopping tablet replica
I20260709 13:11:22.500058 12594 raft_consensus.cc:2243] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.500456 12594 raft_consensus.cc:2272] T 49d6d03206a0410aa73ce2a90384d519 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.502416 12594 tablet_replica.cc:333] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b: stopping tablet replica
I20260709 13:11:22.502930 12594 raft_consensus.cc:2243] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.503522 12594 raft_consensus.cc:2272] T a4cdb73e8b3f4f0f879a792183a634d7 P cb1c3a28d32d452fbc4fdbf43cc1bf7b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:22.537079 24438 consensus_peers.cc:597] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c -> Peer cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241): Couldn't send request to peer cb1c3a28d32d452fbc4fdbf43cc1bf7b. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:22.546444 12594 tablet_server.cc:196] TabletServer@127.12.76.129:0 shutdown complete.
W20260709 13:11:22.577270 24438 consensus_peers.cc:597] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c -> Peer cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241): Couldn't send request to peer cb1c3a28d32d452fbc4fdbf43cc1bf7b. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:22.583298 12594 tablet_server.cc:179] TabletServer@127.12.76.130:0 shutting down...
I20260709 13:11:22.613508 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:22.614390 12594 tablet_replica.cc:333] T 853da295b17940229be236438a3d75a9 P 104401b105224f1e9b05d58be1749d9c: stopping tablet replica
I20260709 13:11:22.615155 12594 raft_consensus.cc:2243] T 853da295b17940229be236438a3d75a9 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.615670 12594 raft_consensus.cc:2272] T 853da295b17940229be236438a3d75a9 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:22.617645 24510 consensus_peers.cc:597] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 -> Peer 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451): Couldn't send request to peer 104401b105224f1e9b05d58be1749d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:22.618093 12594 tablet_replica.cc:333] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c: stopping tablet replica
I20260709 13:11:22.618757 12594 raft_consensus.cc:2243] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.619524 12594 raft_consensus.cc:2272] T bbfb443d80634ca48fe563786c4df46d P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.621397 12594 tablet_replica.cc:333] T 417e26d295ef405584514341f5a6bd21 P 104401b105224f1e9b05d58be1749d9c: stopping tablet replica
I20260709 13:11:22.621940 12594 raft_consensus.cc:2243] T 417e26d295ef405584514341f5a6bd21 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.622341 12594 raft_consensus.cc:2272] T 417e26d295ef405584514341f5a6bd21 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.624164 12594 tablet_replica.cc:333] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c: stopping tablet replica
I20260709 13:11:22.624701 12594 raft_consensus.cc:2243] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.625099 12594 raft_consensus.cc:2272] T 263d149907bb4478a4af8c412649244a P 104401b105224f1e9b05d58be1749d9c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.626889 12594 tablet_replica.cc:333] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c: stopping tablet replica
I20260709 13:11:22.627466 12594 raft_consensus.cc:2243] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.628252 12594 raft_consensus.cc:2272] T 19b1fd5922b448ebbf580bca848ac864 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.630038 12594 tablet_replica.cc:333] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c: stopping tablet replica
I20260709 13:11:22.630546 12594 raft_consensus.cc:2243] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.631251 12594 raft_consensus.cc:2272] T 465329cb805e4e7fba15939cecd9759e P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.633152 12594 tablet_replica.cc:333] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c: stopping tablet replica
I20260709 13:11:22.633661 12594 raft_consensus.cc:2243] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.634388 12594 raft_consensus.cc:2272] T 3b3ec318f9304bc08fad059e9895e87c P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.636528 12594 tablet_replica.cc:333] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c: stopping tablet replica
I20260709 13:11:22.637058 12594 raft_consensus.cc:2243] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.637809 12594 raft_consensus.cc:2272] T f36cde9868304ce6ba53977484021f63 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.639801 12594 tablet_replica.cc:333] T 40209789a45a43478a84057bb2f85444 P 104401b105224f1e9b05d58be1749d9c: stopping tablet replica
I20260709 13:11:22.640378 12594 raft_consensus.cc:2243] T 40209789a45a43478a84057bb2f85444 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.640877 12594 raft_consensus.cc:2272] T 40209789a45a43478a84057bb2f85444 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.643311 12594 tablet_replica.cc:333] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c: stopping tablet replica
I20260709 13:11:22.643877 12594 raft_consensus.cc:2243] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:22.644137 24510 consensus_peers.cc:597] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 -> Peer 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451): Couldn't send request to peer 104401b105224f1e9b05d58be1749d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:22.644271 12594 raft_consensus.cc:2272] T e7a46359788d4c1688bfff6b39ebb9ba P 104401b105224f1e9b05d58be1749d9c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.646286 12594 tablet_replica.cc:333] T c1f30fcf9ddb433a95594b906e4b29e5 P 104401b105224f1e9b05d58be1749d9c: stopping tablet replica
I20260709 13:11:22.646850 12594 raft_consensus.cc:2243] T c1f30fcf9ddb433a95594b906e4b29e5 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.647253 12594 raft_consensus.cc:2272] T c1f30fcf9ddb433a95594b906e4b29e5 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.649304 12594 tablet_replica.cc:333] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c: stopping tablet replica
I20260709 13:11:22.649840 12594 raft_consensus.cc:2243] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.650599 12594 raft_consensus.cc:2272] T e2eef84f60154cbfb6443c8bd9fe56d3 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.652678 12594 tablet_replica.cc:333] T a4cdb73e8b3f4f0f879a792183a634d7 P 104401b105224f1e9b05d58be1749d9c: stopping tablet replica
I20260709 13:11:22.653254 12594 raft_consensus.cc:2243] T a4cdb73e8b3f4f0f879a792183a634d7 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.653702 12594 raft_consensus.cc:2272] T a4cdb73e8b3f4f0f879a792183a634d7 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.655778 12594 tablet_replica.cc:333] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c: stopping tablet replica
I20260709 13:11:22.656306 12594 raft_consensus.cc:2243] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.656783 12594 raft_consensus.cc:2272] T 49d6d03206a0410aa73ce2a90384d519 P 104401b105224f1e9b05d58be1749d9c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.658629 12594 tablet_replica.cc:333] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c: stopping tablet replica
I20260709 13:11:22.659116 12594 raft_consensus.cc:2243] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.659574 12594 raft_consensus.cc:2272] T 7b164bcf2be54c5a84127382df5c2365 P 104401b105224f1e9b05d58be1749d9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.661389 12594 tablet_replica.cc:333] T bb70e8be13544040a6bef963d1056f29 P 104401b105224f1e9b05d58be1749d9c: stopping tablet replica
I20260709 13:11:22.661931 12594 raft_consensus.cc:2243] T bb70e8be13544040a6bef963d1056f29 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.662297 12594 raft_consensus.cc:2272] T bb70e8be13544040a6bef963d1056f29 P 104401b105224f1e9b05d58be1749d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.664187 12594 tablet_replica.cc:333] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c: stopping tablet replica
I20260709 13:11:22.664603 12594 raft_consensus.cc:2243] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.664924 12594 raft_consensus.cc:2272] T 33faf243a678428d85bee175371e7bd0 P 104401b105224f1e9b05d58be1749d9c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.666597 12594 tablet_replica.cc:333] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c: stopping tablet replica
I20260709 13:11:22.666982 12594 raft_consensus.cc:2243] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.667356 12594 raft_consensus.cc:2272] T faee6f7d44bb40e8afcf691b6ff167f2 P 104401b105224f1e9b05d58be1749d9c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:22.681241 24510 consensus_peers.cc:597] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 -> Peer 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451): Couldn't send request to peer 104401b105224f1e9b05d58be1749d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:22.682986 24512 consensus_peers.cc:597] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 -> Peer cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241): Couldn't send request to peer cb1c3a28d32d452fbc4fdbf43cc1bf7b. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:22.704252 24512 consensus_peers.cc:597] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 -> Peer cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241): Couldn't send request to peer cb1c3a28d32d452fbc4fdbf43cc1bf7b. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:22.708398 12594 tablet_server.cc:196] TabletServer@127.12.76.130:0 shutdown complete.
W20260709 13:11:22.727365 24510 consensus_peers.cc:597] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 -> Peer 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451): Couldn't send request to peer 104401b105224f1e9b05d58be1749d9c. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:43451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:22.744815 12594 tablet_server.cc:179] TabletServer@127.12.76.131:0 shutting down...
W20260709 13:11:22.770566 24512 consensus_peers.cc:597] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 -> Peer cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241): Couldn't send request to peer cb1c3a28d32d452fbc4fdbf43cc1bf7b. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:22.775549 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:22.776263 12594 tablet_replica.cc:333] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1: stopping tablet replica
I20260709 13:11:22.776928 12594 raft_consensus.cc:2243] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.777704 12594 raft_consensus.cc:2272] T 263d149907bb4478a4af8c412649244a P f4717668718a44baada8b0fc4b30cfe1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.779939 12594 tablet_replica.cc:333] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1: stopping tablet replica
I20260709 13:11:22.780536 12594 raft_consensus.cc:2243] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.780959 12594 raft_consensus.cc:2272] T 417e26d295ef405584514341f5a6bd21 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.782965 12594 tablet_replica.cc:333] T bbfb443d80634ca48fe563786c4df46d P f4717668718a44baada8b0fc4b30cfe1: stopping tablet replica
I20260709 13:11:22.783568 12594 raft_consensus.cc:2243] T bbfb443d80634ca48fe563786c4df46d P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.784271 12594 raft_consensus.cc:2272] T bbfb443d80634ca48fe563786c4df46d P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.787099 12594 tablet_replica.cc:333] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1: stopping tablet replica
I20260709 13:11:22.787863 12594 raft_consensus.cc:2243] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.788321 12594 raft_consensus.cc:2272] T 853da295b17940229be236438a3d75a9 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:22.789008 24510 consensus_peers.cc:597] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 -> Peer 104401b105224f1e9b05d58be1749d9c (127.12.76.130:43451): Couldn't send request to peer 104401b105224f1e9b05d58be1749d9c. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:43451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:22.790575 12594 tablet_replica.cc:333] T 19b1fd5922b448ebbf580bca848ac864 P f4717668718a44baada8b0fc4b30cfe1: stopping tablet replica
I20260709 13:11:22.791327 12594 raft_consensus.cc:2243] T 19b1fd5922b448ebbf580bca848ac864 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.791873 12594 raft_consensus.cc:2272] T 19b1fd5922b448ebbf580bca848ac864 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.794391 12594 tablet_replica.cc:333] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1: stopping tablet replica
W20260709 13:11:22.794950 24512 consensus_peers.cc:597] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 -> Peer cb1c3a28d32d452fbc4fdbf43cc1bf7b (127.12.76.129:33241): Couldn't send request to peer cb1c3a28d32d452fbc4fdbf43cc1bf7b. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:33241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:22.795073 12594 raft_consensus.cc:2243] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.795753 12594 raft_consensus.cc:2272] T 3b3ec318f9304bc08fad059e9895e87c P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.797863 12594 tablet_replica.cc:333] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1: stopping tablet replica
I20260709 13:11:22.798358 12594 raft_consensus.cc:2243] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.798818 12594 raft_consensus.cc:2272] T 465329cb805e4e7fba15939cecd9759e P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.800603 12594 tablet_replica.cc:333] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1: stopping tablet replica
I20260709 13:11:22.801093 12594 raft_consensus.cc:2243] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.801443 12594 raft_consensus.cc:2272] T 40209789a45a43478a84057bb2f85444 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.803382 12594 tablet_replica.cc:333] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1: stopping tablet replica
I20260709 13:11:22.803897 12594 raft_consensus.cc:2243] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.804283 12594 raft_consensus.cc:2272] T f36cde9868304ce6ba53977484021f63 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.806264 12594 tablet_replica.cc:333] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1: stopping tablet replica
I20260709 13:11:22.806789 12594 raft_consensus.cc:2243] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.807564 12594 raft_consensus.cc:2272] T 49d6d03206a0410aa73ce2a90384d519 P f4717668718a44baada8b0fc4b30cfe1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.809396 12594 tablet_replica.cc:333] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1: stopping tablet replica
I20260709 13:11:22.809851 12594 raft_consensus.cc:2243] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.810545 12594 raft_consensus.cc:2272] T a4cdb73e8b3f4f0f879a792183a634d7 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.812510 12594 tablet_replica.cc:333] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1: stopping tablet replica
I20260709 13:11:22.813002 12594 raft_consensus.cc:2243] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.813854 12594 raft_consensus.cc:2272] T e7a46359788d4c1688bfff6b39ebb9ba P f4717668718a44baada8b0fc4b30cfe1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.815760 12594 tablet_replica.cc:333] T c1f30fcf9ddb433a95594b906e4b29e5 P f4717668718a44baada8b0fc4b30cfe1: stopping tablet replica
I20260709 13:11:22.816228 12594 raft_consensus.cc:2243] T c1f30fcf9ddb433a95594b906e4b29e5 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.816608 12594 raft_consensus.cc:2272] T c1f30fcf9ddb433a95594b906e4b29e5 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.818423 12594 tablet_replica.cc:333] T e2eef84f60154cbfb6443c8bd9fe56d3 P f4717668718a44baada8b0fc4b30cfe1: stopping tablet replica
I20260709 13:11:22.818863 12594 raft_consensus.cc:2243] T e2eef84f60154cbfb6443c8bd9fe56d3 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.819227 12594 raft_consensus.cc:2272] T e2eef84f60154cbfb6443c8bd9fe56d3 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.821002 12594 tablet_replica.cc:333] T 7b164bcf2be54c5a84127382df5c2365 P f4717668718a44baada8b0fc4b30cfe1: stopping tablet replica
I20260709 13:11:22.821424 12594 raft_consensus.cc:2243] T 7b164bcf2be54c5a84127382df5c2365 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.821774 12594 raft_consensus.cc:2272] T 7b164bcf2be54c5a84127382df5c2365 P f4717668718a44baada8b0fc4b30cfe1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.823601 12594 tablet_replica.cc:333] T bb70e8be13544040a6bef963d1056f29 P f4717668718a44baada8b0fc4b30cfe1: stopping tablet replica
I20260709 13:11:22.824095 12594 raft_consensus.cc:2243] T bb70e8be13544040a6bef963d1056f29 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.824456 12594 raft_consensus.cc:2272] T bb70e8be13544040a6bef963d1056f29 P f4717668718a44baada8b0fc4b30cfe1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.826198 12594 tablet_replica.cc:333] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1: stopping tablet replica
I20260709 13:11:22.826637 12594 raft_consensus.cc:2243] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.827316 12594 raft_consensus.cc:2272] T 33faf243a678428d85bee175371e7bd0 P f4717668718a44baada8b0fc4b30cfe1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.829317 12594 tablet_replica.cc:333] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1: stopping tablet replica
I20260709 13:11:22.829730 12594 raft_consensus.cc:2243] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.830395 12594 raft_consensus.cc:2272] T faee6f7d44bb40e8afcf691b6ff167f2 P f4717668718a44baada8b0fc4b30cfe1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.858917 12594 tablet_server.cc:196] TabletServer@127.12.76.131:0 shutdown complete.
I20260709 13:11:22.893626 12594 master.cc:562] Master@127.12.76.190:39059 shutting down...
I20260709 13:11:22.921389 12594 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:22.921901 12594 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.922170 12594 tablet_replica.cc:333] T 00000000000000000000000000000000 P 84afb25dd5144739bf7cc82652ffa76d: stopping tablet replica
I20260709 13:11:22.942840 12594 master.cc:584] Master@127.12.76.190:39059 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (14039 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:11:22.994797 12594 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.76.190:37061
I20260709 13:11:22.996028 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:23.002434 24901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:23.002460 24900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:23.003223 24903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:23.003752 12594 server_base.cc:1061] running on GCE node
I20260709 13:11:23.004920 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:23.005198 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:23.005371 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602683005353 us; error 0 us; skew 500 ppm
I20260709 13:11:23.005937 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:23.008525 12594 webserver.cc:533] Webserver started at http://127.12.76.190:45837/ using document root <none> and password file <none>
I20260709 13:11:23.009039 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:23.009263 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:23.009573 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:23.010793 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602303087285-12594-0/minicluster-data/master-0-root/instance:
uuid: "5aabfad0f519458082d17e146e444b8f"
format_stamp: "Formatted at 2026-07-09 13:11:23 on dist-test-slave-th5x"
I20260709 13:11:23.015545 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:11:23.018918 24908 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:23.019806 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:23.020097 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602303087285-12594-0/minicluster-data/master-0-root
uuid: "5aabfad0f519458082d17e146e444b8f"
format_stamp: "Formatted at 2026-07-09 13:11:23 on dist-test-slave-th5x"
I20260709 13:11:23.020437 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602303087285-12594-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602303087285-12594-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602303087285-12594-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:23.037582 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:23.038780 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:23.076416 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.190:37061
I20260709 13:11:23.076531 24959 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.190:37061 every 8 connection(s)
I20260709 13:11:23.080224 24960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.090598 24960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f: Bootstrap starting.
I20260709 13:11:23.095510 24960 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.099666 24960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f: No bootstrap required, opened a new log
I20260709 13:11:23.101804 24960 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5aabfad0f519458082d17e146e444b8f" member_type: VOTER }
I20260709 13:11:23.102197 24960 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.102440 24960 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5aabfad0f519458082d17e146e444b8f, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.103075 24960 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5aabfad0f519458082d17e146e444b8f" member_type: VOTER }
I20260709 13:11:23.103610 24960 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:23.103839 24960 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:23.104102 24960 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.108567 24960 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5aabfad0f519458082d17e146e444b8f" member_type: VOTER }
I20260709 13:11:23.109047 24960 leader_election.cc:304] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5aabfad0f519458082d17e146e444b8f; no voters: 
I20260709 13:11:23.110191 24960 leader_election.cc:290] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:23.110495 24963 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:23.111937 24963 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f [term 1 LEADER]: Becoming Leader. State: Replica: 5aabfad0f519458082d17e146e444b8f, State: Running, Role: LEADER
I20260709 13:11:23.112534 24963 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5aabfad0f519458082d17e146e444b8f" member_type: VOTER }
I20260709 13:11:23.113142 24960 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:23.116798 24964 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5aabfad0f519458082d17e146e444b8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5aabfad0f519458082d17e146e444b8f" member_type: VOTER } }
I20260709 13:11:23.117601 24964 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:23.117592 24965 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5aabfad0f519458082d17e146e444b8f. Latest consensus state: current_term: 1 leader_uuid: "5aabfad0f519458082d17e146e444b8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5aabfad0f519458082d17e146e444b8f" member_type: VOTER } }
I20260709 13:11:23.119344 24965 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:23.125676 24972 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:23.133630 24972 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:23.134660 12594 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:23.142822 24972 catalog_manager.cc:1383] Generated new cluster ID: 70fa9a45ca0641ff89f99a2fc9769de6
I20260709 13:11:23.143121 24972 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:23.170027 24972 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:23.171370 24972 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:23.190081 24972 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f: Generated new TSK 0
I20260709 13:11:23.190707 24972 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:23.201030 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:23.207350 24981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:23.208499 24982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:23.210398 24984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:23.210868 12594 server_base.cc:1061] running on GCE node
I20260709 13:11:23.211818 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:23.211997 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:23.212113 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602683212102 us; error 0 us; skew 500 ppm
I20260709 13:11:23.212546 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:23.214741 12594 webserver.cc:533] Webserver started at http://127.12.76.129:44803/ using document root <none> and password file <none>
I20260709 13:11:23.215152 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:23.215310 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:23.215574 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:23.216583 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602303087285-12594-0/minicluster-data/ts-0-root/instance:
uuid: "3f8a1edc55ec49da8d471f29f89febc2"
format_stamp: "Formatted at 2026-07-09 13:11:23 on dist-test-slave-th5x"
I20260709 13:11:23.220780 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:11:23.224031 24989 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:23.224737 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:23.225026 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602303087285-12594-0/minicluster-data/ts-0-root
uuid: "3f8a1edc55ec49da8d471f29f89febc2"
format_stamp: "Formatted at 2026-07-09 13:11:23 on dist-test-slave-th5x"
I20260709 13:11:23.225320 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602303087285-12594-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602303087285-12594-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602303087285-12594-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:23.234933 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:23.236172 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:23.237564 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:23.239746 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:23.239962 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:23.240195 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:23.240391 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:23.279702 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.129:37639
I20260709 13:11:23.279817 25051 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.129:37639 every 8 connection(s)
I20260709 13:11:23.284734 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:23.291708 25056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:23.292218 25057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:23.295674 25060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:23.295910 12594 server_base.cc:1061] running on GCE node
I20260709 13:11:23.297991 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:23.298202 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:23.298341 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602683298330 us; error 0 us; skew 500 ppm
I20260709 13:11:23.298875 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:23.301837 12594 webserver.cc:533] Webserver started at http://127.12.76.130:40795/ using document root <none> and password file <none>
I20260709 13:11:23.302392 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:23.302629 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:23.302977 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:23.303031 25052 heartbeater.cc:344] Connected to a master server at 127.12.76.190:37061
I20260709 13:11:23.303615 25052 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:23.304319 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602303087285-12594-0/minicluster-data/ts-1-root/instance:
uuid: "bf8661d86cd14b0caded7f5606eba9c0"
format_stamp: "Formatted at 2026-07-09 13:11:23 on dist-test-slave-th5x"
I20260709 13:11:23.304378 25052 heartbeater.cc:507] Master 127.12.76.190:37061 requested a full tablet report, sending...
I20260709 13:11:23.306762 24925 ts_manager.cc:194] Registered new tserver with Master: 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639)
I20260709 13:11:23.308703 24925 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46334
I20260709 13:11:23.309448 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:11:23.313251 25064 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:23.314083 12594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:11:23.314334 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602303087285-12594-0/minicluster-data/ts-1-root
uuid: "bf8661d86cd14b0caded7f5606eba9c0"
format_stamp: "Formatted at 2026-07-09 13:11:23 on dist-test-slave-th5x"
I20260709 13:11:23.314644 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602303087285-12594-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602303087285-12594-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602303087285-12594-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:23.331090 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:23.332319 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:23.333760 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:23.336035 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:23.336207 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:23.336519 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:23.336659 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:23.377465 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.130:36971
I20260709 13:11:23.377578 25126 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.130:36971 every 8 connection(s)
I20260709 13:11:23.382345 12594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:23.389626 25130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:23.391173 25131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:23.394476 25133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:23.395026 12594 server_base.cc:1061] running on GCE node
I20260709 13:11:23.395579 25127 heartbeater.cc:344] Connected to a master server at 127.12.76.190:37061
I20260709 13:11:23.396036 25127 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:23.396230 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:23.396522 12594 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:23.396744 12594 hybrid_clock.cc:648] HybridClock initialized: now 1783602683396722 us; error 0 us; skew 500 ppm
I20260709 13:11:23.396955 25127 heartbeater.cc:507] Master 127.12.76.190:37061 requested a full tablet report, sending...
I20260709 13:11:23.397558 12594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:23.399392 24925 ts_manager.cc:194] Registered new tserver with Master: bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971)
I20260709 13:11:23.400476 12594 webserver.cc:533] Webserver started at http://127.12.76.131:37547/ using document root <none> and password file <none>
I20260709 13:11:23.401147 12594 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:23.401286 24925 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46342
I20260709 13:11:23.401400 12594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:23.401868 12594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:23.403448 12594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602303087285-12594-0/minicluster-data/ts-2-root/instance:
uuid: "1b2fbb12f91f47f2b0abab045013abab"
format_stamp: "Formatted at 2026-07-09 13:11:23 on dist-test-slave-th5x"
I20260709 13:11:23.408453 12594 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:11:23.413391 25138 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:23.414446 12594 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:11:23.414870 12594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602303087285-12594-0/minicluster-data/ts-2-root
uuid: "1b2fbb12f91f47f2b0abab045013abab"
format_stamp: "Formatted at 2026-07-09 13:11:23 on dist-test-slave-th5x"
I20260709 13:11:23.415225 12594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602303087285-12594-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602303087285-12594-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskE_NwD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602303087285-12594-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:23.429401 12594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:23.431069 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:23.432963 12594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:23.436451 12594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:23.436721 12594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:23.437016 12594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:23.437300 12594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:23.485729 12594 rpc_server.cc:307] RPC server started. Bound to: 127.12.76.131:43479
I20260709 13:11:23.485828 25200 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.76.131:43479 every 8 connection(s)
I20260709 13:11:23.501121 25201 heartbeater.cc:344] Connected to a master server at 127.12.76.190:37061
I20260709 13:11:23.501612 25201 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:23.502451 25201 heartbeater.cc:507] Master 127.12.76.190:37061 requested a full tablet report, sending...
I20260709 13:11:23.504508 24925 ts_manager.cc:194] Registered new tserver with Master: 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:23.505005 12594 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015813495s
I20260709 13:11:23.505913 24925 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46354
I20260709 13:11:23.529994 24925 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46370:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:23.532630 24925 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:23.605975 25166 tablet_service.cc:1511] Processing CreateTablet for tablet 678ed24005be40eeb9bc4041fce6ee35 (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:23.607484 25166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 678ed24005be40eeb9bc4041fce6ee35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.608171 25165 tablet_service.cc:1511] Processing CreateTablet for tablet b81757f4945249a590eb6f0d48e39982 (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:23.609617 25165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b81757f4945249a590eb6f0d48e39982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.613092 25164 tablet_service.cc:1511] Processing CreateTablet for tablet 17e6bbc00e20487d992e8550a9610038 (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:23.614217 25017 tablet_service.cc:1511] Processing CreateTablet for tablet 678ed24005be40eeb9bc4041fce6ee35 (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:23.615615 25017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 678ed24005be40eeb9bc4041fce6ee35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.617887 25016 tablet_service.cc:1511] Processing CreateTablet for tablet b81757f4945249a590eb6f0d48e39982 (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:23.618758 25163 tablet_service.cc:1511] Processing CreateTablet for tablet dd14bc55420b4bfda81e00b11b16480a (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:23.620610 25015 tablet_service.cc:1511] Processing CreateTablet for tablet 17e6bbc00e20487d992e8550a9610038 (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:23.623204 25091 tablet_service.cc:1511] Processing CreateTablet for tablet b81757f4945249a590eb6f0d48e39982 (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:23.623332 25092 tablet_service.cc:1511] Processing CreateTablet for tablet 678ed24005be40eeb9bc4041fce6ee35 (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:23.624575 25091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b81757f4945249a590eb6f0d48e39982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.625818 25092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 678ed24005be40eeb9bc4041fce6ee35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.626567 25090 tablet_service.cc:1511] Processing CreateTablet for tablet 17e6bbc00e20487d992e8550a9610038 (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:23.627242 25162 tablet_service.cc:1511] Processing CreateTablet for tablet ed3a721a22bf4cfa80f834d4e284b209 (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:23.619287 25016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b81757f4945249a590eb6f0d48e39982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.627954 25090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17e6bbc00e20487d992e8550a9610038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.614568 25164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17e6bbc00e20487d992e8550a9610038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.631496 25089 tablet_service.cc:1511] Processing CreateTablet for tablet dd14bc55420b4bfda81e00b11b16480a (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:23.632863 25089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd14bc55420b4bfda81e00b11b16480a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.632599 25161 tablet_service.cc:1511] Processing CreateTablet for tablet 0f2be738daf040ec8055ea11ffba43de (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:23.633970 25161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f2be738daf040ec8055ea11ffba43de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.637846 25162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed3a721a22bf4cfa80f834d4e284b209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.638445 25087 tablet_service.cc:1511] Processing CreateTablet for tablet 0f2be738daf040ec8055ea11ffba43de (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:23.639381 25086 tablet_service.cc:1511] Processing CreateTablet for tablet 99bee58920cf48df8afb0277a28a9ad2 (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:23.640537 25013 tablet_service.cc:1511] Processing CreateTablet for tablet ed3a721a22bf4cfa80f834d4e284b209 (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:23.641712 25011 tablet_service.cc:1511] Processing CreateTablet for tablet 99bee58920cf48df8afb0277a28a9ad2 (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:23.642292 25014 tablet_service.cc:1511] Processing CreateTablet for tablet dd14bc55420b4bfda81e00b11b16480a (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:23.637351 25088 tablet_service.cc:1511] Processing CreateTablet for tablet ed3a721a22bf4cfa80f834d4e284b209 (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:23.638512 25012 tablet_service.cc:1511] Processing CreateTablet for tablet 0f2be738daf040ec8055ea11ffba43de (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:23.637866 25015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17e6bbc00e20487d992e8550a9610038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.647779 25014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd14bc55420b4bfda81e00b11b16480a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.649596 25163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd14bc55420b4bfda81e00b11b16480a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.651772 25012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f2be738daf040ec8055ea11ffba43de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.652913 25011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99bee58920cf48df8afb0277a28a9ad2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.655881 25087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f2be738daf040ec8055ea11ffba43de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.659837 25086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99bee58920cf48df8afb0277a28a9ad2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.663776 25088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed3a721a22bf4cfa80f834d4e284b209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.667749 25013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed3a721a22bf4cfa80f834d4e284b209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.688787 25160 tablet_service.cc:1511] Processing CreateTablet for tablet 99bee58920cf48df8afb0277a28a9ad2 (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:23.690296 25160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99bee58920cf48df8afb0277a28a9ad2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.692847 25010 tablet_service.cc:1511] Processing CreateTablet for tablet f0f039f792f742499a2ba068a50a8a40 (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:23.694307 25010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0f039f792f742499a2ba068a50a8a40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.728996 25217 tablet_bootstrap.cc:492] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab: Bootstrap starting.
I20260709 13:11:23.739331 25090 tablet_service.cc:1511] Processing CreateTablet for tablet f0f039f792f742499a2ba068a50a8a40 (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:23.740406 25218 tablet_bootstrap.cc:492] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2: Bootstrap starting.
I20260709 13:11:23.740826 25090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0f039f792f742499a2ba068a50a8a40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.750438 25217 tablet_bootstrap.cc:654] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.753620 25218 tablet_bootstrap.cc:654] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.758388 25011 tablet_service.cc:1511] Processing CreateTablet for tablet e5a4d99b1cc845cab2478402bf9df1a2 (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:23.758388 25166 tablet_service.cc:1511] Processing CreateTablet for tablet f0f039f792f742499a2ba068a50a8a40 (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:23.761173 25166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0f039f792f742499a2ba068a50a8a40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.761157 25085 tablet_service.cc:1511] Processing CreateTablet for tablet e5a4d99b1cc845cab2478402bf9df1a2 (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:23.762820 25085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5a4d99b1cc845cab2478402bf9df1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.765085 25011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5a4d99b1cc845cab2478402bf9df1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.766682 25163 tablet_service.cc:1511] Processing CreateTablet for tablet e5a4d99b1cc845cab2478402bf9df1a2 (DEFAULT_TABLE table=test-workload [id=10f034f4a0a8441dafa54ef3c5267305]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:23.777976 25163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5a4d99b1cc845cab2478402bf9df1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:23.796121 25216 tablet_bootstrap.cc:492] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0: Bootstrap starting.
I20260709 13:11:23.797039 25218 tablet_bootstrap.cc:492] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2: No bootstrap required, opened a new log
I20260709 13:11:23.797596 25218 ts_tablet_manager.cc:1403] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.004s
I20260709 13:11:23.800617 25218 raft_consensus.cc:359] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } }
I20260709 13:11:23.801894 25217 tablet_bootstrap.cc:492] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab: No bootstrap required, opened a new log
I20260709 13:11:23.801620 25218 raft_consensus.cc:385] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.809990 25218 raft_consensus.cc:740] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.809983 25217 ts_tablet_manager.cc:1403] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab: Time spent bootstrapping tablet: real 0.081s	user 0.010s	sys 0.011s
I20260709 13:11:23.811014 25218 consensus_queue.cc:260] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } }
I20260709 13:11:23.812348 25216 tablet_bootstrap.cc:654] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.813686 25217 raft_consensus.cc:359] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:23.814520 25217 raft_consensus.cc:385] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.814881 25217 raft_consensus.cc:740] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.815783 25217 consensus_queue.cc:260] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:23.821022 25218 ts_tablet_manager.cc:1434] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.004s
I20260709 13:11:23.822058 25052 heartbeater.cc:499] Master 127.12.76.190:37061 was elected leader, sending a full tablet report...
I20260709 13:11:23.824536 25216 tablet_bootstrap.cc:492] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0: No bootstrap required, opened a new log
I20260709 13:11:23.825058 25216 ts_tablet_manager.cc:1403] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.009s
I20260709 13:11:23.828028 25216 raft_consensus.cc:359] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } }
I20260709 13:11:23.828711 25216 raft_consensus.cc:385] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.829005 25216 raft_consensus.cc:740] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.829957 25216 consensus_queue.cc:260] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } }
I20260709 13:11:23.833665 25127 heartbeater.cc:499] Master 127.12.76.190:37061 was elected leader, sending a full tablet report...
I20260709 13:11:23.835400 25216 ts_tablet_manager.cc:1434] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:11:23.836956 25216 tablet_bootstrap.cc:492] T 17e6bbc00e20487d992e8550a9610038 P bf8661d86cd14b0caded7f5606eba9c0: Bootstrap starting.
I20260709 13:11:23.841898 25218 tablet_bootstrap.cc:492] T 99bee58920cf48df8afb0277a28a9ad2 P 3f8a1edc55ec49da8d471f29f89febc2: Bootstrap starting.
I20260709 13:11:23.843510 25224 raft_consensus.cc:493] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.844092 25224 raft_consensus.cc:515] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } }
I20260709 13:11:23.846210 25216 tablet_bootstrap.cc:654] T 17e6bbc00e20487d992e8550a9610038 P bf8661d86cd14b0caded7f5606eba9c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.847667 25224 leader_election.cc:290] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479), 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639)
I20260709 13:11:23.862562 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678ed24005be40eeb9bc4041fce6ee35" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab" is_pre_election: true
W20260709 13:11:23.864503 25067 leader_election.cc:343] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.864902 25218 tablet_bootstrap.cc:654] T 99bee58920cf48df8afb0277a28a9ad2 P 3f8a1edc55ec49da8d471f29f89febc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.873946 25201 heartbeater.cc:499] Master 127.12.76.190:37061 was elected leader, sending a full tablet report...
I20260709 13:11:23.874163 25217 ts_tablet_manager.cc:1434] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab: Time spent starting tablet: real 0.063s	user 0.021s	sys 0.038s
I20260709 13:11:23.875694 25217 tablet_bootstrap.cc:492] T dd14bc55420b4bfda81e00b11b16480a P 1b2fbb12f91f47f2b0abab045013abab: Bootstrap starting.
I20260709 13:11:23.879462 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678ed24005be40eeb9bc4041fce6ee35" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2" is_pre_election: true
I20260709 13:11:23.880208 25027 raft_consensus.cc:2468] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 0.
I20260709 13:11:23.882954 25216 tablet_bootstrap.cc:492] T 17e6bbc00e20487d992e8550a9610038 P bf8661d86cd14b0caded7f5606eba9c0: No bootstrap required, opened a new log
I20260709 13:11:23.882993 25217 tablet_bootstrap.cc:654] T dd14bc55420b4bfda81e00b11b16480a P 1b2fbb12f91f47f2b0abab045013abab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.883834 25216 ts_tablet_manager.cc:1403] T 17e6bbc00e20487d992e8550a9610038 P bf8661d86cd14b0caded7f5606eba9c0: Time spent bootstrapping tablet: real 0.047s	user 0.026s	sys 0.017s
I20260709 13:11:23.887142 25216 raft_consensus.cc:359] T 17e6bbc00e20487d992e8550a9610038 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:23.887387 25065 leader_election.cc:304] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 1b2fbb12f91f47f2b0abab045013abab
I20260709 13:11:23.887988 25216 raft_consensus.cc:385] T 17e6bbc00e20487d992e8550a9610038 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.888494 25216 raft_consensus.cc:740] T 17e6bbc00e20487d992e8550a9610038 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.889103 25224 raft_consensus.cc:2804] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:23.889694 25224 raft_consensus.cc:493] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.889451 25216 consensus_queue.cc:260] T 17e6bbc00e20487d992e8550a9610038 P bf8661d86cd14b0caded7f5606eba9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:23.890185 25224 raft_consensus.cc:3060] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.895141 25217 tablet_bootstrap.cc:492] T dd14bc55420b4bfda81e00b11b16480a P 1b2fbb12f91f47f2b0abab045013abab: No bootstrap required, opened a new log
I20260709 13:11:23.896845 25217 ts_tablet_manager.cc:1403] T dd14bc55420b4bfda81e00b11b16480a P 1b2fbb12f91f47f2b0abab045013abab: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.011s
I20260709 13:11:23.899354 25224 raft_consensus.cc:515] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } }
I20260709 13:11:23.900053 25217 raft_consensus.cc:359] T dd14bc55420b4bfda81e00b11b16480a P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:23.900856 25217 raft_consensus.cc:385] T dd14bc55420b4bfda81e00b11b16480a P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.901240 25217 raft_consensus.cc:740] T dd14bc55420b4bfda81e00b11b16480a P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.902369 25217 consensus_queue.cc:260] T dd14bc55420b4bfda81e00b11b16480a P 1b2fbb12f91f47f2b0abab045013abab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:23.903728 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678ed24005be40eeb9bc4041fce6ee35" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:23.904522 25217 ts_tablet_manager.cc:1434] T dd14bc55420b4bfda81e00b11b16480a P 1b2fbb12f91f47f2b0abab045013abab: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
W20260709 13:11:23.905185 25067 leader_election.cc:343] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.905568 25217 tablet_bootstrap.cc:492] T b81757f4945249a590eb6f0d48e39982 P 1b2fbb12f91f47f2b0abab045013abab: Bootstrap starting.
I20260709 13:11:23.906875 25224 leader_election.cc:290] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479), 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639)
I20260709 13:11:23.908406 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678ed24005be40eeb9bc4041fce6ee35" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
I20260709 13:11:23.909255 25027 raft_consensus.cc:3060] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.913640 25216 ts_tablet_manager.cc:1434] T 17e6bbc00e20487d992e8550a9610038 P bf8661d86cd14b0caded7f5606eba9c0: Time spent starting tablet: real 0.029s	user 0.011s	sys 0.016s
I20260709 13:11:23.914785 25216 tablet_bootstrap.cc:492] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0: Bootstrap starting.
I20260709 13:11:23.915246 25218 tablet_bootstrap.cc:492] T 99bee58920cf48df8afb0277a28a9ad2 P 3f8a1edc55ec49da8d471f29f89febc2: No bootstrap required, opened a new log
I20260709 13:11:23.915345 25217 tablet_bootstrap.cc:654] T b81757f4945249a590eb6f0d48e39982 P 1b2fbb12f91f47f2b0abab045013abab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.915958 25218 ts_tablet_manager.cc:1403] T 99bee58920cf48df8afb0277a28a9ad2 P 3f8a1edc55ec49da8d471f29f89febc2: Time spent bootstrapping tablet: real 0.074s	user 0.015s	sys 0.004s
I20260709 13:11:23.918445 25027 raft_consensus.cc:2468] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 1.
I20260709 13:11:23.919883 25065 leader_election.cc:304] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 1b2fbb12f91f47f2b0abab045013abab
I20260709 13:11:23.919617 25218 raft_consensus.cc:359] T 99bee58920cf48df8afb0277a28a9ad2 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:23.920972 25228 raft_consensus.cc:2804] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:23.921448 25216 tablet_bootstrap.cc:654] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.921691 25228 raft_consensus.cc:697] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Becoming Leader. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Running, Role: LEADER
I20260709 13:11:23.922937 25228 consensus_queue.cc:237] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } }
I20260709 13:11:23.928020 25218 raft_consensus.cc:385] T 99bee58920cf48df8afb0277a28a9ad2 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.928488 25218 raft_consensus.cc:740] T 99bee58920cf48df8afb0277a28a9ad2 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.930166 25218 consensus_queue.cc:260] T 99bee58920cf48df8afb0277a28a9ad2 P 3f8a1edc55ec49da8d471f29f89febc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:23.939384 25218 ts_tablet_manager.cc:1434] T 99bee58920cf48df8afb0277a28a9ad2 P 3f8a1edc55ec49da8d471f29f89febc2: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:11:23.940727 25218 tablet_bootstrap.cc:492] T f0f039f792f742499a2ba068a50a8a40 P 3f8a1edc55ec49da8d471f29f89febc2: Bootstrap starting.
I20260709 13:11:23.952481 25218 tablet_bootstrap.cc:654] T f0f039f792f742499a2ba068a50a8a40 P 3f8a1edc55ec49da8d471f29f89febc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.962286 25217 tablet_bootstrap.cc:492] T b81757f4945249a590eb6f0d48e39982 P 1b2fbb12f91f47f2b0abab045013abab: No bootstrap required, opened a new log
I20260709 13:11:23.961911 24923 catalog_manager.cc:5697] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "bf8661d86cd14b0caded7f5606eba9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:23.962913 25217 ts_tablet_manager.cc:1403] T b81757f4945249a590eb6f0d48e39982 P 1b2fbb12f91f47f2b0abab045013abab: Time spent bootstrapping tablet: real 0.058s	user 0.024s	sys 0.029s
I20260709 13:11:23.965044 25216 tablet_bootstrap.cc:492] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0: No bootstrap required, opened a new log
I20260709 13:11:23.965606 25216 ts_tablet_manager.cc:1403] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.034s
I20260709 13:11:23.966013 25217 raft_consensus.cc:359] T b81757f4945249a590eb6f0d48e39982 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:23.966602 25217 raft_consensus.cc:385] T b81757f4945249a590eb6f0d48e39982 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.966889 25217 raft_consensus.cc:740] T b81757f4945249a590eb6f0d48e39982 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.967751 25217 consensus_queue.cc:260] T b81757f4945249a590eb6f0d48e39982 P 1b2fbb12f91f47f2b0abab045013abab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:23.968600 25216 raft_consensus.cc:359] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:23.969308 25216 raft_consensus.cc:385] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.969595 25216 raft_consensus.cc:740] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.970078 25217 ts_tablet_manager.cc:1434] T b81757f4945249a590eb6f0d48e39982 P 1b2fbb12f91f47f2b0abab045013abab: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:23.970316 25216 consensus_queue.cc:260] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:23.971131 25217 tablet_bootstrap.cc:492] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab: Bootstrap starting.
I20260709 13:11:23.972522 25223 raft_consensus.cc:493] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.973183 25223 raft_consensus.cc:515] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:23.976344 25216 ts_tablet_manager.cc:1434] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:11:23.977415 25216 tablet_bootstrap.cc:492] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0: Bootstrap starting.
I20260709 13:11:23.988222 25216 tablet_bootstrap.cc:654] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.988425 25217 tablet_bootstrap.cc:654] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.991778 25223 leader_election.cc:290] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971)
I20260709 13:11:23.991972 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2be738daf040ec8055ea11ffba43de" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0" is_pre_election: true
I20260709 13:11:23.992643 25223 raft_consensus.cc:493] T b81757f4945249a590eb6f0d48e39982 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.993295 25223 raft_consensus.cc:515] T b81757f4945249a590eb6f0d48e39982 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
W20260709 13:11:23.993856 25142 leader_election.cc:343] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.997939 25223 leader_election.cc:290] T b81757f4945249a590eb6f0d48e39982 P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971)
I20260709 13:11:23.999027 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81757f4945249a590eb6f0d48e39982" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0" is_pre_election: true
W20260709 13:11:24.000646 25142 leader_election.cc:343] T b81757f4945249a590eb6f0d48e39982 P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.002095 25216 tablet_bootstrap.cc:492] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0: No bootstrap required, opened a new log
I20260709 13:11:24.002821 25216 ts_tablet_manager.cc:1403] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 13:11:24.006062 25216 raft_consensus.cc:359] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.006759 25216 raft_consensus.cc:385] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.007094 25218 tablet_bootstrap.cc:492] T f0f039f792f742499a2ba068a50a8a40 P 3f8a1edc55ec49da8d471f29f89febc2: No bootstrap required, opened a new log
I20260709 13:11:24.007735 25218 ts_tablet_manager.cc:1403] T f0f039f792f742499a2ba068a50a8a40 P 3f8a1edc55ec49da8d471f29f89febc2: Time spent bootstrapping tablet: real 0.067s	user 0.028s	sys 0.008s
I20260709 13:11:24.009706 25217 tablet_bootstrap.cc:492] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab: No bootstrap required, opened a new log
I20260709 13:11:24.010201 25217 ts_tablet_manager.cc:1403] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.002s
I20260709 13:11:24.010860 25218 raft_consensus.cc:359] T f0f039f792f742499a2ba068a50a8a40 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.007050 25216 raft_consensus.cc:740] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.011479 25218 raft_consensus.cc:385] T f0f039f792f742499a2ba068a50a8a40 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.011896 25218 raft_consensus.cc:740] T f0f039f792f742499a2ba068a50a8a40 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.012446 25216 consensus_queue.cc:260] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.012669 25218 consensus_queue.cc:260] T f0f039f792f742499a2ba068a50a8a40 P 3f8a1edc55ec49da8d471f29f89febc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.013496 25217 raft_consensus.cc:359] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } }
I20260709 13:11:24.014264 25217 raft_consensus.cc:385] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.014532 25217 raft_consensus.cc:740] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.015081 25218 ts_tablet_manager.cc:1434] T f0f039f792f742499a2ba068a50a8a40 P 3f8a1edc55ec49da8d471f29f89febc2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:24.015360 25217 consensus_queue.cc:260] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } }
I20260709 13:11:24.016158 25218 tablet_bootstrap.cc:492] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2: Bootstrap starting.
I20260709 13:11:24.018294 25217 ts_tablet_manager.cc:1434] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:11:24.018345 25216 ts_tablet_manager.cc:1434] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:11:24.019495 25217 tablet_bootstrap.cc:492] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab: Bootstrap starting.
I20260709 13:11:24.019646 25216 tablet_bootstrap.cc:492] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0: Bootstrap starting.
I20260709 13:11:24.023854 25218 tablet_bootstrap.cc:654] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.027560 25217 tablet_bootstrap.cc:654] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.027659 25216 tablet_bootstrap.cc:654] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.039143 25217 tablet_bootstrap.cc:492] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab: No bootstrap required, opened a new log
I20260709 13:11:24.039762 25217 ts_tablet_manager.cc:1403] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 13:11:24.044368 25026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81757f4945249a590eb6f0d48e39982" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2" is_pre_election: true
I20260709 13:11:24.044222 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2be738daf040ec8055ea11ffba43de" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2" is_pre_election: true
I20260709 13:11:24.042817 25217 raft_consensus.cc:359] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
W20260709 13:11:24.045934 25139 leader_election.cc:343] T b81757f4945249a590eb6f0d48e39982 P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.046097 25217 raft_consensus.cc:385] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.046463 25217 raft_consensus.cc:740] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.046464 25139 leader_election.cc:304] T b81757f4945249a590eb6f0d48e39982 P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab; no voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0
I20260709 13:11:24.042812 25218 tablet_bootstrap.cc:492] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2: No bootstrap required, opened a new log
I20260709 13:11:24.047266 25217 consensus_queue.cc:260] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.048316 25218 ts_tablet_manager.cc:1403] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.008s
I20260709 13:11:24.048466 25234 raft_consensus.cc:2749] T b81757f4945249a590eb6f0d48e39982 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:24.048902 25139 leader_election.cc:343] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.049369 25139 leader_election.cc:304] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab; no voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0
I20260709 13:11:24.050751 25217 ts_tablet_manager.cc:1434] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:11:24.051970 25217 tablet_bootstrap.cc:492] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab: Bootstrap starting.
I20260709 13:11:24.052553 25218 raft_consensus.cc:359] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.053646 25218 raft_consensus.cc:385] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.054055 25218 raft_consensus.cc:740] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.055083 25218 consensus_queue.cc:260] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.056064 25234 raft_consensus.cc:2749] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.057749 25218 ts_tablet_manager.cc:1434] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:11:24.058844 25218 tablet_bootstrap.cc:492] T e5a4d99b1cc845cab2478402bf9df1a2 P 3f8a1edc55ec49da8d471f29f89febc2: Bootstrap starting.
I20260709 13:11:24.058897 25217 tablet_bootstrap.cc:654] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.067108 25218 tablet_bootstrap.cc:654] T e5a4d99b1cc845cab2478402bf9df1a2 P 3f8a1edc55ec49da8d471f29f89febc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.068311 25216 tablet_bootstrap.cc:492] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0: No bootstrap required, opened a new log
I20260709 13:11:24.068964 25216 ts_tablet_manager.cc:1403] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.021s
I20260709 13:11:24.072464 25217 tablet_bootstrap.cc:492] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab: No bootstrap required, opened a new log
I20260709 13:11:24.073112 25217 ts_tablet_manager.cc:1403] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:11:24.073022 25216 raft_consensus.cc:359] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.075163 25216 raft_consensus.cc:385] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.075620 25216 raft_consensus.cc:740] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.076591 25216 consensus_queue.cc:260] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.079319 25216 ts_tablet_manager.cc:1434] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:11:24.080389 25216 tablet_bootstrap.cc:492] T b81757f4945249a590eb6f0d48e39982 P bf8661d86cd14b0caded7f5606eba9c0: Bootstrap starting.
I20260709 13:11:24.083717 25223 raft_consensus.cc:493] T dd14bc55420b4bfda81e00b11b16480a P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.084308 25223 raft_consensus.cc:515] T dd14bc55420b4bfda81e00b11b16480a P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.086316 25216 tablet_bootstrap.cc:654] T b81757f4945249a590eb6f0d48e39982 P bf8661d86cd14b0caded7f5606eba9c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.086624 25223 leader_election.cc:290] T dd14bc55420b4bfda81e00b11b16480a P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971)
I20260709 13:11:24.088246 25218 tablet_bootstrap.cc:492] T e5a4d99b1cc845cab2478402bf9df1a2 P 3f8a1edc55ec49da8d471f29f89febc2: No bootstrap required, opened a new log
I20260709 13:11:24.088160 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd14bc55420b4bfda81e00b11b16480a" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0" is_pre_election: true
I20260709 13:11:24.089779 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd14bc55420b4bfda81e00b11b16480a" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2" is_pre_election: true
I20260709 13:11:24.086374 25217 raft_consensus.cc:359] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.092451 25217 raft_consensus.cc:385] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.092797 25217 raft_consensus.cc:740] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Initialized, Role: FOLLOWER
W20260709 13:11:24.093459 25142 leader_election.cc:343] T dd14bc55420b4bfda81e00b11b16480a P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.093925 25218 ts_tablet_manager.cc:1403] T e5a4d99b1cc845cab2478402bf9df1a2 P 3f8a1edc55ec49da8d471f29f89febc2: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.005s
W20260709 13:11:24.094658 25139 leader_election.cc:343] T dd14bc55420b4bfda81e00b11b16480a P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.093750 25217 consensus_queue.cc:260] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.095165 25139 leader_election.cc:304] T dd14bc55420b4bfda81e00b11b16480a P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab; no voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0
I20260709 13:11:24.096290 25234 raft_consensus.cc:2749] T dd14bc55420b4bfda81e00b11b16480a P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.096997 25217 ts_tablet_manager.cc:1434] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:11:24.096939 25218 raft_consensus.cc:359] T e5a4d99b1cc845cab2478402bf9df1a2 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.097740 25218 raft_consensus.cc:385] T e5a4d99b1cc845cab2478402bf9df1a2 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.098027 25218 raft_consensus.cc:740] T e5a4d99b1cc845cab2478402bf9df1a2 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.098234 25217 tablet_bootstrap.cc:492] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab: Bootstrap starting.
I20260709 13:11:24.098732 25218 consensus_queue.cc:260] T e5a4d99b1cc845cab2478402bf9df1a2 P 3f8a1edc55ec49da8d471f29f89febc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.101042 25218 ts_tablet_manager.cc:1434] T e5a4d99b1cc845cab2478402bf9df1a2 P 3f8a1edc55ec49da8d471f29f89febc2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:24.102164 25218 tablet_bootstrap.cc:492] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2: Bootstrap starting.
I20260709 13:11:24.105310 25217 tablet_bootstrap.cc:654] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.108286 25216 tablet_bootstrap.cc:492] T b81757f4945249a590eb6f0d48e39982 P bf8661d86cd14b0caded7f5606eba9c0: No bootstrap required, opened a new log
I20260709 13:11:24.108958 25216 ts_tablet_manager.cc:1403] T b81757f4945249a590eb6f0d48e39982 P bf8661d86cd14b0caded7f5606eba9c0: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.004s
I20260709 13:11:24.112854 25218 tablet_bootstrap.cc:654] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.117462 25217 tablet_bootstrap.cc:492] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab: No bootstrap required, opened a new log
I20260709 13:11:24.123229 25217 ts_tablet_manager.cc:1403] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.001s
I20260709 13:11:24.120373 25216 raft_consensus.cc:359] T b81757f4945249a590eb6f0d48e39982 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.117251 25228 raft_consensus.cc:493] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.123735 25216 raft_consensus.cc:385] T b81757f4945249a590eb6f0d48e39982 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.124083 25216 raft_consensus.cc:740] T b81757f4945249a590eb6f0d48e39982 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.123919 25228 raft_consensus.cc:515] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.127086 25217 raft_consensus.cc:359] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.127833 25217 raft_consensus.cc:385] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.128129 25217 raft_consensus.cc:740] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.124987 25216 consensus_queue.cc:260] T b81757f4945249a590eb6f0d48e39982 P bf8661d86cd14b0caded7f5606eba9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.129453 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bee58920cf48df8afb0277a28a9ad2" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2" is_pre_election: true
I20260709 13:11:24.130358 25027 raft_consensus.cc:2468] T 99bee58920cf48df8afb0277a28a9ad2 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 0.
I20260709 13:11:24.130779 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bee58920cf48df8afb0277a28a9ad2" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab" is_pre_election: true
I20260709 13:11:24.131238 25216 ts_tablet_manager.cc:1434] T b81757f4945249a590eb6f0d48e39982 P bf8661d86cd14b0caded7f5606eba9c0: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:11:24.132313 25216 tablet_bootstrap.cc:492] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0: Bootstrap starting.
W20260709 13:11:24.132278 25067 leader_election.cc:343] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.128850 25217 consensus_queue.cc:260] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.133791 25065 leader_election.cc:304] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 1b2fbb12f91f47f2b0abab045013abab
I20260709 13:11:24.134948 25224 raft_consensus.cc:2804] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.135476 25224 raft_consensus.cc:493] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.135896 25224 raft_consensus.cc:3060] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.137029 25217 ts_tablet_manager.cc:1434] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:11:24.138134 25217 tablet_bootstrap.cc:492] T f0f039f792f742499a2ba068a50a8a40 P 1b2fbb12f91f47f2b0abab045013abab: Bootstrap starting.
I20260709 13:11:24.142042 25216 tablet_bootstrap.cc:654] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:24.125522 24973 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:24.144280 25217 tablet_bootstrap.cc:654] T f0f039f792f742499a2ba068a50a8a40 P 1b2fbb12f91f47f2b0abab045013abab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.129465 25228 leader_election.cc:290] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:24.147644 25218 tablet_bootstrap.cc:492] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2: No bootstrap required, opened a new log
I20260709 13:11:24.148340 25218 ts_tablet_manager.cc:1403] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.020s
I20260709 13:11:24.151219 25224 raft_consensus.cc:515] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.154358 25224 leader_election.cc:290] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:24.155454 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bee58920cf48df8afb0277a28a9ad2" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:24.155793 25216 tablet_bootstrap.cc:492] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0: No bootstrap required, opened a new log
I20260709 13:11:24.155934 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bee58920cf48df8afb0277a28a9ad2" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
I20260709 13:11:24.156293 25216 ts_tablet_manager.cc:1403] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.000s
I20260709 13:11:24.156579 25027 raft_consensus.cc:3060] T 99bee58920cf48df8afb0277a28a9ad2 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:24.156925 25067 leader_election.cc:343] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.157368 25223 raft_consensus.cc:493] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.157845 25223 raft_consensus.cc:515] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.158911 25216 raft_consensus.cc:359] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.159399 25216 raft_consensus.cc:385] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.152379 25218 raft_consensus.cc:359] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.159765 25216 raft_consensus.cc:740] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.159873 25223 leader_election.cc:290] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971)
I20260709 13:11:24.160118 25218 raft_consensus.cc:385] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.160506 25218 raft_consensus.cc:740] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.160683 25216 consensus_queue.cc:260] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.161293 25218 consensus_queue.cc:260] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.161574 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e6bbc00e20487d992e8550a9610038" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0" is_pre_election: true
I20260709 13:11:24.162349 25102 raft_consensus.cc:2468] T 17e6bbc00e20487d992e8550a9610038 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b2fbb12f91f47f2b0abab045013abab in term 0.
I20260709 13:11:24.163439 25216 ts_tablet_manager.cc:1434] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:24.163625 25142 leader_election.cc:304] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:24.164498 25216 tablet_bootstrap.cc:492] T dd14bc55420b4bfda81e00b11b16480a P bf8661d86cd14b0caded7f5606eba9c0: Bootstrap starting.
I20260709 13:11:24.165786 25218 ts_tablet_manager.cc:1434] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.005s
I20260709 13:11:24.166553 25217 tablet_bootstrap.cc:492] T f0f039f792f742499a2ba068a50a8a40 P 1b2fbb12f91f47f2b0abab045013abab: No bootstrap required, opened a new log
I20260709 13:11:24.166833 25218 tablet_bootstrap.cc:492] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2: Bootstrap starting.
I20260709 13:11:24.167302 25217 ts_tablet_manager.cc:1403] T f0f039f792f742499a2ba068a50a8a40 P 1b2fbb12f91f47f2b0abab045013abab: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.007s
I20260709 13:11:24.170131 25217 raft_consensus.cc:359] T f0f039f792f742499a2ba068a50a8a40 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.171861 25217 raft_consensus.cc:385] T f0f039f792f742499a2ba068a50a8a40 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.172176 25217 raft_consensus.cc:740] T f0f039f792f742499a2ba068a50a8a40 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.172839 25217 consensus_queue.cc:260] T f0f039f792f742499a2ba068a50a8a40 P 1b2fbb12f91f47f2b0abab045013abab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.173614 25027 raft_consensus.cc:2468] T 99bee58920cf48df8afb0277a28a9ad2 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 1.
I20260709 13:11:24.173789 25218 tablet_bootstrap.cc:654] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.175133 25217 ts_tablet_manager.cc:1434] T f0f039f792f742499a2ba068a50a8a40 P 1b2fbb12f91f47f2b0abab045013abab: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:11:24.171456 25216 tablet_bootstrap.cc:654] T dd14bc55420b4bfda81e00b11b16480a P bf8661d86cd14b0caded7f5606eba9c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.176137 25217 tablet_bootstrap.cc:492] T 99bee58920cf48df8afb0277a28a9ad2 P 1b2fbb12f91f47f2b0abab045013abab: Bootstrap starting.
I20260709 13:11:24.177263 25065 leader_election.cc:304] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 1b2fbb12f91f47f2b0abab045013abab
I20260709 13:11:24.178463 25224 raft_consensus.cc:2804] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.178957 25224 raft_consensus.cc:697] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Becoming Leader. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Running, Role: LEADER
I20260709 13:11:24.180152 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e6bbc00e20487d992e8550a9610038" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2" is_pre_election: true
I20260709 13:11:24.179863 25224 consensus_queue.cc:237] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.182204 25217 tablet_bootstrap.cc:654] T 99bee58920cf48df8afb0277a28a9ad2 P 1b2fbb12f91f47f2b0abab045013abab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.184557 25027 raft_consensus.cc:2468] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b2fbb12f91f47f2b0abab045013abab in term 0.
I20260709 13:11:24.186933 25223 raft_consensus.cc:2804] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.187512 25223 raft_consensus.cc:493] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.187920 25223 raft_consensus.cc:3060] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.199743 25216 tablet_bootstrap.cc:492] T dd14bc55420b4bfda81e00b11b16480a P bf8661d86cd14b0caded7f5606eba9c0: No bootstrap required, opened a new log
I20260709 13:11:24.200352 25216 ts_tablet_manager.cc:1403] T dd14bc55420b4bfda81e00b11b16480a P bf8661d86cd14b0caded7f5606eba9c0: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.007s
I20260709 13:11:24.200284 25218 tablet_bootstrap.cc:492] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2: No bootstrap required, opened a new log
I20260709 13:11:24.202847 25218 ts_tablet_manager.cc:1403] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.008s
I20260709 13:11:24.203023 25223 raft_consensus.cc:515] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.203485 25216 raft_consensus.cc:359] T dd14bc55420b4bfda81e00b11b16480a P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.204159 25216 raft_consensus.cc:385] T dd14bc55420b4bfda81e00b11b16480a P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.204448 25216 raft_consensus.cc:740] T dd14bc55420b4bfda81e00b11b16480a P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.200570 25217 tablet_bootstrap.cc:492] T 99bee58920cf48df8afb0277a28a9ad2 P 1b2fbb12f91f47f2b0abab045013abab: No bootstrap required, opened a new log
I20260709 13:11:24.205358 25217 ts_tablet_manager.cc:1403] T 99bee58920cf48df8afb0277a28a9ad2 P 1b2fbb12f91f47f2b0abab045013abab: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.008s
I20260709 13:11:24.205958 25218 raft_consensus.cc:359] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.206282 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e6bbc00e20487d992e8550a9610038" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
I20260709 13:11:24.206897 25027 raft_consensus.cc:3060] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.208138 25217 raft_consensus.cc:359] T 99bee58920cf48df8afb0277a28a9ad2 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.208489 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e6bbc00e20487d992e8550a9610038" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
I20260709 13:11:24.209065 25102 raft_consensus.cc:3060] T 17e6bbc00e20487d992e8550a9610038 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.209198 25216 consensus_queue.cc:260] T dd14bc55420b4bfda81e00b11b16480a P bf8661d86cd14b0caded7f5606eba9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.211356 25216 ts_tablet_manager.cc:1434] T dd14bc55420b4bfda81e00b11b16480a P bf8661d86cd14b0caded7f5606eba9c0: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.001s
I20260709 13:11:24.210620 24925 catalog_manager.cc:5697] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "bf8661d86cd14b0caded7f5606eba9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.212381 25216 tablet_bootstrap.cc:492] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0: Bootstrap starting.
I20260709 13:11:24.208829 25217 raft_consensus.cc:385] T 99bee58920cf48df8afb0277a28a9ad2 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.214286 25027 raft_consensus.cc:2468] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b2fbb12f91f47f2b0abab045013abab in term 1.
I20260709 13:11:24.214690 25217 raft_consensus.cc:740] T 99bee58920cf48df8afb0277a28a9ad2 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.215308 25218 raft_consensus.cc:385] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.215655 25218 raft_consensus.cc:740] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.215651 25217 consensus_queue.cc:260] T 99bee58920cf48df8afb0277a28a9ad2 P 1b2fbb12f91f47f2b0abab045013abab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.216054 25139 leader_election.cc:304] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab, 3f8a1edc55ec49da8d471f29f89febc2; no voters: 
I20260709 13:11:24.217233 25234 raft_consensus.cc:2804] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.216985 25218 consensus_queue.cc:260] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.219496 25218 ts_tablet_manager.cc:1434] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.005s
I20260709 13:11:24.220561 25218 tablet_bootstrap.cc:492] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2: Bootstrap starting.
I20260709 13:11:24.220572 25217 ts_tablet_manager.cc:1434] T 99bee58920cf48df8afb0277a28a9ad2 P 1b2fbb12f91f47f2b0abab045013abab: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:11:24.223845 25221 raft_consensus.cc:493] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.224442 25221 raft_consensus.cc:515] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.226156 25216 tablet_bootstrap.cc:654] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.227025 25218 tablet_bootstrap.cc:654] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.229060 25102 raft_consensus.cc:2468] T 17e6bbc00e20487d992e8550a9610038 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b2fbb12f91f47f2b0abab045013abab in term 1.
I20260709 13:11:24.230222 25223 leader_election.cc:290] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 election: Requested vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971)
I20260709 13:11:24.247498 25224 raft_consensus.cc:493] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.248330 25224 raft_consensus.cc:515] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.231088 25221 leader_election.cc:290] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:24.252957 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f039f792f742499a2ba068a50a8a40" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab" is_pre_election: true
I20260709 13:11:24.253882 25176 raft_consensus.cc:2468] T f0f039f792f742499a2ba068a50a8a40 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 0.
I20260709 13:11:24.255867 25067 leader_election.cc:304] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:24.257083 25228 raft_consensus.cc:2804] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.257550 25228 raft_consensus.cc:493] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.257958 25228 raft_consensus.cc:3060] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.268626 25224 leader_election.cc:290] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:24.275214 25223 raft_consensus.cc:493] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.276139 25223 raft_consensus.cc:515] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } }
I20260709 13:11:24.277509 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f039f792f742499a2ba068a50a8a40" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2" is_pre_election: true
I20260709 13:11:24.279017 25027 raft_consensus.cc:2468] T f0f039f792f742499a2ba068a50a8a40 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 0.
I20260709 13:11:24.280342 25224 raft_consensus.cc:493] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.280922 25224 raft_consensus.cc:515] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.284224 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed3a721a22bf4cfa80f834d4e284b209" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab" is_pre_election: true
I20260709 13:11:24.284891 25176 raft_consensus.cc:2468] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 0.
I20260709 13:11:24.286237 25067 leader_election.cc:304] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:24.288951 25234 raft_consensus.cc:697] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [term 1 LEADER]: Becoming Leader. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Running, Role: LEADER
I20260709 13:11:24.289440 25224 leader_election.cc:290] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:24.290637 25224 raft_consensus.cc:2804] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.290997 25224 raft_consensus.cc:493] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.291342 25224 raft_consensus.cc:3060] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.292066 25234 consensus_queue.cc:237] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.292755 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed3a721a22bf4cfa80f834d4e284b209" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2" is_pre_election: true
I20260709 13:11:24.290143 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678ed24005be40eeb9bc4041fce6ee35" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0" is_pre_election: true
W20260709 13:11:24.295771 25065 leader_election.cc:343] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.297132 25223 leader_election.cc:290] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971), 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639)
I20260709 13:11:24.299437 25218 tablet_bootstrap.cc:492] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2: No bootstrap required, opened a new log
I20260709 13:11:24.299935 25218 ts_tablet_manager.cc:1403] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2: Time spent bootstrapping tablet: real 0.080s	user 0.029s	sys 0.032s
I20260709 13:11:24.300423 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678ed24005be40eeb9bc4041fce6ee35" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2" is_pre_election: true
I20260709 13:11:24.301529 25027 raft_consensus.cc:2393] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1b2fbb12f91f47f2b0abab045013abab in current term 1: Already voted for candidate bf8661d86cd14b0caded7f5606eba9c0 in this term.
I20260709 13:11:24.303225 25139 leader_election.cc:304] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab; no voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0
I20260709 13:11:24.295221 25228 raft_consensus.cc:515] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.303000 25218 raft_consensus.cc:359] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.304975 25218 raft_consensus.cc:385] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.305331 25218 raft_consensus.cc:740] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.306010 25223 raft_consensus.cc:3060] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.306181 25218 consensus_queue.cc:260] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.307458 25224 raft_consensus.cc:515] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.309530 25216 tablet_bootstrap.cc:492] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0: No bootstrap required, opened a new log
I20260709 13:11:24.310228 25216 ts_tablet_manager.cc:1403] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0: Time spent bootstrapping tablet: real 0.098s	user 0.041s	sys 0.045s
I20260709 13:11:24.310731 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f039f792f742499a2ba068a50a8a40" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
I20260709 13:11:24.311331 25027 raft_consensus.cc:3060] T f0f039f792f742499a2ba068a50a8a40 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.315966 25218 ts_tablet_manager.cc:1434] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:11:24.316653 25224 leader_election.cc:290] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:24.313807 25216 raft_consensus.cc:359] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.317536 25216 raft_consensus.cc:385] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.317916 25216 raft_consensus.cc:740] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.318786 25216 consensus_queue.cc:260] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.319540 25027 raft_consensus.cc:2468] T f0f039f792f742499a2ba068a50a8a40 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 1.
I20260709 13:11:24.320820 25065 leader_election.cc:304] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:24.321538 25216 ts_tablet_manager.cc:1434] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:11:24.321643 25224 raft_consensus.cc:2804] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.322233 25224 raft_consensus.cc:697] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Becoming Leader. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Running, Role: LEADER
I20260709 13:11:24.323223 25224 consensus_queue.cc:237] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.324223 25218 tablet_bootstrap.cc:492] T ed3a721a22bf4cfa80f834d4e284b209 P 3f8a1edc55ec49da8d471f29f89febc2: Bootstrap starting.
I20260709 13:11:24.328678 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed3a721a22bf4cfa80f834d4e284b209" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:24.329306 25176 raft_consensus.cc:3060] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.330736 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81757f4945249a590eb6f0d48e39982" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0" is_pre_election: true
I20260709 13:11:24.331511 25102 raft_consensus.cc:2468] T b81757f4945249a590eb6f0d48e39982 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 0.
I20260709 13:11:24.332782 25218 tablet_bootstrap.cc:654] T ed3a721a22bf4cfa80f834d4e284b209 P 3f8a1edc55ec49da8d471f29f89febc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.337294 25176 raft_consensus.cc:2468] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 1.
I20260709 13:11:24.340031 25228 leader_election.cc:290] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:24.339286 24925 catalog_manager.cc:5697] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "bf8661d86cd14b0caded7f5606eba9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.341606 24993 leader_election.cc:304] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:24.342026 25067 leader_election.cc:304] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:24.342548 25221 raft_consensus.cc:2804] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.342918 25221 raft_consensus.cc:493] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.343132 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed3a721a22bf4cfa80f834d4e284b209" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
I20260709 13:11:24.343343 25221 raft_consensus.cc:3060] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.349293 25223 raft_consensus.cc:2749] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.343608 25228 raft_consensus.cc:2804] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:11:24.350229 25065 leader_election.cc:343] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.350503 25228 raft_consensus.cc:697] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Becoming Leader. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Running, Role: LEADER
I20260709 13:11:24.351400 25228 consensus_queue.cc:237] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.352761 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f039f792f742499a2ba068a50a8a40" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:24.353360 25176 raft_consensus.cc:3060] T f0f039f792f742499a2ba068a50a8a40 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.353962 25174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81757f4945249a590eb6f0d48e39982" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab" is_pre_election: true
I20260709 13:11:24.354830 25174 raft_consensus.cc:2468] T b81757f4945249a590eb6f0d48e39982 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 0.
I20260709 13:11:24.356447 25221 raft_consensus.cc:515] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.357613 25224 consensus_queue.cc:1048] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.349346 24924 catalog_manager.cc:5697] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131). New cstate: current_term: 1 leader_uuid: "1b2fbb12f91f47f2b0abab045013abab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:24.361075 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81757f4945249a590eb6f0d48e39982" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
I20260709 13:11:24.361675 25102 raft_consensus.cc:3060] T b81757f4945249a590eb6f0d48e39982 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.361902 25223 raft_consensus.cc:493] T 99bee58920cf48df8afb0277a28a9ad2 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.362458 25223 raft_consensus.cc:515] T 99bee58920cf48df8afb0277a28a9ad2 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.363274 25218 tablet_bootstrap.cc:492] T ed3a721a22bf4cfa80f834d4e284b209 P 3f8a1edc55ec49da8d471f29f89febc2: No bootstrap required, opened a new log
I20260709 13:11:24.363519 25174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81757f4945249a590eb6f0d48e39982" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:24.363813 25218 ts_tablet_manager.cc:1403] T ed3a721a22bf4cfa80f834d4e284b209 P 3f8a1edc55ec49da8d471f29f89febc2: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 13:11:24.364123 25174 raft_consensus.cc:3060] T b81757f4945249a590eb6f0d48e39982 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.367853 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bee58920cf48df8afb0277a28a9ad2" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2" is_pre_election: true
I20260709 13:11:24.368142 25101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bee58920cf48df8afb0277a28a9ad2" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0" is_pre_election: true
I20260709 13:11:24.368682 25027 raft_consensus.cc:2393] T 99bee58920cf48df8afb0277a28a9ad2 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1b2fbb12f91f47f2b0abab045013abab in current term 1: Already voted for candidate bf8661d86cd14b0caded7f5606eba9c0 in this term.
I20260709 13:11:24.368789 25176 raft_consensus.cc:2468] T f0f039f792f742499a2ba068a50a8a40 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 1.
I20260709 13:11:24.369963 25139 leader_election.cc:304] T 99bee58920cf48df8afb0277a28a9ad2 P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab; no voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0
I20260709 13:11:24.370299 25218 raft_consensus.cc:359] T ed3a721a22bf4cfa80f834d4e284b209 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.370855 25234 raft_consensus.cc:3060] T 99bee58920cf48df8afb0277a28a9ad2 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.371038 25218 raft_consensus.cc:385] T ed3a721a22bf4cfa80f834d4e284b209 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.371436 25218 raft_consensus.cc:740] T ed3a721a22bf4cfa80f834d4e284b209 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.372189 25218 consensus_queue.cc:260] T ed3a721a22bf4cfa80f834d4e284b209 P 3f8a1edc55ec49da8d471f29f89febc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.375833 25257 raft_consensus.cc:493] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.376361 25257 raft_consensus.cc:515] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.370124 25223 leader_election.cc:290] T 99bee58920cf48df8afb0277a28a9ad2 P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971)
I20260709 13:11:24.378531 25257 leader_election.cc:290] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:24.380350 25218 ts_tablet_manager.cc:1434] T ed3a721a22bf4cfa80f834d4e284b209 P 3f8a1edc55ec49da8d471f29f89febc2: Time spent starting tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:11:24.380645 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a4d99b1cc845cab2478402bf9df1a2" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab" is_pre_election: true
I20260709 13:11:24.381389 25176 raft_consensus.cc:2468] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 0.
I20260709 13:11:24.381671 25174 raft_consensus.cc:2468] T b81757f4945249a590eb6f0d48e39982 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 1.
I20260709 13:11:24.382607 25067 leader_election.cc:304] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:24.382783 25221 leader_election.cc:290] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 election: Requested vote from peers bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:24.383802 25257 raft_consensus.cc:2804] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.384209 25257 raft_consensus.cc:493] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.384578 25257 raft_consensus.cc:3060] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.384972 25234 raft_consensus.cc:2749] T 99bee58920cf48df8afb0277a28a9ad2 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.385345 25102 raft_consensus.cc:2468] T b81757f4945249a590eb6f0d48e39982 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 1.
I20260709 13:11:24.386215 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a4d99b1cc845cab2478402bf9df1a2" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2" is_pre_election: true
I20260709 13:11:24.380379 25263 raft_consensus.cc:493] T e5a4d99b1cc845cab2478402bf9df1a2 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.383880 24992 leader_election.cc:304] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab, 3f8a1edc55ec49da8d471f29f89febc2; no voters: 
I20260709 13:11:24.393463 25263 raft_consensus.cc:515] T e5a4d99b1cc845cab2478402bf9df1a2 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.394659 25027 raft_consensus.cc:2468] T e5a4d99b1cc845cab2478402bf9df1a2 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 0.
I20260709 13:11:24.395341 25221 raft_consensus.cc:2804] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.392530 25257 raft_consensus.cc:515] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.395915 25221 raft_consensus.cc:697] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 LEADER]: Becoming Leader. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Running, Role: LEADER
I20260709 13:11:24.396777 25221 consensus_queue.cc:237] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.397565 25257 leader_election.cc:290] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:24.398514 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a4d99b1cc845cab2478402bf9df1a2" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
I20260709 13:11:24.399143 25027 raft_consensus.cc:3060] T e5a4d99b1cc845cab2478402bf9df1a2 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.399884 25263 leader_election.cc:290] T e5a4d99b1cc845cab2478402bf9df1a2 P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:24.399813 25174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a4d99b1cc845cab2478402bf9df1a2" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:24.400602 25174 raft_consensus.cc:3060] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.401234 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a4d99b1cc845cab2478402bf9df1a2" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab" is_pre_election: true
I20260709 13:11:24.403141 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a4d99b1cc845cab2478402bf9df1a2" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0" is_pre_election: true
I20260709 13:11:24.401260 24925 catalog_manager.cc:5697] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "bf8661d86cd14b0caded7f5606eba9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.404067 25102 raft_consensus.cc:2393] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f8a1edc55ec49da8d471f29f89febc2 in current term 1: Already voted for candidate bf8661d86cd14b0caded7f5606eba9c0 in this term.
I20260709 13:11:24.408543 24993 leader_election.cc:304] T e5a4d99b1cc845cab2478402bf9df1a2 P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2; no voters: 1b2fbb12f91f47f2b0abab045013abab, bf8661d86cd14b0caded7f5606eba9c0
I20260709 13:11:24.410072 25174 raft_consensus.cc:2468] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 1.
I20260709 13:11:24.411693 25067 leader_election.cc:304] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:24.412850 25257 raft_consensus.cc:2804] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.413479 25257 raft_consensus.cc:697] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Becoming Leader. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Running, Role: LEADER
I20260709 13:11:24.414489 25257 consensus_queue.cc:237] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.440975 25027 raft_consensus.cc:2468] T e5a4d99b1cc845cab2478402bf9df1a2 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 1.
I20260709 13:11:24.441633 25263 raft_consensus.cc:2749] T e5a4d99b1cc845cab2478402bf9df1a2 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.443310 25228 consensus_queue.cc:1048] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:24.446260 25263 raft_consensus.cc:493] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.446882 25263 raft_consensus.cc:515] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.440824 24924 catalog_manager.cc:5697] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "bf8661d86cd14b0caded7f5606eba9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.453176 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd14bc55420b4bfda81e00b11b16480a" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0" is_pre_election: true
I20260709 13:11:24.453899 25102 raft_consensus.cc:2468] T dd14bc55420b4bfda81e00b11b16480a P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 0.
I20260709 13:11:24.455035 24993 leader_election.cc:304] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:24.455869 25266 raft_consensus.cc:2804] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.456236 25266 raft_consensus.cc:493] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.456554 25266 raft_consensus.cc:3060] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.458093 24923 catalog_manager.cc:5697] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "3f8a1edc55ec49da8d471f29f89febc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.460219 25263 leader_election.cc:290] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:24.462905 25175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd14bc55420b4bfda81e00b11b16480a" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab" is_pre_election: true
I20260709 13:11:24.463673 25175 raft_consensus.cc:2468] T dd14bc55420b4bfda81e00b11b16480a P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 0.
I20260709 13:11:24.464498 25266 raft_consensus.cc:515] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.467190 25266 leader_election.cc:290] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 election: Requested vote from peers bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:24.467188 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd14bc55420b4bfda81e00b11b16480a" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
I20260709 13:11:24.468061 25102 raft_consensus.cc:3060] T dd14bc55420b4bfda81e00b11b16480a P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.469336 25175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd14bc55420b4bfda81e00b11b16480a" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:24.469938 25175 raft_consensus.cc:3060] T dd14bc55420b4bfda81e00b11b16480a P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.475370 25102 raft_consensus.cc:2468] T dd14bc55420b4bfda81e00b11b16480a P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 1.
I20260709 13:11:24.476732 25175 raft_consensus.cc:2468] T dd14bc55420b4bfda81e00b11b16480a P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 1.
I20260709 13:11:24.476680 24993 leader_election.cc:304] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:24.477787 25266 raft_consensus.cc:2804] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.478296 25266 raft_consensus.cc:697] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 LEADER]: Becoming Leader. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Running, Role: LEADER
I20260709 13:11:24.479051 25266 consensus_queue.cc:237] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.486738 24924 catalog_manager.cc:5697] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "3f8a1edc55ec49da8d471f29f89febc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.518179 25257 raft_consensus.cc:493] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.518349 25266 raft_consensus.cc:493] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.518877 25257 raft_consensus.cc:515] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.518901 25266 raft_consensus.cc:515] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.521189 25266 leader_election.cc:290] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:24.521268 25257 leader_election.cc:290] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:24.522130 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2be738daf040ec8055ea11ffba43de" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0" is_pre_election: true
I20260709 13:11:24.522444 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2be738daf040ec8055ea11ffba43de" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2" is_pre_election: true
I20260709 13:11:24.522601 25175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2be738daf040ec8055ea11ffba43de" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab" is_pre_election: true
I20260709 13:11:24.522825 25102 raft_consensus.cc:2468] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 0.
I20260709 13:11:24.522969 25174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2be738daf040ec8055ea11ffba43de" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab" is_pre_election: true
I20260709 13:11:24.523099 25027 raft_consensus.cc:2468] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 0.
I20260709 13:11:24.523353 25175 raft_consensus.cc:2468] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 0.
I20260709 13:11:24.524163 24993 leader_election.cc:304] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:24.524695 25065 leader_election.cc:304] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:24.525134 25266 raft_consensus.cc:2804] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.525539 25257 raft_consensus.cc:2804] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.525599 25266 raft_consensus.cc:493] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.526048 25257 raft_consensus.cc:493] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.526129 25266 raft_consensus.cc:3060] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.526407 25257 raft_consensus.cc:3060] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.531255 25266 raft_consensus.cc:515] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.531257 25257 raft_consensus.cc:515] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.533190 25257 leader_election.cc:290] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:24.533207 25266 leader_election.cc:290] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 election: Requested vote from peers bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:24.534271 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2be738daf040ec8055ea11ffba43de" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
I20260709 13:11:24.534636 25175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2be738daf040ec8055ea11ffba43de" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:24.534933 25174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2be738daf040ec8055ea11ffba43de" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:24.535368 25175 raft_consensus.cc:3060] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.535116 25027 raft_consensus.cc:2393] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bf8661d86cd14b0caded7f5606eba9c0 in current term 1: Already voted for candidate 3f8a1edc55ec49da8d471f29f89febc2 in this term.
I20260709 13:11:24.535641 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2be738daf040ec8055ea11ffba43de" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
I20260709 13:11:24.536456 25102 raft_consensus.cc:2393] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f8a1edc55ec49da8d471f29f89febc2 in current term 1: Already voted for candidate bf8661d86cd14b0caded7f5606eba9c0 in this term.
I20260709 13:11:24.536707 25065 leader_election.cc:304] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf8661d86cd14b0caded7f5606eba9c0; no voters: 1b2fbb12f91f47f2b0abab045013abab, 3f8a1edc55ec49da8d471f29f89febc2
I20260709 13:11:24.537545 25257 raft_consensus.cc:2749] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.541245 25175 raft_consensus.cc:2468] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 1.
I20260709 13:11:24.542562 24992 leader_election.cc:304] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab, 3f8a1edc55ec49da8d471f29f89febc2; no voters: bf8661d86cd14b0caded7f5606eba9c0
I20260709 13:11:24.543507 25266 raft_consensus.cc:2804] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.544013 25266 raft_consensus.cc:697] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 LEADER]: Becoming Leader. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Running, Role: LEADER
I20260709 13:11:24.544979 25266 consensus_queue.cc:237] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.553138 24924 catalog_manager.cc:5697] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "3f8a1edc55ec49da8d471f29f89febc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.582446 25257 consensus_queue.cc:1048] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.593195 25224 consensus_queue.cc:1048] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.736981 25224 consensus_queue.cc:1048] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.743352 25102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "678ed24005be40eeb9bc4041fce6ee35"
dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
mode: GRACEFUL
new_leader_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
 from {username='slave'} at 127.0.0.1:60938
I20260709 13:11:24.744069 25102 raft_consensus.cc:606] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Received request to transfer leadership to TS 3f8a1edc55ec49da8d471f29f89febc2
I20260709 13:11:24.748659 25257 consensus_queue.cc:1048] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.770355 25175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17e6bbc00e20487d992e8550a9610038"
dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
mode: GRACEFUL
new_leader_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
 from {username='slave'} at 127.0.0.1:37948
I20260709 13:11:24.771037 25175 raft_consensus.cc:606] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [term 1 LEADER]: Received request to transfer leadership to TS 3f8a1edc55ec49da8d471f29f89febc2
I20260709 13:11:24.790293 25027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f2be738daf040ec8055ea11ffba43de"
dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
mode: GRACEFUL
new_leader_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
 from {username='slave'} at 127.0.0.1:55728
I20260709 13:11:24.790836 25027 raft_consensus.cc:606] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 LEADER]: Received request to transfer leadership to TS bf8661d86cd14b0caded7f5606eba9c0
I20260709 13:11:24.801994 25102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5a4d99b1cc845cab2478402bf9df1a2"
dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
mode: GRACEFUL
new_leader_uuid: "1b2fbb12f91f47f2b0abab045013abab"
 from {username='slave'} at 127.0.0.1:60938
I20260709 13:11:24.802537 25102 raft_consensus.cc:606] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Received request to transfer leadership to TS 1b2fbb12f91f47f2b0abab045013abab
I20260709 13:11:24.815367 25234 consensus_queue.cc:1048] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.820163 25266 consensus_queue.cc:1048] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.827260 25234 consensus_queue.cc:1048] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.837626 25234 raft_consensus.cc:993] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab: : Instructing follower 3f8a1edc55ec49da8d471f29f89febc2 to start an election
I20260709 13:11:24.838152 25234 raft_consensus.cc:1081] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [term 1 LEADER]: Signalling peer 3f8a1edc55ec49da8d471f29f89febc2 to start an election
I20260709 13:11:24.839597 25261 consensus_queue.cc:1048] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:24.843523 25027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17e6bbc00e20487d992e8550a9610038"
dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
 from {username='slave'} at 127.0.0.1:55714
I20260709 13:11:24.844213 25027 raft_consensus.cc:493] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:24.844630 25027 raft_consensus.cc:3060] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:24.852380 25027 raft_consensus.cc:515] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.853953 25257 consensus_queue.cc:1048] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:24.854786 25027 leader_election.cc:290] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 2 election: Requested vote from peers bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:24.856554 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e6bbc00e20487d992e8550a9610038" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
I20260709 13:11:24.857182 25102 raft_consensus.cc:3060] T 17e6bbc00e20487d992e8550a9610038 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:24.857285 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e6bbc00e20487d992e8550a9610038" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:24.857985 25176 raft_consensus.cc:3055] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:24.858327 25176 raft_consensus.cc:740] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Running, Role: LEADER
I20260709 13:11:24.859162 25176 consensus_queue.cc:260] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.860538 25176 raft_consensus.cc:3060] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:24.860654 25261 raft_consensus.cc:493] T ed3a721a22bf4cfa80f834d4e284b209 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.861166 25261 raft_consensus.cc:515] T ed3a721a22bf4cfa80f834d4e284b209 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.863260 25261 leader_election.cc:290] T ed3a721a22bf4cfa80f834d4e284b209 P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:24.864501 25173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed3a721a22bf4cfa80f834d4e284b209" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab" is_pre_election: true
I20260709 13:11:24.864939 25101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed3a721a22bf4cfa80f834d4e284b209" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0" is_pre_election: true
I20260709 13:11:24.866485 24993 leader_election.cc:304] T ed3a721a22bf4cfa80f834d4e284b209 P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2; no voters: 1b2fbb12f91f47f2b0abab045013abab, bf8661d86cd14b0caded7f5606eba9c0
I20260709 13:11:24.867285 25261 raft_consensus.cc:2749] T ed3a721a22bf4cfa80f834d4e284b209 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.870411 25176 raft_consensus.cc:2468] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 2.
I20260709 13:11:24.871628 24992 leader_election.cc:304] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab, 3f8a1edc55ec49da8d471f29f89febc2; no voters: 
I20260709 13:11:24.870431 25102 raft_consensus.cc:2468] T 17e6bbc00e20487d992e8550a9610038 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 2.
I20260709 13:11:24.872601 25261 raft_consensus.cc:2804] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:24.874111 25261 raft_consensus.cc:697] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 LEADER]: Becoming Leader. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Running, Role: LEADER
I20260709 13:11:24.875342 25261 consensus_queue.cc:237] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.883844 25027 raft_consensus.cc:3060] T ed3a721a22bf4cfa80f834d4e284b209 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.885154 24924 catalog_manager.cc:5697] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2 reported cstate change: term changed from 1 to 2, leader changed from 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131) to 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "3f8a1edc55ec49da8d471f29f89febc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.893216 25257 consensus_queue.cc:1048] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.933259 25257 consensus_queue.cc:1048] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.944056 25270 consensus_queue.cc:1048] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.951532 25228 raft_consensus.cc:993] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0: : Instructing follower 1b2fbb12f91f47f2b0abab045013abab to start an election
I20260709 13:11:24.952062 25228 raft_consensus.cc:1081] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Signalling peer 1b2fbb12f91f47f2b0abab045013abab to start an election
I20260709 13:11:24.953804 25174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5a4d99b1cc845cab2478402bf9df1a2"
dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
 from {username='slave'} at 127.0.0.1:37942
I20260709 13:11:24.954385 25174 raft_consensus.cc:493] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:24.954713 25174 raft_consensus.cc:3060] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:24.959928 25174 raft_consensus.cc:515] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.962184 25174 leader_election.cc:290] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 2 election: Requested vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971)
I20260709 13:11:24.962502 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a4d99b1cc845cab2478402bf9df1a2" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
I20260709 13:11:24.962785 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a4d99b1cc845cab2478402bf9df1a2" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
I20260709 13:11:24.963184 25027 raft_consensus.cc:3060] T e5a4d99b1cc845cab2478402bf9df1a2 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:24.963346 25102 raft_consensus.cc:3055] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:24.963814 25102 raft_consensus.cc:740] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Running, Role: LEADER
I20260709 13:11:24.964620 25102 consensus_queue.cc:260] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.965898 25102 raft_consensus.cc:3060] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:24.970295 25027 raft_consensus.cc:2468] T e5a4d99b1cc845cab2478402bf9df1a2 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b2fbb12f91f47f2b0abab045013abab in term 2.
I20260709 13:11:24.971549 25139 leader_election.cc:304] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab, 3f8a1edc55ec49da8d471f29f89febc2; no voters: 
I20260709 13:11:24.972235 25234 raft_consensus.cc:2804] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:24.972517 25102 raft_consensus.cc:2468] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b2fbb12f91f47f2b0abab045013abab in term 2.
I20260709 13:11:24.972652 25234 raft_consensus.cc:697] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab [term 2 LEADER]: Becoming Leader. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Running, Role: LEADER
I20260709 13:11:24.973595 25234 consensus_queue.cc:237] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:24.979508 24925 catalog_manager.cc:5697] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab reported cstate change: term changed from 1 to 2, leader changed from bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130) to 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131). New cstate: current_term: 2 leader_uuid: "1b2fbb12f91f47f2b0abab045013abab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:24.988754 25261 consensus_queue.cc:1048] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.999028 25263 consensus_queue.cc:1048] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:25.066035 25228 raft_consensus.cc:993] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0: : Instructing follower 3f8a1edc55ec49da8d471f29f89febc2 to start an election
I20260709 13:11:25.066658 25228 raft_consensus.cc:1081] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Signalling peer 3f8a1edc55ec49da8d471f29f89febc2 to start an election
I20260709 13:11:25.068302 25026 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "678ed24005be40eeb9bc4041fce6ee35"
dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
 from {username='slave'} at 127.0.0.1:55698
I20260709 13:11:25.068921 25026 raft_consensus.cc:493] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:25.069420 25026 raft_consensus.cc:3060] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:25.074823 25026 raft_consensus.cc:515] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } }
I20260709 13:11:25.076395 25026 leader_election.cc:290] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 2 election: Requested vote from peers 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479), bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971)
I20260709 13:11:25.077195 25174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678ed24005be40eeb9bc4041fce6ee35" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:25.077425 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678ed24005be40eeb9bc4041fce6ee35" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
I20260709 13:11:25.077972 25174 raft_consensus.cc:3060] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:25.077972 25102 raft_consensus.cc:3055] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:25.078506 25102 raft_consensus.cc:740] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Running, Role: LEADER
I20260709 13:11:25.079326 25102 consensus_queue.cc:260] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } }
I20260709 13:11:25.080747 25102 raft_consensus.cc:3060] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:25.086179 25174 raft_consensus.cc:2468] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 2.
I20260709 13:11:25.087361 24992 leader_election.cc:304] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab, 3f8a1edc55ec49da8d471f29f89febc2; no voters: 
I20260709 13:11:25.087586 25102 raft_consensus.cc:2468] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 2.
I20260709 13:11:25.088155 25263 raft_consensus.cc:2804] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:25.088683 25263 raft_consensus.cc:697] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 LEADER]: Becoming Leader. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Running, Role: LEADER
I20260709 13:11:25.089414 25263 consensus_queue.cc:237] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } }
I20260709 13:11:25.095247 24924 catalog_manager.cc:5697] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 reported cstate change: term changed from 1 to 2, leader changed from bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130) to 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "3f8a1edc55ec49da8d471f29f89febc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:25.114872 25263 consensus_queue.cc:1048] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:25.122421 25261 raft_consensus.cc:993] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2: : Instructing follower bf8661d86cd14b0caded7f5606eba9c0 to start an election
I20260709 13:11:25.122943 25261 raft_consensus.cc:1081] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 LEADER]: Signalling peer bf8661d86cd14b0caded7f5606eba9c0 to start an election
I20260709 13:11:25.125074 25101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f2be738daf040ec8055ea11ffba43de"
dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
 from {username='slave'} at 127.0.0.1:60932
I20260709 13:11:25.125685 25101 raft_consensus.cc:493] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:25.126091 25101 raft_consensus.cc:3060] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:25.127833 25263 consensus_queue.cc:1048] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:25.134007 25101 raft_consensus.cc:515] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:25.135242 25102 raft_consensus.cc:1240] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Rejecting Update request from peer 3f8a1edc55ec49da8d471f29f89febc2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:25.136957 25101 leader_election.cc:290] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 2 election: Requested vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:25.137120 25026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2be738daf040ec8055ea11ffba43de" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
I20260709 13:11:25.137378 25263 consensus_queue.cc:1059] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:25.138147 25026 raft_consensus.cc:3055] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:25.138551 25026 raft_consensus.cc:740] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Running, Role: LEADER
I20260709 13:11:25.138582 25174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2be738daf040ec8055ea11ffba43de" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:25.139288 25174 raft_consensus.cc:3060] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:25.139595 25026 consensus_queue.cc:260] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:25.141064 25026 raft_consensus.cc:3060] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:25.147006 25174 raft_consensus.cc:2468] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 2.
I20260709 13:11:25.148257 25067 leader_election.cc:304] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:25.149214 25228 raft_consensus.cc:2804] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:25.149732 25228 raft_consensus.cc:697] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [term 2 LEADER]: Becoming Leader. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Running, Role: LEADER
I20260709 13:11:25.150628 25228 consensus_queue.cc:237] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:25.153074 25026 raft_consensus.cc:2468] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 2.
W20260709 13:11:25.154119 25263 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:11:25.160337 24924 catalog_manager.cc:5697] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 reported cstate change: term changed from 1 to 2, leader changed from 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129) to bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130). New cstate: current_term: 2 leader_uuid: "bf8661d86cd14b0caded7f5606eba9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:25.394026 25026 raft_consensus.cc:1275] T e5a4d99b1cc845cab2478402bf9df1a2 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Refusing update from remote peer 1b2fbb12f91f47f2b0abab045013abab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:25.395303 25234 consensus_queue.cc:1048] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:25.403142 25101 raft_consensus.cc:1275] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Refusing update from remote peer 1b2fbb12f91f47f2b0abab045013abab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:25.404692 25234 consensus_queue.cc:1048] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:25.455173 25174 raft_consensus.cc:1275] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Refusing update from remote peer 3f8a1edc55ec49da8d471f29f89febc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:25.456765 25263 consensus_queue.cc:1048] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:25.465725 25101 raft_consensus.cc:1275] T 17e6bbc00e20487d992e8550a9610038 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Refusing update from remote peer 3f8a1edc55ec49da8d471f29f89febc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:25.467334 25261 consensus_queue.cc:1048] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:25.474303 25101 raft_consensus.cc:1275] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Refusing update from remote peer 3f8a1edc55ec49da8d471f29f89febc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:25.475626 25266 consensus_queue.cc:1048] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:25.484373 25174 raft_consensus.cc:1275] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Refusing update from remote peer 3f8a1edc55ec49da8d471f29f89febc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:25.485812 25261 consensus_queue.cc:1048] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:25.651959 25026 raft_consensus.cc:1275] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Refusing update from remote peer bf8661d86cd14b0caded7f5606eba9c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:25.653342 25270 consensus_queue.cc:1048] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:25.661548 25176 raft_consensus.cc:1275] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Refusing update from remote peer bf8661d86cd14b0caded7f5606eba9c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:25.662803 25228 consensus_queue.cc:1048] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:27.840988 24925 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46374:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:27.844197 24925 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:27.898272 25014 tablet_service.cc:1511] Processing CreateTablet for tablet c2e555a672e249fb858b43e84a8e173d (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:27.900354 25014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2e555a672e249fb858b43e84a8e173d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.900094 25085 tablet_service.cc:1511] Processing CreateTablet for tablet c2e555a672e249fb858b43e84a8e173d (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:27.901414 25160 tablet_service.cc:1511] Processing CreateTablet for tablet c2e555a672e249fb858b43e84a8e173d (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:27.901906 25085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2e555a672e249fb858b43e84a8e173d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.903045 25160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2e555a672e249fb858b43e84a8e173d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.906045 25013 tablet_service.cc:1511] Processing CreateTablet for tablet 1e4591d1871f4a83b553f0e85a5e8f2e (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:27.907608 25013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e4591d1871f4a83b553f0e85a5e8f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.907298 25162 tablet_service.cc:1511] Processing CreateTablet for tablet 1e4591d1871f4a83b553f0e85a5e8f2e (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:27.908818 25162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e4591d1871f4a83b553f0e85a5e8f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.919611 25089 tablet_service.cc:1511] Processing CreateTablet for tablet 1e4591d1871f4a83b553f0e85a5e8f2e (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:27.921053 25089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e4591d1871f4a83b553f0e85a5e8f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.930675 25166 tablet_service.cc:1511] Processing CreateTablet for tablet e26bbe99a450447cb4fc0012e1ba76bc (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:27.932466 25166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e26bbe99a450447cb4fc0012e1ba76bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.933446 25012 tablet_service.cc:1511] Processing CreateTablet for tablet e26bbe99a450447cb4fc0012e1ba76bc (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:27.934940 25012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e26bbe99a450447cb4fc0012e1ba76bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.934800 25090 tablet_service.cc:1511] Processing CreateTablet for tablet e26bbe99a450447cb4fc0012e1ba76bc (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:27.936267 25090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e26bbe99a450447cb4fc0012e1ba76bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.943444 25015 tablet_service.cc:1511] Processing CreateTablet for tablet 03bfae1924654fe38456ed1322baf805 (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:27.944878 25015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bfae1924654fe38456ed1322baf805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.946447 25163 tablet_service.cc:1511] Processing CreateTablet for tablet 03bfae1924654fe38456ed1322baf805 (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:27.948040 25163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bfae1924654fe38456ed1322baf805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.950878 25164 tablet_service.cc:1511] Processing CreateTablet for tablet ee8eea63cef84ee491051ae46df28a79 (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:27.952338 25164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee8eea63cef84ee491051ae46df28a79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.952124 25016 tablet_service.cc:1511] Processing CreateTablet for tablet 02e788e9b5124317a9a7e3317702542e (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:27.953467 25016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02e788e9b5124317a9a7e3317702542e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.956012 25010 tablet_service.cc:1511] Processing CreateTablet for tablet aa9abe466aa24d50b4cb387a95142271 (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:27.957458 25010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa9abe466aa24d50b4cb387a95142271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.970935 25312 tablet_bootstrap.cc:492] T 1e4591d1871f4a83b553f0e85a5e8f2e P 1b2fbb12f91f47f2b0abab045013abab: Bootstrap starting.
I20260709 13:11:27.971832 25087 tablet_service.cc:1511] Processing CreateTablet for tablet 03bfae1924654fe38456ed1322baf805 (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:27.971879 25161 tablet_service.cc:1511] Processing CreateTablet for tablet aa9abe466aa24d50b4cb387a95142271 (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:27.973208 25092 tablet_service.cc:1511] Processing CreateTablet for tablet ee8eea63cef84ee491051ae46df28a79 (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:27.948634 25011 tablet_service.cc:1511] Processing CreateTablet for tablet ee8eea63cef84ee491051ae46df28a79 (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:28.005024 25161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa9abe466aa24d50b4cb387a95142271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.005694 25011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee8eea63cef84ee491051ae46df28a79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:27.981658 25091 tablet_service.cc:1511] Processing CreateTablet for tablet aa9abe466aa24d50b4cb387a95142271 (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:27.997356 25314 tablet_bootstrap.cc:492] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2: Bootstrap starting.
I20260709 13:11:27.999099 25160 tablet_service.cc:1511] Processing CreateTablet for tablet 02e788e9b5124317a9a7e3317702542e (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:28.008419 25160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02e788e9b5124317a9a7e3317702542e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.004051 25087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bfae1924654fe38456ed1322baf805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.012039 25091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa9abe466aa24d50b4cb387a95142271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.016839 25092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee8eea63cef84ee491051ae46df28a79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.028968 25014 tablet_service.cc:1511] Processing CreateTablet for tablet 18f98d4d56ae4f3498a731b57404b6c6 (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:28.032954 25014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f98d4d56ae4f3498a731b57404b6c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.042966 25090 tablet_service.cc:1511] Processing CreateTablet for tablet 18f98d4d56ae4f3498a731b57404b6c6 (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:28.043782 25085 tablet_service.cc:1511] Processing CreateTablet for tablet 02e788e9b5124317a9a7e3317702542e (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:28.044476 25090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f98d4d56ae4f3498a731b57404b6c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.047775 25085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02e788e9b5124317a9a7e3317702542e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.056710 25314 tablet_bootstrap.cc:654] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.064930 25166 tablet_service.cc:1511] Processing CreateTablet for tablet 18f98d4d56ae4f3498a731b57404b6c6 (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:28.091091 25166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f98d4d56ae4f3498a731b57404b6c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.090684 25161 tablet_service.cc:1511] Processing CreateTablet for tablet 7d987c9c368c4d7cbf8a5c5091365b28 (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:28.093171 25161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d987c9c368c4d7cbf8a5c5091365b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.090684 25092 tablet_service.cc:1511] Processing CreateTablet for tablet 7d987c9c368c4d7cbf8a5c5091365b28 (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:28.096812 25092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d987c9c368c4d7cbf8a5c5091365b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.100991 25315 tablet_bootstrap.cc:492] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0: Bootstrap starting.
I20260709 13:11:28.104900 25016 tablet_service.cc:1511] Processing CreateTablet for tablet 7d987c9c368c4d7cbf8a5c5091365b28 (DEFAULT_TABLE table=soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:28.108012 25016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d987c9c368c4d7cbf8a5c5091365b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.119674 25312 tablet_bootstrap.cc:654] T 1e4591d1871f4a83b553f0e85a5e8f2e P 1b2fbb12f91f47f2b0abab045013abab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.124595 25315 tablet_bootstrap.cc:654] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.124773 25314 tablet_bootstrap.cc:492] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2: No bootstrap required, opened a new log
I20260709 13:11:28.128873 25314 ts_tablet_manager.cc:1403] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2: Time spent bootstrapping tablet: real 0.132s	user 0.030s	sys 0.012s
I20260709 13:11:28.132176 25314 raft_consensus.cc:359] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.133133 25314 raft_consensus.cc:385] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.133442 25314 raft_consensus.cc:740] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.134295 25314 consensus_queue.cc:260] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.139827 25314 ts_tablet_manager.cc:1434] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:11:28.141076 25314 tablet_bootstrap.cc:492] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2: Bootstrap starting.
I20260709 13:11:28.143159 25312 tablet_bootstrap.cc:492] T 1e4591d1871f4a83b553f0e85a5e8f2e P 1b2fbb12f91f47f2b0abab045013abab: No bootstrap required, opened a new log
I20260709 13:11:28.146014 25315 tablet_bootstrap.cc:492] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0: No bootstrap required, opened a new log
I20260709 13:11:28.146721 25312 ts_tablet_manager.cc:1403] T 1e4591d1871f4a83b553f0e85a5e8f2e P 1b2fbb12f91f47f2b0abab045013abab: Time spent bootstrapping tablet: real 0.176s	user 0.003s	sys 0.012s
I20260709 13:11:28.147202 25315 ts_tablet_manager.cc:1403] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.000s
I20260709 13:11:28.149451 25314 tablet_bootstrap.cc:654] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.150094 25312 raft_consensus.cc:359] T 1e4591d1871f4a83b553f0e85a5e8f2e P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.150453 25315 raft_consensus.cc:359] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.151079 25312 raft_consensus.cc:385] T 1e4591d1871f4a83b553f0e85a5e8f2e P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.151353 25315 raft_consensus.cc:385] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.151548 25312 raft_consensus.cc:740] T 1e4591d1871f4a83b553f0e85a5e8f2e P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.151809 25315 raft_consensus.cc:740] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.152706 25315 consensus_queue.cc:260] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.152789 25312 consensus_queue.cc:260] T 1e4591d1871f4a83b553f0e85a5e8f2e P 1b2fbb12f91f47f2b0abab045013abab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.155917 25313 raft_consensus.cc:493] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.157418 25315 ts_tablet_manager.cc:1434] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:11:28.157793 25313 raft_consensus.cc:515] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.158577 25315 tablet_bootstrap.cc:492] T e26bbe99a450447cb4fc0012e1ba76bc P bf8661d86cd14b0caded7f5606eba9c0: Bootstrap starting.
I20260709 13:11:28.162873 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4591d1871f4a83b553f0e85a5e8f2e" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab" is_pre_election: true
I20260709 13:11:28.164683 25313 leader_election.cc:290] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:28.165170 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4591d1871f4a83b553f0e85a5e8f2e" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2" is_pre_election: true
I20260709 13:11:28.165546 25315 tablet_bootstrap.cc:654] T e26bbe99a450447cb4fc0012e1ba76bc P bf8661d86cd14b0caded7f5606eba9c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.167441 25312 ts_tablet_manager.cc:1434] T 1e4591d1871f4a83b553f0e85a5e8f2e P 1b2fbb12f91f47f2b0abab045013abab: Time spent starting tablet: real 0.020s	user 0.000s	sys 0.007s
I20260709 13:11:28.168637 25312 tablet_bootstrap.cc:492] T c2e555a672e249fb858b43e84a8e173d P 1b2fbb12f91f47f2b0abab045013abab: Bootstrap starting.
W20260709 13:11:28.168651 25065 leader_election.cc:343] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.169050 25314 tablet_bootstrap.cc:492] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2: No bootstrap required, opened a new log
I20260709 13:11:28.169564 25314 ts_tablet_manager.cc:1403] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.017s
I20260709 13:11:28.172672 25314 raft_consensus.cc:359] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.173467 25314 raft_consensus.cc:385] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.173817 25314 raft_consensus.cc:740] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.174667 25314 consensus_queue.cc:260] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.166121 25176 raft_consensus.cc:2468] T 1e4591d1871f4a83b553f0e85a5e8f2e P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 0.
I20260709 13:11:28.176904 25312 tablet_bootstrap.cc:654] T c2e555a672e249fb858b43e84a8e173d P 1b2fbb12f91f47f2b0abab045013abab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.177698 25314 ts_tablet_manager.cc:1434] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:11:28.178743 25314 tablet_bootstrap.cc:492] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2: Bootstrap starting.
I20260709 13:11:28.184530 25067 leader_election.cc:304] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab, bf8661d86cd14b0caded7f5606eba9c0; no voters: 3f8a1edc55ec49da8d471f29f89febc2
I20260709 13:11:28.185573 25313 raft_consensus.cc:2804] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:28.185868 25314 tablet_bootstrap.cc:654] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.186115 25313 raft_consensus.cc:493] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.186612 25313 raft_consensus.cc:3060] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:28.188490 24973 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:28.194923 25313 raft_consensus.cc:515] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.198539 25315 tablet_bootstrap.cc:492] T e26bbe99a450447cb4fc0012e1ba76bc P bf8661d86cd14b0caded7f5606eba9c0: No bootstrap required, opened a new log
I20260709 13:11:28.199129 25315 ts_tablet_manager.cc:1403] T e26bbe99a450447cb4fc0012e1ba76bc P bf8661d86cd14b0caded7f5606eba9c0: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.010s
I20260709 13:11:28.200387 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4591d1871f4a83b553f0e85a5e8f2e" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
I20260709 13:11:28.201000 25027 raft_consensus.cc:3060] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.202363 25315 raft_consensus.cc:359] T e26bbe99a450447cb4fc0012e1ba76bc P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.203115 25315 raft_consensus.cc:385] T e26bbe99a450447cb4fc0012e1ba76bc P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.203398 25315 raft_consensus.cc:740] T e26bbe99a450447cb4fc0012e1ba76bc P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.204180 25315 consensus_queue.cc:260] T e26bbe99a450447cb4fc0012e1ba76bc P bf8661d86cd14b0caded7f5606eba9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.206797 25315 ts_tablet_manager.cc:1434] T e26bbe99a450447cb4fc0012e1ba76bc P bf8661d86cd14b0caded7f5606eba9c0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:28.208974 25315 tablet_bootstrap.cc:492] T c2e555a672e249fb858b43e84a8e173d P bf8661d86cd14b0caded7f5606eba9c0: Bootstrap starting.
I20260709 13:11:28.209623 25027 raft_consensus.cc:2468] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 1.
I20260709 13:11:28.197878 25312 tablet_bootstrap.cc:492] T c2e555a672e249fb858b43e84a8e173d P 1b2fbb12f91f47f2b0abab045013abab: No bootstrap required, opened a new log
I20260709 13:11:28.211928 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4591d1871f4a83b553f0e85a5e8f2e" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:28.212417 25312 ts_tablet_manager.cc:1403] T c2e555a672e249fb858b43e84a8e173d P 1b2fbb12f91f47f2b0abab045013abab: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.009s
I20260709 13:11:28.211977 25065 leader_election.cc:304] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:28.213775 25228 raft_consensus.cc:2804] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:28.210626 25313 leader_election.cc:290] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:28.210222 25314 tablet_bootstrap.cc:492] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2: No bootstrap required, opened a new log
I20260709 13:11:28.215932 25176 raft_consensus.cc:3060] T 1e4591d1871f4a83b553f0e85a5e8f2e P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.216831 25315 tablet_bootstrap.cc:654] T c2e555a672e249fb858b43e84a8e173d P bf8661d86cd14b0caded7f5606eba9c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.217725 25312 raft_consensus.cc:359] T c2e555a672e249fb858b43e84a8e173d P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.223598 25312 raft_consensus.cc:385] T c2e555a672e249fb858b43e84a8e173d P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.223845 25314 ts_tablet_manager.cc:1403] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.010s
I20260709 13:11:28.223999 25312 raft_consensus.cc:740] T c2e555a672e249fb858b43e84a8e173d P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.227082 25312 consensus_queue.cc:260] T c2e555a672e249fb858b43e84a8e173d P 1b2fbb12f91f47f2b0abab045013abab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.229638 25312 ts_tablet_manager.cc:1434] T c2e555a672e249fb858b43e84a8e173d P 1b2fbb12f91f47f2b0abab045013abab: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.007s
I20260709 13:11:28.231482 25312 tablet_bootstrap.cc:492] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab: Bootstrap starting.
I20260709 13:11:28.232451 25228 raft_consensus.cc:697] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Becoming Leader. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Running, Role: LEADER
I20260709 13:11:28.233542 25228 consensus_queue.cc:237] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.238628 25312 tablet_bootstrap.cc:654] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.233549 25314 raft_consensus.cc:359] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.239305 25314 raft_consensus.cc:385] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.239835 25314 raft_consensus.cc:740] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.240945 25314 consensus_queue.cc:260] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.244647 25314 ts_tablet_manager.cc:1434] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:11:28.246030 25314 tablet_bootstrap.cc:492] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2: Bootstrap starting.
I20260709 13:11:28.246878 25176 raft_consensus.cc:2468] T 1e4591d1871f4a83b553f0e85a5e8f2e P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 1.
I20260709 13:11:28.251215 25315 tablet_bootstrap.cc:492] T c2e555a672e249fb858b43e84a8e173d P bf8661d86cd14b0caded7f5606eba9c0: No bootstrap required, opened a new log
I20260709 13:11:28.251829 25315 ts_tablet_manager.cc:1403] T c2e555a672e249fb858b43e84a8e173d P bf8661d86cd14b0caded7f5606eba9c0: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.014s
I20260709 13:11:28.254822 25314 tablet_bootstrap.cc:654] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.255066 25315 raft_consensus.cc:359] T c2e555a672e249fb858b43e84a8e173d P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.255934 25315 raft_consensus.cc:385] T c2e555a672e249fb858b43e84a8e173d P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.256258 25315 raft_consensus.cc:740] T c2e555a672e249fb858b43e84a8e173d P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.257277 25315 consensus_queue.cc:260] T c2e555a672e249fb858b43e84a8e173d P bf8661d86cd14b0caded7f5606eba9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.259907 25315 ts_tablet_manager.cc:1434] T c2e555a672e249fb858b43e84a8e173d P bf8661d86cd14b0caded7f5606eba9c0: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:11:28.261253 25315 tablet_bootstrap.cc:492] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0: Bootstrap starting.
I20260709 13:11:28.264535 24925 catalog_manager.cc:5697] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "bf8661d86cd14b0caded7f5606eba9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:28.265718 25314 tablet_bootstrap.cc:492] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2: No bootstrap required, opened a new log
I20260709 13:11:28.265971 25312 tablet_bootstrap.cc:492] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab: No bootstrap required, opened a new log
I20260709 13:11:28.266283 25314 ts_tablet_manager.cc:1403] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.004s
I20260709 13:11:28.266525 25312 ts_tablet_manager.cc:1403] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab: Time spent bootstrapping tablet: real 0.035s	user 0.005s	sys 0.011s
I20260709 13:11:28.268440 25315 tablet_bootstrap.cc:654] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.269361 25314 raft_consensus.cc:359] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.269842 25312 raft_consensus.cc:359] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.270360 25314 raft_consensus.cc:385] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.270622 25312 raft_consensus.cc:385] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.270699 25314 raft_consensus.cc:740] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.271020 25312 raft_consensus.cc:740] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.271366 25261 raft_consensus.cc:493] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.271945 25261 raft_consensus.cc:515] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.272401 25312 consensus_queue.cc:260] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.275238 25312 ts_tablet_manager.cc:1434] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:11:28.276399 25312 tablet_bootstrap.cc:492] T 03bfae1924654fe38456ed1322baf805 P 1b2fbb12f91f47f2b0abab045013abab: Bootstrap starting.
I20260709 13:11:28.278160 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2e555a672e249fb858b43e84a8e173d" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab" is_pre_election: true
I20260709 13:11:28.278836 25176 raft_consensus.cc:2468] T c2e555a672e249fb858b43e84a8e173d P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 0.
I20260709 13:11:28.280407 24992 leader_election.cc:304] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab, 3f8a1edc55ec49da8d471f29f89febc2; no voters: 
I20260709 13:11:28.276300 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2e555a672e249fb858b43e84a8e173d" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0" is_pre_election: true
I20260709 13:11:28.282037 25102 raft_consensus.cc:2468] T c2e555a672e249fb858b43e84a8e173d P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 0.
I20260709 13:11:28.284986 25261 leader_election.cc:290] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:28.285554 25261 raft_consensus.cc:2804] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:28.285960 25261 raft_consensus.cc:493] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.286365 25261 raft_consensus.cc:3060] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.289563 25315 tablet_bootstrap.cc:492] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0: No bootstrap required, opened a new log
I20260709 13:11:28.290170 25315 ts_tablet_manager.cc:1403] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.018s
I20260709 13:11:28.271806 25314 consensus_queue.cc:260] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.293449 25314 ts_tablet_manager.cc:1434] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:11:28.296450 25314 tablet_bootstrap.cc:492] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2: Bootstrap starting.
I20260709 13:11:28.297137 25261 raft_consensus.cc:515] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.294134 25315 raft_consensus.cc:359] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.303707 25315 raft_consensus.cc:385] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.304100 25315 raft_consensus.cc:740] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.304926 25315 consensus_queue.cc:260] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.306674 25314 tablet_bootstrap.cc:654] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.307391 25315 ts_tablet_manager.cc:1434] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.004s
I20260709 13:11:28.298942 25312 tablet_bootstrap.cc:654] T 03bfae1924654fe38456ed1322baf805 P 1b2fbb12f91f47f2b0abab045013abab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.308535 25315 tablet_bootstrap.cc:492] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0: Bootstrap starting.
I20260709 13:11:28.317798 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2e555a672e249fb858b43e84a8e173d" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
I20260709 13:11:28.318584 25102 raft_consensus.cc:3060] T c2e555a672e249fb858b43e84a8e173d P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.323712 25315 tablet_bootstrap.cc:654] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.328140 25261 leader_election.cc:290] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 election: Requested vote from peers bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:28.329463 25314 tablet_bootstrap.cc:492] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2: No bootstrap required, opened a new log
I20260709 13:11:28.329720 25102 raft_consensus.cc:2468] T c2e555a672e249fb858b43e84a8e173d P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 1.
I20260709 13:11:28.330520 25174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2e555a672e249fb858b43e84a8e173d" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:28.331773 24993 leader_election.cc:304] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:28.330054 25314 ts_tablet_manager.cc:1403] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.013s
I20260709 13:11:28.333505 25261 raft_consensus.cc:2804] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:28.331357 25174 raft_consensus.cc:3060] T c2e555a672e249fb858b43e84a8e173d P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.334609 25261 raft_consensus.cc:697] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 LEADER]: Becoming Leader. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Running, Role: LEADER
I20260709 13:11:28.336050 25261 consensus_queue.cc:237] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.343079 25299 raft_consensus.cc:493] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.343863 25299 raft_consensus.cc:515] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.347813 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e26bbe99a450447cb4fc0012e1ba76bc" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2" is_pre_election: true
I20260709 13:11:28.350601 25314 raft_consensus.cc:359] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.351956 25314 raft_consensus.cc:385] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:11:28.353698 25139 leader_election.cc:343] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.354017 25314 raft_consensus.cc:740] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.354403 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e26bbe99a450447cb4fc0012e1ba76bc" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0" is_pre_election: true
I20260709 13:11:28.355180 25102 raft_consensus.cc:2468] T e26bbe99a450447cb4fc0012e1ba76bc P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b2fbb12f91f47f2b0abab045013abab in term 0.
I20260709 13:11:28.357970 25142 leader_election.cc:304] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab, bf8661d86cd14b0caded7f5606eba9c0; no voters: 3f8a1edc55ec49da8d471f29f89febc2
I20260709 13:11:28.355175 25314 consensus_queue.cc:260] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.361927 25174 raft_consensus.cc:2468] T c2e555a672e249fb858b43e84a8e173d P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 1.
I20260709 13:11:28.357291 25299 leader_election.cc:290] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971)
I20260709 13:11:28.356324 25315 tablet_bootstrap.cc:492] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0: No bootstrap required, opened a new log
I20260709 13:11:28.372061 25299 raft_consensus.cc:2804] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:28.372143 25315 ts_tablet_manager.cc:1403] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0: Time spent bootstrapping tablet: real 0.064s	user 0.017s	sys 0.015s
I20260709 13:11:28.372668 25299 raft_consensus.cc:493] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.363564 25314 ts_tablet_manager.cc:1434] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 13:11:28.373185 25299 raft_consensus.cc:3060] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.374042 25314 tablet_bootstrap.cc:492] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2: Bootstrap starting.
I20260709 13:11:28.374881 25312 tablet_bootstrap.cc:492] T 03bfae1924654fe38456ed1322baf805 P 1b2fbb12f91f47f2b0abab045013abab: No bootstrap required, opened a new log
I20260709 13:11:28.375487 25312 ts_tablet_manager.cc:1403] T 03bfae1924654fe38456ed1322baf805 P 1b2fbb12f91f47f2b0abab045013abab: Time spent bootstrapping tablet: real 0.099s	user 0.019s	sys 0.026s
I20260709 13:11:28.375614 25315 raft_consensus.cc:359] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.376478 25315 raft_consensus.cc:385] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.376821 25315 raft_consensus.cc:740] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.377691 25315 consensus_queue.cc:260] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.380162 25315 ts_tablet_manager.cc:1434] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:11:28.380214 25312 raft_consensus.cc:359] T 03bfae1924654fe38456ed1322baf805 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.381105 25312 raft_consensus.cc:385] T 03bfae1924654fe38456ed1322baf805 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.381224 25315 tablet_bootstrap.cc:492] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0: Bootstrap starting.
I20260709 13:11:28.381479 25312 raft_consensus.cc:740] T 03bfae1924654fe38456ed1322baf805 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.383019 25314 tablet_bootstrap.cc:654] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.382540 25312 consensus_queue.cc:260] T 03bfae1924654fe38456ed1322baf805 P 1b2fbb12f91f47f2b0abab045013abab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.393100 25315 tablet_bootstrap.cc:654] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.399734 25314 tablet_bootstrap.cc:492] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2: No bootstrap required, opened a new log
I20260709 13:11:28.400429 25314 ts_tablet_manager.cc:1403] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.009s
I20260709 13:11:28.399793 24924 catalog_manager.cc:5697] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "3f8a1edc55ec49da8d471f29f89febc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:28.403179 25315 tablet_bootstrap.cc:492] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0: No bootstrap required, opened a new log
I20260709 13:11:28.403496 25299 raft_consensus.cc:515] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.403817 25315 ts_tablet_manager.cc:1403] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.002s
I20260709 13:11:28.403703 25314 raft_consensus.cc:359] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.404575 25314 raft_consensus.cc:385] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.404968 25314 raft_consensus.cc:740] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.406265 25314 consensus_queue.cc:260] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.407320 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e26bbe99a450447cb4fc0012e1ba76bc" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
I20260709 13:11:28.407500 25315 raft_consensus.cc:359] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.407991 25102 raft_consensus.cc:3060] T e26bbe99a450447cb4fc0012e1ba76bc P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.408280 25315 raft_consensus.cc:385] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.408608 25315 raft_consensus.cc:740] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.409199 25314 ts_tablet_manager.cc:1434] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:11:28.409371 25315 consensus_queue.cc:260] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.410256 25314 tablet_bootstrap.cc:492] T ee8eea63cef84ee491051ae46df28a79 P 3f8a1edc55ec49da8d471f29f89febc2: Bootstrap starting.
I20260709 13:11:28.406416 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e26bbe99a450447cb4fc0012e1ba76bc" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
I20260709 13:11:28.411830 25315 ts_tablet_manager.cc:1434] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:28.412168 25027 raft_consensus.cc:3060] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.412994 25315 tablet_bootstrap.cc:492] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0: Bootstrap starting.
I20260709 13:11:28.418136 25314 tablet_bootstrap.cc:654] T ee8eea63cef84ee491051ae46df28a79 P 3f8a1edc55ec49da8d471f29f89febc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.420394 25315 tablet_bootstrap.cc:654] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.423514 25102 raft_consensus.cc:2468] T e26bbe99a450447cb4fc0012e1ba76bc P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b2fbb12f91f47f2b0abab045013abab in term 1.
I20260709 13:11:28.426805 25142 leader_election.cc:304] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:28.406833 25312 ts_tablet_manager.cc:1434] T 03bfae1924654fe38456ed1322baf805 P 1b2fbb12f91f47f2b0abab045013abab: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.003s
I20260709 13:11:28.427757 25335 raft_consensus.cc:2804] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:28.428721 25312 tablet_bootstrap.cc:492] T 02e788e9b5124317a9a7e3317702542e P 1b2fbb12f91f47f2b0abab045013abab: Bootstrap starting.
I20260709 13:11:28.425109 25027 raft_consensus.cc:2468] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b2fbb12f91f47f2b0abab045013abab in term 1.
I20260709 13:11:28.425566 25299 leader_election.cc:290] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 election: Requested vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971)
I20260709 13:11:28.435293 25312 tablet_bootstrap.cc:654] T 02e788e9b5124317a9a7e3317702542e P 1b2fbb12f91f47f2b0abab045013abab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.436664 25335 raft_consensus.cc:697] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [term 1 LEADER]: Becoming Leader. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Running, Role: LEADER
I20260709 13:11:28.436869 25228 raft_consensus.cc:493] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.437408 25228 raft_consensus.cc:515] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.438103 25315 tablet_bootstrap.cc:492] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0: No bootstrap required, opened a new log
I20260709 13:11:28.437691 25335 consensus_queue.cc:237] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.439735 25228 leader_election.cc:290] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:28.439869 25315 ts_tablet_manager.cc:1403] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.003s
I20260709 13:11:28.441792 25174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bfae1924654fe38456ed1322baf805" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab" is_pre_election: true
I20260709 13:11:28.442462 25174 raft_consensus.cc:2468] T 03bfae1924654fe38456ed1322baf805 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 0.
I20260709 13:11:28.443310 25315 raft_consensus.cc:359] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.443903 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bfae1924654fe38456ed1322baf805" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2" is_pre_election: true
I20260709 13:11:28.444183 25315 raft_consensus.cc:385] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.444195 25067 leader_election.cc:304] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:28.444552 25027 raft_consensus.cc:2468] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 0.
I20260709 13:11:28.444761 25315 raft_consensus.cc:740] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.445207 25228 raft_consensus.cc:2804] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:28.445631 25228 raft_consensus.cc:493] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.445979 25228 raft_consensus.cc:3060] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.445868 25315 consensus_queue.cc:260] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.448629 25315 ts_tablet_manager.cc:1434] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:11:28.449741 25315 tablet_bootstrap.cc:492] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0: Bootstrap starting.
I20260709 13:11:28.456176 25315 tablet_bootstrap.cc:654] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.455806 25228 raft_consensus.cc:515] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.458642 25314 tablet_bootstrap.cc:492] T ee8eea63cef84ee491051ae46df28a79 P 3f8a1edc55ec49da8d471f29f89febc2: No bootstrap required, opened a new log
I20260709 13:11:28.459211 25314 ts_tablet_manager.cc:1403] T ee8eea63cef84ee491051ae46df28a79 P 3f8a1edc55ec49da8d471f29f89febc2: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.020s
I20260709 13:11:28.460194 25313 raft_consensus.cc:493] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.460893 25313 raft_consensus.cc:515] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.463240 25314 raft_consensus.cc:359] T ee8eea63cef84ee491051ae46df28a79 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.464283 25314 raft_consensus.cc:385] T ee8eea63cef84ee491051ae46df28a79 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.464618 25314 raft_consensus.cc:740] T ee8eea63cef84ee491051ae46df28a79 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.467811 25315 tablet_bootstrap.cc:492] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0: No bootstrap required, opened a new log
I20260709 13:11:28.468354 25315 ts_tablet_manager.cc:1403] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:11:28.467010 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bfae1924654fe38456ed1322baf805" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
I20260709 13:11:28.469509 25027 raft_consensus.cc:3060] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.465152 25026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8eea63cef84ee491051ae46df28a79" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2" is_pre_election: true
I20260709 13:11:28.472007 25315 raft_consensus.cc:359] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.472391 25313 leader_election.cc:290] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:28.472697 25315 raft_consensus.cc:385] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.473034 25315 raft_consensus.cc:740] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.473685 25315 consensus_queue.cc:260] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.474610 25174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8eea63cef84ee491051ae46df28a79" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab" is_pre_election: true
I20260709 13:11:28.475529 25315 ts_tablet_manager.cc:1434] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:11:28.476562 25315 tablet_bootstrap.cc:492] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0: Bootstrap starting.
W20260709 13:11:28.476603 25067 leader_election.cc:343] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.468942 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bfae1924654fe38456ed1322baf805" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:28.477480 25176 raft_consensus.cc:3060] T 03bfae1924654fe38456ed1322baf805 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.483086 25315 tablet_bootstrap.cc:654] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.484754 25176 raft_consensus.cc:2468] T 03bfae1924654fe38456ed1322baf805 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 1.
I20260709 13:11:28.486033 25067 leader_election.cc:304] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:28.476859 25027 raft_consensus.cc:2468] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 1.
I20260709 13:11:28.487102 25313 raft_consensus.cc:2804] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:28.467168 25228 leader_election.cc:290] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:28.468070 25314 consensus_queue.cc:260] T ee8eea63cef84ee491051ae46df28a79 P 3f8a1edc55ec49da8d471f29f89febc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.487602 25313 raft_consensus.cc:697] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Becoming Leader. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Running, Role: LEADER
I20260709 13:11:28.489795 25313 consensus_queue.cc:237] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.490875 25314 ts_tablet_manager.cc:1434] T ee8eea63cef84ee491051ae46df28a79 P 3f8a1edc55ec49da8d471f29f89febc2: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:11:28.492350 25314 tablet_bootstrap.cc:492] T 18f98d4d56ae4f3498a731b57404b6c6 P 3f8a1edc55ec49da8d471f29f89febc2: Bootstrap starting.
I20260709 13:11:28.495927 25026 raft_consensus.cc:2468] T ee8eea63cef84ee491051ae46df28a79 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 0.
I20260709 13:11:28.506616 25314 tablet_bootstrap.cc:654] T 18f98d4d56ae4f3498a731b57404b6c6 P 3f8a1edc55ec49da8d471f29f89febc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.509186 25065 leader_election.cc:304] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 1b2fbb12f91f47f2b0abab045013abab
I20260709 13:11:28.510689 25315 tablet_bootstrap.cc:492] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0: No bootstrap required, opened a new log
I20260709 13:11:28.510959 25228 raft_consensus.cc:2804] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:28.511355 25315 ts_tablet_manager.cc:1403] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.003s
I20260709 13:11:28.511611 25228 raft_consensus.cc:493] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.512187 25228 raft_consensus.cc:3060] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.516248 25315 raft_consensus.cc:359] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.517061 25315 raft_consensus.cc:385] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.517401 25315 raft_consensus.cc:740] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.515569 24922 catalog_manager.cc:5697] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131). New cstate: current_term: 1 leader_uuid: "1b2fbb12f91f47f2b0abab045013abab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:28.519722 25315 consensus_queue.cc:260] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.522475 25315 ts_tablet_manager.cc:1434] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:11:28.525403 25261 raft_consensus.cc:493] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.526171 25261 raft_consensus.cc:515] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.530998 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e788e9b5124317a9a7e3317702542e" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab" is_pre_election: true
I20260709 13:11:28.533700 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e788e9b5124317a9a7e3317702542e" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0" is_pre_election: true
I20260709 13:11:28.534632 25102 raft_consensus.cc:2468] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 0.
W20260709 13:11:28.536615 24992 leader_election.cc:343] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.537606 24993 leader_election.cc:304] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 1b2fbb12f91f47f2b0abab045013abab
I20260709 13:11:28.538929 25330 raft_consensus.cc:2804] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:28.539397 25330 raft_consensus.cc:493] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.539845 25330 raft_consensus.cc:3060] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.551550 25261 leader_election.cc:290] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:28.550829 25330 raft_consensus.cc:515] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.554893 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e788e9b5124317a9a7e3317702542e" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
I20260709 13:11:28.555505 25102 raft_consensus.cc:3060] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.563246 25330 leader_election.cc:290] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 election: Requested vote from peers bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:28.564529 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e788e9b5124317a9a7e3317702542e" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:28.561640 25228 raft_consensus.cc:515] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
W20260709 13:11:28.566380 24992 leader_election.cc:343] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.569949 25026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8eea63cef84ee491051ae46df28a79" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
I20260709 13:11:28.570657 25026 raft_consensus.cc:3060] T ee8eea63cef84ee491051ae46df28a79 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.580438 25312 tablet_bootstrap.cc:492] T 02e788e9b5124317a9a7e3317702542e P 1b2fbb12f91f47f2b0abab045013abab: No bootstrap required, opened a new log
I20260709 13:11:28.581055 25312 ts_tablet_manager.cc:1403] T 02e788e9b5124317a9a7e3317702542e P 1b2fbb12f91f47f2b0abab045013abab: Time spent bootstrapping tablet: real 0.153s	user 0.052s	sys 0.056s
I20260709 13:11:28.582232 25228 leader_election.cc:290] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:28.583346 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8eea63cef84ee491051ae46df28a79" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:28.583884 25026 raft_consensus.cc:2468] T ee8eea63cef84ee491051ae46df28a79 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 1.
I20260709 13:11:28.585443 25314 tablet_bootstrap.cc:492] T 18f98d4d56ae4f3498a731b57404b6c6 P 3f8a1edc55ec49da8d471f29f89febc2: No bootstrap required, opened a new log
I20260709 13:11:28.585811 25065 leader_election.cc:304] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:28.586042 25314 ts_tablet_manager.cc:1403] T 18f98d4d56ae4f3498a731b57404b6c6 P 3f8a1edc55ec49da8d471f29f89febc2: Time spent bootstrapping tablet: real 0.094s	user 0.020s	sys 0.022s
I20260709 13:11:28.586593 25313 raft_consensus.cc:2804] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:11:28.587035 25067 leader_election.cc:343] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.587375 25313 raft_consensus.cc:697] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Becoming Leader. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Running, Role: LEADER
I20260709 13:11:28.588016 25312 raft_consensus.cc:359] T 02e788e9b5124317a9a7e3317702542e P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.588757 25312 raft_consensus.cc:385] T 02e788e9b5124317a9a7e3317702542e P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.588384 25313 consensus_queue.cc:237] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.589090 25312 raft_consensus.cc:740] T 02e788e9b5124317a9a7e3317702542e P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.588898 25314 raft_consensus.cc:359] T 18f98d4d56ae4f3498a731b57404b6c6 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.589592 25314 raft_consensus.cc:385] T 18f98d4d56ae4f3498a731b57404b6c6 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.589884 25314 raft_consensus.cc:740] T 18f98d4d56ae4f3498a731b57404b6c6 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.589946 25312 consensus_queue.cc:260] T 02e788e9b5124317a9a7e3317702542e P 1b2fbb12f91f47f2b0abab045013abab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.590585 25314 consensus_queue.cc:260] T 18f98d4d56ae4f3498a731b57404b6c6 P 3f8a1edc55ec49da8d471f29f89febc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.592648 25314 ts_tablet_manager.cc:1434] T 18f98d4d56ae4f3498a731b57404b6c6 P 3f8a1edc55ec49da8d471f29f89febc2: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:11:28.594424 25312 ts_tablet_manager.cc:1434] T 02e788e9b5124317a9a7e3317702542e P 1b2fbb12f91f47f2b0abab045013abab: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:11:28.595477 25312 tablet_bootstrap.cc:492] T aa9abe466aa24d50b4cb387a95142271 P 1b2fbb12f91f47f2b0abab045013abab: Bootstrap starting.
I20260709 13:11:28.601166 25335 raft_consensus.cc:493] T 02e788e9b5124317a9a7e3317702542e P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.601649 25335 raft_consensus.cc:515] T 02e788e9b5124317a9a7e3317702542e P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.603335 25314 tablet_bootstrap.cc:492] T 7d987c9c368c4d7cbf8a5c5091365b28 P 3f8a1edc55ec49da8d471f29f89febc2: Bootstrap starting.
I20260709 13:11:28.603391 25335 leader_election.cc:290] T 02e788e9b5124317a9a7e3317702542e P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971)
I20260709 13:11:28.605269 25026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e788e9b5124317a9a7e3317702542e" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2" is_pre_election: true
I20260709 13:11:28.606037 25101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e788e9b5124317a9a7e3317702542e" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0" is_pre_election: true
I20260709 13:11:28.606091 25026 raft_consensus.cc:2393] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1b2fbb12f91f47f2b0abab045013abab in current term 1: Already voted for candidate 3f8a1edc55ec49da8d471f29f89febc2 in this term.
I20260709 13:11:28.609305 25142 leader_election.cc:304] T 02e788e9b5124317a9a7e3317702542e P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab; no voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0
I20260709 13:11:28.609604 25314 tablet_bootstrap.cc:654] T 7d987c9c368c4d7cbf8a5c5091365b28 P 3f8a1edc55ec49da8d471f29f89febc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.610473 25335 raft_consensus.cc:3060] T 02e788e9b5124317a9a7e3317702542e P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.611156 25312 tablet_bootstrap.cc:654] T aa9abe466aa24d50b4cb387a95142271 P 1b2fbb12f91f47f2b0abab045013abab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.611764 25228 raft_consensus.cc:493] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.612253 25228 raft_consensus.cc:515] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.614590 25228 leader_election.cc:290] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:28.615993 25026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f98d4d56ae4f3498a731b57404b6c6" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2" is_pre_election: true
I20260709 13:11:28.616662 25026 raft_consensus.cc:2468] T 18f98d4d56ae4f3498a731b57404b6c6 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 0.
I20260709 13:11:28.617654 25065 leader_election.cc:304] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:28.618471 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f98d4d56ae4f3498a731b57404b6c6" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab" is_pre_election: true
I20260709 13:11:28.618723 25313 raft_consensus.cc:2804] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:28.619215 25313 raft_consensus.cc:493] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.619638 25313 raft_consensus.cc:3060] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:28.621409 25067 leader_election.cc:343] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.622212 25314 tablet_bootstrap.cc:492] T 7d987c9c368c4d7cbf8a5c5091365b28 P 3f8a1edc55ec49da8d471f29f89febc2: No bootstrap required, opened a new log
I20260709 13:11:28.622856 25314 ts_tablet_manager.cc:1403] T 7d987c9c368c4d7cbf8a5c5091365b28 P 3f8a1edc55ec49da8d471f29f89febc2: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 13:11:28.623383 25330 raft_consensus.cc:493] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.623911 25330 raft_consensus.cc:515] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.626385 25314 raft_consensus.cc:359] T 7d987c9c368c4d7cbf8a5c5091365b28 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.626637 25101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9abe466aa24d50b4cb387a95142271" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0" is_pre_election: true
I20260709 13:11:28.627341 25101 raft_consensus.cc:2468] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 0.
I20260709 13:11:28.627074 25314 raft_consensus.cc:385] T 7d987c9c368c4d7cbf8a5c5091365b28 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.628153 25314 raft_consensus.cc:740] T 7d987c9c368c4d7cbf8a5c5091365b28 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.628662 24993 leader_election.cc:304] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:28.629513 25261 raft_consensus.cc:2804] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:28.629206 25313 raft_consensus.cc:515] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.629914 25261 raft_consensus.cc:493] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.630307 25261 raft_consensus.cc:3060] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.630867 25312 tablet_bootstrap.cc:492] T aa9abe466aa24d50b4cb387a95142271 P 1b2fbb12f91f47f2b0abab045013abab: No bootstrap required, opened a new log
I20260709 13:11:28.631384 25312 ts_tablet_manager.cc:1403] T aa9abe466aa24d50b4cb387a95142271 P 1b2fbb12f91f47f2b0abab045013abab: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.014s
I20260709 13:11:28.632719 25313 leader_election.cc:290] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:28.633648 25026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f98d4d56ae4f3498a731b57404b6c6" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
I20260709 13:11:28.634290 25026 raft_consensus.cc:3060] T 18f98d4d56ae4f3498a731b57404b6c6 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.633879 25314 consensus_queue.cc:260] T 7d987c9c368c4d7cbf8a5c5091365b28 P 3f8a1edc55ec49da8d471f29f89febc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.635300 25102 raft_consensus.cc:2468] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 1.
I20260709 13:11:28.636260 25314 ts_tablet_manager.cc:1434] T 7d987c9c368c4d7cbf8a5c5091365b28 P 3f8a1edc55ec49da8d471f29f89febc2: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:11:28.638335 25312 raft_consensus.cc:359] T aa9abe466aa24d50b4cb387a95142271 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.639113 25312 raft_consensus.cc:385] T aa9abe466aa24d50b4cb387a95142271 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.639437 25312 raft_consensus.cc:740] T aa9abe466aa24d50b4cb387a95142271 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.640201 25312 consensus_queue.cc:260] T aa9abe466aa24d50b4cb387a95142271 P 1b2fbb12f91f47f2b0abab045013abab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.634632 25330 leader_election.cc:290] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:28.633818 25335 raft_consensus.cc:2749] T 02e788e9b5124317a9a7e3317702542e P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:28.642720 25312 ts_tablet_manager.cc:1434] T aa9abe466aa24d50b4cb387a95142271 P 1b2fbb12f91f47f2b0abab045013abab: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:11:28.642730 24924 catalog_manager.cc:5697] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "bf8661d86cd14b0caded7f5606eba9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:28.643944 25312 tablet_bootstrap.cc:492] T ee8eea63cef84ee491051ae46df28a79 P 1b2fbb12f91f47f2b0abab045013abab: Bootstrap starting.
I20260709 13:11:28.648327 25174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9abe466aa24d50b4cb387a95142271" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab" is_pre_election: true
I20260709 13:11:28.649008 25174 raft_consensus.cc:2468] T aa9abe466aa24d50b4cb387a95142271 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 0.
I20260709 13:11:28.650662 25174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f98d4d56ae4f3498a731b57404b6c6" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:28.642578 25261 raft_consensus.cc:515] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.651675 24993 leader_election.cc:304] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 1b2fbb12f91f47f2b0abab045013abab
I20260709 13:11:28.652072 25312 tablet_bootstrap.cc:654] T ee8eea63cef84ee491051ae46df28a79 P 1b2fbb12f91f47f2b0abab045013abab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.653064 25261 leader_election.cc:290] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 election: Requested vote from peers bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:28.653707 25261 raft_consensus.cc:2804] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:28.654407 25261 raft_consensus.cc:697] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 LEADER]: Becoming Leader. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Running, Role: LEADER
I20260709 13:11:28.655125 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9abe466aa24d50b4cb387a95142271" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
I20260709 13:11:28.655782 25102 raft_consensus.cc:3060] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.655367 25261 consensus_queue.cc:237] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
W20260709 13:11:28.664760 25067 leader_election.cc:343] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.665866 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9abe466aa24d50b4cb387a95142271" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:28.666456 25176 raft_consensus.cc:3060] T aa9abe466aa24d50b4cb387a95142271 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.671662 25313 consensus_queue.cc:1048] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:28.681672 24923 catalog_manager.cc:5697] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "bf8661d86cd14b0caded7f5606eba9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:28.679230 25026 raft_consensus.cc:2468] T 18f98d4d56ae4f3498a731b57404b6c6 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 1.
I20260709 13:11:28.663105 25102 raft_consensus.cc:2468] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 1.
I20260709 13:11:28.686928 24993 leader_election.cc:304] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:28.685272 25065 leader_election.cc:304] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 1b2fbb12f91f47f2b0abab045013abab
I20260709 13:11:28.691778 25330 raft_consensus.cc:2804] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:28.692286 25330 raft_consensus.cc:697] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 LEADER]: Becoming Leader. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Running, Role: LEADER
I20260709 13:11:28.693161 25330 consensus_queue.cc:237] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.695678 25313 raft_consensus.cc:2804] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:28.696235 25313 raft_consensus.cc:697] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Becoming Leader. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Running, Role: LEADER
I20260709 13:11:28.697155 25313 consensus_queue.cc:237] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.683375 25176 raft_consensus.cc:2468] T aa9abe466aa24d50b4cb387a95142271 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 1.
I20260709 13:11:28.712373 25312 tablet_bootstrap.cc:492] T ee8eea63cef84ee491051ae46df28a79 P 1b2fbb12f91f47f2b0abab045013abab: No bootstrap required, opened a new log
I20260709 13:11:28.713068 25312 ts_tablet_manager.cc:1403] T ee8eea63cef84ee491051ae46df28a79 P 1b2fbb12f91f47f2b0abab045013abab: Time spent bootstrapping tablet: real 0.069s	user 0.020s	sys 0.046s
I20260709 13:11:28.712896 24923 catalog_manager.cc:5697] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "bf8661d86cd14b0caded7f5606eba9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:28.718806 25312 raft_consensus.cc:359] T ee8eea63cef84ee491051ae46df28a79 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.719563 25312 raft_consensus.cc:385] T ee8eea63cef84ee491051ae46df28a79 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.719869 25312 raft_consensus.cc:740] T ee8eea63cef84ee491051ae46df28a79 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.720932 25312 consensus_queue.cc:260] T ee8eea63cef84ee491051ae46df28a79 P 1b2fbb12f91f47f2b0abab045013abab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.720640 24924 catalog_manager.cc:5697] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "3f8a1edc55ec49da8d471f29f89febc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:28.725688 25312 ts_tablet_manager.cc:1434] T ee8eea63cef84ee491051ae46df28a79 P 1b2fbb12f91f47f2b0abab045013abab: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.005s
I20260709 13:11:28.728103 25312 tablet_bootstrap.cc:492] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab: Bootstrap starting.
I20260709 13:11:28.740914 25312 tablet_bootstrap.cc:654] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.740821 25261 consensus_queue.cc:1048] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:28.751950 25313 consensus_queue.cc:1048] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:11:28.741182 24925 catalog_manager.cc:5697] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129). New cstate: current_term: 1 leader_uuid: "3f8a1edc55ec49da8d471f29f89febc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:28.754082 25312 tablet_bootstrap.cc:492] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab: No bootstrap required, opened a new log
I20260709 13:11:28.761219 25312 ts_tablet_manager.cc:1403] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.008s
I20260709 13:11:28.761725 25313 raft_consensus.cc:493] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.762229 25313 raft_consensus.cc:515] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.767284 25312 raft_consensus.cc:359] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.768077 25312 raft_consensus.cc:385] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.768334 25312 raft_consensus.cc:740] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.769032 25335 raft_consensus.cc:493] T ee8eea63cef84ee491051ae46df28a79 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.769243 25313 leader_election.cc:290] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:28.769615 25335 raft_consensus.cc:515] T ee8eea63cef84ee491051ae46df28a79 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.771745 25335 leader_election.cc:290] T ee8eea63cef84ee491051ae46df28a79 P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971)
I20260709 13:11:28.772588 25175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d987c9c368c4d7cbf8a5c5091365b28" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab" is_pre_election: true
I20260709 13:11:28.773101 25329 consensus_queue.cc:1048] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:28.769089 25312 consensus_queue.cc:260] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.774091 25101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8eea63cef84ee491051ae46df28a79" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0" is_pre_election: true
I20260709 13:11:28.775264 25175 raft_consensus.cc:2468] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 0.
I20260709 13:11:28.776841 25025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d987c9c368c4d7cbf8a5c5091365b28" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2" is_pre_election: true
I20260709 13:11:28.777189 25312 ts_tablet_manager.cc:1434] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:11:28.777699 25025 raft_consensus.cc:2468] T 7d987c9c368c4d7cbf8a5c5091365b28 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 0.
I20260709 13:11:28.777719 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8eea63cef84ee491051ae46df28a79" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2" is_pre_election: true
I20260709 13:11:28.778350 25312 tablet_bootstrap.cc:492] T 18f98d4d56ae4f3498a731b57404b6c6 P 1b2fbb12f91f47f2b0abab045013abab: Bootstrap starting.
I20260709 13:11:28.778625 25027 raft_consensus.cc:2393] T ee8eea63cef84ee491051ae46df28a79 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1b2fbb12f91f47f2b0abab045013abab in current term 1: Already voted for candidate bf8661d86cd14b0caded7f5606eba9c0 in this term.
I20260709 13:11:28.780608 25065 leader_election.cc:304] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:28.785662 25312 tablet_bootstrap.cc:654] T 18f98d4d56ae4f3498a731b57404b6c6 P 1b2fbb12f91f47f2b0abab045013abab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.786196 25323 raft_consensus.cc:2804] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:28.786696 25323 raft_consensus.cc:493] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.787051 25323 raft_consensus.cc:3060] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.788465 25139 leader_election.cc:304] T ee8eea63cef84ee491051ae46df28a79 P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab; no voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0
I20260709 13:11:28.789829 25335 raft_consensus.cc:3060] T ee8eea63cef84ee491051ae46df28a79 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.809141 25312 tablet_bootstrap.cc:492] T 18f98d4d56ae4f3498a731b57404b6c6 P 1b2fbb12f91f47f2b0abab045013abab: No bootstrap required, opened a new log
I20260709 13:11:28.809715 25312 ts_tablet_manager.cc:1403] T 18f98d4d56ae4f3498a731b57404b6c6 P 1b2fbb12f91f47f2b0abab045013abab: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.007s
I20260709 13:11:28.812698 25312 raft_consensus.cc:359] T 18f98d4d56ae4f3498a731b57404b6c6 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.813460 25312 raft_consensus.cc:385] T 18f98d4d56ae4f3498a731b57404b6c6 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.814067 25312 raft_consensus.cc:740] T 18f98d4d56ae4f3498a731b57404b6c6 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.814985 25312 consensus_queue.cc:260] T 18f98d4d56ae4f3498a731b57404b6c6 P 1b2fbb12f91f47f2b0abab045013abab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.815404 25335 raft_consensus.cc:2749] T ee8eea63cef84ee491051ae46df28a79 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:28.817113 25312 ts_tablet_manager.cc:1434] T 18f98d4d56ae4f3498a731b57404b6c6 P 1b2fbb12f91f47f2b0abab045013abab: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:28.818216 25323 raft_consensus.cc:515] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.822232 25026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d987c9c368c4d7cbf8a5c5091365b28" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
I20260709 13:11:28.822408 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d987c9c368c4d7cbf8a5c5091365b28" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:28.823127 25176 raft_consensus.cc:3060] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.823185 25026 raft_consensus.cc:3060] T 7d987c9c368c4d7cbf8a5c5091365b28 P 3f8a1edc55ec49da8d471f29f89febc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.833230 25026 raft_consensus.cc:2468] T 7d987c9c368c4d7cbf8a5c5091365b28 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 1.
I20260709 13:11:28.834625 25065 leader_election.cc:304] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:28.836369 25228 raft_consensus.cc:2804] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:28.837039 25228 raft_consensus.cc:697] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Becoming Leader. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Running, Role: LEADER
I20260709 13:11:28.838156 25228 consensus_queue.cc:237] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:28.839910 25176 raft_consensus.cc:2468] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 1.
I20260709 13:11:28.841185 25323 leader_election.cc:290] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:28.847924 24923 catalog_manager.cc:5697] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130). New cstate: current_term: 1 leader_uuid: "bf8661d86cd14b0caded7f5606eba9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:28.943336 25228 consensus_queue.cc:1048] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:28.947003 25335 consensus_queue.cc:1048] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:28.954249 25102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e4591d1871f4a83b553f0e85a5e8f2e"
dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
mode: GRACEFUL
new_leader_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
 from {username='slave'} at 127.0.0.1:60938
I20260709 13:11:28.954978 25102 raft_consensus.cc:606] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Received request to transfer leadership to TS 3f8a1edc55ec49da8d471f29f89febc2
I20260709 13:11:28.959280 25323 consensus_queue.cc:1048] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:28.971185 25176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e26bbe99a450447cb4fc0012e1ba76bc"
dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
mode: GRACEFUL
new_leader_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
 from {username='slave'} at 127.0.0.1:37948
I20260709 13:11:28.972817 25368 consensus_queue.cc:1048] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:28.978753 25176 raft_consensus.cc:606] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [term 1 LEADER]: Received request to transfer leadership to TS 3f8a1edc55ec49da8d471f29f89febc2
I20260709 13:11:28.985535 25368 raft_consensus.cc:993] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab: : Instructing follower 3f8a1edc55ec49da8d471f29f89febc2 to start an election
I20260709 13:11:28.985986 25368 raft_consensus.cc:1081] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [term 1 LEADER]: Signalling peer 3f8a1edc55ec49da8d471f29f89febc2 to start an election
I20260709 13:11:28.990737 25101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03bfae1924654fe38456ed1322baf805"
dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
mode: GRACEFUL
new_leader_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
 from {username='slave'} at 127.0.0.1:60938
I20260709 13:11:28.991328 25101 raft_consensus.cc:606] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Received request to transfer leadership to TS 3f8a1edc55ec49da8d471f29f89febc2
I20260709 13:11:28.994783 25027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e26bbe99a450447cb4fc0012e1ba76bc"
dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
 from {username='slave'} at 127.0.0.1:55714
I20260709 13:11:28.995596 25027 raft_consensus.cc:493] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:28.996006 25027 raft_consensus.cc:3060] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:29.001379 25026 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa9abe466aa24d50b4cb387a95142271"
dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
mode: GRACEFUL
new_leader_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
 from {username='slave'} at 127.0.0.1:55728
I20260709 13:11:29.001957 25026 raft_consensus.cc:606] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 LEADER]: Received request to transfer leadership to TS bf8661d86cd14b0caded7f5606eba9c0
I20260709 13:11:29.002434 25027 raft_consensus.cc:515] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:29.004585 25027 leader_election.cc:290] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 2 election: Requested vote from peers bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:29.005016 25101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e26bbe99a450447cb4fc0012e1ba76bc" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
I20260709 13:11:29.005486 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e26bbe99a450447cb4fc0012e1ba76bc" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:29.005641 25101 raft_consensus.cc:3060] T e26bbe99a450447cb4fc0012e1ba76bc P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:29.005954 25176 raft_consensus.cc:3055] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:29.006330 25176 raft_consensus.cc:740] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Running, Role: LEADER
I20260709 13:11:29.006480 25367 raft_consensus.cc:493] T 18f98d4d56ae4f3498a731b57404b6c6 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.006987 25367 raft_consensus.cc:515] T 18f98d4d56ae4f3498a731b57404b6c6 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:29.007085 25176 consensus_queue.cc:260] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:29.008369 25176 raft_consensus.cc:3060] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:29.010265 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f98d4d56ae4f3498a731b57404b6c6" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2" is_pre_election: true
I20260709 13:11:29.010784 25367 leader_election.cc:290] T 18f98d4d56ae4f3498a731b57404b6c6 P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971)
I20260709 13:11:29.011039 25027 raft_consensus.cc:2393] T 18f98d4d56ae4f3498a731b57404b6c6 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1b2fbb12f91f47f2b0abab045013abab in current term 1: Already voted for candidate bf8661d86cd14b0caded7f5606eba9c0 in this term.
I20260709 13:11:29.012676 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f98d4d56ae4f3498a731b57404b6c6" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0" is_pre_election: true
I20260709 13:11:29.014133 25142 leader_election.cc:304] T 18f98d4d56ae4f3498a731b57404b6c6 P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab; no voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0
I20260709 13:11:29.014240 25027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02e788e9b5124317a9a7e3317702542e"
dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
mode: GRACEFUL
new_leader_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
 from {username='slave'} at 127.0.0.1:55728
I20260709 13:11:29.015102 25027 raft_consensus.cc:606] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 LEADER]: Received request to transfer leadership to TS bf8661d86cd14b0caded7f5606eba9c0
I20260709 13:11:29.015551 25367 raft_consensus.cc:3060] T 18f98d4d56ae4f3498a731b57404b6c6 P 1b2fbb12f91f47f2b0abab045013abab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:29.015102 25101 raft_consensus.cc:2468] T e26bbe99a450447cb4fc0012e1ba76bc P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 2.
I20260709 13:11:29.017812 24993 leader_election.cc:304] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:29.018157 25176 raft_consensus.cc:2468] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 2.
I20260709 13:11:29.018697 25329 raft_consensus.cc:2804] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:29.019178 25329 raft_consensus.cc:697] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 LEADER]: Becoming Leader. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Running, Role: LEADER
I20260709 13:11:29.020066 25329 consensus_queue.cc:237] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:29.023501 25367 raft_consensus.cc:2749] T 18f98d4d56ae4f3498a731b57404b6c6 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:29.025003 25101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d987c9c368c4d7cbf8a5c5091365b28"
dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
mode: GRACEFUL
new_leader_uuid: "1b2fbb12f91f47f2b0abab045013abab"
 from {username='slave'} at 127.0.0.1:60938
I20260709 13:11:29.025640 25101 raft_consensus.cc:606] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Received request to transfer leadership to TS 1b2fbb12f91f47f2b0abab045013abab
I20260709 13:11:29.029088 24922 catalog_manager.cc:5697] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2 reported cstate change: term changed from 1 to 2, leader changed from 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131) to 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "3f8a1edc55ec49da8d471f29f89febc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:29.049785 25323 consensus_queue.cc:1048] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:29.060844 25313 consensus_queue.cc:1048] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:29.111464 25329 consensus_queue.cc:1048] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:29.123672 25329 consensus_queue.cc:1048] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:29.133942 25330 raft_consensus.cc:993] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2: : Instructing follower bf8661d86cd14b0caded7f5606eba9c0 to start an election
I20260709 13:11:29.134471 25329 raft_consensus.cc:1081] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 LEADER]: Signalling peer bf8661d86cd14b0caded7f5606eba9c0 to start an election
I20260709 13:11:29.135982 25102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa9abe466aa24d50b4cb387a95142271"
dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
 from {username='slave'} at 127.0.0.1:60932
I20260709 13:11:29.136366 25102 raft_consensus.cc:493] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:29.136615 25102 raft_consensus.cc:3060] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:29.143404 25102 raft_consensus.cc:515] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:29.145259 25102 leader_election.cc:290] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 2 election: Requested vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:29.146005 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9abe466aa24d50b4cb387a95142271" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
I20260709 13:11:29.146237 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9abe466aa24d50b4cb387a95142271" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:29.146658 25027 raft_consensus.cc:3055] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:29.146725 25176 raft_consensus.cc:3060] T aa9abe466aa24d50b4cb387a95142271 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:29.147068 25027 raft_consensus.cc:740] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Running, Role: LEADER
I20260709 13:11:29.147828 25027 consensus_queue.cc:260] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:29.148983 25027 raft_consensus.cc:3060] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:29.153373 25176 raft_consensus.cc:2468] T aa9abe466aa24d50b4cb387a95142271 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 2.
I20260709 13:11:29.154587 25067 leader_election.cc:304] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:29.155144 25027 raft_consensus.cc:2468] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 2.
I20260709 13:11:29.155284 25313 raft_consensus.cc:2804] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:29.155859 25313 raft_consensus.cc:697] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 LEADER]: Becoming Leader. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Running, Role: LEADER
I20260709 13:11:29.156590 25313 consensus_queue.cc:237] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:29.164341 24922 catalog_manager.cc:5697] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0 reported cstate change: term changed from 1 to 2, leader changed from 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129) to bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130). New cstate: current_term: 2 leader_uuid: "bf8661d86cd14b0caded7f5606eba9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:29.200567 25329 consensus_queue.cc:1048] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:29.217134 25313 consensus_queue.cc:1048] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:29.217370 25329 consensus_queue.cc:1048] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:29.229607 25323 consensus_queue.cc:1048] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:29.229910 25329 raft_consensus.cc:993] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2: : Instructing follower bf8661d86cd14b0caded7f5606eba9c0 to start an election
I20260709 13:11:29.230475 25329 raft_consensus.cc:1081] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 LEADER]: Signalling peer bf8661d86cd14b0caded7f5606eba9c0 to start an election
I20260709 13:11:29.232203 25102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02e788e9b5124317a9a7e3317702542e"
dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
 from {username='slave'} at 127.0.0.1:60932
I20260709 13:11:29.232759 25102 raft_consensus.cc:493] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:29.233155 25102 raft_consensus.cc:3060] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:29.240875 25102 raft_consensus.cc:515] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:29.241202 25323 consensus_queue.cc:1048] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:29.242856 25102 leader_election.cc:290] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 2 election: Requested vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:29.243597 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e788e9b5124317a9a7e3317702542e" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
I20260709 13:11:29.244199 25027 raft_consensus.cc:3055] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:29.244483 25027 raft_consensus.cc:740] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Running, Role: LEADER
I20260709 13:11:29.245061 25027 consensus_queue.cc:260] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:29.245563 25174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e788e9b5124317a9a7e3317702542e" candidate_uuid: "bf8661d86cd14b0caded7f5606eba9c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:29.246158 25174 raft_consensus.cc:3060] T 02e788e9b5124317a9a7e3317702542e P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:29.246292 25027 raft_consensus.cc:3060] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:29.253078 25027 raft_consensus.cc:2468] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 2.
I20260709 13:11:29.253573 25174 raft_consensus.cc:2468] T 02e788e9b5124317a9a7e3317702542e P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf8661d86cd14b0caded7f5606eba9c0 in term 2.
I20260709 13:11:29.254499 25065 leader_election.cc:304] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:29.255987 25323 raft_consensus.cc:2804] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:29.256471 25323 raft_consensus.cc:697] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0 [term 2 LEADER]: Becoming Leader. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Running, Role: LEADER
I20260709 13:11:29.257248 25323 consensus_queue.cc:237] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:29.262259 25313 raft_consensus.cc:993] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0: : Instructing follower 1b2fbb12f91f47f2b0abab045013abab to start an election
I20260709 13:11:29.262683 25313 raft_consensus.cc:1081] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Signalling peer 1b2fbb12f91f47f2b0abab045013abab to start an election
I20260709 13:11:29.264771 25174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d987c9c368c4d7cbf8a5c5091365b28"
dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
 from {username='slave'} at 127.0.0.1:37942
I20260709 13:11:29.265338 25174 raft_consensus.cc:493] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:29.266180 25174 raft_consensus.cc:3060] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:29.266788 25323 consensus_queue.cc:1048] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:29.267831 24922 catalog_manager.cc:5697] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0 reported cstate change: term changed from 1 to 2, leader changed from 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129) to bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130). New cstate: current_term: 2 leader_uuid: "bf8661d86cd14b0caded7f5606eba9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:29.274197 25174 raft_consensus.cc:515] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:29.275303 25176 raft_consensus.cc:1240] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Rejecting Update request from peer bf8661d86cd14b0caded7f5606eba9c0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:29.277328 25323 consensus_queue.cc:1059] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:29.278602 25228 raft_consensus.cc:3055] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:29.279104 25228 raft_consensus.cc:740] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Running, Role: LEADER
I20260709 13:11:29.279747 25026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d987c9c368c4d7cbf8a5c5091365b28" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
I20260709 13:11:29.280161 25228 consensus_queue.cc:260] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:29.281080 25228 raft_consensus.cc:3060] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:29.282223 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d987c9c368c4d7cbf8a5c5091365b28" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
I20260709 13:11:29.282840 25174 leader_election.cc:290] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 2 election: Requested vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971)
I20260709 13:11:29.291514 25102 raft_consensus.cc:2468] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b2fbb12f91f47f2b0abab045013abab in term 2.
I20260709 13:11:29.293253 25142 leader_election.cc:304] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab, bf8661d86cd14b0caded7f5606eba9c0; no voters: 3f8a1edc55ec49da8d471f29f89febc2
I20260709 13:11:29.294104 25367 raft_consensus.cc:2804] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:29.294552 25367 raft_consensus.cc:697] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab [term 2 LEADER]: Becoming Leader. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Running, Role: LEADER
I20260709 13:11:29.295265 25367 consensus_queue.cc:237] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:29.301131 24924 catalog_manager.cc:5697] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab reported cstate change: term changed from 1 to 2, leader changed from bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130) to 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131). New cstate: current_term: 2 leader_uuid: "1b2fbb12f91f47f2b0abab045013abab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.329193 25323 raft_consensus.cc:993] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0: : Instructing follower 3f8a1edc55ec49da8d471f29f89febc2 to start an election
I20260709 13:11:29.329748 25228 raft_consensus.cc:1081] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Signalling peer 3f8a1edc55ec49da8d471f29f89febc2 to start an election
I20260709 13:11:29.331121 25027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e4591d1871f4a83b553f0e85a5e8f2e"
dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
 from {username='slave'} at 127.0.0.1:55698
I20260709 13:11:29.331655 25027 raft_consensus.cc:493] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:29.331921 25027 raft_consensus.cc:3060] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:29.336445 25027 raft_consensus.cc:515] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:29.337947 25027 leader_election.cc:290] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 2 election: Requested vote from peers bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:29.338665 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4591d1871f4a83b553f0e85a5e8f2e" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
I20260709 13:11:29.338977 25174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4591d1871f4a83b553f0e85a5e8f2e" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:29.339223 25102 raft_consensus.cc:3055] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:29.339668 25102 raft_consensus.cc:740] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Running, Role: LEADER
I20260709 13:11:29.339726 25174 raft_consensus.cc:3060] T 1e4591d1871f4a83b553f0e85a5e8f2e P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:29.340389 25102 consensus_queue.cc:260] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:29.341252 25102 raft_consensus.cc:3060] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:29.345628 25102 raft_consensus.cc:2468] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 2.
I20260709 13:11:29.346412 25174 raft_consensus.cc:2468] T 1e4591d1871f4a83b553f0e85a5e8f2e P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 2.
I20260709 13:11:29.346622 24993 leader_election.cc:304] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f8a1edc55ec49da8d471f29f89febc2, bf8661d86cd14b0caded7f5606eba9c0; no voters: 
I20260709 13:11:29.347532 25261 raft_consensus.cc:2804] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:29.348024 25261 raft_consensus.cc:697] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 LEADER]: Becoming Leader. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Running, Role: LEADER
I20260709 13:11:29.348809 25261 consensus_queue.cc:237] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:29.354984 24924 catalog_manager.cc:5697] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2 reported cstate change: term changed from 1 to 2, leader changed from bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130) to 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "3f8a1edc55ec49da8d471f29f89febc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:29.469604 25323 raft_consensus.cc:993] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0: : Instructing follower 3f8a1edc55ec49da8d471f29f89febc2 to start an election
I20260709 13:11:29.470115 25323 raft_consensus.cc:1081] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Signalling peer 3f8a1edc55ec49da8d471f29f89febc2 to start an election
I20260709 13:11:29.471692 25027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03bfae1924654fe38456ed1322baf805"
dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
 from {username='slave'} at 127.0.0.1:55698
I20260709 13:11:29.472164 25027 raft_consensus.cc:493] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:29.472448 25027 raft_consensus.cc:3060] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:29.477412 25027 raft_consensus.cc:515] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:29.479095 25027 leader_election.cc:290] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 2 election: Requested vote from peers bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971), 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131:43479)
I20260709 13:11:29.479763 25102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bfae1924654fe38456ed1322baf805" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
I20260709 13:11:29.480240 25174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bfae1924654fe38456ed1322baf805" candidate_uuid: "3f8a1edc55ec49da8d471f29f89febc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
I20260709 13:11:29.480486 25102 raft_consensus.cc:3055] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:29.480886 25174 raft_consensus.cc:3060] T 03bfae1924654fe38456ed1322baf805 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:29.480926 25102 raft_consensus.cc:740] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Running, Role: LEADER
I20260709 13:11:29.482365 25102 consensus_queue.cc:260] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:29.483562 25102 raft_consensus.cc:3060] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:29.486985 25174 raft_consensus.cc:2468] T 03bfae1924654fe38456ed1322baf805 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 2.
I20260709 13:11:29.488070 24992 leader_election.cc:304] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab, 3f8a1edc55ec49da8d471f29f89febc2; no voters: 
I20260709 13:11:29.488447 25102 raft_consensus.cc:2468] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f8a1edc55ec49da8d471f29f89febc2 in term 2.
I20260709 13:11:29.488940 25261 raft_consensus.cc:2804] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:29.489444 25261 raft_consensus.cc:697] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 LEADER]: Becoming Leader. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Running, Role: LEADER
I20260709 13:11:29.490149 25261 consensus_queue.cc:237] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:29.496301 24924 catalog_manager.cc:5697] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2 reported cstate change: term changed from 1 to 2, leader changed from bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130) to 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129). New cstate: current_term: 2 leader_uuid: "3f8a1edc55ec49da8d471f29f89febc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:29.535490 25102 raft_consensus.cc:1275] T e26bbe99a450447cb4fc0012e1ba76bc P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Refusing update from remote peer 3f8a1edc55ec49da8d471f29f89febc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:29.536857 25261 consensus_queue.cc:1048] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:29.544538 25174 raft_consensus.cc:1275] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Refusing update from remote peer 3f8a1edc55ec49da8d471f29f89febc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:29.545967 25330 consensus_queue.cc:1048] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:29.581872 25174 raft_consensus.cc:1275] T aa9abe466aa24d50b4cb387a95142271 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Refusing update from remote peer bf8661d86cd14b0caded7f5606eba9c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:29.583303 25228 consensus_queue.cc:1048] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:29.593855 25027 raft_consensus.cc:1275] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Refusing update from remote peer bf8661d86cd14b0caded7f5606eba9c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:29.596236 25313 consensus_queue.cc:1048] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:29.658659 25175 raft_consensus.cc:1275] T 02e788e9b5124317a9a7e3317702542e P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Refusing update from remote peer bf8661d86cd14b0caded7f5606eba9c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:29.659926 25313 consensus_queue.cc:1048] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:29.670082 25027 raft_consensus.cc:1275] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Refusing update from remote peer bf8661d86cd14b0caded7f5606eba9c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:29.671401 25372 consensus_queue.cc:1048] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:29.705228 25027 raft_consensus.cc:3060] T 7d987c9c368c4d7cbf8a5c5091365b28 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:29.710254 25027 raft_consensus.cc:1275] T 7d987c9c368c4d7cbf8a5c5091365b28 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Refusing update from remote peer 1b2fbb12f91f47f2b0abab045013abab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:29.711814 25367 consensus_queue.cc:1048] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:29.729075 25102 raft_consensus.cc:1275] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Refusing update from remote peer 1b2fbb12f91f47f2b0abab045013abab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:29.730460 25367 consensus_queue.cc:1048] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:29.775465 25175 raft_consensus.cc:1275] T 1e4591d1871f4a83b553f0e85a5e8f2e P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Refusing update from remote peer 3f8a1edc55ec49da8d471f29f89febc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:29.776648 25330 consensus_queue.cc:1048] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:29.784010 25102 raft_consensus.cc:1275] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Refusing update from remote peer 3f8a1edc55ec49da8d471f29f89febc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:29.786088 25382 consensus_queue.cc:1048] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:29.974238 25102 raft_consensus.cc:1275] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Refusing update from remote peer 3f8a1edc55ec49da8d471f29f89febc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:29.975349 25382 consensus_queue.cc:1048] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:29.983335 25175 raft_consensus.cc:1275] T 03bfae1924654fe38456ed1322baf805 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Refusing update from remote peer 3f8a1edc55ec49da8d471f29f89febc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:29.985466 25261 consensus_queue.cc:1048] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:32.028977 24924 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46374:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:11:32.049567 24924 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46374:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:11:32.117295 12594 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:32.214322 25422 tablet.cc:1724] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:32.232378 25067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:43479, user_credentials={real_user=slave}} blocked reactor thread for 65725.6us
I20260709 13:11:32.267150 25432 tablet.cc:1724] T 1e4591d1871f4a83b553f0e85a5e8f2e P 1b2fbb12f91f47f2b0abab045013abab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:32.308635 25443 tablet.cc:1724] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:32.319705 25431 log.cc:927] Time spent T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:11:32.353549 25442 tablet.cc:1724] T aa9abe466aa24d50b4cb387a95142271 P 1b2fbb12f91f47f2b0abab045013abab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:32.363065 25425 log.cc:927] Time spent T 02e788e9b5124317a9a7e3317702542e P 1b2fbb12f91f47f2b0abab045013abab: Append to log took a long time: real 0.060s	user 0.000s	sys 0.003s
I20260709 13:11:32.410444 25452 tablet.cc:1724] T c2e555a672e249fb858b43e84a8e173d P 1b2fbb12f91f47f2b0abab045013abab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:32.460053 25457 tablet.cc:1724] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:11:32.489195 24992 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.76.131:43479, user_credentials={real_user=slave}} blocked reactor thread for 68874.4us
I20260709 13:11:32.450052 25456 tablet.cc:1724] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:32.494457 25422 tablet.cc:1724] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:32.499795 25024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "678ed24005be40eeb9bc4041fce6ee35"
dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
mode: GRACEFUL
new_leader_uuid: "1b2fbb12f91f47f2b0abab045013abab"
 from {username='slave'} at 127.0.0.1:56348
I20260709 13:11:32.500559 25024 raft_consensus.cc:606] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 LEADER]: Received request to transfer leadership to TS 1b2fbb12f91f47f2b0abab045013abab
I20260709 13:11:32.494481 25454 tablet.cc:1724] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:32.509653 25457 tablet.cc:1724] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:32.520735 25443 tablet.cc:1724] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:32.498518 25432 tablet.cc:1724] T 02e788e9b5124317a9a7e3317702542e P 1b2fbb12f91f47f2b0abab045013abab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:32.556133 25422 tablet.cc:1724] T 7d987c9c368c4d7cbf8a5c5091365b28 P 3f8a1edc55ec49da8d471f29f89febc2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:32.530647 25442 tablet.cc:1724] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:32.580780 25422 tablet.cc:1724] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:32.600618 25464 tablet.cc:1724] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:32.585593 25432 tablet.cc:1724] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:32.648200 25454 tablet.cc:1724] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:32.666865 25456 tablet.cc:1724] T c2e555a672e249fb858b43e84a8e173d P bf8661d86cd14b0caded7f5606eba9c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:32.667843 25454 tablet.cc:1724] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:32.668865 25432 tablet.cc:1724] T ee8eea63cef84ee491051ae46df28a79 P 1b2fbb12f91f47f2b0abab045013abab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:32.678201 25452 tablet.cc:1724] T 03bfae1924654fe38456ed1322baf805 P 1b2fbb12f91f47f2b0abab045013abab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:32.681478 25443 tablet.cc:1724] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:32.682512 25457 tablet.cc:1724] T e26bbe99a450447cb4fc0012e1ba76bc P bf8661d86cd14b0caded7f5606eba9c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:32.686131 25465 tablet.cc:1724] T 18f98d4d56ae4f3498a731b57404b6c6 P 1b2fbb12f91f47f2b0abab045013abab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:32.699131 25463 raft_consensus.cc:993] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2: : Instructing follower 1b2fbb12f91f47f2b0abab045013abab to start an election
I20260709 13:11:32.700525 25466 tablet.cc:1724] T 18f98d4d56ae4f3498a731b57404b6c6 P 3f8a1edc55ec49da8d471f29f89febc2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:32.705088 25455 raft_consensus.cc:1081] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 LEADER]: Signalling peer 1b2fbb12f91f47f2b0abab045013abab to start an election
I20260709 13:11:32.707571 25173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "678ed24005be40eeb9bc4041fce6ee35"
dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
 from {username='slave'} at 127.0.0.1:37946
I20260709 13:11:32.708112 25173 raft_consensus.cc:493] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:32.708477 25173 raft_consensus.cc:3060] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:32.708910 25422 tablet.cc:1724] T ee8eea63cef84ee491051ae46df28a79 P 3f8a1edc55ec49da8d471f29f89febc2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:11:32.765340 25173 raft_consensus.cc:515] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } }
I20260709 13:11:32.773342 25024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678ed24005be40eeb9bc4041fce6ee35" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
I20260709 13:11:32.773695 25173 leader_election.cc:290] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 3 election: Requested vote from peers bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971), 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639)
I20260709 13:11:32.774147 25024 raft_consensus.cc:3055] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:32.774605 25024 raft_consensus.cc:740] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f8a1edc55ec49da8d471f29f89febc2, State: Running, Role: LEADER
I20260709 13:11:32.779589 25101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678ed24005be40eeb9bc4041fce6ee35" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
I20260709 13:11:32.780371 25101 raft_consensus.cc:3060] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:32.775543 25024 consensus_queue.cc:260] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } }
I20260709 13:11:32.781962 25024 raft_consensus.cc:3060] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:32.794019 25101 raft_consensus.cc:2468] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b2fbb12f91f47f2b0abab045013abab in term 3.
I20260709 13:11:32.798545 25098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed3a721a22bf4cfa80f834d4e284b209"
dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
mode: GRACEFUL
new_leader_uuid: "1b2fbb12f91f47f2b0abab045013abab"
 from {username='slave'} at 127.0.0.1:42670
I20260709 13:11:32.799008 25024 raft_consensus.cc:2468] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b2fbb12f91f47f2b0abab045013abab in term 3.
I20260709 13:11:32.799186 25098 raft_consensus.cc:606] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Received request to transfer leadership to TS 1b2fbb12f91f47f2b0abab045013abab
I20260709 13:11:32.800184 25139 leader_election.cc:304] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab, 3f8a1edc55ec49da8d471f29f89febc2; no voters: 
I20260709 13:11:32.800665 12594 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:32.801173 25450 raft_consensus.cc:2804] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:32.801358 12594 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:32.801595 25450 raft_consensus.cc:697] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [term 3 LEADER]: Becoming Leader. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Running, Role: LEADER
I20260709 13:11:32.802338 25450 consensus_queue.cc:237] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } }
I20260709 13:11:32.807485 24922 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f: soft_deleted_table [id=7c1cb8b0a00140218837dff831f433f3] alter complete (version 1)
I20260709 13:11:32.817902 24923 catalog_manager.cc:5697] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab reported cstate change: term changed from 2 to 3, leader changed from 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129) to 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131). New cstate: current_term: 3 leader_uuid: "1b2fbb12f91f47f2b0abab045013abab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:33.010561 25444 raft_consensus.cc:993] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0: : Instructing follower 1b2fbb12f91f47f2b0abab045013abab to start an election
I20260709 13:11:33.011104 25389 raft_consensus.cc:1081] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Signalling peer 1b2fbb12f91f47f2b0abab045013abab to start an election
I20260709 13:11:33.012518 25173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed3a721a22bf4cfa80f834d4e284b209"
dest_uuid: "1b2fbb12f91f47f2b0abab045013abab"
 from {username='slave'} at 127.0.0.1:37942
I20260709 13:11:33.013021 25173 raft_consensus.cc:493] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:33.013367 25173 raft_consensus.cc:3060] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.018606 25173 raft_consensus.cc:515] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:33.020423 25173 leader_election.cc:290] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 2 election: Requested vote from peers 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639), bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971)
I20260709 13:11:33.021260 25024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed3a721a22bf4cfa80f834d4e284b209" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f8a1edc55ec49da8d471f29f89febc2"
I20260709 13:11:33.021916 25098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed3a721a22bf4cfa80f834d4e284b209" candidate_uuid: "1b2fbb12f91f47f2b0abab045013abab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf8661d86cd14b0caded7f5606eba9c0"
I20260709 13:11:33.022099 25024 raft_consensus.cc:3060] T ed3a721a22bf4cfa80f834d4e284b209 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.022650 25098 raft_consensus.cc:3055] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:33.023008 25098 raft_consensus.cc:740] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf8661d86cd14b0caded7f5606eba9c0, State: Running, Role: LEADER
I20260709 13:11:33.023936 25098 consensus_queue.cc:260] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:33.025383 25098 raft_consensus.cc:3060] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.030311 25024 raft_consensus.cc:2468] T ed3a721a22bf4cfa80f834d4e284b209 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b2fbb12f91f47f2b0abab045013abab in term 2.
I20260709 13:11:33.031618 25139 leader_election.cc:304] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b2fbb12f91f47f2b0abab045013abab, 3f8a1edc55ec49da8d471f29f89febc2; no voters: 
I20260709 13:11:33.033561 25098 raft_consensus.cc:2468] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b2fbb12f91f47f2b0abab045013abab in term 2.
I20260709 13:11:33.033757 25450 raft_consensus.cc:2804] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:33.034899 25450 raft_consensus.cc:697] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab [term 2 LEADER]: Becoming Leader. State: Replica: 1b2fbb12f91f47f2b0abab045013abab, State: Running, Role: LEADER
I20260709 13:11:33.035871 25450 consensus_queue.cc:237] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } }
I20260709 13:11:33.043289 24923 catalog_manager.cc:5697] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab reported cstate change: term changed from 1 to 2, leader changed from bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130) to 1b2fbb12f91f47f2b0abab045013abab (127.12.76.131). New cstate: current_term: 2 leader_uuid: "1b2fbb12f91f47f2b0abab045013abab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b2fbb12f91f47f2b0abab045013abab" member_type: VOTER last_known_addr { host: "127.12.76.131" port: 43479 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.191150 25024 raft_consensus.cc:1275] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [term 3 FOLLOWER]: Refusing update from remote peer 1b2fbb12f91f47f2b0abab045013abab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:33.192510 25450 consensus_queue.cc:1048] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:33.204372 25098 raft_consensus.cc:1275] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [term 3 FOLLOWER]: Refusing update from remote peer 1b2fbb12f91f47f2b0abab045013abab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:33.205994 25450 consensus_queue.cc:1048] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:33.606559 25027 raft_consensus.cc:1275] T ed3a721a22bf4cfa80f834d4e284b209 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Refusing update from remote peer 1b2fbb12f91f47f2b0abab045013abab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.607887 25450 consensus_queue.cc:1048] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f8a1edc55ec49da8d471f29f89febc2" member_type: VOTER last_known_addr { host: "127.12.76.129" port: 37639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:33.617825 25098 raft_consensus.cc:1275] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Refusing update from remote peer 1b2fbb12f91f47f2b0abab045013abab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.619306 25475 consensus_queue.cc:1048] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf8661d86cd14b0caded7f5606eba9c0" member_type: VOTER last_known_addr { host: "127.12.76.130" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:33.856406 12594 tablet_server.cc:179] TabletServer@127.12.76.129:0 shutting down...
I20260709 13:11:33.882304 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:33.883196 12594 tablet_replica.cc:333] T ee8eea63cef84ee491051ae46df28a79 P 3f8a1edc55ec49da8d471f29f89febc2: stopping tablet replica
I20260709 13:11:33.883860 12594 raft_consensus.cc:2243] T ee8eea63cef84ee491051ae46df28a79 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.884295 12594 raft_consensus.cc:2272] T ee8eea63cef84ee491051ae46df28a79 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.886103 12594 tablet_replica.cc:333] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2: stopping tablet replica
I20260709 13:11:33.886641 12594 raft_consensus.cc:2243] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.887336 12594 raft_consensus.cc:2272] T 03bfae1924654fe38456ed1322baf805 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.889151 12594 tablet_replica.cc:333] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2: stopping tablet replica
I20260709 13:11:33.889632 12594 raft_consensus.cc:2243] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.890013 12594 raft_consensus.cc:2272] T 02e788e9b5124317a9a7e3317702542e P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.891795 12594 tablet_replica.cc:333] T ed3a721a22bf4cfa80f834d4e284b209 P 3f8a1edc55ec49da8d471f29f89febc2: stopping tablet replica
I20260709 13:11:33.892449 12594 raft_consensus.cc:2243] T ed3a721a22bf4cfa80f834d4e284b209 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.892822 12594 raft_consensus.cc:2272] T ed3a721a22bf4cfa80f834d4e284b209 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.895473 12594 tablet_replica.cc:333] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2: stopping tablet replica
I20260709 13:11:33.896013 12594 raft_consensus.cc:2243] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.896713 12594 raft_consensus.cc:2272] T 1e4591d1871f4a83b553f0e85a5e8f2e P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.898380 12594 tablet_replica.cc:333] T 18f98d4d56ae4f3498a731b57404b6c6 P 3f8a1edc55ec49da8d471f29f89febc2: stopping tablet replica
I20260709 13:11:33.898842 12594 raft_consensus.cc:2243] T 18f98d4d56ae4f3498a731b57404b6c6 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.899209 12594 raft_consensus.cc:2272] T 18f98d4d56ae4f3498a731b57404b6c6 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.900925 12594 tablet_replica.cc:333] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2: stopping tablet replica
I20260709 13:11:33.901396 12594 raft_consensus.cc:2243] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.902128 12594 raft_consensus.cc:2272] T c2e555a672e249fb858b43e84a8e173d P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.904089 12594 tablet_replica.cc:333] T 7d987c9c368c4d7cbf8a5c5091365b28 P 3f8a1edc55ec49da8d471f29f89febc2: stopping tablet replica
I20260709 13:11:33.904817 12594 raft_consensus.cc:2243] T 7d987c9c368c4d7cbf8a5c5091365b28 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.905308 12594 raft_consensus.cc:2272] T 7d987c9c368c4d7cbf8a5c5091365b28 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:33.905684 25065 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 12 similar messages]
I20260709 13:11:33.907689 12594 tablet_replica.cc:333] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2: stopping tablet replica
I20260709 13:11:33.908624 12594 raft_consensus.cc:2243] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:11:33.908969 25065 consensus_peers.cc:597] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 -> Peer 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639): Couldn't send request to peer 3f8a1edc55ec49da8d471f29f89febc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:33.909471 12594 raft_consensus.cc:2272] T dd14bc55420b4bfda81e00b11b16480a P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.911674 12594 tablet_replica.cc:333] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2: stopping tablet replica
I20260709 13:11:33.912286 12594 raft_consensus.cc:2243] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.912717 12594 raft_consensus.cc:2272] T aa9abe466aa24d50b4cb387a95142271 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.914541 12594 tablet_replica.cc:333] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2: stopping tablet replica
I20260709 13:11:33.915128 12594 raft_consensus.cc:2243] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.915587 12594 raft_consensus.cc:2272] T 0f2be738daf040ec8055ea11ffba43de P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.917785 12594 tablet_replica.cc:333] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2: stopping tablet replica
I20260709 13:11:33.918411 12594 raft_consensus.cc:2243] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.919317 12594 raft_consensus.cc:2272] T e26bbe99a450447cb4fc0012e1ba76bc P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.921206 12594 tablet_replica.cc:333] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2: stopping tablet replica
I20260709 13:11:33.921785 12594 raft_consensus.cc:2243] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.922554 12594 raft_consensus.cc:2272] T b81757f4945249a590eb6f0d48e39982 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.924542 12594 tablet_replica.cc:333] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2: stopping tablet replica
I20260709 13:11:33.925071 12594 raft_consensus.cc:2243] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.925783 12594 raft_consensus.cc:2272] T 17e6bbc00e20487d992e8550a9610038 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.927748 12594 tablet_replica.cc:333] T e5a4d99b1cc845cab2478402bf9df1a2 P 3f8a1edc55ec49da8d471f29f89febc2: stopping tablet replica
I20260709 13:11:33.928254 12594 raft_consensus.cc:2243] T e5a4d99b1cc845cab2478402bf9df1a2 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.928658 12594 raft_consensus.cc:2272] T e5a4d99b1cc845cab2478402bf9df1a2 P 3f8a1edc55ec49da8d471f29f89febc2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.930517 12594 tablet_replica.cc:333] T 99bee58920cf48df8afb0277a28a9ad2 P 3f8a1edc55ec49da8d471f29f89febc2: stopping tablet replica
I20260709 13:11:33.931006 12594 raft_consensus.cc:2243] T 99bee58920cf48df8afb0277a28a9ad2 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.931391 12594 raft_consensus.cc:2272] T 99bee58920cf48df8afb0277a28a9ad2 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.933284 12594 tablet_replica.cc:333] T f0f039f792f742499a2ba068a50a8a40 P 3f8a1edc55ec49da8d471f29f89febc2: stopping tablet replica
I20260709 13:11:33.933760 12594 raft_consensus.cc:2243] T f0f039f792f742499a2ba068a50a8a40 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.934170 12594 raft_consensus.cc:2272] T f0f039f792f742499a2ba068a50a8a40 P 3f8a1edc55ec49da8d471f29f89febc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.936128 12594 tablet_replica.cc:333] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2: stopping tablet replica
I20260709 13:11:33.936597 12594 raft_consensus.cc:2243] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.936995 12594 raft_consensus.cc:2272] T 678ed24005be40eeb9bc4041fce6ee35 P 3f8a1edc55ec49da8d471f29f89febc2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.975498 12594 tablet_server.cc:196] TabletServer@127.12.76.129:0 shutdown complete.
W20260709 13:11:34.006448 25065 consensus_peers.cc:597] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 -> Peer 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639): Couldn't send request to peer 3f8a1edc55ec49da8d471f29f89febc2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37639: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:34.011487 25139 consensus_peers.cc:597] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab -> Peer 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639): Couldn't send request to peer 3f8a1edc55ec49da8d471f29f89febc2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37639: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.011699 12594 tablet_server.cc:179] TabletServer@127.12.76.130:0 shutting down...
I20260709 13:11:34.041674 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:34.042570 12594 tablet_replica.cc:333] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0: stopping tablet replica
I20260709 13:11:34.043498 12594 raft_consensus.cc:2243] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.044360 12594 raft_consensus.cc:2272] T 02e788e9b5124317a9a7e3317702542e P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.046286 12594 tablet_replica.cc:333] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0: stopping tablet replica
I20260709 13:11:34.046872 12594 raft_consensus.cc:2243] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.047712 12594 raft_consensus.cc:2272] T ee8eea63cef84ee491051ae46df28a79 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.049825 12594 tablet_replica.cc:333] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0: stopping tablet replica
I20260709 13:11:34.051220 12594 raft_consensus.cc:2243] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.051842 12594 raft_consensus.cc:2272] T 03bfae1924654fe38456ed1322baf805 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.054301 12594 tablet_replica.cc:333] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0: stopping tablet replica
I20260709 13:11:34.055088 12594 raft_consensus.cc:2243] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.055899 12594 raft_consensus.cc:2272] T 18f98d4d56ae4f3498a731b57404b6c6 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.057703 12594 tablet_replica.cc:333] T c2e555a672e249fb858b43e84a8e173d P bf8661d86cd14b0caded7f5606eba9c0: stopping tablet replica
I20260709 13:11:34.058204 12594 raft_consensus.cc:2243] T c2e555a672e249fb858b43e84a8e173d P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.058573 12594 raft_consensus.cc:2272] T c2e555a672e249fb858b43e84a8e173d P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.060334 12594 tablet_replica.cc:333] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0: stopping tablet replica
I20260709 13:11:34.060822 12594 raft_consensus.cc:2243] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.061187 12594 raft_consensus.cc:2272] T ed3a721a22bf4cfa80f834d4e284b209 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.063632 12594 tablet_replica.cc:333] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0: stopping tablet replica
I20260709 13:11:34.064129 12594 raft_consensus.cc:2243] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.064512 12594 raft_consensus.cc:2272] T 1e4591d1871f4a83b553f0e85a5e8f2e P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.066154 12594 tablet_replica.cc:333] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0: stopping tablet replica
I20260709 13:11:34.066648 12594 raft_consensus.cc:2243] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.067040 12594 raft_consensus.cc:2272] T e5a4d99b1cc845cab2478402bf9df1a2 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.068899 12594 tablet_replica.cc:333] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0: stopping tablet replica
I20260709 13:11:34.069373 12594 raft_consensus.cc:2243] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.069731 12594 raft_consensus.cc:2272] T 7d987c9c368c4d7cbf8a5c5091365b28 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.071336 12594 tablet_replica.cc:333] T dd14bc55420b4bfda81e00b11b16480a P bf8661d86cd14b0caded7f5606eba9c0: stopping tablet replica
I20260709 13:11:34.071889 12594 raft_consensus.cc:2243] T dd14bc55420b4bfda81e00b11b16480a P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.072230 12594 raft_consensus.cc:2272] T dd14bc55420b4bfda81e00b11b16480a P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.073974 12594 tablet_replica.cc:333] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0: stopping tablet replica
I20260709 13:11:34.074668 12594 raft_consensus.cc:2243] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.075431 12594 raft_consensus.cc:2272] T aa9abe466aa24d50b4cb387a95142271 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.077998 12594 tablet_replica.cc:333] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0: stopping tablet replica
I20260709 13:11:34.078727 12594 raft_consensus.cc:2243] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.079771 12594 raft_consensus.cc:2272] T 0f2be738daf040ec8055ea11ffba43de P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.082056 12594 tablet_replica.cc:333] T e26bbe99a450447cb4fc0012e1ba76bc P bf8661d86cd14b0caded7f5606eba9c0: stopping tablet replica
I20260709 13:11:34.082536 12594 raft_consensus.cc:2243] T e26bbe99a450447cb4fc0012e1ba76bc P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.082909 12594 raft_consensus.cc:2272] T e26bbe99a450447cb4fc0012e1ba76bc P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.084599 12594 tablet_replica.cc:333] T 17e6bbc00e20487d992e8550a9610038 P bf8661d86cd14b0caded7f5606eba9c0: stopping tablet replica
I20260709 13:11:34.085035 12594 raft_consensus.cc:2243] T 17e6bbc00e20487d992e8550a9610038 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.085390 12594 raft_consensus.cc:2272] T 17e6bbc00e20487d992e8550a9610038 P bf8661d86cd14b0caded7f5606eba9c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.087378 12594 tablet_replica.cc:333] T b81757f4945249a590eb6f0d48e39982 P bf8661d86cd14b0caded7f5606eba9c0: stopping tablet replica
I20260709 13:11:34.087877 12594 raft_consensus.cc:2243] T b81757f4945249a590eb6f0d48e39982 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.088224 12594 raft_consensus.cc:2272] T b81757f4945249a590eb6f0d48e39982 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.090051 12594 tablet_replica.cc:333] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0: stopping tablet replica
I20260709 13:11:34.090483 12594 raft_consensus.cc:2243] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.091176 12594 raft_consensus.cc:2272] T 99bee58920cf48df8afb0277a28a9ad2 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.092931 12594 tablet_replica.cc:333] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0: stopping tablet replica
I20260709 13:11:34.093354 12594 raft_consensus.cc:2243] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.093694 12594 raft_consensus.cc:2272] T 678ed24005be40eeb9bc4041fce6ee35 P bf8661d86cd14b0caded7f5606eba9c0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.095971 12594 tablet_replica.cc:333] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0: stopping tablet replica
I20260709 13:11:34.096385 12594 raft_consensus.cc:2243] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.097033 12594 raft_consensus.cc:2272] T f0f039f792f742499a2ba068a50a8a40 P bf8661d86cd14b0caded7f5606eba9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:34.121023 25139 consensus_peers.cc:597] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab -> Peer 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639): Couldn't send request to peer 3f8a1edc55ec49da8d471f29f89febc2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37639: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.128113 12594 tablet_server.cc:196] TabletServer@127.12.76.130:0 shutdown complete.
W20260709 13:11:34.131048 25139 consensus_peers.cc:597] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab -> Peer 3f8a1edc55ec49da8d471f29f89febc2 (127.12.76.129:37639): Couldn't send request to peer 3f8a1edc55ec49da8d471f29f89febc2. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.129:37639: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:34.137773 25142 consensus_peers.cc:597] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab -> Peer bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971): Couldn't send request to peer bf8661d86cd14b0caded7f5606eba9c0. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:36971: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.159690 12594 tablet_server.cc:179] TabletServer@127.12.76.131:0 shutting down...
W20260709 13:11:34.176592 25142 consensus_peers.cc:597] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab -> Peer bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971): Couldn't send request to peer bf8661d86cd14b0caded7f5606eba9c0. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:36971: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:34.190328 25142 consensus_peers.cc:597] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab -> Peer bf8661d86cd14b0caded7f5606eba9c0 (127.12.76.130:36971): Couldn't send request to peer bf8661d86cd14b0caded7f5606eba9c0. Status: Network error: Client connection negotiation failed: client connection to 127.12.76.130:36971: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.195194 12594 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:34.196045 12594 tablet_replica.cc:333] T ee8eea63cef84ee491051ae46df28a79 P 1b2fbb12f91f47f2b0abab045013abab: stopping tablet replica
I20260709 13:11:34.196663 12594 raft_consensus.cc:2243] T ee8eea63cef84ee491051ae46df28a79 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.197140 12594 raft_consensus.cc:2272] T ee8eea63cef84ee491051ae46df28a79 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.198997 12594 tablet_replica.cc:333] T 02e788e9b5124317a9a7e3317702542e P 1b2fbb12f91f47f2b0abab045013abab: stopping tablet replica
I20260709 13:11:34.199610 12594 raft_consensus.cc:2243] T 02e788e9b5124317a9a7e3317702542e P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.200021 12594 raft_consensus.cc:2272] T 02e788e9b5124317a9a7e3317702542e P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.201738 12594 tablet_replica.cc:333] T 03bfae1924654fe38456ed1322baf805 P 1b2fbb12f91f47f2b0abab045013abab: stopping tablet replica
I20260709 13:11:34.202273 12594 raft_consensus.cc:2243] T 03bfae1924654fe38456ed1322baf805 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.202684 12594 raft_consensus.cc:2272] T 03bfae1924654fe38456ed1322baf805 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.204452 12594 tablet_replica.cc:333] T 18f98d4d56ae4f3498a731b57404b6c6 P 1b2fbb12f91f47f2b0abab045013abab: stopping tablet replica
I20260709 13:11:34.204990 12594 raft_consensus.cc:2243] T 18f98d4d56ae4f3498a731b57404b6c6 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.205399 12594 raft_consensus.cc:2272] T 18f98d4d56ae4f3498a731b57404b6c6 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.207259 12594 tablet_replica.cc:333] T c2e555a672e249fb858b43e84a8e173d P 1b2fbb12f91f47f2b0abab045013abab: stopping tablet replica
I20260709 13:11:34.207804 12594 raft_consensus.cc:2243] T c2e555a672e249fb858b43e84a8e173d P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.208202 12594 raft_consensus.cc:2272] T c2e555a672e249fb858b43e84a8e173d P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.209867 12594 tablet_replica.cc:333] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab: stopping tablet replica
I20260709 13:11:34.210386 12594 raft_consensus.cc:2243] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.211124 12594 raft_consensus.cc:2272] T ed3a721a22bf4cfa80f834d4e284b209 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.213341 12594 tablet_replica.cc:333] T 1e4591d1871f4a83b553f0e85a5e8f2e P 1b2fbb12f91f47f2b0abab045013abab: stopping tablet replica
I20260709 13:11:34.213865 12594 raft_consensus.cc:2243] T 1e4591d1871f4a83b553f0e85a5e8f2e P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.214283 12594 raft_consensus.cc:2272] T 1e4591d1871f4a83b553f0e85a5e8f2e P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.216020 12594 tablet_replica.cc:333] T f0f039f792f742499a2ba068a50a8a40 P 1b2fbb12f91f47f2b0abab045013abab: stopping tablet replica
I20260709 13:11:34.216511 12594 raft_consensus.cc:2243] T f0f039f792f742499a2ba068a50a8a40 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.216938 12594 raft_consensus.cc:2272] T f0f039f792f742499a2ba068a50a8a40 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.218899 12594 tablet_replica.cc:333] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab: stopping tablet replica
I20260709 13:11:34.219449 12594 raft_consensus.cc:2243] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.220227 12594 raft_consensus.cc:2272] T e5a4d99b1cc845cab2478402bf9df1a2 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.222154 12594 tablet_replica.cc:333] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab: stopping tablet replica
I20260709 13:11:34.222697 12594 raft_consensus.cc:2243] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.223934 12594 raft_consensus.cc:2272] T 678ed24005be40eeb9bc4041fce6ee35 P 1b2fbb12f91f47f2b0abab045013abab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.226385 12594 tablet_replica.cc:333] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab: stopping tablet replica
I20260709 13:11:34.226970 12594 raft_consensus.cc:2243] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.227517 12594 raft_consensus.cc:2272] T e26bbe99a450447cb4fc0012e1ba76bc P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.229405 12594 tablet_replica.cc:333] T b81757f4945249a590eb6f0d48e39982 P 1b2fbb12f91f47f2b0abab045013abab: stopping tablet replica
I20260709 13:11:34.230000 12594 raft_consensus.cc:2243] T b81757f4945249a590eb6f0d48e39982 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.230445 12594 raft_consensus.cc:2272] T b81757f4945249a590eb6f0d48e39982 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.232407 12594 tablet_replica.cc:333] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab: stopping tablet replica
I20260709 13:11:34.232889 12594 raft_consensus.cc:2243] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.233300 12594 raft_consensus.cc:2272] T 17e6bbc00e20487d992e8550a9610038 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.235045 12594 tablet_replica.cc:333] T 99bee58920cf48df8afb0277a28a9ad2 P 1b2fbb12f91f47f2b0abab045013abab: stopping tablet replica
I20260709 13:11:34.235582 12594 raft_consensus.cc:2243] T 99bee58920cf48df8afb0277a28a9ad2 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.235996 12594 raft_consensus.cc:2272] T 99bee58920cf48df8afb0277a28a9ad2 P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.237793 12594 tablet_replica.cc:333] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab: stopping tablet replica
I20260709 13:11:34.238270 12594 raft_consensus.cc:2243] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.238979 12594 raft_consensus.cc:2272] T 7d987c9c368c4d7cbf8a5c5091365b28 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.240752 12594 tablet_replica.cc:333] T dd14bc55420b4bfda81e00b11b16480a P 1b2fbb12f91f47f2b0abab045013abab: stopping tablet replica
I20260709 13:11:34.241230 12594 raft_consensus.cc:2243] T dd14bc55420b4bfda81e00b11b16480a P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.241618 12594 raft_consensus.cc:2272] T dd14bc55420b4bfda81e00b11b16480a P 1b2fbb12f91f47f2b0abab045013abab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.243522 12594 tablet_replica.cc:333] T aa9abe466aa24d50b4cb387a95142271 P 1b2fbb12f91f47f2b0abab045013abab: stopping tablet replica
I20260709 13:11:34.243975 12594 raft_consensus.cc:2243] T aa9abe466aa24d50b4cb387a95142271 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.244374 12594 raft_consensus.cc:2272] T aa9abe466aa24d50b4cb387a95142271 P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.246008 12594 tablet_replica.cc:333] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab: stopping tablet replica
I20260709 13:11:34.246455 12594 raft_consensus.cc:2243] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:34.246855 12594 raft_consensus.cc:2272] T 0f2be738daf040ec8055ea11ffba43de P 1b2fbb12f91f47f2b0abab045013abab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.283785 12594 tablet_server.cc:196] TabletServer@127.12.76.131:0 shutdown complete.
I20260709 13:11:34.314409 12594 master.cc:562] Master@127.12.76.190:37061 shutting down...
I20260709 13:11:34.334671 12594 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:34.335217 12594 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:34.335577 12594 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5aabfad0f519458082d17e146e444b8f: stopping tablet replica
I20260709 13:11:34.356362 12594 master.cc:584] Master@127.12.76.190:37061 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11416 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (25456 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (391147 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:11:34.414625 12594 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 405 messages since previous log ~14 seconds ago
I20260709 13:11:34.414906 12594 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 405 messages since previous log ~14 seconds ago
I20260709 13:11:34.415102 12594 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 398 messages since previous log ~14 seconds ago
I20260709 13:11:34.415302 12594 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:11:34.415674 12594 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:11:34.415913 12594 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 3 messages since previous log ~267 seconds ago
I20260709 13:11:34.416100 12594 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 3 messages since previous log ~267 seconds ago
I20260709 13:11:34.416347 12594 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 8 messages since previous log ~0 seconds ago
I20260709 13:11:34.416637 12594 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 125 messages since previous log ~33 seconds ago
